2023-10-06T02:50:20.762 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T02:50:20.763 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} --verbose --name yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412180 --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412180/orig.config.yaml 2023-10-06T02:50:20.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T02:50:20.906 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412180 branch: wip-yuri-testing-2023-10-05-0730-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} email: yweinste@redhat.com first_in_suite: false job_id: '7412180' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri-testing-2023-10-05-0730-quincy ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-05-0730-quincy sha1: f1e315a9732d36c05ec316678e2397dc58561c7f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7519 sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-05-0730-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f1e315a9732d36c05ec316678e2397dc58561c7f targets: smithi125.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLMm0/tC54OqctW/6NOr0JjGFyBYJQrLYamtDn1HVZ/PGppy0ZiOxmlxcCmEhC+q/g/akDf7LHSEuo9zZob1UuE= smithi130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAZtS6KUubNiYH/E/d3hs3JkgqTG/TbcaWtWLghQmDL/qv0IggKGQ38iK1ZqMzBew/GzoyV652PrLfwE0fSJvxE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_pool_perm teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:52:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T02:50:20.907 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa; will attempt to use it 2023-10-06T02:50:20.908 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa/tasks 2023-10-06T02:50:20.908 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T02:50:20.910 INFO:teuthology.task.internal:Checking packages... 2023-10-06T02:50:20.933 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2' 2023-10-06T02:50:20.933 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T02:50:20.933 INFO:teuthology.packaging:ref: None 2023-10-06T02:50:20.934 INFO:teuthology.packaging:tag: None 2023-10-06T02:50:20.934 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T02:50:20.934 INFO:teuthology.packaging:sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T02:50:20.934 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T02:50:21.154 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1296.gf1e315a9 2023-10-06T02:50:21.154 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T02:50:21.160 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T02:50:21.160 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T02:50:21.166 INFO:teuthology.task.internal:Saving configuration 2023-10-06T02:50:21.181 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T02:50:21.187 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T02:50:21.213 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412180', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:45:19.294093', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLMm0/tC54OqctW/6NOr0JjGFyBYJQrLYamtDn1HVZ/PGppy0ZiOxmlxcCmEhC+q/g/akDf7LHSEuo9zZob1UuE='} 2023-10-06T02:50:21.235 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412180', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:45:19.295639', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAZtS6KUubNiYH/E/d3hs3JkgqTG/TbcaWtWLghQmDL/qv0IggKGQ38iK1ZqMzBew/GzoyV652PrLfwE0fSJvxE='} 2023-10-06T02:50:21.235 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T02:50:21.241 INFO:teuthology.task.internal:roles: ubuntu@smithi125.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T02:50:21.241 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T02:50:21.241 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T02:50:21.307 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8ec9264b80>, signals=[15]) 2023-10-06T02:50:21.309 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T02:50:21.315 INFO:teuthology.task.internal:Opening connections... 2023-10-06T02:50:21.315 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T02:50:21.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:50:21.386 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2023-10-06T02:50:21.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:50:21.453 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T02:50:21.459 DEBUG:teuthology.orchestra.run.smithi125:> uname -m 2023-10-06T02:50:21.481 INFO:teuthology.orchestra.run.smithi125.stdout:x86_64 2023-10-06T02:50:21.482 DEBUG:teuthology.orchestra.run.smithi125:> cat /etc/os-release 2023-10-06T02:50:21.543 INFO:teuthology.orchestra.run.smithi125.stdout:NAME="CentOS Stream" 2023-10-06T02:50:21.543 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION="8" 2023-10-06T02:50:21.544 INFO:teuthology.orchestra.run.smithi125.stdout:ID="centos" 2023-10-06T02:50:21.544 INFO:teuthology.orchestra.run.smithi125.stdout:ID_LIKE="rhel fedora" 2023-10-06T02:50:21.544 INFO:teuthology.orchestra.run.smithi125.stdout:VERSION_ID="8" 2023-10-06T02:50:21.544 INFO:teuthology.orchestra.run.smithi125.stdout:PLATFORM_ID="platform:el8" 2023-10-06T02:50:21.544 INFO:teuthology.orchestra.run.smithi125.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-06T02:50:21.544 INFO:teuthology.orchestra.run.smithi125.stdout:ANSI_COLOR="0;31" 2023-10-06T02:50:21.544 INFO:teuthology.orchestra.run.smithi125.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-06T02:50:21.544 INFO:teuthology.orchestra.run.smithi125.stdout:HOME_URL="https://centos.org/" 2023-10-06T02:50:21.544 INFO:teuthology.orchestra.run.smithi125.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T02:50:21.544 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T02:50:21.544 INFO:teuthology.orchestra.run.smithi125.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-06T02:50:21.545 INFO:teuthology.lock.ops:Updating smithi125.front.sepia.ceph.com on lock server 2023-10-06T02:50:21.578 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2023-10-06T02:50:21.600 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2023-10-06T02:50:21.600 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2023-10-06T02:50:21.661 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2023-10-06T02:50:21.662 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="8" 2023-10-06T02:50:21.662 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2023-10-06T02:50:21.662 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2023-10-06T02:50:21.662 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="8" 2023-10-06T02:50:21.662 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el8" 2023-10-06T02:50:21.662 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 8" 2023-10-06T02:50:21.662 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2023-10-06T02:50:21.662 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-10-06T02:50:21.662 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2023-10-06T02:50:21.662 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T02:50:21.662 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T02:50:21.663 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-06T02:50:21.663 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2023-10-06T02:50:21.702 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T02:50:21.711 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T02:50:21.718 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T02:50:21.719 DEBUG:teuthology.orchestra.run.smithi125:> test '!' -e /home/ubuntu/cephtest 2023-10-06T02:50:21.721 DEBUG:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2023-10-06T02:50:21.743 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T02:50:21.752 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T02:50:21.752 DEBUG:teuthology.orchestra.run.smithi125:> test -z $(ls -A /var/lib/ceph) 2023-10-06T02:50:21.783 DEBUG:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2023-10-06T02:50:21.813 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T02:50:21.865 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T02:50:21.879 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-06T02:50:21.879 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-06T02:50:21.879 DEBUG:teuthology.orchestra.run.smithi125:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T02:50:21.880 DEBUG:teuthology.orchestra.run.smithi130:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T02:50:21.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:50:21.901 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2023-10-06T02:50:21.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:50:21.902 DEBUG:teuthology.orchestra.run.smithi125:> uname -r 2023-10-06T02:50:21.961 INFO:teuthology.orchestra.run.smithi130.stdout:4.18.0-489.el8.x86_64 2023-10-06T02:50:21.961 INFO:teuthology.task.kernel:Running kernel on smithi130: 4.18.0-489.el8.x86_64 2023-10-06T02:50:21.962 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum install -y kernel 2023-10-06T02:50:21.965 INFO:teuthology.orchestra.run.smithi125.stdout:4.18.0-489.el8.x86_64 2023-10-06T02:50:21.965 INFO:teuthology.task.kernel:Running kernel on smithi125: 4.18.0-489.el8.x86_64 2023-10-06T02:50:21.966 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum install -y kernel 2023-10-06T02:50:26.155 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - AppStream 21 MB/s | 33 MB 00:01 2023-10-06T02:50:26.610 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - AppStream 16 MB/s | 33 MB 00:02 2023-10-06T02:50:36.487 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - BaseOS 11 MB/s | 48 MB 00:04 2023-10-06T02:50:36.677 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - BaseOS 12 MB/s | 48 MB 00:04 2023-10-06T02:50:43.570 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - Extras 104 kB/s | 18 kB 00:00 2023-10-06T02:50:43.851 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - Extras 57 kB/s | 18 kB 00:00 2023-10-06T02:50:44.196 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - Extras common packages 16 kB/s | 6.9 kB 00:00 2023-10-06T02:50:44.310 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - Extras common packages 25 kB/s | 6.9 kB 00:00 2023-10-06T02:50:44.522 INFO:teuthology.orchestra.run.smithi125.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-10-06T02:50:44.612 INFO:teuthology.orchestra.run.smithi130.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2023-10-06T02:50:45.464 INFO:teuthology.orchestra.run.smithi125.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-10-06T02:50:45.565 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-10-06T02:50:49.329 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 472 kB/s | 24 kB 00:00 2023-10-06T02:50:49.376 INFO:teuthology.orchestra.run.smithi125.stdout:lab-extras 304 kB/s | 24 kB 00:00 2023-10-06T02:50:52.854 INFO:teuthology.orchestra.run.smithi130.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-10-06T02:50:52.854 INFO:teuthology.orchestra.run.smithi130.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-10-06T02:50:52.889 INFO:teuthology.orchestra.run.smithi125.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-10-06T02:50:52.889 INFO:teuthology.orchestra.run.smithi125.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-10-06T02:50:53.111 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-06T02:50:53.111 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-06T02:50:53.111 INFO:teuthology.orchestra.run.smithi130.stdout: Package Architecture Version Repository Size 2023-10-06T02:50:53.112 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-06T02:50:53.112 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-10-06T02:50:53.112 INFO:teuthology.orchestra.run.smithi130.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-10-06T02:50:53.112 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-10-06T02:50:53.112 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-10-06T02:50:53.112 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-10-06T02:50:53.112 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T02:50:53.112 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-06T02:50:53.112 INFO:teuthology.orchestra.run.smithi130.stdout:================================================================================ 2023-10-06T02:50:53.112 INFO:teuthology.orchestra.run.smithi130.stdout:Install 3 Packages 2023-10-06T02:50:53.113 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T02:50:53.113 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 88 M 2023-10-06T02:50:53.113 INFO:teuthology.orchestra.run.smithi130.stdout:Installed size: 96 M 2023-10-06T02:50:53.113 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-06T02:50:53.140 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2023-10-06T02:50:53.141 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2023-10-06T02:50:53.141 INFO:teuthology.orchestra.run.smithi125.stdout: Package Architecture Version Repository Size 2023-10-06T02:50:53.141 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2023-10-06T02:50:53.141 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2023-10-06T02:50:53.141 INFO:teuthology.orchestra.run.smithi125.stdout: kernel x86_64 4.18.0-514.el8 baseos 10 M 2023-10-06T02:50:53.141 INFO:teuthology.orchestra.run.smithi125.stdout:Installing dependencies: 2023-10-06T02:50:53.142 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-core x86_64 4.18.0-514.el8 baseos 43 M 2023-10-06T02:50:53.142 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-modules x86_64 4.18.0-514.el8 baseos 35 M 2023-10-06T02:50:53.142 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T02:50:53.142 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2023-10-06T02:50:53.142 INFO:teuthology.orchestra.run.smithi125.stdout:================================================================================ 2023-10-06T02:50:53.142 INFO:teuthology.orchestra.run.smithi125.stdout:Install 3 Packages 2023-10-06T02:50:53.142 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T02:50:53.143 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 88 M 2023-10-06T02:50:53.143 INFO:teuthology.orchestra.run.smithi125.stdout:Installed size: 96 M 2023-10-06T02:50:53.143 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2023-10-06T02:50:55.497 INFO:teuthology.orchestra.run.smithi130.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 4.3 MB/s | 10 MB 00:02 2023-10-06T02:50:55.807 INFO:teuthology.orchestra.run.smithi125.stdout:(1/3): kernel-4.18.0-514.el8.x86_64.rpm 4.0 MB/s | 10 MB 00:02 2023-10-06T02:50:57.274 INFO:teuthology.orchestra.run.smithi125.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 9.0 MB/s | 35 MB 00:03 2023-10-06T02:50:57.864 INFO:teuthology.orchestra.run.smithi130.stdout:(2/3): kernel-modules-4.18.0-514.el8.x86_64.rpm 7.5 MB/s | 35 MB 00:04 2023-10-06T02:50:58.231 INFO:teuthology.orchestra.run.smithi130.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 8.4 MB/s | 43 MB 00:05 2023-10-06T02:50:58.231 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-06T02:50:58.231 INFO:teuthology.orchestra.run.smithi130.stdout:Total 17 MB/s | 88 MB 00:05 2023-10-06T02:50:58.683 INFO:teuthology.orchestra.run.smithi125.stdout:(3/3): kernel-core-4.18.0-514.el8.x86_64.rpm 7.9 MB/s | 43 MB 00:05 2023-10-06T02:50:58.683 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2023-10-06T02:50:58.683 INFO:teuthology.orchestra.run.smithi125.stdout:Total 16 MB/s | 88 MB 00:05 2023-10-06T02:50:58.897 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-06T02:50:59.314 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-06T02:50:59.314 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-06T02:50:59.348 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2023-10-06T02:50:59.773 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2023-10-06T02:50:59.773 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2023-10-06T02:51:00.568 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-06T02:51:00.590 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-06T02:51:00.989 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2023-10-06T02:51:01.009 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2023-10-06T02:51:03.467 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-06T02:51:03.766 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2023-10-06T02:51:04.067 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-06T02:51:04.301 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-06T02:51:07.624 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-06T02:51:07.857 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 1/3 2023-10-06T02:51:07.992 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-06T02:51:08.275 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-06T02:51:11.368 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-06T02:51:11.651 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 2/3 2023-10-06T02:51:11.664 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-10-06T02:51:11.956 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : kernel-4.18.0-514.el8.x86_64 3/3 2023-10-06T02:51:33.214 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-10-06T02:51:33.238 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-06T02:51:33.583 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-10-06T02:51:33.584 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-10-06T02:51:33.584 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-10-06T02:51:33.701 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-core-4.18.0-514.el8.x86_64 3/3 2023-10-06T02:51:33.726 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-06T02:51:34.074 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: kernel-4.18.0-514.el8.x86_64 3/3 2023-10-06T02:51:34.074 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : kernel-4.18.0-514.el8.x86_64 1/3 2023-10-06T02:51:34.074 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : kernel-core-4.18.0-514.el8.x86_64 2/3 2023-10-06T02:51:34.284 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-06T02:51:34.284 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T02:51:34.284 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-10-06T02:51:34.284 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-10-06T02:51:34.285 INFO:teuthology.orchestra.run.smithi130.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-10-06T02:51:34.285 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T02:51:34.285 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-06T02:51:34.419 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:51:34.695 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-06T02:51:34.696 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-06T02:51:34.696 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-10-06T02:51:34.696 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T02:51:34.696 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T02:51:34.696 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-06T02:51:34.696 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi130.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T02:51:34.696 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:51:34.904 INFO:teuthology.orchestra.run.smithi130.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-06T02:51:34.904 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-06T02:51:34.904 DEBUG:teuthology.orchestra.run.smithi130:> sudo rpm -qi grub2-tools 2023-10-06T02:51:34.938 INFO:teuthology.orchestra.run.smithi130.stdout:Name : grub2-tools 2023-10-06T02:51:34.938 INFO:teuthology.orchestra.run.smithi130.stdout:Epoch : 1 2023-10-06T02:51:34.938 INFO:teuthology.orchestra.run.smithi130.stdout:Version : 2.02 2023-10-06T02:51:34.938 INFO:teuthology.orchestra.run.smithi130.stdout:Release : 129.el8 2023-10-06T02:51:34.938 INFO:teuthology.orchestra.run.smithi130.stdout:Architecture: x86_64 2023-10-06T02:51:34.938 INFO:teuthology.orchestra.run.smithi130.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-06T02:51:34.938 INFO:teuthology.orchestra.run.smithi130.stdout:Group : System Environment/Base 2023-10-06T02:51:34.938 INFO:teuthology.orchestra.run.smithi130.stdout:Size : 9265586 2023-10-06T02:51:34.939 INFO:teuthology.orchestra.run.smithi130.stdout:License : GPLv3+ 2023-10-06T02:51:34.939 INFO:teuthology.orchestra.run.smithi130.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-06T02:51:34.939 INFO:teuthology.orchestra.run.smithi130.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-06T02:51:34.939 INFO:teuthology.orchestra.run.smithi130.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-06T02:51:34.939 INFO:teuthology.orchestra.run.smithi130.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-06T02:51:34.939 INFO:teuthology.orchestra.run.smithi130.stdout:Relocations : (not relocatable) 2023-10-06T02:51:34.939 INFO:teuthology.orchestra.run.smithi130.stdout:Packager : CentOS BuildSystem 2023-10-06T02:51:34.939 INFO:teuthology.orchestra.run.smithi130.stdout:Vendor : CentOS 2023-10-06T02:51:34.939 INFO:teuthology.orchestra.run.smithi130.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T02:51:34.939 INFO:teuthology.orchestra.run.smithi130.stdout:Summary : Support tools for GRUB. 2023-10-06T02:51:34.939 INFO:teuthology.orchestra.run.smithi130.stdout:Description : 2023-10-06T02:51:34.939 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T02:51:34.940 INFO:teuthology.orchestra.run.smithi130.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T02:51:34.940 INFO:teuthology.orchestra.run.smithi130.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T02:51:34.940 INFO:teuthology.orchestra.run.smithi130.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T02:51:34.940 INFO:teuthology.orchestra.run.smithi130.stdout:hardware devices. 2023-10-06T02:51:34.940 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T02:51:34.940 INFO:teuthology.orchestra.run.smithi130.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T02:51:34.941 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T02:51:34.941 INFO:teuthology.task.kernel:Updating grub on smithi130 to boot 4.18.0-514.el8.x86_64 2023-10-06T02:51:34.941 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T02:51:34.945 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : kernel-modules-4.18.0-514.el8.x86_64 3/3 2023-10-06T02:51:34.946 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T02:51:34.946 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2023-10-06T02:51:34.946 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-4.18.0-514.el8.x86_64 kernel-core-4.18.0-514.el8.x86_64 2023-10-06T02:51:34.946 INFO:teuthology.orchestra.run.smithi125.stdout: kernel-modules-4.18.0-514.el8.x86_64 2023-10-06T02:51:34.946 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T02:51:34.946 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2023-10-06T02:51:35.136 DEBUG:teuthology.orchestra.run.smithi125:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:51:35.353 INFO:teuthology.orchestra.run.smithi125.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-06T02:51:35.353 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-06T02:51:35.353 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-514.el8.x86_64 2023-10-06T02:51:35.353 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T02:51:35.353 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T02:51:35.353 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-06T02:51:35.354 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi125.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T02:51:35.354 DEBUG:teuthology.orchestra.run.smithi125:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T02:51:35.559 INFO:teuthology.orchestra.run.smithi125.stdout:kernel-4.18.0-514.el8.x86_64 2023-10-06T02:51:35.560 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-514.el8.x86_64 2023-10-06T02:51:35.560 DEBUG:teuthology.orchestra.run.smithi125:> sudo rpm -qi grub2-tools 2023-10-06T02:51:35.593 INFO:teuthology.orchestra.run.smithi125.stdout:Name : grub2-tools 2023-10-06T02:51:35.593 INFO:teuthology.orchestra.run.smithi125.stdout:Epoch : 1 2023-10-06T02:51:35.594 INFO:teuthology.orchestra.run.smithi125.stdout:Version : 2.02 2023-10-06T02:51:35.594 INFO:teuthology.orchestra.run.smithi125.stdout:Release : 129.el8 2023-10-06T02:51:35.594 INFO:teuthology.orchestra.run.smithi125.stdout:Architecture: x86_64 2023-10-06T02:51:35.594 INFO:teuthology.orchestra.run.smithi125.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-10-06T02:51:35.594 INFO:teuthology.orchestra.run.smithi125.stdout:Group : System Environment/Base 2023-10-06T02:51:35.594 INFO:teuthology.orchestra.run.smithi125.stdout:Size : 9265586 2023-10-06T02:51:35.594 INFO:teuthology.orchestra.run.smithi125.stdout:License : GPLv3+ 2023-10-06T02:51:35.594 INFO:teuthology.orchestra.run.smithi125.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-10-06T02:51:35.594 INFO:teuthology.orchestra.run.smithi125.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-10-06T02:51:35.594 INFO:teuthology.orchestra.run.smithi125.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-10-06T02:51:35.595 INFO:teuthology.orchestra.run.smithi125.stdout:Build Host : kbuilder.bsys.centos.org 2023-10-06T02:51:35.595 INFO:teuthology.orchestra.run.smithi125.stdout:Relocations : (not relocatable) 2023-10-06T02:51:35.595 INFO:teuthology.orchestra.run.smithi125.stdout:Packager : CentOS BuildSystem 2023-10-06T02:51:35.595 INFO:teuthology.orchestra.run.smithi125.stdout:Vendor : CentOS 2023-10-06T02:51:35.595 INFO:teuthology.orchestra.run.smithi125.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T02:51:35.595 INFO:teuthology.orchestra.run.smithi125.stdout:Summary : Support tools for GRUB. 2023-10-06T02:51:35.595 INFO:teuthology.orchestra.run.smithi125.stdout:Description : 2023-10-06T02:51:35.595 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T02:51:35.596 INFO:teuthology.orchestra.run.smithi125.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T02:51:35.596 INFO:teuthology.orchestra.run.smithi125.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T02:51:35.596 INFO:teuthology.orchestra.run.smithi125.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T02:51:35.596 INFO:teuthology.orchestra.run.smithi125.stdout:hardware devices. 2023-10-06T02:51:35.596 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T02:51:35.596 INFO:teuthology.orchestra.run.smithi125.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T02:51:35.597 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T02:51:35.597 INFO:teuthology.task.kernel:Updating grub on smithi125 to boot 4.18.0-514.el8.x86_64 2023-10-06T02:51:35.597 DEBUG:teuthology.orchestra.run.smithi125:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T02:51:36.222 INFO:teuthology.orchestra.run.smithi130.stderr:Generating grub configuration file ... 2023-10-06T02:51:36.981 INFO:teuthology.orchestra.run.smithi125.stderr:Generating grub configuration file ... 2023-10-06T02:51:38.477 INFO:teuthology.orchestra.run.smithi130.stderr:done 2023-10-06T02:51:38.479 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2023-10-06T02:51:38.516 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.DUAYiiCNPw 2023-10-06T02:51:38.517 DEBUG:teuthology.orchestra.run.smithi130:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.DUAYiiCNPw 2023-10-06T02:51:38.591 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.DUAYiiCNPw 2023-10-06T02:51:38.736 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.DUAYiiCNPw is 6KB 2023-10-06T02:51:38.784 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.DUAYiiCNPw 2023-10-06T02:51:38.802 DEBUG:teuthology.orchestra.run.smithi130:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T02:51:38.886 INFO:teuthology.orchestra.run.smithi130.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-06T02:51:38.887 INFO:teuthology.orchestra.run.smithi130.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-06T02:51:38.887 INFO:teuthology.orchestra.run.smithi130.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-06T02:51:38.887 INFO:teuthology.orchestra.run.smithi130.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-10-06T02:51:38.888 DEBUG:teuthology.orchestra.run.smithi130:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-10-06T02:51:39.011 DEBUG:teuthology.orchestra.run.smithi130:> sudo shutdown -r now 2023-10-06T02:51:39.299 INFO:teuthology.orchestra.run.smithi125.stderr:done 2023-10-06T02:51:39.300 DEBUG:teuthology.orchestra.run.smithi125:> mktemp 2023-10-06T02:51:39.328 INFO:teuthology.orchestra.run.smithi125.stdout:/tmp/tmp.lIEXNMSRJB 2023-10-06T02:51:39.328 DEBUG:teuthology.orchestra.run.smithi125:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.lIEXNMSRJB 2023-10-06T02:51:39.404 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0666 /tmp/tmp.lIEXNMSRJB 2023-10-06T02:51:39.540 DEBUG:teuthology.orchestra.remote:smithi125:/tmp/tmp.lIEXNMSRJB is 6KB 2023-10-06T02:51:39.588 DEBUG:teuthology.orchestra.run.smithi125:> rm -fr /tmp/tmp.lIEXNMSRJB 2023-10-06T02:51:39.606 DEBUG:teuthology.orchestra.run.smithi125:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T02:51:39.689 INFO:teuthology.orchestra.run.smithi125.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-10-06T02:51:39.690 INFO:teuthology.orchestra.run.smithi125.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-10-06T02:51:39.690 INFO:teuthology.orchestra.run.smithi125.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-10-06T02:51:39.690 INFO:teuthology.orchestra.run.smithi125.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64.conf 2023-10-06T02:51:39.691 DEBUG:teuthology.orchestra.run.smithi125:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-514.el8.x86_64 2023-10-06T02:51:39.841 DEBUG:teuthology.orchestra.run.smithi125:> sudo shutdown -r now 2023-10-06T02:52:09.042 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-06T02:52:09.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-06T02:52:09.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:52:09.845 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-06T02:52:09.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-06T02:52:09.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:52:27.386 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-10-06T02:52:28.410 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-06T02:52:36.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-06T02:52:36.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:52:37.412 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-06T02:52:37.413 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:52:39.454 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-10-06T02:52:40.474 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-06T02:52:51.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-06T02:52:51.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:52:52.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-06T02:52:52.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:53:09.886 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.130 2023-10-06T02:53:10.906 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.125 2023-10-06T02:53:24.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-06T02:53:24.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:53:25.669 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-10-06T02:53:25.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-06T02:53:25.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T02:53:26.479 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-06T02:53:26.479 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-514.el8.x86_64"... 2023-10-06T02:53:26.479 DEBUG:teuthology.orchestra.run.smithi130:> uname -r 2023-10-06T02:53:26.496 INFO:teuthology.orchestra.run.smithi130.stdout:4.18.0-514.el8.x86_64 2023-10-06T02:53:26.496 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-10-06T02:53:26.496 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T02:53:26.496 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-06T02:53:26.620 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-10-06T02:53:27.497 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-06T02:53:27.498 DEBUG:teuthology.orchestra.run.smithi130:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T02:53:27.566 INFO:teuthology.orchestra.run.smithi130.stdout:ttyS1 2023-10-06T02:53:27.584 DEBUG:teuthology.parallel:result is None 2023-10-06T02:53:27.990 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-06T02:53:27.991 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-514.el8.x86_64"... 2023-10-06T02:53:27.991 DEBUG:teuthology.orchestra.run.smithi125:> uname -r 2023-10-06T02:53:28.242 INFO:teuthology.orchestra.run.smithi125.stdout:4.18.0-514.el8.x86_64 2023-10-06T02:53:28.242 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-514.el8.x86_64 vs 4.18.0-514.el8.x86_64 2023-10-06T02:53:28.243 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T02:53:28.243 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-06T02:53:29.243 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-06T02:53:29.243 DEBUG:teuthology.orchestra.run.smithi125:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T02:53:29.321 INFO:teuthology.orchestra.run.smithi125.stdout:ttyS1 2023-10-06T02:53:29.338 DEBUG:teuthology.parallel:result is None 2023-10-06T02:53:29.338 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T02:53:29.345 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T02:53:29.345 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T02:53:29.348 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T02:53:29.371 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T02:53:29.379 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T02:53:29.395 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T02:53:29.396 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T02:53:29.409 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T02:53:29.459 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T02:53:29.469 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T02:53:29.470 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T02:53:29.477 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T02:53:29.505 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:53:29.515 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:53:29.530 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:53:29.542 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T02:53:29.543 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T02:53:29.552 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T02:53:29.552 DEBUG:teuthology.orchestra.run.smithi125:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T02:53:29.562 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T02:53:29.615 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T02:53:29.630 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T02:53:29.630 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T02:53:29.633 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T02:53:29.674 DEBUG:teuthology.orchestra.run.smithi125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:53:29.734 DEBUG:teuthology.orchestra.run.smithi125:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:53:29.788 DEBUG:teuthology.orchestra.run.smithi125:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:53:29.875 DEBUG:teuthology.orchestra.run.smithi125:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:53:29.922 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T02:53:29.922 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T02:53:29.993 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:53:30.043 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T02:53:30.100 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:53:30.187 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T02:53:30.232 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T02:53:30.232 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T02:53:30.300 DEBUG:teuthology.orchestra.run.smithi125:> sudo service rsyslog restart 2023-10-06T02:53:30.302 DEBUG:teuthology.orchestra.run.smithi130:> sudo service rsyslog restart 2023-10-06T02:53:30.362 INFO:teuthology.orchestra.run.smithi125.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T02:53:30.404 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T02:53:30.880 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T02:53:30.887 INFO:teuthology.task.internal:Starting timer... 2023-10-06T02:53:30.887 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T02:53:30.957 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T02:53:30.968 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T02:53:30.968 DEBUG:teuthology.orchestra.run.smithi125:> sudo service auditd rotate 2023-10-06T02:53:31.060 INFO:teuthology.orchestra.run.smithi125.stdout:Rotating logs: 2023-10-06T02:53:31.062 DEBUG:teuthology.orchestra.run.smithi130:> sudo service auditd rotate 2023-10-06T02:53:31.140 INFO:teuthology.orchestra.run.smithi130.stdout:Rotating logs: 2023-10-06T02:53:31.143 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T02:53:31.143 DEBUG:teuthology.orchestra.run.smithi125:> /usr/sbin/getenforce 2023-10-06T02:53:31.167 INFO:teuthology.orchestra.run.smithi125.stdout:Permissive 2023-10-06T02:53:31.168 DEBUG:teuthology.orchestra.run.smithi130:> /usr/sbin/getenforce 2023-10-06T02:53:31.197 INFO:teuthology.orchestra.run.smithi130.stdout:Permissive 2023-10-06T02:53:31.197 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi125.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi130.front.sepia.ceph.com': 'permissive'} 2023-10-06T02:53:31.198 DEBUG:teuthology.orchestra.run.smithi125:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T02:53:31.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:53:31.241 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T02:53:31.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T02:53:31.270 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T02:53:31.270 DEBUG:teuthology.orchestra.run.smithi125:> sudo /usr/sbin/setenforce permissive 2023-10-06T02:53:31.312 DEBUG:teuthology.orchestra.run.smithi130:> sudo /usr/sbin/setenforce permissive 2023-10-06T02:53:31.340 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T02:53:31.349 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-06T02:53:31.353 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-06T02:53:31.481 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T02:53:31.497 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T02:53:31.498 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi125.front.sepia.ceph.com,smithi130.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T03:00:53.386 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi125.front.sepia.ceph.com'), Remote(name='ubuntu@smithi130.front.sepia.ceph.com')] 2023-10-06T03:00:53.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-06T03:00:53.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi125.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:00:53.457 DEBUG:teuthology.orchestra.run.smithi125:> true 2023-10-06T03:00:53.528 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi125.front.sepia.ceph.com' 2023-10-06T03:00:53.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-06T03:00:53.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T03:00:53.597 DEBUG:teuthology.orchestra.run.smithi130:> true 2023-10-06T03:00:53.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2023-10-06T03:00:53.666 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T03:00:53.680 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T03:00:53.680 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T03:00:53.680 DEBUG:teuthology.orchestra.run.smithi125:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:00:53.683 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T03:00:53.683 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:00:53.711 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T03:00:53.725 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T03:00:53.740 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T03:00:53.755 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T03:00:53.800 INFO:teuthology.orchestra.run.smithi125.stderr:sudo: ntpd: command not found 2023-10-06T03:00:53.813 INFO:teuthology.orchestra.run.smithi125.stdout:506 Cannot talk to daemon 2023-10-06T03:00:53.826 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T03:00:53.828 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: ntpd: command not found 2023-10-06T03:00:53.840 INFO:teuthology.orchestra.run.smithi125.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T03:00:53.840 INFO:teuthology.orchestra.run.smithi130.stdout:506 Cannot talk to daemon 2023-10-06T03:00:53.854 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T03:00:53.868 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T03:00:53.907 INFO:teuthology.orchestra.run.smithi125.stderr:bash: ntpq: command not found 2023-10-06T03:00:53.910 INFO:teuthology.orchestra.run.smithi125.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T03:00:53.910 INFO:teuthology.orchestra.run.smithi125.stdout:=============================================================================== 2023-10-06T03:00:53.910 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:00:53.910 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:00:53.910 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:00:53.910 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:00:53.939 INFO:teuthology.orchestra.run.smithi130.stderr:bash: ntpq: command not found 2023-10-06T03:00:53.943 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T03:00:53.944 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2023-10-06T03:00:53.944 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:00:53.944 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:00:53.944 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:00:53.944 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:00:53.945 INFO:teuthology.run_tasks:Running task install... 2023-10-06T03:00:53.953 DEBUG:teuthology.task.install:project ceph 2023-10-06T03:00:53.953 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}} 2023-10-06T03:00:53.953 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'} 2023-10-06T03:00:53.954 INFO:teuthology.task.install:Using flavor: default 2023-10-06T03:00:53.959 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T03:00:53.959 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T03:00:53.960 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T03:00:53.960 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T03:00:53.962 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T03:00:53.963 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T03:00:54.103 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T03:00:54.104 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T03:00:54.112 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T03:00:54.112 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T03:00:54.229 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T03:00:54.229 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:00:54.229 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T03:00:54.258 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T03:00:54.258 DEBUG:teuthology.orchestra.run.smithi130:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T03:00:54.327 DEBUG:teuthology.orchestra.run.smithi130:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T03:00:54.333 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T03:00:54.334 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:00:54.334 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T03:00:54.361 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T03:00:54.362 DEBUG:teuthology.orchestra.run.smithi125:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T03:00:54.404 DEBUG:teuthology.orchestra.run.smithi130:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T03:00:54.430 DEBUG:teuthology.orchestra.run.smithi125:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T03:00:54.471 INFO:teuthology.orchestra.run.smithi130.stdout:check_obsoletes = 1 2023-10-06T03:00:54.472 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum clean all 2023-10-06T03:00:54.507 DEBUG:teuthology.orchestra.run.smithi125:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T03:00:54.574 INFO:teuthology.orchestra.run.smithi125.stdout:check_obsoletes = 1 2023-10-06T03:00:54.575 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum clean all 2023-10-06T03:00:54.750 INFO:teuthology.orchestra.run.smithi130.stdout:76 files removed 2023-10-06T03:00:54.778 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T03:00:54.848 INFO:teuthology.orchestra.run.smithi125.stdout:76 files removed 2023-10-06T03:00:54.875 DEBUG:teuthology.orchestra.run.smithi125:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T03:00:55.484 INFO:teuthology.orchestra.run.smithi130.stdout:ceph packages for x86_64 259 kB/s | 78 kB 00:00 2023-10-06T03:00:55.672 INFO:teuthology.orchestra.run.smithi125.stdout:ceph packages for x86_64 199 kB/s | 78 kB 00:00 2023-10-06T03:00:55.785 INFO:teuthology.orchestra.run.smithi130.stdout:ceph noarch packages 35 kB/s | 9.2 kB 00:00 2023-10-06T03:00:55.997 INFO:teuthology.orchestra.run.smithi125.stdout:ceph noarch packages 32 kB/s | 9.2 kB 00:00 2023-10-06T03:00:56.102 INFO:teuthology.orchestra.run.smithi130.stdout:ceph source packages 5.0 kB/s | 1.4 kB 00:00 2023-10-06T03:00:56.290 INFO:teuthology.orchestra.run.smithi125.stdout:ceph source packages 5.5 kB/s | 1.4 kB 00:00 2023-10-06T03:00:57.827 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - AppStream 20 MB/s | 33 MB 00:01 2023-10-06T03:01:01.790 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - AppStream 6.1 MB/s | 33 MB 00:05 2023-10-06T03:01:09.244 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - BaseOS 9.0 MB/s | 48 MB 00:05 2023-10-06T03:01:12.273 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - BaseOS 11 MB/s | 48 MB 00:04 2023-10-06T03:01:16.303 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - Extras 98 kB/s | 18 kB 00:00 2023-10-06T03:01:16.921 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - Extras common packages 16 kB/s | 6.9 kB 00:00 2023-10-06T03:01:17.864 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 8 - PowerTools 8.2 MB/s | 6.5 MB 00:00 2023-10-06T03:01:19.257 INFO:teuthology.orchestra.run.smithi130.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-06T03:01:19.257 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - Extras 112 kB/s | 18 kB 00:00 2023-10-06T03:01:19.832 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.9 kB 00:00 2023-10-06T03:01:20.340 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-10-06T03:01:20.658 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS Stream 8 - PowerTools 9.6 MB/s | 6.5 MB 00:00 2023-10-06T03:01:22.051 INFO:teuthology.orchestra.run.smithi125.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2023-10-06T03:01:23.171 INFO:teuthology.orchestra.run.smithi125.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2023-10-06T03:01:24.190 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 385 kB/s | 24 kB 00:00 2023-10-06T03:01:26.994 INFO:teuthology.orchestra.run.smithi125.stdout:lab-extras 404 kB/s | 24 kB 00:00 2023-10-06T03:01:28.373 INFO:teuthology.orchestra.run.smithi130.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T03:01:28.374 INFO:teuthology.orchestra.run.smithi130.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T03:01:28.387 INFO:teuthology.orchestra.run.smithi130.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-10-06T03:01:28.387 INFO:teuthology.orchestra.run.smithi130.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-10-06T03:01:28.388 INFO:teuthology.orchestra.run.smithi130.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-10-06T03:01:28.389 INFO:teuthology.orchestra.run.smithi130.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-10-06T03:01:28.390 INFO:teuthology.orchestra.run.smithi130.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T03:01:28.392 INFO:teuthology.orchestra.run.smithi130.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T03:01:28.396 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-06T03:01:28.397 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-06T03:01:28.609 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2023-10-06T03:01:28.622 INFO:teuthology.orchestra.run.smithi130.stdout:==================================================================================================== 2023-10-06T03:01:28.622 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2023-10-06T03:01:28.623 INFO:teuthology.orchestra.run.smithi130.stdout:==================================================================================================== 2023-10-06T03:01:28.623 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2023-10-06T03:01:28.623 INFO:teuthology.orchestra.run.smithi130.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-10-06T03:01:28.623 INFO:teuthology.orchestra.run.smithi130.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T03:01:28.623 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T03:01:28.623 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T03:01:28.623 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T03:01:28.623 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T03:01:28.623 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T03:01:28.623 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T03:01:28.623 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T03:01:28.624 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T03:01:28.624 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T03:01:28.624 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T03:01:28.624 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T03:01:28.624 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T03:01:28.624 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T03:01:28.624 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T03:01:28.624 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-10-06T03:01:28.624 INFO:teuthology.orchestra.run.smithi130.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-10-06T03:01:28.624 INFO:teuthology.orchestra.run.smithi130.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-10-06T03:01:28.624 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T03:01:28.624 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T03:01:28.624 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T03:01:28.625 INFO:teuthology.orchestra.run.smithi130.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-10-06T03:01:28.625 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-devel x86_64 2.32.1-43.el8 baseos 100 k 2023-10-06T03:01:28.625 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-10-06T03:01:28.625 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T03:01:28.625 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T03:01:28.625 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T03:01:28.625 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T03:01:28.625 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T03:01:28.625 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T03:01:28.625 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T03:01:28.625 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-10-06T03:01:28.625 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrading: 2023-10-06T03:01:28.626 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-10-06T03:01:28.626 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-10-06T03:01:28.626 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-10-06T03:01:28.626 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-10-06T03:01:28.626 INFO:teuthology.orchestra.run.smithi130.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2023-10-06T03:01:28.626 INFO:teuthology.orchestra.run.smithi130.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-10-06T03:01:28.626 INFO:teuthology.orchestra.run.smithi130.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-10-06T03:01:28.626 INFO:teuthology.orchestra.run.smithi130.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-10-06T03:01:28.626 INFO:teuthology.orchestra.run.smithi130.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T03:01:28.626 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T03:01:28.626 INFO:teuthology.orchestra.run.smithi130.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-10-06T03:01:28.626 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-10-06T03:01:28.627 INFO:teuthology.orchestra.run.smithi130.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-10-06T03:01:28.627 INFO:teuthology.orchestra.run.smithi130.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-10-06T03:01:28.627 INFO:teuthology.orchestra.run.smithi130.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-10-06T03:01:28.627 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-10-06T03:01:28.627 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2023-10-06T03:01:28.627 INFO:teuthology.orchestra.run.smithi130.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2023-10-06T03:01:28.627 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T03:01:28.627 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T03:01:28.627 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T03:01:28.627 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T03:01:28.627 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T03:01:28.627 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T03:01:28.628 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T03:01:28.628 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T03:01:28.628 INFO:teuthology.orchestra.run.smithi130.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-06T03:01:28.628 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T03:01:28.628 INFO:teuthology.orchestra.run.smithi130.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-06T03:01:28.628 INFO:teuthology.orchestra.run.smithi130.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-10-06T03:01:28.628 INFO:teuthology.orchestra.run.smithi130.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-10-06T03:01:28.628 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T03:01:28.628 INFO:teuthology.orchestra.run.smithi130.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-10-06T03:01:28.628 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-06T03:01:28.628 INFO:teuthology.orchestra.run.smithi130.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T03:01:28.628 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-06T03:01:28.629 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-06T03:01:28.629 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T03:01:28.629 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-06T03:01:28.629 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T03:01:28.629 INFO:teuthology.orchestra.run.smithi130.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-10-06T03:01:28.629 INFO:teuthology.orchestra.run.smithi130.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-10-06T03:01:28.629 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T03:01:28.629 INFO:teuthology.orchestra.run.smithi130.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-10-06T03:01:28.629 INFO:teuthology.orchestra.run.smithi130.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-10-06T03:01:28.629 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-06T03:01:28.629 INFO:teuthology.orchestra.run.smithi130.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-06T03:01:28.630 INFO:teuthology.orchestra.run.smithi130.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-06T03:01:28.630 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-06T03:01:28.630 INFO:teuthology.orchestra.run.smithi130.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-10-06T03:01:28.630 INFO:teuthology.orchestra.run.smithi130.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-10-06T03:01:28.630 INFO:teuthology.orchestra.run.smithi130.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-10-06T03:01:28.630 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T03:01:28.630 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-10-06T03:01:28.630 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T03:01:28.630 INFO:teuthology.orchestra.run.smithi130.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T03:01:28.630 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T03:01:28.630 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T03:01:28.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T03:01:28.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T03:01:28.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-06T03:01:28.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T03:01:28.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T03:01:28.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-06T03:01:28.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T03:01:28.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T03:01:28.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T03:01:28.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-10-06T03:01:28.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-06T03:01:28.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-06T03:01:28.631 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-06T03:01:28.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T03:01:28.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T03:01:28.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-06T03:01:28.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-06T03:01:28.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T03:01:28.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T03:01:28.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-06T03:01:28.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-06T03:01:28.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-06T03:01:28.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T03:01:28.632 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T03:01:28.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-06T03:01:28.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-06T03:01:28.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-06T03:01:28.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-06T03:01:28.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-06T03:01:28.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-06T03:01:28.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T03:01:28.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-06T03:01:28.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T03:01:28.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T03:01:28.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-06T03:01:28.633 INFO:teuthology.orchestra.run.smithi130.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T03:01:28.634 INFO:teuthology.orchestra.run.smithi130.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T03:01:28.634 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T03:01:28.634 INFO:teuthology.orchestra.run.smithi130.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T03:01:28.634 INFO:teuthology.orchestra.run.smithi130.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T03:01:28.634 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T03:01:28.634 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T03:01:28.634 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T03:01:28.634 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-06T03:01:28.634 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T03:01:28.634 INFO:teuthology.orchestra.run.smithi130.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-06T03:01:28.634 INFO:teuthology.orchestra.run.smithi130.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T03:01:28.634 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-06T03:01:28.635 INFO:teuthology.orchestra.run.smithi130.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-10-06T03:01:28.635 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:01:28.635 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2023-10-06T03:01:28.635 INFO:teuthology.orchestra.run.smithi130.stdout:==================================================================================================== 2023-10-06T03:01:28.635 INFO:teuthology.orchestra.run.smithi130.stdout:Install 123 Packages 2023-10-06T03:01:28.635 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrade 16 Packages 2023-10-06T03:01:28.635 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:01:28.636 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 210 M 2023-10-06T03:01:28.636 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2023-10-06T03:01:28.875 INFO:teuthology.orchestra.run.smithi130.stdout:(1/139): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 52 kB/s | 6.4 kB 00:00 2023-10-06T03:01:29.111 INFO:teuthology.orchestra.run.smithi130.stdout:(2/139): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 3.6 MB/s | 876 kB 00:00 2023-10-06T03:01:29.236 INFO:teuthology.orchestra.run.smithi130.stdout:(3/139): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 11 MB/s | 5.2 MB 00:00 2023-10-06T03:01:29.261 INFO:teuthology.orchestra.run.smithi130.stdout:(4/139): ceph-immutable-object-cache-17.2.6-129 1.1 MB/s | 162 kB 00:00 2023-10-06T03:01:29.395 INFO:teuthology.orchestra.run.smithi130.stdout:(5/139): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 15 MB/s | 2.3 MB 00:00 2023-10-06T03:01:29.579 INFO:teuthology.orchestra.run.smithi130.stdout:(6/139): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 5.0 MB/s | 1.6 MB 00:00 2023-10-06T03:01:29.670 INFO:teuthology.orchestra.run.smithi130.stdout:(7/139): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 14 MB/s | 3.9 MB 00:00 2023-10-06T03:01:31.140 INFO:teuthology.orchestra.run.smithi130.stdout:(8/139): ceph-radosgw-17.2.6-1296.g736ac5ba.el8 11 MB/s | 17 MB 00:01 2023-10-06T03:01:31.188 INFO:teuthology.orchestra.run.smithi125.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T03:01:31.188 INFO:teuthology.orchestra.run.smithi125.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T03:01:31.203 INFO:teuthology.orchestra.run.smithi125.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-10-06T03:01:31.203 INFO:teuthology.orchestra.run.smithi125.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-10-06T03:01:31.204 INFO:teuthology.orchestra.run.smithi125.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-10-06T03:01:31.204 INFO:teuthology.orchestra.run.smithi130.stdout:(9/139): ceph-selinux-17.2.6-1296.g736ac5ba.el8 382 kB/s | 24 kB 00:00 2023-10-06T03:01:31.205 INFO:teuthology.orchestra.run.smithi125.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-10-06T03:01:31.206 INFO:teuthology.orchestra.run.smithi125.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T03:01:31.208 INFO:teuthology.orchestra.run.smithi125.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T03:01:31.211 INFO:teuthology.orchestra.run.smithi125.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-10-06T03:01:31.212 INFO:teuthology.orchestra.run.smithi125.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-10-06T03:01:31.426 INFO:teuthology.orchestra.run.smithi125.stdout:Dependencies resolved. 2023-10-06T03:01:31.439 INFO:teuthology.orchestra.run.smithi125.stdout:==================================================================================================== 2023-10-06T03:01:31.439 INFO:teuthology.orchestra.run.smithi125.stdout: Package Arch Version Repository Size 2023-10-06T03:01:31.439 INFO:teuthology.orchestra.run.smithi125.stdout:==================================================================================================== 2023-10-06T03:01:31.439 INFO:teuthology.orchestra.run.smithi125.stdout:Installing: 2023-10-06T03:01:31.439 INFO:teuthology.orchestra.run.smithi125.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-10-06T03:01:31.439 INFO:teuthology.orchestra.run.smithi125.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T03:01:31.439 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T03:01:31.439 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T03:01:31.439 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T03:01:31.439 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T03:01:31.440 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T03:01:31.440 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T03:01:31.440 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T03:01:31.440 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T03:01:31.440 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T03:01:31.440 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T03:01:31.440 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T03:01:31.440 INFO:teuthology.orchestra.run.smithi125.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T03:01:31.440 INFO:teuthology.orchestra.run.smithi125.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T03:01:31.440 INFO:teuthology.orchestra.run.smithi125.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T03:01:31.440 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 baseos 62 k 2023-10-06T03:01:31.440 INFO:teuthology.orchestra.run.smithi125.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-10-06T03:01:31.441 INFO:teuthology.orchestra.run.smithi125.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-10-06T03:01:31.441 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T03:01:31.441 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T03:01:31.441 INFO:teuthology.orchestra.run.smithi125.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T03:01:31.441 INFO:teuthology.orchestra.run.smithi125.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-10-06T03:01:31.441 INFO:teuthology.orchestra.run.smithi125.stdout: libuuid-devel x86_64 2.32.1-43.el8 baseos 100 k 2023-10-06T03:01:31.441 INFO:teuthology.orchestra.run.smithi125.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-10-06T03:01:31.441 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T03:01:31.441 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T03:01:31.441 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T03:01:31.441 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T03:01:31.442 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T03:01:31.442 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T03:01:31.442 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T03:01:31.442 INFO:teuthology.orchestra.run.smithi125.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-10-06T03:01:31.442 INFO:teuthology.orchestra.run.smithi125.stdout:Upgrading: 2023-10-06T03:01:31.442 INFO:teuthology.orchestra.run.smithi125.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 baseos 143 k 2023-10-06T03:01:31.442 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-debuginfod-client x86_64 0.189-3.el8 baseos 76 k 2023-10-06T03:01:31.442 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-libelf x86_64 0.189-3.el8 baseos 232 k 2023-10-06T03:01:31.442 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-libs x86_64 0.189-3.el8 baseos 303 k 2023-10-06T03:01:31.442 INFO:teuthology.orchestra.run.smithi125.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2023-10-06T03:01:31.442 INFO:teuthology.orchestra.run.smithi125.stdout: libblkid x86_64 2.32.1-43.el8 baseos 220 k 2023-10-06T03:01:31.442 INFO:teuthology.orchestra.run.smithi125.stdout: libfdisk x86_64 2.32.1-43.el8 baseos 254 k 2023-10-06T03:01:31.443 INFO:teuthology.orchestra.run.smithi125.stdout: libmount x86_64 2.32.1-43.el8 baseos 236 k 2023-10-06T03:01:31.443 INFO:teuthology.orchestra.run.smithi125.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T03:01:31.443 INFO:teuthology.orchestra.run.smithi125.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T03:01:31.443 INFO:teuthology.orchestra.run.smithi125.stdout: libsmartcols x86_64 2.32.1-43.el8 baseos 179 k 2023-10-06T03:01:31.443 INFO:teuthology.orchestra.run.smithi125.stdout: libuuid x86_64 2.32.1-43.el8 baseos 99 k 2023-10-06T03:01:31.443 INFO:teuthology.orchestra.run.smithi125.stdout: util-linux x86_64 2.32.1-43.el8 baseos 2.5 M 2023-10-06T03:01:31.443 INFO:teuthology.orchestra.run.smithi125.stdout: util-linux-user x86_64 2.32.1-43.el8 baseos 103 k 2023-10-06T03:01:31.443 INFO:teuthology.orchestra.run.smithi125.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-10-06T03:01:31.443 INFO:teuthology.orchestra.run.smithi125.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-10-06T03:01:31.443 INFO:teuthology.orchestra.run.smithi125.stdout:Installing dependencies: 2023-10-06T03:01:31.443 INFO:teuthology.orchestra.run.smithi125.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2023-10-06T03:01:31.443 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T03:01:31.444 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T03:01:31.444 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T03:01:31.444 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T03:01:31.444 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T03:01:31.444 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T03:01:31.444 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T03:01:31.444 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T03:01:31.444 INFO:teuthology.orchestra.run.smithi125.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-10-06T03:01:31.444 INFO:teuthology.orchestra.run.smithi125.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T03:01:31.444 INFO:teuthology.orchestra.run.smithi125.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-10-06T03:01:31.444 INFO:teuthology.orchestra.run.smithi125.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-10-06T03:01:31.444 INFO:teuthology.orchestra.run.smithi125.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-10-06T03:01:31.445 INFO:teuthology.orchestra.run.smithi125.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T03:01:31.445 INFO:teuthology.orchestra.run.smithi125.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-10-06T03:01:31.445 INFO:teuthology.orchestra.run.smithi125.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-10-06T03:01:31.445 INFO:teuthology.orchestra.run.smithi125.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T03:01:31.445 INFO:teuthology.orchestra.run.smithi125.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-10-06T03:01:31.445 INFO:teuthology.orchestra.run.smithi125.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-10-06T03:01:31.445 INFO:teuthology.orchestra.run.smithi125.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T03:01:31.445 INFO:teuthology.orchestra.run.smithi125.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-10-06T03:01:31.445 INFO:teuthology.orchestra.run.smithi125.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T03:01:31.445 INFO:teuthology.orchestra.run.smithi125.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-10-06T03:01:31.445 INFO:teuthology.orchestra.run.smithi125.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-10-06T03:01:31.445 INFO:teuthology.orchestra.run.smithi125.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T03:01:31.445 INFO:teuthology.orchestra.run.smithi125.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-10-06T03:01:31.446 INFO:teuthology.orchestra.run.smithi125.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-10-06T03:01:31.446 INFO:teuthology.orchestra.run.smithi125.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-10-06T03:01:31.446 INFO:teuthology.orchestra.run.smithi125.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-10-06T03:01:31.446 INFO:teuthology.orchestra.run.smithi125.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-10-06T03:01:31.446 INFO:teuthology.orchestra.run.smithi125.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-10-06T03:01:31.446 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-10-06T03:01:31.446 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-10-06T03:01:31.446 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-10-06T03:01:31.446 INFO:teuthology.orchestra.run.smithi125.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T03:01:31.446 INFO:teuthology.orchestra.run.smithi125.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-10-06T03:01:31.446 INFO:teuthology.orchestra.run.smithi125.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T03:01:31.447 INFO:teuthology.orchestra.run.smithi125.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T03:01:31.447 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T03:01:31.447 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T03:01:31.447 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T03:01:31.447 INFO:teuthology.orchestra.run.smithi125.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T03:01:31.447 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-10-06T03:01:31.447 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T03:01:31.447 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T03:01:31.447 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-10-06T03:01:31.447 INFO:teuthology.orchestra.run.smithi125.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T03:01:31.447 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T03:01:31.447 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T03:01:31.448 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-10-06T03:01:31.448 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-10-06T03:01:31.448 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-10-06T03:01:31.448 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-10-06T03:01:31.448 INFO:teuthology.orchestra.run.smithi125.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T03:01:31.448 INFO:teuthology.orchestra.run.smithi125.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T03:01:31.448 INFO:teuthology.orchestra.run.smithi125.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-10-06T03:01:31.448 INFO:teuthology.orchestra.run.smithi125.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-10-06T03:01:31.448 INFO:teuthology.orchestra.run.smithi125.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T03:01:31.448 INFO:teuthology.orchestra.run.smithi125.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T03:01:31.448 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-10-06T03:01:31.448 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-10-06T03:01:31.449 INFO:teuthology.orchestra.run.smithi125.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-10-06T03:01:31.449 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T03:01:31.449 INFO:teuthology.orchestra.run.smithi125.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T03:01:31.449 INFO:teuthology.orchestra.run.smithi125.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-10-06T03:01:31.449 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-10-06T03:01:31.449 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-10-06T03:01:31.449 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-10-06T03:01:31.449 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-10-06T03:01:31.449 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-10-06T03:01:31.449 INFO:teuthology.orchestra.run.smithi125.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T03:01:31.449 INFO:teuthology.orchestra.run.smithi125.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-10-06T03:01:31.449 INFO:teuthology.orchestra.run.smithi125.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T03:01:31.449 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T03:01:31.450 INFO:teuthology.orchestra.run.smithi125.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-10-06T03:01:31.450 INFO:teuthology.orchestra.run.smithi125.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T03:01:31.450 INFO:teuthology.orchestra.run.smithi125.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T03:01:31.450 INFO:teuthology.orchestra.run.smithi125.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T03:01:31.450 INFO:teuthology.orchestra.run.smithi125.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T03:01:31.450 INFO:teuthology.orchestra.run.smithi125.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T03:01:31.450 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T03:01:31.450 INFO:teuthology.orchestra.run.smithi125.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T03:01:31.450 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T03:01:31.450 INFO:teuthology.orchestra.run.smithi125.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-10-06T03:01:31.450 INFO:teuthology.orchestra.run.smithi125.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T03:01:31.451 INFO:teuthology.orchestra.run.smithi125.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-10-06T03:01:31.451 INFO:teuthology.orchestra.run.smithi125.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T03:01:31.451 INFO:teuthology.orchestra.run.smithi125.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-10-06T03:01:31.451 INFO:teuthology.orchestra.run.smithi125.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-10-06T03:01:31.451 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:01:31.451 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction Summary 2023-10-06T03:01:31.451 INFO:teuthology.orchestra.run.smithi125.stdout:==================================================================================================== 2023-10-06T03:01:31.451 INFO:teuthology.orchestra.run.smithi125.stdout:Install 123 Packages 2023-10-06T03:01:31.451 INFO:teuthology.orchestra.run.smithi125.stdout:Upgrade 16 Packages 2023-10-06T03:01:31.451 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:01:31.452 INFO:teuthology.orchestra.run.smithi125.stdout:Total download size: 210 M 2023-10-06T03:01:31.452 INFO:teuthology.orchestra.run.smithi125.stdout:Downloading Packages: 2023-10-06T03:01:31.871 INFO:teuthology.orchestra.run.smithi130.stdout:(10/139): ceph-osd-17.2.6-1296.g736ac5ba.el8.x8 7.3 MB/s | 17 MB 00:02 2023-10-06T03:01:32.121 INFO:teuthology.orchestra.run.smithi130.stdout:(11/139): ceph-common-17.2.6-1296.g736ac5ba.el8 7.0 MB/s | 23 MB 00:03 2023-10-06T03:01:32.146 INFO:teuthology.orchestra.run.smithi130.stdout:(12/139): cephfs-mirror-17.2.6-1296.g736ac5ba.e 929 kB/s | 255 kB 00:00 2023-10-06T03:01:32.180 INFO:teuthology.orchestra.run.smithi130.stdout:(13/139): libcephfs-devel-17.2.6-1296.g736ac5ba 426 kB/s | 25 kB 00:00 2023-10-06T03:01:32.272 INFO:teuthology.orchestra.run.smithi130.stdout:(14/139): libcephfs2-17.2.6-1296.g736ac5ba.el8. 6.2 MB/s | 797 kB 00:00 2023-10-06T03:01:32.289 INFO:teuthology.orchestra.run.smithi130.stdout:(15/139): libcephsqlite-17.2.6-1296.g736ac5ba.e 1.6 MB/s | 174 kB 00:00 2023-10-06T03:01:32.339 INFO:teuthology.orchestra.run.smithi130.stdout:(16/139): librados-devel-17.2.6-1296.g736ac5ba. 1.9 MB/s | 130 kB 00:00 2023-10-06T03:01:32.415 INFO:teuthology.orchestra.run.smithi130.stdout:(17/139): libradosstriper1-17.2.6-1296.g736ac5b 4.0 MB/s | 507 kB 00:00 2023-10-06T03:01:32.506 INFO:teuthology.orchestra.run.smithi130.stdout:(18/139): python3-ceph-argparse-17.2.6-1296.g73 488 kB/s | 45 kB 00:00 2023-10-06T03:01:32.599 INFO:teuthology.orchestra.run.smithi130.stdout:(19/139): python3-ceph-common-17.2.6-1296.g736a 1.2 MB/s | 115 kB 00:00 2023-10-06T03:01:32.699 INFO:teuthology.orchestra.run.smithi130.stdout:(20/139): python3-cephfs-17.2.6-1296.g736ac5ba. 1.9 MB/s | 190 kB 00:00 2023-10-06T03:01:32.799 INFO:teuthology.orchestra.run.smithi130.stdout:(21/139): python3-rados-17.2.6-1296.g736ac5ba.e 3.6 MB/s | 371 kB 00:00 2023-10-06T03:01:32.899 INFO:teuthology.orchestra.run.smithi130.stdout:(22/139): python3-rbd-17.2.6-1296.g736ac5ba.el8 3.5 MB/s | 358 kB 00:00 2023-10-06T03:01:32.983 INFO:teuthology.orchestra.run.smithi130.stdout:(23/139): librgw2-17.2.6-1296.g736ac5ba.el8.x86 8.6 MB/s | 5.6 MB 00:00 2023-10-06T03:01:33.008 INFO:teuthology.orchestra.run.smithi130.stdout:(24/139): python3-rgw-17.2.6-1296.g736ac5ba.el8 984 kB/s | 107 kB 00:00 2023-10-06T03:01:33.033 INFO:teuthology.orchestra.run.smithi130.stdout:(25/139): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.8 MB/s | 90 kB 00:00 2023-10-06T03:01:33.117 INFO:teuthology.orchestra.run.smithi130.stdout:(26/139): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 2.0 MB/s | 173 kB 00:00 2023-10-06T03:01:33.184 INFO:teuthology.orchestra.run.smithi130.stdout:(27/139): ceph-grafana-dashboards-17.2.6-1296.g 347 kB/s | 23 kB 00:00 2023-10-06T03:01:33.251 INFO:teuthology.orchestra.run.smithi130.stdout:(28/139): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 1.8 MB/s | 121 kB 00:00 2023-10-06T03:01:33.501 INFO:teuthology.orchestra.run.smithi130.stdout:(29/139): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 7.0 MB/s | 3.5 MB 00:00 2023-10-06T03:01:33.564 INFO:teuthology.orchestra.run.smithi130.stdout:(30/139): ceph-mgr-dashboard-17.2.6-1296.g736ac 5.4 MB/s | 1.7 MB 00:00 2023-10-06T03:01:33.595 INFO:teuthology.orchestra.run.smithi125.stdout:(1/139): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 30 kB/s | 6.4 kB 00:00 2023-10-06T03:01:33.644 INFO:teuthology.orchestra.run.smithi130.stdout:(31/139): ceph-mgr-modules-core-17.2.6-1296.g73 2.9 MB/s | 238 kB 00:00 2023-10-06T03:01:33.719 INFO:teuthology.orchestra.run.smithi130.stdout:(32/139): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 632 kB/s | 47 kB 00:00 2023-10-06T03:01:33.794 INFO:teuthology.orchestra.run.smithi130.stdout:(33/139): ceph-prometheus-alerts-17.2.6-1296.g7 194 kB/s | 14 kB 00:00 2023-10-06T03:01:33.878 INFO:teuthology.orchestra.run.smithi130.stdout:(34/139): ceph-volume-17.2.6-1296.g736ac5ba.el8 3.1 MB/s | 267 kB 00:00 2023-10-06T03:01:33.953 INFO:teuthology.orchestra.run.smithi130.stdout:(35/139): cephadm-17.2.6-1296.g736ac5ba.el8.noa 1.0 MB/s | 80 kB 00:00 2023-10-06T03:01:34.020 INFO:teuthology.orchestra.run.smithi130.stdout:(36/139): cephfs-top-17.2.6-1296.g736ac5ba.el8. 271 kB/s | 18 kB 00:00 2023-10-06T03:01:34.320 INFO:teuthology.orchestra.run.smithi125.stdout:(2/139): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.2 MB/s | 876 kB 00:00 2023-10-06T03:01:34.404 INFO:teuthology.orchestra.run.smithi125.stdout:(3/139): ceph-immutable-object-cache-17.2.6-129 1.9 MB/s | 162 kB 00:00 2023-10-06T03:01:34.429 INFO:teuthology.orchestra.run.smithi130.stdout:(37/139): ceph-mgr-diskprediction-local-17.2.6- 8.0 MB/s | 7.4 MB 00:00 2023-10-06T03:01:34.762 INFO:teuthology.orchestra.run.smithi125.stdout:(4/139): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 6.4 MB/s | 2.3 MB 00:00 2023-10-06T03:01:34.929 INFO:teuthology.orchestra.run.smithi130.stdout:(38/139): ceph-test-17.2.6-1296.g736ac5ba.el8.x 14 MB/s | 52 MB 00:03 2023-10-06T03:01:34.937 INFO:teuthology.orchestra.run.smithi125.stdout:(5/139): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 9.0 MB/s | 1.6 MB 00:00 2023-10-06T03:01:34.954 INFO:teuthology.orchestra.run.smithi130.stdout:(39/139): automake-1.16.1-8.el8.noarch.rpm 792 kB/s | 740 kB 00:00 2023-10-06T03:01:35.105 INFO:teuthology.orchestra.run.smithi130.stdout:(40/139): jq-1.6-7.el8.x86_64.rpm 1.3 MB/s | 202 kB 00:00 2023-10-06T03:01:35.213 INFO:teuthology.orchestra.run.smithi130.stdout:(41/139): flex-2.6.1-9.el8.x86_64.rpm 1.1 MB/s | 320 kB 00:00 2023-10-06T03:01:35.288 INFO:teuthology.orchestra.run.smithi130.stdout:(42/139): librdkafka-0.11.4-3.el8.x86_64.rpm 1.9 MB/s | 354 kB 00:00 2023-10-06T03:01:35.371 INFO:teuthology.orchestra.run.smithi125.stdout:(6/139): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 9.1 MB/s | 3.9 MB 00:00 2023-10-06T03:01:35.372 INFO:teuthology.orchestra.run.smithi130.stdout:(43/139): libtool-2.4.6-25.el8.x86_64.rpm 4.4 MB/s | 709 kB 00:00 2023-10-06T03:01:35.439 INFO:teuthology.orchestra.run.smithi130.stdout:(44/139): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.7 MB/s | 259 kB 00:00 2023-10-06T03:01:35.464 INFO:teuthology.orchestra.run.smithi130.stdout:(45/139): oniguruma-6.8.2-2.el8.x86_64.rpm 2.0 MB/s | 187 kB 00:00 2023-10-06T03:01:35.515 INFO:teuthology.orchestra.run.smithi130.stdout:(46/139): bison-3.0.4-10.el8.x86_64.rpm 634 kB/s | 688 kB 00:01 2023-10-06T03:01:36.132 INFO:teuthology.orchestra.run.smithi130.stdout:(47/139): openblas-threads-0.3.15-4.el8.x86_64. 7.3 MB/s | 4.9 MB 00:00 2023-10-06T03:01:36.204 INFO:teuthology.orchestra.run.smithi125.stdout:(7/139): ceph-common-17.2.6-1296.g736ac5ba.el8. 8.3 MB/s | 23 MB 00:02 2023-10-06T03:01:36.373 INFO:teuthology.orchestra.run.smithi130.stdout:(48/139): python3-jinja2-2.10.1-3.el8.noarch.rp 2.2 MB/s | 538 kB 00:00 2023-10-06T03:01:36.465 INFO:teuthology.orchestra.run.smithi130.stdout:(49/139): python3-jsonpatch-1.21-2.el8.noarch.r 290 kB/s | 27 kB 00:00 2023-10-06T03:01:36.566 INFO:teuthology.orchestra.run.smithi130.stdout:(50/139): python3-jsonpointer-1.10-11.el8.noarc 200 kB/s | 20 kB 00:00 2023-10-06T03:01:36.674 INFO:teuthology.orchestra.run.smithi130.stdout:(51/139): python3-mako-1.0.6-14.el8.noarch.rpm 1.4 MB/s | 157 kB 00:00 2023-10-06T03:01:36.758 INFO:teuthology.orchestra.run.smithi130.stdout:(52/139): python3-markupsafe-0.23-19.el8.x86_64 466 kB/s | 39 kB 00:00 2023-10-06T03:01:37.005 INFO:teuthology.orchestra.run.smithi125.stdout:(8/139): ceph-osd-17.2.6-1296.g736ac5ba.el8.x86 10 MB/s | 17 MB 00:01 2023-10-06T03:01:37.066 INFO:teuthology.orchestra.run.smithi130.stdout:(53/139): openblas-0.3.15-4.el8.x86_64.rpm 2.9 MB/s | 4.7 MB 00:01 2023-10-06T03:01:37.081 INFO:teuthology.orchestra.run.smithi125.stdout:(9/139): ceph-selinux-17.2.6-1296.g736ac5ba.el8 325 kB/s | 24 kB 00:00 2023-10-06T03:01:37.158 INFO:teuthology.orchestra.run.smithi130.stdout:(54/139): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.4 MB/s | 225 kB 00:00 2023-10-06T03:01:37.222 INFO:teuthology.orchestra.run.smithi125.stdout:(10/139): ceph-base-17.2.6-1296.g736ac5ba.el8.x 1.3 MB/s | 5.2 MB 00:03 2023-10-06T03:01:37.242 INFO:teuthology.orchestra.run.smithi130.stdout:(55/139): python3-numpy-1.14.3-10.el8.x86_64.rp 7.7 MB/s | 3.7 MB 00:00 2023-10-06T03:01:37.267 INFO:teuthology.orchestra.run.smithi130.stdout:(56/139): python3-prettytable-0.7.2-14.el8.noar 404 kB/s | 44 kB 00:00 2023-10-06T03:01:37.301 INFO:teuthology.orchestra.run.smithi130.stdout:(57/139): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.7 MB/s | 103 kB 00:00 2023-10-06T03:01:37.326 INFO:teuthology.orchestra.run.smithi130.stdout:(58/139): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2023-10-06T03:01:37.351 INFO:teuthology.orchestra.run.smithi130.stdout:(59/139): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2023-10-06T03:01:37.410 INFO:teuthology.orchestra.run.smithi130.stdout:(60/139): python3-babel-2.5.1-7.el8.noarch.rpm 2.5 MB/s | 4.8 MB 00:01 2023-10-06T03:01:37.427 INFO:teuthology.orchestra.run.smithi130.stdout:(61/139): python3-pytz-2017.2-11.el8.noarch.rpm 566 kB/s | 57 kB 00:00 2023-10-06T03:01:37.527 INFO:teuthology.orchestra.run.smithi130.stdout:(62/139): python3-werkzeug-0.12.2-4.el8.noarch. 3.8 MB/s | 457 kB 00:00 2023-10-06T03:01:37.539 INFO:teuthology.orchestra.run.smithi125.stdout:(11/139): ceph-radosgw-17.2.6-1296.g736ac5ba.el 13 MB/s | 17 MB 00:01 2023-10-06T03:01:37.552 INFO:teuthology.orchestra.run.smithi130.stdout:(63/139): socat-1.7.4.1-1.el8.x86_64.rpm 2.5 MB/s | 323 kB 00:00 2023-10-06T03:01:37.564 INFO:teuthology.orchestra.run.smithi125.stdout:(12/139): cephfs-mirror-17.2.6-1296.g736ac5ba.e 748 kB/s | 255 kB 00:00 2023-10-06T03:01:37.589 INFO:teuthology.orchestra.run.smithi125.stdout:(13/139): libcephfs-devel-17.2.6-1296.g736ac5ba 498 kB/s | 25 kB 00:00 2023-10-06T03:01:37.603 INFO:teuthology.orchestra.run.smithi130.stdout:(64/139): xmlstarlet-1.6.1-20.el8.x86_64.rpm 940 kB/s | 71 kB 00:00 2023-10-06T03:01:37.826 INFO:teuthology.orchestra.run.smithi125.stdout:(14/139): libcephsqlite-17.2.6-1296.g736ac5ba.e 736 kB/s | 174 kB 00:00 2023-10-06T03:01:37.982 INFO:teuthology.orchestra.run.smithi125.stdout:(15/139): librados-devel-17.2.6-1296.g736ac5ba. 836 kB/s | 130 kB 00:00 2023-10-06T03:01:38.026 INFO:teuthology.orchestra.run.smithi125.stdout:(16/139): libcephfs2-17.2.6-1296.g736ac5ba.el8. 1.7 MB/s | 797 kB 00:00 2023-10-06T03:01:38.057 INFO:teuthology.orchestra.run.smithi125.stdout:(17/139): libradosstriper1-17.2.6-1296.g736ac5b 6.6 MB/s | 507 kB 00:00 2023-10-06T03:01:38.124 INFO:teuthology.orchestra.run.smithi125.stdout:(18/139): python3-ceph-argparse-17.2.6-1296.g73 670 kB/s | 45 kB 00:00 2023-10-06T03:01:38.200 INFO:teuthology.orchestra.run.smithi125.stdout:(19/139): python3-ceph-common-17.2.6-1296.g736a 1.5 MB/s | 115 kB 00:00 2023-10-06T03:01:38.212 INFO:teuthology.orchestra.run.smithi130.stdout:(65/139): python3-scipy-1.0.0-21.module_el8.5.0 16 MB/s | 14 MB 00:00 2023-10-06T03:01:38.228 INFO:teuthology.orchestra.run.smithi130.stdout:(66/139): elfutils-libelf-devel-0.189-3.el8.x86 91 kB/s | 62 kB 00:00 2023-10-06T03:01:38.267 INFO:teuthology.orchestra.run.smithi125.stdout:(20/139): python3-cephfs-17.2.6-1296.g736ac5ba. 2.8 MB/s | 190 kB 00:00 2023-10-06T03:01:38.334 INFO:teuthology.orchestra.run.smithi125.stdout:(21/139): python3-rados-17.2.6-1296.g736ac5ba.e 5.5 MB/s | 371 kB 00:00 2023-10-06T03:01:38.370 INFO:teuthology.orchestra.run.smithi130.stdout:(67/139): fuse-2.9.7-17.el8.x86_64.rpm 108 kB/s | 83 kB 00:00 2023-10-06T03:01:38.409 INFO:teuthology.orchestra.run.smithi125.stdout:(22/139): python3-rbd-17.2.6-1296.g736ac5ba.el8 4.7 MB/s | 358 kB 00:00 2023-10-06T03:01:38.484 INFO:teuthology.orchestra.run.smithi125.stdout:(23/139): python3-rgw-17.2.6-1296.g736ac5ba.el8 1.4 MB/s | 107 kB 00:00 2023-10-06T03:01:38.560 INFO:teuthology.orchestra.run.smithi125.stdout:(24/139): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.2 MB/s | 90 kB 00:00 2023-10-06T03:01:38.870 INFO:teuthology.orchestra.run.smithi130.stdout:(68/139): keyutils-libs-devel-1.5.10-9.el8.x86_ 73 kB/s | 48 kB 00:00 2023-10-06T03:01:38.887 INFO:teuthology.orchestra.run.smithi130.stdout:(69/139): libaio-devel-0.3.112-1.el8.x86_64.rpm 36 kB/s | 19 kB 00:00 2023-10-06T03:01:39.026 INFO:teuthology.orchestra.run.smithi125.stdout:(25/139): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 7.4 MB/s | 3.5 MB 00:00 2023-10-06T03:01:39.102 INFO:teuthology.orchestra.run.smithi125.stdout:(26/139): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 2.3 MB/s | 173 kB 00:00 2023-10-06T03:01:39.160 INFO:teuthology.orchestra.run.smithi125.stdout:(27/139): ceph-grafana-dashboards-17.2.6-1296.g 395 kB/s | 23 kB 00:00 2023-10-06T03:01:39.235 INFO:teuthology.orchestra.run.smithi125.stdout:(28/139): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 1.6 MB/s | 121 kB 00:00 2023-10-06T03:01:39.461 INFO:teuthology.orchestra.run.smithi125.stdout:(29/139): ceph-mgr-dashboard-17.2.6-1296.g736ac 7.5 MB/s | 1.7 MB 00:00 2023-10-06T03:01:39.488 INFO:teuthology.orchestra.run.smithi130.stdout:(70/139): libcom_err-devel-1.45.6-5.el8.x86_64. 63 kB/s | 39 kB 00:00 2023-10-06T03:01:39.663 INFO:teuthology.orchestra.run.smithi130.stdout:(71/139): krb5-devel-1.18.2-22.el8.x86_64.rpm 391 kB/s | 561 kB 00:01 2023-10-06T03:01:40.280 INFO:teuthology.orchestra.run.smithi130.stdout:(72/139): librabbitmq-0.9.0-4.el8.x86_64.rpm 76 kB/s | 47 kB 00:00 2023-10-06T03:01:40.412 INFO:teuthology.orchestra.run.smithi125.stdout:(30/139): ceph-mgr-diskprediction-local-17.2.6- 7.8 MB/s | 7.4 MB 00:00 2023-10-06T03:01:40.486 INFO:teuthology.orchestra.run.smithi125.stdout:(31/139): ceph-mgr-modules-core-17.2.6-1296.g73 3.1 MB/s | 238 kB 00:00 2023-10-06T03:01:40.521 INFO:teuthology.orchestra.run.smithi130.stdout:(73/139): libquadmath-8.5.0-20.el8.x86_64.rpm 167 kB/s | 172 kB 00:01 2023-10-06T03:01:40.544 INFO:teuthology.orchestra.run.smithi125.stdout:(32/139): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 811 kB/s | 47 kB 00:00 2023-10-06T03:01:40.572 INFO:teuthology.orchestra.run.smithi130.stdout:(74/139): libgfortran-8.5.0-20.el8.x86_64.rpm 383 kB/s | 645 kB 00:01 2023-10-06T03:01:40.595 INFO:teuthology.orchestra.run.smithi125.stdout:(33/139): ceph-prometheus-alerts-17.2.6-1296.g7 289 kB/s | 14 kB 00:00 2023-10-06T03:01:40.670 INFO:teuthology.orchestra.run.smithi125.stdout:(34/139): ceph-volume-17.2.6-1296.g736ac5ba.el8 3.5 MB/s | 267 kB 00:00 2023-10-06T03:01:40.737 INFO:teuthology.orchestra.run.smithi125.stdout:(35/139): cephadm-17.2.6-1296.g736ac5ba.el8.noa 1.2 MB/s | 80 kB 00:00 2023-10-06T03:01:40.854 INFO:teuthology.orchestra.run.smithi125.stdout:(36/139): librgw2-17.2.6-1296.g736ac5ba.el8.x86 2.0 MB/s | 5.6 MB 00:02 2023-10-06T03:01:40.880 INFO:teuthology.orchestra.run.smithi125.stdout:(37/139): cephfs-top-17.2.6-1296.g736ac5ba.el8. 127 kB/s | 18 kB 00:00 2023-10-06T03:01:41.272 INFO:teuthology.orchestra.run.smithi130.stdout:(75/139): libsepol-devel-2.9-3.el8.x86_64.rpm 116 kB/s | 87 kB 00:00 2023-10-06T03:01:41.313 INFO:teuthology.orchestra.run.smithi125.stdout:(38/139): ceph-test-17.2.6-1296.g736ac5ba.el8.x 12 MB/s | 52 MB 00:04 2023-10-06T03:01:41.330 INFO:teuthology.orchestra.run.smithi130.stdout:(76/139): libuuid-devel-2.32.1-43.el8.x86_64.rp 131 kB/s | 100 kB 00:00 2023-10-06T03:01:41.365 INFO:teuthology.orchestra.run.smithi130.stdout:(77/139): libselinux-devel-2.9-8.el8.x86_64.rpm 185 kB/s | 200 kB 00:01 2023-10-06T03:01:41.672 INFO:teuthology.orchestra.run.smithi125.stdout:(39/139): flex-2.6.1-9.el8.x86_64.rpm 893 kB/s | 320 kB 00:00 2023-10-06T03:01:41.705 INFO:teuthology.orchestra.run.smithi125.stdout:(40/139): automake-1.16.1-8.el8.noarch.rpm 870 kB/s | 740 kB 00:00 2023-10-06T03:01:41.731 INFO:teuthology.orchestra.run.smithi125.stdout:(41/139): bison-3.0.4-10.el8.x86_64.rpm 809 kB/s | 688 kB 00:00 2023-10-06T03:01:41.747 INFO:teuthology.orchestra.run.smithi130.stdout:(78/139): libverto-devel-0.3.2-2.el8.x86_64.rpm 38 kB/s | 18 kB 00:00 2023-10-06T03:01:41.756 INFO:teuthology.orchestra.run.smithi125.stdout:(42/139): jq-1.6-7.el8.x86_64.rpm 2.3 MB/s | 202 kB 00:00 2023-10-06T03:01:41.798 INFO:teuthology.orchestra.run.smithi125.stdout:(43/139): librdkafka-0.11.4-3.el8.x86_64.rpm 3.7 MB/s | 354 kB 00:00 2023-10-06T03:01:41.877 INFO:teuthology.orchestra.run.smithi125.stdout:(44/139): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.1 MB/s | 259 kB 00:00 2023-10-06T03:01:41.907 INFO:teuthology.orchestra.run.smithi125.stdout:(45/139): libtool-2.4.6-25.el8.x86_64.rpm 3.9 MB/s | 709 kB 00:00 2023-10-06T03:01:41.932 INFO:teuthology.orchestra.run.smithi125.stdout:(46/139): oniguruma-6.8.2-2.el8.x86_64.rpm 1.4 MB/s | 187 kB 00:00 2023-10-06T03:01:41.989 INFO:teuthology.orchestra.run.smithi130.stdout:(79/139): libzstd-devel-1.4.4-1.el8.x86_64.rpm 66 kB/s | 44 kB 00:00 2023-10-06T03:01:42.374 INFO:teuthology.orchestra.run.smithi125.stdout:(47/139): openblas-0.3.15-4.el8.x86_64.rpm 9.5 MB/s | 4.7 MB 00:00 2023-10-06T03:01:42.441 INFO:teuthology.orchestra.run.smithi125.stdout:(48/139): openblas-threads-0.3.15-4.el8.x86_64. 9.1 MB/s | 4.9 MB 00:00 2023-10-06T03:01:42.483 INFO:teuthology.orchestra.run.smithi125.stdout:(49/139): python3-jinja2-2.10.1-3.el8.noarch.rp 4.9 MB/s | 538 kB 00:00 2023-10-06T03:01:42.550 INFO:teuthology.orchestra.run.smithi125.stdout:(50/139): python3-babel-2.5.1-7.el8.noarch.rpm 7.8 MB/s | 4.8 MB 00:00 2023-10-06T03:01:42.584 INFO:teuthology.orchestra.run.smithi125.stdout:(51/139): python3-jsonpatch-1.21-2.el8.noarch.r 187 kB/s | 27 kB 00:00 2023-10-06T03:01:42.608 INFO:teuthology.orchestra.run.smithi125.stdout:(52/139): python3-jsonpointer-1.10-11.el8.noarc 159 kB/s | 20 kB 00:00 2023-10-06T03:01:42.634 INFO:teuthology.orchestra.run.smithi125.stdout:(53/139): python3-mako-1.0.6-14.el8.noarch.rpm 1.8 MB/s | 157 kB 00:00 2023-10-06T03:01:42.684 INFO:teuthology.orchestra.run.smithi125.stdout:(54/139): python3-markupsafe-0.23-19.el8.x86_64 516 kB/s | 39 kB 00:00 2023-10-06T03:01:42.718 INFO:teuthology.orchestra.run.smithi125.stdout:(55/139): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.6 MB/s | 225 kB 00:00 2023-10-06T03:01:42.760 INFO:teuthology.orchestra.run.smithi125.stdout:(56/139): python3-prettytable-0.7.2-14.el8.noar 584 kB/s | 44 kB 00:00 2023-10-06T03:01:42.838 INFO:teuthology.orchestra.run.smithi125.stdout:(57/139): python3-pyOpenSSL-19.0.0-1.el8.noarch 860 kB/s | 103 kB 00:00 2023-10-06T03:01:42.860 INFO:teuthology.orchestra.run.smithi125.stdout:(58/139): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.2 MB/s | 126 kB 00:00 2023-10-06T03:01:42.919 INFO:teuthology.orchestra.run.smithi125.stdout:(59/139): python3-pyasn1-modules-0.3.7-6.el8.no 1.3 MB/s | 110 kB 00:00 2023-10-06T03:01:42.944 INFO:teuthology.orchestra.run.smithi125.stdout:(60/139): python3-pytz-2017.2-11.el8.noarch.rpm 682 kB/s | 57 kB 00:00 2023-10-06T03:01:43.011 INFO:teuthology.orchestra.run.smithi125.stdout:(61/139): python3-numpy-1.14.3-10.el8.x86_64.rp 9.3 MB/s | 3.7 MB 00:00 2023-10-06T03:01:43.036 INFO:teuthology.orchestra.run.smithi125.stdout:(62/139): python3-werkzeug-0.12.2-4.el8.noarch. 4.9 MB/s | 457 kB 00:00 2023-10-06T03:01:43.106 INFO:teuthology.orchestra.run.smithi130.stdout:(80/139): pcre2-utf16-10.32-3.el8.x86_64.rpm 205 kB/s | 229 kB 00:01 2023-10-06T03:01:43.128 INFO:teuthology.orchestra.run.smithi125.stdout:(63/139): xmlstarlet-1.6.1-20.el8.x86_64.rpm 770 kB/s | 71 kB 00:00 2023-10-06T03:01:43.315 INFO:teuthology.orchestra.run.smithi130.stdout:(81/139): pcre2-devel-10.32-3.el8.x86_64.rpm 386 kB/s | 605 kB 00:01 2023-10-06T03:01:43.681 INFO:teuthology.orchestra.run.smithi130.stdout:(82/139): openssl-devel-1.1.1k-9.el8.x86_64.rpm 1.4 MB/s | 3.2 MB 00:02 2023-10-06T03:01:43.929 INFO:teuthology.orchestra.run.smithi125.stdout:(64/139): elfutils-libelf-devel-0.189-3.el8.x86 77 kB/s | 62 kB 00:00 2023-10-06T03:01:43.954 INFO:teuthology.orchestra.run.smithi125.stdout:(65/139): socat-1.7.4.1-1.el8.x86_64.rpm 343 kB/s | 323 kB 00:00 2023-10-06T03:01:44.324 INFO:teuthology.orchestra.run.smithi130.stdout:(83/139): pcre2-utf32-10.32-3.el8.x86_64.rpm 181 kB/s | 220 kB 00:01 2023-10-06T03:01:44.540 INFO:teuthology.orchestra.run.smithi130.stdout:(84/139): python3-cffi-1.11.5-6.el8.x86_64.rpm 203 kB/s | 249 kB 00:01 2023-10-06T03:01:44.546 INFO:teuthology.orchestra.run.smithi125.stdout:(66/139): keyutils-libs-devel-1.5.10-9.el8.x86_ 81 kB/s | 48 kB 00:00 2023-10-06T03:01:44.671 INFO:teuthology.orchestra.run.smithi125.stdout:(67/139): fuse-2.9.7-17.el8.x86_64.rpm 112 kB/s | 83 kB 00:00 2023-10-06T03:01:44.855 INFO:teuthology.orchestra.run.smithi125.stdout:(68/139): python3-scipy-1.0.0-21.module_el8.5.0 7.1 MB/s | 14 MB 00:01 2023-10-06T03:01:44.899 INFO:teuthology.orchestra.run.smithi130.stdout:(85/139): python3-jwt-1.6.1-2.el8.noarch.rpm 74 kB/s | 43 kB 00:00 2023-10-06T03:01:45.155 INFO:teuthology.orchestra.run.smithi125.stdout:(69/139): libaio-devel-0.3.112-1.el8.x86_64.rpm 39 kB/s | 19 kB 00:00 2023-10-06T03:01:45.207 INFO:teuthology.orchestra.run.smithi130.stdout:(86/139): python3-cryptography-3.2.1-6.el8.x86_ 420 kB/s | 641 kB 00:01 2023-10-06T03:01:45.422 INFO:teuthology.orchestra.run.smithi125.stdout:(70/139): libcom_err-devel-1.45.6-5.el8.x86_64. 68 kB/s | 39 kB 00:00 2023-10-06T03:01:45.491 INFO:teuthology.orchestra.run.smithi130.stdout:(87/139): python3-oauthlib-2.1.0-1.el8.noarch.r 163 kB/s | 155 kB 00:00 2023-10-06T03:01:45.741 INFO:teuthology.orchestra.run.smithi130.stdout:(88/139): python3-pycparser-2.14-14.el8.noarch. 129 kB/s | 109 kB 00:00 2023-10-06T03:01:45.766 INFO:teuthology.orchestra.run.smithi130.stdout:(89/139): python3-requests-oauthlib-1.0.0-1.el8 76 kB/s | 43 kB 00:00 2023-10-06T03:01:45.780 INFO:teuthology.orchestra.run.smithi125.stdout:(71/139): krb5-devel-1.18.2-22.el8.x86_64.rpm 454 kB/s | 561 kB 00:01 2023-10-06T03:01:46.184 INFO:teuthology.orchestra.run.smithi130.stdout:(90/139): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 108 kB/s | 74 kB 00:00 2023-10-06T03:01:46.331 INFO:teuthology.orchestra.run.smithi125.stdout:(72/139): librabbitmq-0.9.0-4.el8.x86_64.rpm 85 kB/s | 47 kB 00:00 2023-10-06T03:01:46.356 INFO:teuthology.orchestra.run.smithi125.stdout:(73/139): libquadmath-8.5.0-20.el8.x86_64.rpm 184 kB/s | 172 kB 00:00 2023-10-06T03:01:46.398 INFO:teuthology.orchestra.run.smithi125.stdout:(74/139): libgfortran-8.5.0-20.el8.x86_64.rpm 519 kB/s | 645 kB 00:01 2023-10-06T03:01:46.586 INFO:teuthology.orchestra.run.smithi130.stdout:(91/139): zlib-devel-1.2.11-21.el8.x86_64.rpm 69 kB/s | 58 kB 00:00 2023-10-06T03:01:46.801 INFO:teuthology.orchestra.run.smithi130.stdout:(92/139): gperftools-libs-2.7-9.el8.x86_64.rpm 296 kB/s | 306 kB 00:01 2023-10-06T03:01:46.826 INFO:teuthology.orchestra.run.smithi130.stdout:(93/139): liboath-2.6.2-3.el8.x86_64.rpm 91 kB/s | 59 kB 00:00 2023-10-06T03:01:46.985 INFO:teuthology.orchestra.run.smithi130.stdout:(94/139): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 275 kB/s | 44 kB 00:00 2023-10-06T03:01:47.068 INFO:teuthology.orchestra.run.smithi130.stdout:(95/139): python3-asyncssh-2.7.0-2.el8.noarch.r 1.8 MB/s | 476 kB 00:00 2023-10-06T03:01:47.098 INFO:teuthology.orchestra.run.smithi125.stdout:(75/139): libsepol-devel-2.9-3.el8.x86_64.rpm 117 kB/s | 87 kB 00:00 2023-10-06T03:01:47.193 INFO:teuthology.orchestra.run.smithi130.stdout:(96/139): python3-cachetools-3.1.1-4.el8.noarch 264 kB/s | 33 kB 00:00 2023-10-06T03:01:47.215 INFO:teuthology.orchestra.run.smithi125.stdout:(76/139): libuuid-devel-2.32.1-43.el8.x86_64.rp 122 kB/s | 100 kB 00:00 2023-10-06T03:01:47.352 INFO:teuthology.orchestra.run.smithi125.stdout:(77/139): libselinux-devel-2.9-8.el8.x86_64.rpm 197 kB/s | 200 kB 00:01 2023-10-06T03:01:47.352 INFO:teuthology.orchestra.run.smithi130.stdout:(97/139): libunwind-1.3.1-3.el8.x86_64.rpm 113 kB/s | 75 kB 00:00 2023-10-06T03:01:47.352 INFO:teuthology.orchestra.run.smithi130.stdout:(98/139): python3-beautifulsoup4-4.6.3-2.el8.1. 634 kB/s | 185 kB 00:00 2023-10-06T03:01:47.353 INFO:teuthology.orchestra.run.smithi130.stdout:(99/139): python3-certifi-2018.10.15-7.el8.noar 130 kB/s | 16 kB 00:00 2023-10-06T03:01:47.453 INFO:teuthology.orchestra.run.smithi130.stdout:(100/139): python3-google-auth-1.1.1-10.el8.noa 609 kB/s | 81 kB 00:00 2023-10-06T03:01:47.532 INFO:teuthology.orchestra.run.smithi125.stdout:(78/139): libverto-devel-0.3.2-2.el8.x86_64.rpm 42 kB/s | 18 kB 00:00 2023-10-06T03:01:47.536 INFO:teuthology.orchestra.run.smithi130.stdout:(101/139): python3-cheroot-8.5.2-1.el8.noarch.r 607 kB/s | 173 kB 00:00 2023-10-06T03:01:47.570 INFO:teuthology.orchestra.run.smithi130.stdout:(102/139): python3-cherrypy-18.4.0-1.el8.noarch 1.3 MB/s | 384 kB 00:00 2023-10-06T03:01:47.595 INFO:teuthology.orchestra.run.smithi130.stdout:(103/139): python3-jaraco-6.2-6.el8.noarch.rpm 78 kB/s | 11 kB 00:00 2023-10-06T03:01:47.662 INFO:teuthology.orchestra.run.smithi130.stdout:(104/139): python3-jaraco-functools-2.0-4.el8.n 140 kB/s | 18 kB 00:00 2023-10-06T03:01:47.721 INFO:teuthology.orchestra.run.smithi130.stdout:(105/139): python3-logutils-0.3.5-11.el8.noarch 389 kB/s | 49 kB 00:00 2023-10-06T03:01:47.796 INFO:teuthology.orchestra.run.smithi130.stdout:(106/139): python3-more-itertools-7.2.0-3.el8.n 440 kB/s | 59 kB 00:00 2023-10-06T03:01:47.816 INFO:teuthology.orchestra.run.smithi125.stdout:(79/139): libzstd-devel-1.4.4-1.el8.x86_64.rpm 73 kB/s | 44 kB 00:00 2023-10-06T03:01:47.838 INFO:teuthology.orchestra.run.smithi130.stdout:(107/139): python3-kubernetes-11.0.0-6.el8.noar 4.4 MB/s | 1.2 MB 00:00 2023-10-06T03:01:47.863 INFO:teuthology.orchestra.run.smithi130.stdout:(108/139): python3-natsort-7.1.1-2.el8.noarch.r 424 kB/s | 60 kB 00:00 2023-10-06T03:01:47.963 INFO:teuthology.orchestra.run.smithi130.stdout:(109/139): python3-portend-2.6-1.el8.noarch.rpm 124 kB/s | 16 kB 00:00 2023-10-06T03:01:47.989 INFO:teuthology.orchestra.run.smithi130.stdout:(110/139): python3-repoze-lru-0.7-6.el8.noarch. 268 kB/s | 34 kB 00:00 2023-10-06T03:01:48.014 INFO:teuthology.orchestra.run.smithi130.stdout:(111/139): python3-pecan-1.3.2-9.el8.noarch.rpm 1.3 MB/s | 283 kB 00:00 2023-10-06T03:01:48.097 INFO:teuthology.orchestra.run.smithi130.stdout:(112/139): python3-routes-2.4.1-12.el8.noarch.r 1.4 MB/s | 196 kB 00:00 2023-10-06T03:01:48.123 INFO:teuthology.orchestra.run.smithi130.stdout:(113/139): python3-rsa-4.9-2.el8.noarch.rpm 480 kB/s | 64 kB 00:00 2023-10-06T03:01:48.140 INFO:teuthology.orchestra.run.smithi130.stdout:(114/139): python3-simplegeneric-0.8.1-17.el8.n 149 kB/s | 19 kB 00:00 2023-10-06T03:01:48.240 INFO:teuthology.orchestra.run.smithi130.stdout:(115/139): python3-tempora-1.14.1-5.el8.noarch. 251 kB/s | 29 kB 00:00 2023-10-06T03:01:48.265 INFO:teuthology.orchestra.run.smithi130.stdout:(116/139): python3-trustme-0.6.0-4.el8.noarch.r 220 kB/s | 27 kB 00:00 2023-10-06T03:01:48.399 INFO:teuthology.orchestra.run.smithi130.stdout:(117/139): python3-waitress-1.4.3-1.el8.noarch. 1.6 MB/s | 255 kB 00:00 2023-10-06T03:01:48.449 INFO:teuthology.orchestra.run.smithi130.stdout:(118/139): python3-webob-1.8.5-1.el8.1.noarch.r 1.3 MB/s | 251 kB 00:00 2023-10-06T03:01:48.524 INFO:teuthology.orchestra.run.smithi130.stdout:(119/139): python3-singledispatch-3.4.0.3-18.el 56 kB/s | 24 kB 00:00 2023-10-06T03:01:48.549 INFO:teuthology.orchestra.run.smithi130.stdout:(120/139): python3-websocket-client-0.56.0-5.el 407 kB/s | 61 kB 00:00 2023-10-06T03:01:48.591 INFO:teuthology.orchestra.run.smithi130.stdout:(121/139): python3-webtest-2.0.33-1.el8.noarch. 600 kB/s | 85 kB 00:00 2023-10-06T03:01:48.650 INFO:teuthology.orchestra.run.smithi130.stdout:(122/139): python3-zc-lockfile-2.0-2.el8.noarch 183 kB/s | 23 kB 00:00 2023-10-06T03:01:48.841 INFO:teuthology.orchestra.run.smithi125.stdout:(80/139): pcre2-utf16-10.32-3.el8.x86_64.rpm 223 kB/s | 229 kB 00:01 2023-10-06T03:01:48.874 INFO:teuthology.orchestra.run.smithi125.stdout:(81/139): pcre2-devel-10.32-3.el8.x86_64.rpm 451 kB/s | 605 kB 00:01 2023-10-06T03:01:48.900 INFO:teuthology.orchestra.run.smithi130.stdout:(123/139): thrift-0.13.0-2.el8.x86_64.rpm 4.9 MB/s | 1.7 MB 00:00 2023-10-06T03:01:49.101 INFO:teuthology.orchestra.run.smithi130.stdout:(124/139): librados2-17.2.6-1296.g736ac5ba.el8. 6.8 MB/s | 3.5 MB 00:00 2023-10-06T03:01:49.383 INFO:teuthology.orchestra.run.smithi125.stdout:(82/139): openssl-devel-1.1.1k-9.el8.x86_64.rpm 1.6 MB/s | 3.2 MB 00:02 2023-10-06T03:01:49.718 INFO:teuthology.orchestra.run.smithi130.stdout:(125/139): librbd1-17.2.6-1296.g736ac5ba.el8.x8 3.4 MB/s | 3.6 MB 00:01 2023-10-06T03:01:49.953 INFO:teuthology.orchestra.run.smithi130.stdout:(126/139): NetworkManager-initscripts-updown-1. 137 kB/s | 143 kB 00:01 2023-10-06T03:01:50.116 INFO:teuthology.orchestra.run.smithi125.stdout:(83/139): pcre2-utf32-10.32-3.el8.x86_64.rpm 173 kB/s | 220 kB 00:01 2023-10-06T03:01:50.126 INFO:teuthology.orchestra.run.smithi130.stdout:(127/139): elfutils-debuginfod-client-0.189-3.e 74 kB/s | 76 kB 00:01 2023-10-06T03:01:50.208 INFO:teuthology.orchestra.run.smithi125.stdout:(84/139): python3-cffi-1.11.5-6.el8.x86_64.rpm 186 kB/s | 249 kB 00:01 2023-10-06T03:01:50.650 INFO:teuthology.orchestra.run.smithi125.stdout:(85/139): python3-jwt-1.6.1-2.el8.noarch.rpm 80 kB/s | 43 kB 00:00 2023-10-06T03:01:50.675 INFO:teuthology.orchestra.run.smithi125.stdout:(86/139): python3-cryptography-3.2.1-6.el8.x86_ 496 kB/s | 641 kB 00:01 2023-10-06T03:01:50.727 INFO:teuthology.orchestra.run.smithi130.stdout:(128/139): elfutils-libelf-0.189-3.el8.x86_64.r 230 kB/s | 232 kB 00:01 2023-10-06T03:01:51.026 INFO:teuthology.orchestra.run.smithi125.stdout:(87/139): python3-oauthlib-2.1.0-1.el8.noarch.r 190 kB/s | 155 kB 00:00 2023-10-06T03:01:51.119 INFO:teuthology.orchestra.run.smithi130.stdout:(129/139): elfutils-libs-0.189-3.el8.x86_64.rpm 259 kB/s | 303 kB 00:01 2023-10-06T03:01:51.201 INFO:teuthology.orchestra.run.smithi125.stdout:(88/139): python3-requests-oauthlib-1.0.0-1.el8 81 kB/s | 43 kB 00:00 2023-10-06T03:01:51.434 INFO:teuthology.orchestra.run.smithi125.stdout:(89/139): python3-pycparser-2.14-14.el8.noarch. 139 kB/s | 109 kB 00:00 2023-10-06T03:01:51.669 INFO:teuthology.orchestra.run.smithi130.stdout:(130/139): libblkid-2.32.1-43.el8.x86_64.rpm 235 kB/s | 220 kB 00:00 2023-10-06T03:01:51.693 INFO:teuthology.orchestra.run.smithi125.stdout:(90/139): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 112 kB/s | 74 kB 00:00 2023-10-06T03:01:51.727 INFO:teuthology.orchestra.run.smithi125.stdout:(91/139): zlib-devel-1.2.11-21.el8.x86_64.rpm 110 kB/s | 58 kB 00:00 2023-10-06T03:01:52.077 INFO:teuthology.orchestra.run.smithi125.stdout:(92/139): gperftools-libs-2.7-9.el8.x86_64.rpm 477 kB/s | 306 kB 00:00 2023-10-06T03:01:52.144 INFO:teuthology.orchestra.run.smithi125.stdout:(93/139): liboath-2.6.2-3.el8.x86_64.rpm 130 kB/s | 59 kB 00:00 2023-10-06T03:01:52.177 INFO:teuthology.orchestra.run.smithi125.stdout:(94/139): libunwind-1.3.1-3.el8.x86_64.rpm 167 kB/s | 75 kB 00:00 2023-10-06T03:01:52.253 INFO:teuthology.orchestra.run.smithi125.stdout:(95/139): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 402 kB/s | 44 kB 00:00 2023-10-06T03:01:52.277 INFO:teuthology.orchestra.run.smithi130.stdout:(131/139): libfdisk-2.32.1-43.el8.x86_64.rpm 219 kB/s | 254 kB 00:01 2023-10-06T03:01:52.303 INFO:teuthology.orchestra.run.smithi125.stdout:(96/139): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-10-06T03:01:52.361 INFO:teuthology.orchestra.run.smithi125.stdout:(97/139): python3-cachetools-3.1.1-4.el8.noarch 304 kB/s | 33 kB 00:00 2023-10-06T03:01:52.378 INFO:teuthology.orchestra.run.smithi130.stdout:(132/139): iproute-6.2.0-5.el8.x86_64.rpm 379 kB/s | 854 kB 00:02 2023-10-06T03:01:52.387 INFO:teuthology.orchestra.run.smithi125.stdout:(98/139): python3-beautifulsoup4-4.6.3-2.el8.1. 886 kB/s | 185 kB 00:00 2023-10-06T03:01:52.454 INFO:teuthology.orchestra.run.smithi125.stdout:(99/139): python3-certifi-2018.10.15-7.el8.noar 108 kB/s | 16 kB 00:00 2023-10-06T03:01:52.562 INFO:teuthology.orchestra.run.smithi125.stdout:(100/139): python3-cheroot-8.5.2-1.el8.noarch.r 860 kB/s | 173 kB 00:00 2023-10-06T03:01:52.588 INFO:teuthology.orchestra.run.smithi125.stdout:(101/139): python3-google-auth-1.1.1-10.el8.noa 608 kB/s | 81 kB 00:00 2023-10-06T03:01:52.671 INFO:teuthology.orchestra.run.smithi125.stdout:(102/139): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2023-10-06T03:01:52.697 INFO:teuthology.orchestra.run.smithi125.stdout:(103/139): python3-jaraco-functools-2.0-4.el8.n 162 kB/s | 18 kB 00:00 2023-10-06T03:01:52.703 INFO:teuthology.orchestra.run.smithi130.stdout:(133/139): libmount-2.32.1-43.el8.x86_64.rpm 229 kB/s | 236 kB 00:01 2023-10-06T03:01:52.755 INFO:teuthology.orchestra.run.smithi125.stdout:(104/139): python3-cherrypy-18.4.0-1.el8.noarch 1.0 MB/s | 384 kB 00:00 2023-10-06T03:01:52.806 INFO:teuthology.orchestra.run.smithi125.stdout:(105/139): python3-logutils-0.3.5-11.el8.noarch 449 kB/s | 49 kB 00:00 2023-10-06T03:01:52.873 INFO:teuthology.orchestra.run.smithi125.stdout:(106/139): python3-more-itertools-7.2.0-3.el8.n 502 kB/s | 59 kB 00:00 2023-10-06T03:01:52.914 INFO:teuthology.orchestra.run.smithi125.stdout:(107/139): python3-natsort-7.1.1-2.el8.noarch.r 554 kB/s | 60 kB 00:00 2023-10-06T03:01:52.990 INFO:teuthology.orchestra.run.smithi125.stdout:(108/139): python3-kubernetes-11.0.0-6.el8.noar 3.7 MB/s | 1.2 MB 00:00 2023-10-06T03:01:53.023 INFO:teuthology.orchestra.run.smithi125.stdout:(109/139): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-10-06T03:01:53.099 INFO:teuthology.orchestra.run.smithi125.stdout:(110/139): python3-repoze-lru-0.7-6.el8.noarch. 310 kB/s | 34 kB 00:00 2023-10-06T03:01:53.124 INFO:teuthology.orchestra.run.smithi125.stdout:(111/139): python3-routes-2.4.1-12.el8.noarch.r 1.9 MB/s | 196 kB 00:00 2023-10-06T03:01:53.149 INFO:teuthology.orchestra.run.smithi125.stdout:(112/139): python3-pecan-1.3.2-9.el8.noarch.rpm 1.0 MB/s | 283 kB 00:00 2023-10-06T03:01:53.162 INFO:teuthology.orchestra.run.smithi130.stdout:(134/139): libuuid-2.32.1-43.el8.x86_64.rpm 126 kB/s | 99 kB 00:00 2023-10-06T03:01:53.187 INFO:teuthology.orchestra.run.smithi130.stdout:(135/139): libsmartcols-2.32.1-43.el8.x86_64.rp 197 kB/s | 179 kB 00:00 2023-10-06T03:01:53.208 INFO:teuthology.orchestra.run.smithi125.stdout:(113/139): python3-rsa-4.9-2.el8.noarch.rpm 592 kB/s | 64 kB 00:00 2023-10-06T03:01:53.233 INFO:teuthology.orchestra.run.smithi125.stdout:(114/139): python3-simplegeneric-0.8.1-17.el8.n 172 kB/s | 19 kB 00:00 2023-10-06T03:01:53.258 INFO:teuthology.orchestra.run.smithi125.stdout:(115/139): python3-singledispatch-3.4.0.3-18.el 219 kB/s | 24 kB 00:00 2023-10-06T03:01:53.317 INFO:teuthology.orchestra.run.smithi125.stdout:(116/139): python3-tempora-1.14.1-5.el8.noarch. 268 kB/s | 29 kB 00:00 2023-10-06T03:01:53.367 INFO:teuthology.orchestra.run.smithi125.stdout:(117/139): python3-trustme-0.6.0-4.el8.noarch.r 205 kB/s | 27 kB 00:00 2023-10-06T03:01:53.434 INFO:teuthology.orchestra.run.smithi125.stdout:(118/139): python3-webob-1.8.5-1.el8.1.noarch.r 2.1 MB/s | 251 kB 00:00 2023-10-06T03:01:53.468 INFO:teuthology.orchestra.run.smithi125.stdout:(119/139): python3-waitress-1.4.3-1.el8.noarch. 1.2 MB/s | 255 kB 00:00 2023-10-06T03:01:53.493 INFO:teuthology.orchestra.run.smithi125.stdout:(120/139): python3-websocket-client-0.56.0-5.el 487 kB/s | 61 kB 00:00 2023-10-06T03:01:53.535 INFO:teuthology.orchestra.run.smithi125.stdout:(121/139): python3-webtest-2.0.33-1.el8.noarch. 850 kB/s | 85 kB 00:00 2023-10-06T03:01:53.585 INFO:teuthology.orchestra.run.smithi125.stdout:(122/139): python3-zc-lockfile-2.0-2.el8.noarch 196 kB/s | 23 kB 00:00 2023-10-06T03:01:53.794 INFO:teuthology.orchestra.run.smithi125.stdout:(123/139): thrift-0.13.0-2.el8.x86_64.rpm 5.8 MB/s | 1.7 MB 00:00 2023-10-06T03:01:53.970 INFO:teuthology.orchestra.run.smithi130.stdout:(136/139): util-linux-user-2.32.1-43.el8.x86_64 127 kB/s | 103 kB 00:00 2023-10-06T03:01:54.312 INFO:teuthology.orchestra.run.smithi130.stdout:(137/139): xfsdump-3.1.8-6.el8.x86_64.rpm 297 kB/s | 334 kB 00:01 2023-10-06T03:01:54.569 INFO:teuthology.orchestra.run.smithi125.stdout:(124/139): librados2-17.2.6-1296.g736ac5ba.el8. 3.3 MB/s | 3.5 MB 00:01 2023-10-06T03:01:54.603 INFO:teuthology.orchestra.run.smithi125.stdout:(125/139): NetworkManager-initscripts-updown-1. 177 kB/s | 143 kB 00:00 2023-10-06T03:01:54.654 INFO:teuthology.orchestra.run.smithi130.stdout:(138/139): util-linux-2.32.1-43.el8.x86_64.rpm 1.3 MB/s | 2.5 MB 00:01 2023-10-06T03:01:55.228 INFO:teuthology.orchestra.run.smithi125.stdout:(126/139): elfutils-debuginfod-client-0.189-3.e 116 kB/s | 76 kB 00:00 2023-10-06T03:01:55.278 INFO:teuthology.orchestra.run.smithi125.stdout:(127/139): librbd1-17.2.6-1296.g736ac5ba.el8.x8 2.1 MB/s | 3.6 MB 00:01 2023-10-06T03:01:55.346 INFO:teuthology.orchestra.run.smithi130.stdout:(139/139): xfsprogs-5.0.0-12.el8.x86_64.rpm 806 kB/s | 1.1 MB 00:01 2023-10-06T03:01:55.349 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2023-10-06T03:01:55.350 INFO:teuthology.orchestra.run.smithi130.stdout:Total 7.8 MB/s | 210 MB 00:26 2023-10-06T03:01:55.512 INFO:teuthology.orchestra.run.smithi125.stdout:(128/139): elfutils-libelf-0.189-3.el8.x86_64.r 255 kB/s | 232 kB 00:00 2023-10-06T03:01:56.188 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2023-10-06T03:01:56.237 INFO:teuthology.orchestra.run.smithi125.stdout:(129/139): elfutils-libs-0.189-3.el8.x86_64.rpm 300 kB/s | 303 kB 00:01 2023-10-06T03:01:56.555 INFO:teuthology.orchestra.run.smithi125.stdout:(130/139): libblkid-2.32.1-43.el8.x86_64.rpm 212 kB/s | 220 kB 00:01 2023-10-06T03:01:56.604 INFO:teuthology.orchestra.run.smithi125.stdout:(131/139): iproute-6.2.0-5.el8.x86_64.rpm 644 kB/s | 854 kB 00:01 2023-10-06T03:01:56.614 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2023-10-06T03:01:56.614 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2023-10-06T03:01:57.271 INFO:teuthology.orchestra.run.smithi125.stdout:(132/139): libfdisk-2.32.1-43.el8.x86_64.rpm 245 kB/s | 254 kB 00:01 2023-10-06T03:01:57.497 INFO:teuthology.orchestra.run.smithi125.stdout:(133/139): libsmartcols-2.32.1-43.el8.x86_64.rp 201 kB/s | 179 kB 00:00 2023-10-06T03:01:57.580 INFO:teuthology.orchestra.run.smithi125.stdout:(134/139): libmount-2.32.1-43.el8.x86_64.rpm 231 kB/s | 236 kB 00:01 2023-10-06T03:01:58.027 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2023-10-06T03:01:58.030 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2023-10-06T03:01:58.064 INFO:teuthology.orchestra.run.smithi125.stdout:(135/139): libuuid-2.32.1-43.el8.x86_64.rpm 125 kB/s | 99 kB 00:00 2023-10-06T03:01:58.239 INFO:teuthology.orchestra.run.smithi125.stdout:(136/139): util-linux-user-2.32.1-43.el8.x86_64 156 kB/s | 103 kB 00:00 2023-10-06T03:01:59.114 INFO:teuthology.orchestra.run.smithi125.stdout:(137/139): xfsdump-3.1.8-6.el8.x86_64.rpm 318 kB/s | 334 kB 00:01 2023-10-06T03:01:59.389 INFO:teuthology.orchestra.run.smithi125.stdout:(138/139): util-linux-2.32.1-43.el8.x86_64.rpm 1.3 MB/s | 2.5 MB 00:01 2023-10-06T03:01:59.906 INFO:teuthology.orchestra.run.smithi125.stdout:(139/139): xfsprogs-5.0.0-12.el8.x86_64.rpm 665 kB/s | 1.1 MB 00:01 2023-10-06T03:01:59.912 INFO:teuthology.orchestra.run.smithi125.stdout:-------------------------------------------------------------------------------- 2023-10-06T03:01:59.912 INFO:teuthology.orchestra.run.smithi125.stdout:Total 7.4 MB/s | 210 MB 00:28 2023-10-06T03:02:00.721 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction check 2023-10-06T03:02:01.145 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction check succeeded. 2023-10-06T03:02:01.251 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction test 2023-10-06T03:02:02.525 INFO:teuthology.orchestra.run.smithi125.stdout:Transaction test succeeded. 2023-10-06T03:02:02.791 INFO:teuthology.orchestra.run.smithi125.stdout:Running transaction 2023-10-06T03:02:03.191 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2023-10-06T03:02:03.232 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/1 2023-10-06T03:02:03.383 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 1/155 2023-10-06T03:02:03.462 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/155 2023-10-06T03:02:03.616 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 2/155 2023-10-06T03:02:03.692 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 2/155 2023-10-06T03:02:03.917 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/155 2023-10-06T03:02:04.254 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 4/155 2023-10-06T03:02:04.454 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : thrift-0.13.0-2.el8.x86_64 5/155 2023-10-06T03:02:04.660 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/155 2023-10-06T03:02:04.849 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-10-06T03:02:05.232 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-10-06T03:02:05.441 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/155 2023-10-06T03:02:05.843 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/155 2023-10-06T03:02:06.038 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/155 2023-10-06T03:02:06.166 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/155 2023-10-06T03:02:06.341 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/155 2023-10-06T03:02:06.460 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/155 2023-10-06T03:02:06.655 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/155 2023-10-06T03:02:06.807 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/155 2023-10-06T03:02:07.352 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/155 2023-10-06T03:02:07.532 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/155 2023-10-06T03:02:07.675 INFO:teuthology.orchestra.run.smithi125.stdout: Preparing : 1/1 2023-10-06T03:02:07.717 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/1 2023-10-06T03:02:07.744 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/155 2023-10-06T03:02:07.893 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 1/155 2023-10-06T03:02:07.972 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 1/155 2023-10-06T03:02:08.007 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-10-06T03:02:08.084 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-10-06T03:02:08.127 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 2/155 2023-10-06T03:02:08.202 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 2/155 2023-10-06T03:02:08.297 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/155 2023-10-06T03:02:08.389 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/155 2023-10-06T03:02:08.499 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/155 2023-10-06T03:02:08.682 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 17/155 2023-10-06T03:02:08.722 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 4/155 2023-10-06T03:02:08.786 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 17/155 2023-10-06T03:02:08.940 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/155 2023-10-06T03:02:08.956 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : thrift-0.13.0-2.el8.x86_64 5/155 2023-10-06T03:02:09.067 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/155 2023-10-06T03:02:09.164 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/155 2023-10-06T03:02:09.271 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/155 2023-10-06T03:02:09.351 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-10-06T03:02:09.438 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/155 2023-10-06T03:02:09.607 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/155 2023-10-06T03:02:09.765 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/155 2023-10-06T03:02:09.932 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/155 2023-10-06T03:02:09.934 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/155 2023-10-06T03:02:10.118 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/155 2023-10-06T03:02:10.515 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/155 2023-10-06T03:02:10.520 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/155 2023-10-06T03:02:10.732 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/155 2023-10-06T03:02:10.765 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/155 2023-10-06T03:02:10.868 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/155 2023-10-06T03:02:11.051 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/155 2023-10-06T03:02:11.146 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/155 2023-10-06T03:02:11.375 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/155 2023-10-06T03:02:11.375 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/155 2023-10-06T03:02:11.534 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/155 2023-10-06T03:02:11.548 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-10-06T03:02:12.078 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/155 2023-10-06T03:02:12.209 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/155 2023-10-06T03:02:12.253 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-10-06T03:02:12.389 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/155 2023-10-06T03:02:12.568 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/155 2023-10-06T03:02:12.642 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-10-06T03:02:12.710 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/155 2023-10-06T03:02:12.746 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/155 2023-10-06T03:02:12.886 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/155 2023-10-06T03:02:12.914 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 15/155 2023-10-06T03:02:13.108 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 16/155 2023-10-06T03:02:13.126 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/155 2023-10-06T03:02:13.251 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 17/155 2023-10-06T03:02:13.346 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 29/155 2023-10-06T03:02:13.355 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 17/155 2023-10-06T03:02:13.493 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/155 2023-10-06T03:02:13.517 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 30/155 2023-10-06T03:02:13.635 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/155 2023-10-06T03:02:13.722 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 31/155 2023-10-06T03:02:13.815 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/155 2023-10-06T03:02:13.992 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 20/155 2023-10-06T03:02:14.126 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 21/155 2023-10-06T03:02:14.239 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 21/155 2023-10-06T03:02:14.375 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 22/155 2023-10-06T03:02:14.685 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/155 2023-10-06T03:02:14.959 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 22/155 2023-10-06T03:02:15.076 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/155 2023-10-06T03:02:15.159 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : openblas-0.3.15-4.el8.x86_64 23/155 2023-10-06T03:02:15.364 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/155 2023-10-06T03:02:15.573 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-10-06T03:02:15.762 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 23/155 2023-10-06T03:02:15.909 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-10-06T03:02:16.609 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 24/155 2023-10-06T03:02:16.919 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/155 2023-10-06T03:02:17.123 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/155 2023-10-06T03:02:17.314 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 27/155 2023-10-06T03:02:17.384 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-10-06T03:02:17.561 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/155 2023-10-06T03:02:17.757 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 29/155 2023-10-06T03:02:17.786 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/155 2023-10-06T03:02:17.945 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 30/155 2023-10-06T03:02:17.982 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/155 2023-10-06T03:02:18.147 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 31/155 2023-10-06T03:02:18.486 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/155 2023-10-06T03:02:18.791 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/155 2023-10-06T03:02:18.985 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 40/155 2023-10-06T03:02:19.129 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 32/155 2023-10-06T03:02:19.240 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 41/155 2023-10-06T03:02:19.459 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 42/155 2023-10-06T03:02:19.524 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/155 2023-10-06T03:02:19.673 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 43/155 2023-10-06T03:02:19.797 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/155 2023-10-06T03:02:19.897 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/155 2023-10-06T03:02:19.975 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/155 2023-10-06T03:02:20.008 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-10-06T03:02:20.147 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 45/155 2023-10-06T03:02:20.218 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 45/155 2023-10-06T03:02:20.393 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 46/155 2023-10-06T03:02:20.555 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-10-06T03:02:21.061 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-10-06T03:02:21.298 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/155 2023-10-06T03:02:21.313 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/155 2023-10-06T03:02:21.509 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/155 2023-10-06T03:02:21.767 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/155 2023-10-06T03:02:21.809 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/155 2023-10-06T03:02:22.003 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/155 2023-10-06T03:02:22.079 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/155 2023-10-06T03:02:22.193 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/155 2023-10-06T03:02:22.275 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/155 2023-10-06T03:02:22.357 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/155 2023-10-06T03:02:22.469 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rsa-4.9-2.el8.noarch 38/155 2023-10-06T03:02:22.547 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/155 2023-10-06T03:02:22.684 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/155 2023-10-06T03:02:22.774 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/155 2023-10-06T03:02:22.862 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 40/155 2023-10-06T03:02:22.999 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/155 2023-10-06T03:02:23.099 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 41/155 2023-10-06T03:02:23.166 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/155 2023-10-06T03:02:23.314 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 42/155 2023-10-06T03:02:23.327 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/155 2023-10-06T03:02:23.501 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/155 2023-10-06T03:02:23.508 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : elfutils-debuginfod-client-0.189-3.el8.x86_64 43/155 2023-10-06T03:02:23.677 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/155 2023-10-06T03:02:23.707 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 44/155 2023-10-06T03:02:23.786 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 44/155 2023-10-06T03:02:23.862 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/155 2023-10-06T03:02:23.974 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 45/155 2023-10-06T03:02:24.045 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 45/155 2023-10-06T03:02:24.072 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/155 2023-10-06T03:02:24.212 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 46/155 2023-10-06T03:02:24.275 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/155 2023-10-06T03:02:24.391 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-10-06T03:02:24.482 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/155 2023-10-06T03:02:24.718 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/155 2023-10-06T03:02:24.875 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 47/155 2023-10-06T03:02:25.091 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/155 2023-10-06T03:02:25.133 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 48/155 2023-10-06T03:02:25.147 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 48/155 2023-10-06T03:02:25.322 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/155 2023-10-06T03:02:25.345 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/155 2023-10-06T03:02:25.538 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/155 2023-10-06T03:02:25.574 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/155 2023-10-06T03:02:25.726 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/155 2023-10-06T03:02:25.772 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/155 2023-10-06T03:02:25.945 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/155 2023-10-06T03:02:25.975 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 70/155 2023-10-06T03:02:26.125 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/155 2023-10-06T03:02:26.314 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/155 2023-10-06T03:02:26.360 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 71/155 2023-10-06T03:02:26.534 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/155 2023-10-06T03:02:26.600 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 72/155 2023-10-06T03:02:26.724 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/155 2023-10-06T03:02:26.824 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 73/155 2023-10-06T03:02:26.885 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/155 2023-10-06T03:02:27.087 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/155 2023-10-06T03:02:27.094 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 74/155 2023-10-06T03:02:27.293 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/155 2023-10-06T03:02:27.360 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 75/155 2023-10-06T03:02:27.462 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/155 2023-10-06T03:02:27.640 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/155 2023-10-06T03:02:27.843 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/155 2023-10-06T03:02:28.081 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/155 2023-10-06T03:02:28.313 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/155 2023-10-06T03:02:28.424 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/155 2023-10-06T03:02:28.525 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/155 2023-10-06T03:02:28.749 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 77/155 2023-10-06T03:02:28.865 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/155 2023-10-06T03:02:29.003 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 78/155 2023-10-06T03:02:29.140 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/155 2023-10-06T03:02:29.257 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 79/155 2023-10-06T03:02:29.339 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/155 2023-10-06T03:02:29.545 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/155 2023-10-06T03:02:29.588 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/155 2023-10-06T03:02:29.801 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 70/155 2023-10-06T03:02:29.830 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/155 2023-10-06T03:02:30.115 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/155 2023-10-06T03:02:30.209 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 71/155 2023-10-06T03:02:30.332 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-10-06T03:02:30.493 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 72/155 2023-10-06T03:02:30.684 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 84/155 2023-10-06T03:02:30.691 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 73/155 2023-10-06T03:02:30.917 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 85/155 2023-10-06T03:02:30.969 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 74/155 2023-10-06T03:02:31.081 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 86/155 2023-10-06T03:02:31.194 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 75/155 2023-10-06T03:02:31.242 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/155 2023-10-06T03:02:31.541 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/155 2023-10-06T03:02:31.782 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 89/155 2023-10-06T03:02:31.941 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/155 2023-10-06T03:02:32.164 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/155 2023-10-06T03:02:32.231 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/155 2023-10-06T03:02:32.388 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/155 2023-10-06T03:02:32.565 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 77/155 2023-10-06T03:02:32.605 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : fuse-2.9.7-17.el8.x86_64 93/155 2023-10-06T03:02:32.806 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 78/155 2023-10-06T03:02:32.854 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/155 2023-10-06T03:02:33.037 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 95/155 2023-10-06T03:02:33.037 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 79/155 2023-10-06T03:02:33.179 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/155 2023-10-06T03:02:33.331 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/155 2023-10-06T03:02:33.565 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 81/155 2023-10-06T03:02:33.833 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 82/155 2023-10-06T03:02:34.042 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-10-06T03:02:34.346 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 84/155 2023-10-06T03:02:34.577 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 85/155 2023-10-06T03:02:34.741 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 86/155 2023-10-06T03:02:34.921 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 87/155 2023-10-06T03:02:35.230 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 88/155 2023-10-06T03:02:35.476 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 89/155 2023-10-06T03:02:35.661 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 90/155 2023-10-06T03:02:35.859 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 97/155 2023-10-06T03:02:35.898 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 91/155 2023-10-06T03:02:36.082 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 92/155 2023-10-06T03:02:36.137 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 97/155 2023-10-06T03:02:36.283 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : fuse-2.9.7-17.el8.x86_64 93/155 2023-10-06T03:02:36.498 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 94/155 2023-10-06T03:02:36.689 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 95/155 2023-10-06T03:02:36.718 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 97/155 2023-10-06T03:02:36.830 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 96/155 2023-10-06T03:02:36.966 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 98/155 2023-10-06T03:02:37.075 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 98/155 2023-10-06T03:02:37.269 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 99/155 2023-10-06T03:02:39.518 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 97/155 2023-10-06T03:02:39.747 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 97/155 2023-10-06T03:02:40.323 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 97/155 2023-10-06T03:02:40.864 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 98/155 2023-10-06T03:02:41.466 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 98/155 2023-10-06T03:02:41.746 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 99/155 2023-10-06T03:02:55.588 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 99/155 2023-10-06T03:02:55.588 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /sys 2023-10-06T03:02:55.588 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /proc 2023-10-06T03:02:55.588 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /dev 2023-10-06T03:02:55.588 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /run 2023-10-06T03:02:55.588 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /mnt 2023-10-06T03:02:55.588 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /var/tmp 2023-10-06T03:02:55.588 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /home 2023-10-06T03:02:55.589 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /tmp 2023-10-06T03:02:55.589 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /dev 2023-10-06T03:02:55.589 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:02:55.992 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 100/155 2023-10-06T03:02:57.461 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 100/155 2023-10-06T03:02:57.696 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/155 2023-10-06T03:02:57.916 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/155 2023-10-06T03:02:58.150 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 102/155 2023-10-06T03:02:58.547 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 102/155 2023-10-06T03:02:58.733 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/155 2023-10-06T03:02:58.757 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/155 2023-10-06T03:02:58.973 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/155 2023-10-06T03:02:59.177 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/155 2023-10-06T03:02:59.316 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/155 2023-10-06T03:02:59.378 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/155 2023-10-06T03:02:59.626 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : jq-1.6-7.el8.x86_64 107/155 2023-10-06T03:02:59.849 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : automake-1.16.1-8.el8.noarch 108/155 2023-10-06T03:03:00.121 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 99/155 2023-10-06T03:03:00.121 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /sys 2023-10-06T03:03:00.122 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /proc 2023-10-06T03:03:00.122 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /dev 2023-10-06T03:03:00.122 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /run 2023-10-06T03:03:00.122 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /mnt 2023-10-06T03:03:00.122 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /var/tmp 2023-10-06T03:03:00.122 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /home 2023-10-06T03:03:00.122 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /tmp 2023-10-06T03:03:00.122 INFO:teuthology.orchestra.run.smithi125.stdout:skipping the directory /dev 2023-10-06T03:03:00.122 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:00.372 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 109/155 2023-10-06T03:03:00.485 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 100/155 2023-10-06T03:03:00.556 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 109/155 2023-10-06T03:03:00.680 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 110/155 2023-10-06T03:03:00.852 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 111/155 2023-10-06T03:03:01.057 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 112/155 2023-10-06T03:03:01.268 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 112/155 2023-10-06T03:03:01.478 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 113/155 2023-10-06T03:03:01.956 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 100/155 2023-10-06T03:03:02.177 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/155 2023-10-06T03:03:02.397 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/155 2023-10-06T03:03:02.441 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 113/155 2023-10-06T03:03:02.601 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 102/155 2023-10-06T03:03:02.624 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 114/155 2023-10-06T03:03:02.716 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 114/155 2023-10-06T03:03:03.006 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 102/155 2023-10-06T03:03:03.057 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 115/155 2023-10-06T03:03:03.201 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/155 2023-10-06T03:03:03.224 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/155 2023-10-06T03:03:03.262 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/155 2023-10-06T03:03:03.297 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/155 2023-10-06T03:03:03.450 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 104/155 2023-10-06T03:03:03.482 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 117/155 2023-10-06T03:03:03.493 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 117/155 2023-10-06T03:03:03.677 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 118/155 2023-10-06T03:03:03.678 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 105/155 2023-10-06T03:03:03.801 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 106/155 2023-10-06T03:03:03.840 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/155 2023-10-06T03:03:03.881 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 106/155 2023-10-06T03:03:04.145 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : jq-1.6-7.el8.x86_64 107/155 2023-10-06T03:03:04.351 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : automake-1.16.1-8.el8.noarch 108/155 2023-10-06T03:03:04.771 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 109/155 2023-10-06T03:03:04.962 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 109/155 2023-10-06T03:03:05.074 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 110/155 2023-10-06T03:03:05.261 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 111/155 2023-10-06T03:03:05.492 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 112/155 2023-10-06T03:03:05.701 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 112/155 2023-10-06T03:03:05.901 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 113/155 2023-10-06T03:03:06.861 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 113/155 2023-10-06T03:03:07.042 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 114/155 2023-10-06T03:03:07.132 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 114/155 2023-10-06T03:03:07.520 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 115/155 2023-10-06T03:03:07.717 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/155 2023-10-06T03:03:07.752 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/155 2023-10-06T03:03:07.942 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 117/155 2023-10-06T03:03:07.953 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 117/155 2023-10-06T03:03:08.154 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 118/155 2023-10-06T03:03:08.300 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/155 2023-10-06T03:03:08.697 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/155 2023-10-06T03:03:10.429 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 120/155 2023-10-06T03:03:10.661 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/155 2023-10-06T03:03:10.744 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/155 2023-10-06T03:03:10.948 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 122/155 2023-10-06T03:03:10.990 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 122/155 2023-10-06T03:03:11.173 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 123/155 2023-10-06T03:03:11.517 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 123/155 2023-10-06T03:03:11.690 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 124/155 2023-10-06T03:03:11.784 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 124/155 2023-10-06T03:03:12.647 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 125/155 2023-10-06T03:03:12.918 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 126/155 2023-10-06T03:03:13.094 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 127/155 2023-10-06T03:03:13.156 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/155 2023-10-06T03:03:13.283 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 128/155 2023-10-06T03:03:13.484 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 129/155 2023-10-06T03:03:13.710 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 130/155 2023-10-06T03:03:13.952 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 131/155 2023-10-06T03:03:14.164 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 132/155 2023-10-06T03:03:14.444 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 133/155 2023-10-06T03:03:14.784 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 134/155 2023-10-06T03:03:14.886 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 120/155 2023-10-06T03:03:15.057 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 135/155 2023-10-06T03:03:15.174 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/155 2023-10-06T03:03:15.205 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-10-06T03:03:15.224 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-10-06T03:03:15.261 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/155 2023-10-06T03:03:15.427 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 137/155 2023-10-06T03:03:15.449 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 122/155 2023-10-06T03:03:15.490 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 122/155 2023-10-06T03:03:15.646 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flex-2.6.1-9.el8.x86_64 138/155 2023-10-06T03:03:15.682 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 123/155 2023-10-06T03:03:15.744 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 138/155 2023-10-06T03:03:15.963 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : bison-3.0.4-10.el8.x86_64 139/155 2023-10-06T03:03:15.976 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 139/155 2023-10-06T03:03:16.027 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 123/155 2023-10-06T03:03:16.173 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 140/155 2023-10-06T03:03:16.215 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 124/155 2023-10-06T03:03:16.309 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 124/155 2023-10-06T03:03:16.345 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 141/155 2023-10-06T03:03:16.526 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 142/155 2023-10-06T03:03:16.526 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-10-06T03:03:16.795 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-10-06T03:03:16.795 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-10-06T03:03:17.032 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-10-06T03:03:17.038 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-10-06T03:03:17.150 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-10-06T03:03:17.150 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/155 2023-10-06T03:03:17.178 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 125/155 2023-10-06T03:03:17.377 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/155 2023-10-06T03:03:17.469 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 126/155 2023-10-06T03:03:17.557 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 147/155 2023-10-06T03:03:17.671 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 127/155 2023-10-06T03:03:17.719 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 148/155 2023-10-06T03:03:17.843 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 128/155 2023-10-06T03:03:17.973 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 149/155 2023-10-06T03:03:17.973 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 150/155 2023-10-06T03:03:18.060 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 129/155 2023-10-06T03:03:18.174 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 150/155 2023-10-06T03:03:18.174 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 151/155 2023-10-06T03:03:18.327 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 130/155 2023-10-06T03:03:18.374 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 151/155 2023-10-06T03:03:18.374 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 152/155 2023-10-06T03:03:18.519 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 131/155 2023-10-06T03:03:18.591 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 152/155 2023-10-06T03:03:18.591 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 153/155 2023-10-06T03:03:18.731 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 132/155 2023-10-06T03:03:18.782 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 153/155 2023-10-06T03:03:18.783 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-10-06T03:03:19.015 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-10-06T03:03:19.040 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 133/155 2023-10-06T03:03:19.214 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-10-06T03:03:19.348 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 134/155 2023-10-06T03:03:19.592 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 135/155 2023-10-06T03:03:19.756 INFO:teuthology.orchestra.run.smithi125.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-10-06T03:03:19.773 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 136/155 2023-10-06T03:03:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-10-06T03:03:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/155 2023-10-06T03:03:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/155 2023-10-06T03:03:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/155 2023-10-06T03:03:19.824 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/155 2023-10-06T03:03:19.825 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/155 2023-10-06T03:03:19.825 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/155 2023-10-06T03:03:19.825 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/155 2023-10-06T03:03:19.825 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/155 2023-10-06T03:03:19.825 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/155 2023-10-06T03:03:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/155 2023-10-06T03:03:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/155 2023-10-06T03:03:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/155 2023-10-06T03:03:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/155 2023-10-06T03:03:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/155 2023-10-06T03:03:19.826 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/155 2023-10-06T03:03:19.827 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/155 2023-10-06T03:03:19.827 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/155 2023-10-06T03:03:19.827 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/155 2023-10-06T03:03:19.827 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/155 2023-10-06T03:03:19.827 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/155 2023-10-06T03:03:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/155 2023-10-06T03:03:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/155 2023-10-06T03:03:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/155 2023-10-06T03:03:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/155 2023-10-06T03:03:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/155 2023-10-06T03:03:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/155 2023-10-06T03:03:19.828 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/155 2023-10-06T03:03:19.844 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/155 2023-10-06T03:03:19.844 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/155 2023-10-06T03:03:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/155 2023-10-06T03:03:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/155 2023-10-06T03:03:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/155 2023-10-06T03:03:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/155 2023-10-06T03:03:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/155 2023-10-06T03:03:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/155 2023-10-06T03:03:19.845 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/155 2023-10-06T03:03:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/155 2023-10-06T03:03:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/155 2023-10-06T03:03:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/155 2023-10-06T03:03:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/155 2023-10-06T03:03:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/155 2023-10-06T03:03:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : jq-1.6-7.el8.x86_64 42/155 2023-10-06T03:03:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 43/155 2023-10-06T03:03:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 44/155 2023-10-06T03:03:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 45/155 2023-10-06T03:03:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 46/155 2023-10-06T03:03:19.846 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 47/155 2023-10-06T03:03:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 48/155 2023-10-06T03:03:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 49/155 2023-10-06T03:03:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 50/155 2023-10-06T03:03:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 51/155 2023-10-06T03:03:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 52/155 2023-10-06T03:03:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 53/155 2023-10-06T03:03:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 54/155 2023-10-06T03:03:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 55/155 2023-10-06T03:03:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 56/155 2023-10-06T03:03:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 57/155 2023-10-06T03:03:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 58/155 2023-10-06T03:03:19.847 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 59/155 2023-10-06T03:03:19.848 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 60/155 2023-10-06T03:03:19.848 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 61/155 2023-10-06T03:03:19.848 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 62/155 2023-10-06T03:03:19.848 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 63/155 2023-10-06T03:03:19.848 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 64/155 2023-10-06T03:03:19.848 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 65/155 2023-10-06T03:03:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 66/155 2023-10-06T03:03:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 67/155 2023-10-06T03:03:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 68/155 2023-10-06T03:03:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 69/155 2023-10-06T03:03:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 70/155 2023-10-06T03:03:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 71/155 2023-10-06T03:03:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 72/155 2023-10-06T03:03:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 73/155 2023-10-06T03:03:19.849 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 74/155 2023-10-06T03:03:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 75/155 2023-10-06T03:03:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 76/155 2023-10-06T03:03:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 77/155 2023-10-06T03:03:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 78/155 2023-10-06T03:03:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/155 2023-10-06T03:03:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 80/155 2023-10-06T03:03:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 81/155 2023-10-06T03:03:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 82/155 2023-10-06T03:03:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-10-06T03:03:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 84/155 2023-10-06T03:03:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 85/155 2023-10-06T03:03:19.850 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 86/155 2023-10-06T03:03:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 87/155 2023-10-06T03:03:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 88/155 2023-10-06T03:03:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 89/155 2023-10-06T03:03:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 90/155 2023-10-06T03:03:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 91/155 2023-10-06T03:03:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 92/155 2023-10-06T03:03:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 93/155 2023-10-06T03:03:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 94/155 2023-10-06T03:03:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 95/155 2023-10-06T03:03:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 96/155 2023-10-06T03:03:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/155 2023-10-06T03:03:19.851 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 98/155 2023-10-06T03:03:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 99/155 2023-10-06T03:03:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 100/155 2023-10-06T03:03:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 101/155 2023-10-06T03:03:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 102/155 2023-10-06T03:03:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 103/155 2023-10-06T03:03:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 104/155 2023-10-06T03:03:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 105/155 2023-10-06T03:03:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 106/155 2023-10-06T03:03:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 107/155 2023-10-06T03:03:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 108/155 2023-10-06T03:03:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 109/155 2023-10-06T03:03:19.852 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-portend-2.6-1.el8.noarch 110/155 2023-10-06T03:03:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 111/155 2023-10-06T03:03:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 112/155 2023-10-06T03:03:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 113/155 2023-10-06T03:03:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 114/155 2023-10-06T03:03:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 115/155 2023-10-06T03:03:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 116/155 2023-10-06T03:03:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 117/155 2023-10-06T03:03:19.853 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 118/155 2023-10-06T03:03:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 119/155 2023-10-06T03:03:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 120/155 2023-10-06T03:03:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 121/155 2023-10-06T03:03:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 122/155 2023-10-06T03:03:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 123/155 2023-10-06T03:03:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 124/155 2023-10-06T03:03:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/155 2023-10-06T03:03:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 126/155 2023-10-06T03:03:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/155 2023-10-06T03:03:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 128/155 2023-10-06T03:03:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 129/155 2023-10-06T03:03:19.854 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 130/155 2023-10-06T03:03:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 131/155 2023-10-06T03:03:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 132/155 2023-10-06T03:03:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 133/155 2023-10-06T03:03:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 134/155 2023-10-06T03:03:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 135/155 2023-10-06T03:03:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 136/155 2023-10-06T03:03:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 137/155 2023-10-06T03:03:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 138/155 2023-10-06T03:03:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 139/155 2023-10-06T03:03:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 140/155 2023-10-06T03:03:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 141/155 2023-10-06T03:03:19.855 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 142/155 2023-10-06T03:03:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 143/155 2023-10-06T03:03:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 144/155 2023-10-06T03:03:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 145/155 2023-10-06T03:03:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 146/155 2023-10-06T03:03:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 147/155 2023-10-06T03:03:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 148/155 2023-10-06T03:03:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 149/155 2023-10-06T03:03:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 150/155 2023-10-06T03:03:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 151/155 2023-10-06T03:03:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/155 2023-10-06T03:03:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/155 2023-10-06T03:03:19.856 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 154/155 2023-10-06T03:03:19.984 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 137/155 2023-10-06T03:03:20.189 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : flex-2.6.1-9.el8.x86_64 138/155 2023-10-06T03:03:20.275 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 138/155 2023-10-06T03:03:20.506 INFO:teuthology.orchestra.run.smithi125.stdout: Installing : bison-3.0.4-10.el8.x86_64 139/155 2023-10-06T03:03:20.519 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 139/155 2023-10-06T03:03:20.716 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 140/155 2023-10-06T03:03:20.892 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 141/155 2023-10-06T03:03:21.049 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 142/155 2023-10-06T03:03:21.049 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-10-06T03:03:21.276 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 143/155 2023-10-06T03:03:21.276 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-10-06T03:03:21.491 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 144/155 2023-10-06T03:03:21.496 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-10-06T03:03:21.626 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 145/155 2023-10-06T03:03:21.626 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 146/155 2023-10-06T03:03:21.887 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 146/155 2023-10-06T03:03:21.945 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 155/155 2023-10-06T03:03:21.945 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:21.945 INFO:teuthology.orchestra.run.smithi130.stdout:Upgraded: 2023-10-06T03:03:21.945 INFO:teuthology.orchestra.run.smithi130.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-10-06T03:03:21.945 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-10-06T03:03:21.945 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-10-06T03:03:21.946 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-10-06T03:03:21.946 INFO:teuthology.orchestra.run.smithi130.stdout: iproute-6.2.0-5.el8.x86_64 2023-10-06T03:03:21.946 INFO:teuthology.orchestra.run.smithi130.stdout: libblkid-2.32.1-43.el8.x86_64 2023-10-06T03:03:21.946 INFO:teuthology.orchestra.run.smithi130.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-10-06T03:03:21.946 INFO:teuthology.orchestra.run.smithi130.stdout: libmount-2.32.1-43.el8.x86_64 2023-10-06T03:03:21.946 INFO:teuthology.orchestra.run.smithi130.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.947 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.947 INFO:teuthology.orchestra.run.smithi130.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-10-06T03:03:21.947 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-2.32.1-43.el8.x86_64 2023-10-06T03:03:21.947 INFO:teuthology.orchestra.run.smithi130.stdout: util-linux-2.32.1-43.el8.x86_64 2023-10-06T03:03:21.947 INFO:teuthology.orchestra.run.smithi130.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-10-06T03:03:21.948 INFO:teuthology.orchestra.run.smithi130.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-10-06T03:03:21.948 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-10-06T03:03:21.948 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2023-10-06T03:03:21.948 INFO:teuthology.orchestra.run.smithi130.stdout: automake-1.16.1-8.el8.noarch 2023-10-06T03:03:21.948 INFO:teuthology.orchestra.run.smithi130.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T03:03:21.948 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.948 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.949 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.949 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.949 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:21.949 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.949 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.949 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.949 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:21.950 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:21.950 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:21.950 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:21.950 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:21.950 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.950 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.950 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:21.951 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.951 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.951 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.951 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:21.951 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:21.951 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.952 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:21.952 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-10-06T03:03:21.952 INFO:teuthology.orchestra.run.smithi130.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T03:03:21.952 INFO:teuthology.orchestra.run.smithi130.stdout: fuse-2.9.7-17.el8.x86_64 2023-10-06T03:03:21.952 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T03:03:21.952 INFO:teuthology.orchestra.run.smithi130.stdout: jq-1.6-7.el8.x86_64 2023-10-06T03:03:21.953 INFO:teuthology.orchestra.run.smithi130.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-06T03:03:21.953 INFO:teuthology.orchestra.run.smithi130.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-10-06T03:03:21.953 INFO:teuthology.orchestra.run.smithi130.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T03:03:21.953 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.953 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.953 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.953 INFO:teuthology.orchestra.run.smithi130.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-10-06T03:03:21.953 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-06T03:03:21.954 INFO:teuthology.orchestra.run.smithi130.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T03:03:21.954 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-06T03:03:21.954 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-06T03:03:21.954 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.954 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.954 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-06T03:03:21.954 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.954 INFO:teuthology.orchestra.run.smithi130.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-10-06T03:03:21.954 INFO:teuthology.orchestra.run.smithi130.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-06T03:03:21.954 INFO:teuthology.orchestra.run.smithi130.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T03:03:21.954 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T03:03:21.955 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-10-06T03:03:21.955 INFO:teuthology.orchestra.run.smithi130.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-10-06T03:03:21.955 INFO:teuthology.orchestra.run.smithi130.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-10-06T03:03:21.955 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T03:03:21.955 INFO:teuthology.orchestra.run.smithi130.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T03:03:21.955 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-06T03:03:21.955 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-06T03:03:21.955 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-10-06T03:03:21.955 INFO:teuthology.orchestra.run.smithi130.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-10-06T03:03:21.955 INFO:teuthology.orchestra.run.smithi130.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-10-06T03:03:21.955 INFO:teuthology.orchestra.run.smithi130.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-10-06T03:03:21.956 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T03:03:21.956 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-06T03:03:21.956 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T03:03:21.956 INFO:teuthology.orchestra.run.smithi130.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T03:03:21.956 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T03:03:21.956 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.956 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.956 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.956 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T03:03:21.956 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-06T03:03:21.956 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T03:03:21.956 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T03:03:21.957 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-06T03:03:21.957 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T03:03:21.957 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T03:03:21.957 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T03:03:21.957 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-06T03:03:21.957 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T03:03:21.957 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T03:03:21.957 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T03:03:21.957 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T03:03:21.957 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T03:03:21.957 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-06T03:03:21.957 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T03:03:21.957 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T03:03:21.958 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T03:03:21.958 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-06T03:03:21.958 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-06T03:03:21.958 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T03:03:21.958 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T03:03:21.958 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T03:03:21.958 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T03:03:21.958 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-06T03:03:21.958 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T03:03:21.958 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T03:03:21.958 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-06T03:03:21.959 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-06T03:03:21.959 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.959 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.959 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T03:03:21.959 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T03:03:21.959 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.959 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T03:03:21.959 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T03:03:21.959 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-06T03:03:21.959 INFO:teuthology.orchestra.run.smithi130.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T03:03:21.959 INFO:teuthology.orchestra.run.smithi130.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T03:03:21.959 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T03:03:21.960 INFO:teuthology.orchestra.run.smithi130.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T03:03:21.960 INFO:teuthology.orchestra.run.smithi130.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T03:03:21.960 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T03:03:21.960 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T03:03:21.960 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T03:03:21.960 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T03:03:21.960 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T03:03:21.960 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.960 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.960 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:21.960 INFO:teuthology.orchestra.run.smithi130.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-06T03:03:21.960 INFO:teuthology.orchestra.run.smithi130.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T03:03:21.960 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-10-06T03:03:21.961 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T03:03:21.961 INFO:teuthology.orchestra.run.smithi130.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-10-06T03:03:21.961 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:21.961 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2023-10-06T03:03:22.041 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 147/155 2023-10-06T03:03:22.179 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 148/155 2023-10-06T03:03:22.236 DEBUG:teuthology.parallel:result is None 2023-10-06T03:03:22.383 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 149/155 2023-10-06T03:03:22.383 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 150/155 2023-10-06T03:03:22.600 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 150/155 2023-10-06T03:03:22.600 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 151/155 2023-10-06T03:03:22.817 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 151/155 2023-10-06T03:03:22.817 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 152/155 2023-10-06T03:03:23.000 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 152/155 2023-10-06T03:03:23.000 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 153/155 2023-10-06T03:03:23.191 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 153/155 2023-10-06T03:03:23.192 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-10-06T03:03:23.384 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 154/155 2023-10-06T03:03:23.573 INFO:teuthology.orchestra.run.smithi125.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-10-06T03:03:24.143 INFO:teuthology.orchestra.run.smithi125.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 155/155 2023-10-06T03:03:24.143 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/155 2023-10-06T03:03:24.143 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/155 2023-10-06T03:03:24.143 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/155 2023-10-06T03:03:24.144 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/155 2023-10-06T03:03:24.144 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/155 2023-10-06T03:03:24.144 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/155 2023-10-06T03:03:24.144 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/155 2023-10-06T03:03:24.144 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/155 2023-10-06T03:03:24.144 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/155 2023-10-06T03:03:24.144 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/155 2023-10-06T03:03:24.144 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/155 2023-10-06T03:03:24.144 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/155 2023-10-06T03:03:24.144 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/155 2023-10-06T03:03:24.144 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/155 2023-10-06T03:03:24.144 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/155 2023-10-06T03:03:24.145 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/155 2023-10-06T03:03:24.145 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/155 2023-10-06T03:03:24.145 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/155 2023-10-06T03:03:24.145 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/155 2023-10-06T03:03:24.145 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/155 2023-10-06T03:03:24.145 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/155 2023-10-06T03:03:24.145 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/155 2023-10-06T03:03:24.145 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/155 2023-10-06T03:03:24.145 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/155 2023-10-06T03:03:24.145 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/155 2023-10-06T03:03:24.145 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/155 2023-10-06T03:03:24.145 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/155 2023-10-06T03:03:24.145 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/155 2023-10-06T03:03:24.146 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/155 2023-10-06T03:03:24.146 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/155 2023-10-06T03:03:24.146 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/155 2023-10-06T03:03:24.146 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/155 2023-10-06T03:03:24.146 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/155 2023-10-06T03:03:24.146 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/155 2023-10-06T03:03:24.146 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/155 2023-10-06T03:03:24.146 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/155 2023-10-06T03:03:24.146 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/155 2023-10-06T03:03:24.146 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/155 2023-10-06T03:03:24.146 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/155 2023-10-06T03:03:24.147 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/155 2023-10-06T03:03:24.147 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/155 2023-10-06T03:03:24.147 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : jq-1.6-7.el8.x86_64 42/155 2023-10-06T03:03:24.147 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 43/155 2023-10-06T03:03:24.147 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 44/155 2023-10-06T03:03:24.147 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 45/155 2023-10-06T03:03:24.147 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 46/155 2023-10-06T03:03:24.147 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 47/155 2023-10-06T03:03:24.147 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 48/155 2023-10-06T03:03:24.147 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 49/155 2023-10-06T03:03:24.147 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 50/155 2023-10-06T03:03:24.147 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 51/155 2023-10-06T03:03:24.148 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 52/155 2023-10-06T03:03:24.148 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 53/155 2023-10-06T03:03:24.148 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 54/155 2023-10-06T03:03:24.148 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 55/155 2023-10-06T03:03:24.148 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 56/155 2023-10-06T03:03:24.148 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 57/155 2023-10-06T03:03:24.148 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 58/155 2023-10-06T03:03:24.148 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 59/155 2023-10-06T03:03:24.148 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 60/155 2023-10-06T03:03:24.148 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 61/155 2023-10-06T03:03:24.148 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 62/155 2023-10-06T03:03:24.149 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 63/155 2023-10-06T03:03:24.149 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 64/155 2023-10-06T03:03:24.149 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 65/155 2023-10-06T03:03:24.149 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 66/155 2023-10-06T03:03:24.149 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 67/155 2023-10-06T03:03:24.149 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 68/155 2023-10-06T03:03:24.149 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 69/155 2023-10-06T03:03:24.149 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 70/155 2023-10-06T03:03:24.149 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 71/155 2023-10-06T03:03:24.149 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 72/155 2023-10-06T03:03:24.149 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 73/155 2023-10-06T03:03:24.149 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 74/155 2023-10-06T03:03:24.150 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 75/155 2023-10-06T03:03:24.150 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 76/155 2023-10-06T03:03:24.150 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 77/155 2023-10-06T03:03:24.150 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 78/155 2023-10-06T03:03:24.150 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/155 2023-10-06T03:03:24.150 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 80/155 2023-10-06T03:03:24.150 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 81/155 2023-10-06T03:03:24.150 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 82/155 2023-10-06T03:03:24.150 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 83/155 2023-10-06T03:03:24.150 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 84/155 2023-10-06T03:03:24.150 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 85/155 2023-10-06T03:03:24.151 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 86/155 2023-10-06T03:03:24.151 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 87/155 2023-10-06T03:03:24.151 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 88/155 2023-10-06T03:03:24.151 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 89/155 2023-10-06T03:03:24.151 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 90/155 2023-10-06T03:03:24.151 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 91/155 2023-10-06T03:03:24.151 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 92/155 2023-10-06T03:03:24.151 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 93/155 2023-10-06T03:03:24.151 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 94/155 2023-10-06T03:03:24.151 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 95/155 2023-10-06T03:03:24.151 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 96/155 2023-10-06T03:03:24.151 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 97/155 2023-10-06T03:03:24.152 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 98/155 2023-10-06T03:03:24.152 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 99/155 2023-10-06T03:03:24.152 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 100/155 2023-10-06T03:03:24.152 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 101/155 2023-10-06T03:03:24.152 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 102/155 2023-10-06T03:03:24.152 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 103/155 2023-10-06T03:03:24.152 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 104/155 2023-10-06T03:03:24.152 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 105/155 2023-10-06T03:03:24.152 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 106/155 2023-10-06T03:03:24.152 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 107/155 2023-10-06T03:03:24.152 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 108/155 2023-10-06T03:03:24.152 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 109/155 2023-10-06T03:03:24.153 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-portend-2.6-1.el8.noarch 110/155 2023-10-06T03:03:24.153 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 111/155 2023-10-06T03:03:24.153 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 112/155 2023-10-06T03:03:24.153 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 113/155 2023-10-06T03:03:24.153 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 114/155 2023-10-06T03:03:24.153 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 115/155 2023-10-06T03:03:24.153 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 116/155 2023-10-06T03:03:24.153 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 117/155 2023-10-06T03:03:24.153 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 118/155 2023-10-06T03:03:24.153 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 119/155 2023-10-06T03:03:24.153 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 120/155 2023-10-06T03:03:24.153 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 121/155 2023-10-06T03:03:24.154 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 122/155 2023-10-06T03:03:24.154 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 123/155 2023-10-06T03:03:24.154 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 124/155 2023-10-06T03:03:24.154 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 125/155 2023-10-06T03:03:24.154 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 126/155 2023-10-06T03:03:24.154 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 127/155 2023-10-06T03:03:24.154 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 128/155 2023-10-06T03:03:24.154 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 129/155 2023-10-06T03:03:24.154 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el8.x86_64 130/155 2023-10-06T03:03:24.154 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 131/155 2023-10-06T03:03:24.154 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 132/155 2023-10-06T03:03:24.155 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 133/155 2023-10-06T03:03:24.155 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 134/155 2023-10-06T03:03:24.155 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 135/155 2023-10-06T03:03:24.155 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 136/155 2023-10-06T03:03:24.155 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 137/155 2023-10-06T03:03:24.155 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 138/155 2023-10-06T03:03:24.155 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 139/155 2023-10-06T03:03:24.155 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 140/155 2023-10-06T03:03:24.155 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 141/155 2023-10-06T03:03:24.155 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 142/155 2023-10-06T03:03:24.155 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 143/155 2023-10-06T03:03:24.156 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 144/155 2023-10-06T03:03:24.156 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 145/155 2023-10-06T03:03:24.156 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 146/155 2023-10-06T03:03:24.156 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 147/155 2023-10-06T03:03:24.156 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 148/155 2023-10-06T03:03:24.156 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 149/155 2023-10-06T03:03:24.156 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 150/155 2023-10-06T03:03:24.156 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 151/155 2023-10-06T03:03:24.156 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 152/155 2023-10-06T03:03:24.156 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 153/155 2023-10-06T03:03:24.156 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 154/155 2023-10-06T03:03:26.202 INFO:teuthology.orchestra.run.smithi125.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 155/155 2023-10-06T03:03:26.202 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:26.202 INFO:teuthology.orchestra.run.smithi125.stdout:Upgraded: 2023-10-06T03:03:26.202 INFO:teuthology.orchestra.run.smithi125.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-10-06T03:03:26.202 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-debuginfod-client-0.189-3.el8.x86_64 2023-10-06T03:03:26.202 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-10-06T03:03:26.203 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-10-06T03:03:26.203 INFO:teuthology.orchestra.run.smithi125.stdout: iproute-6.2.0-5.el8.x86_64 2023-10-06T03:03:26.203 INFO:teuthology.orchestra.run.smithi125.stdout: libblkid-2.32.1-43.el8.x86_64 2023-10-06T03:03:26.203 INFO:teuthology.orchestra.run.smithi125.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-10-06T03:03:26.203 INFO:teuthology.orchestra.run.smithi125.stdout: libmount-2.32.1-43.el8.x86_64 2023-10-06T03:03:26.203 INFO:teuthology.orchestra.run.smithi125.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.203 INFO:teuthology.orchestra.run.smithi125.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.204 INFO:teuthology.orchestra.run.smithi125.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-10-06T03:03:26.204 INFO:teuthology.orchestra.run.smithi125.stdout: libuuid-2.32.1-43.el8.x86_64 2023-10-06T03:03:26.204 INFO:teuthology.orchestra.run.smithi125.stdout: util-linux-2.32.1-43.el8.x86_64 2023-10-06T03:03:26.204 INFO:teuthology.orchestra.run.smithi125.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-10-06T03:03:26.204 INFO:teuthology.orchestra.run.smithi125.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-10-06T03:03:26.204 INFO:teuthology.orchestra.run.smithi125.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-10-06T03:03:26.204 INFO:teuthology.orchestra.run.smithi125.stdout:Installed: 2023-10-06T03:03:26.205 INFO:teuthology.orchestra.run.smithi125.stdout: automake-1.16.1-8.el8.noarch 2023-10-06T03:03:26.205 INFO:teuthology.orchestra.run.smithi125.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T03:03:26.205 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.205 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.205 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.205 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.205 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:26.205 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.205 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.205 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.206 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:26.206 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:26.206 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:26.206 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:26.206 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:26.206 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.206 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.206 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:26.206 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.206 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.206 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.207 INFO:teuthology.orchestra.run.smithi125.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:26.207 INFO:teuthology.orchestra.run.smithi125.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:26.207 INFO:teuthology.orchestra.run.smithi125.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.207 INFO:teuthology.orchestra.run.smithi125.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T03:03:26.207 INFO:teuthology.orchestra.run.smithi125.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-10-06T03:03:26.207 INFO:teuthology.orchestra.run.smithi125.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T03:03:26.207 INFO:teuthology.orchestra.run.smithi125.stdout: fuse-2.9.7-17.el8.x86_64 2023-10-06T03:03:26.207 INFO:teuthology.orchestra.run.smithi125.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T03:03:26.207 INFO:teuthology.orchestra.run.smithi125.stdout: jq-1.6-7.el8.x86_64 2023-10-06T03:03:26.207 INFO:teuthology.orchestra.run.smithi125.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-10-06T03:03:26.207 INFO:teuthology.orchestra.run.smithi125.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-10-06T03:03:26.207 INFO:teuthology.orchestra.run.smithi125.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T03:03:26.208 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.208 INFO:teuthology.orchestra.run.smithi125.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.208 INFO:teuthology.orchestra.run.smithi125.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.208 INFO:teuthology.orchestra.run.smithi125.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-10-06T03:03:26.208 INFO:teuthology.orchestra.run.smithi125.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-10-06T03:03:26.208 INFO:teuthology.orchestra.run.smithi125.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T03:03:26.208 INFO:teuthology.orchestra.run.smithi125.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-10-06T03:03:26.208 INFO:teuthology.orchestra.run.smithi125.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-10-06T03:03:26.208 INFO:teuthology.orchestra.run.smithi125.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.208 INFO:teuthology.orchestra.run.smithi125.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.208 INFO:teuthology.orchestra.run.smithi125.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-10-06T03:03:26.208 INFO:teuthology.orchestra.run.smithi125.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.209 INFO:teuthology.orchestra.run.smithi125.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-10-06T03:03:26.209 INFO:teuthology.orchestra.run.smithi125.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-10-06T03:03:26.209 INFO:teuthology.orchestra.run.smithi125.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T03:03:26.209 INFO:teuthology.orchestra.run.smithi125.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T03:03:26.209 INFO:teuthology.orchestra.run.smithi125.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-10-06T03:03:26.209 INFO:teuthology.orchestra.run.smithi125.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-10-06T03:03:26.209 INFO:teuthology.orchestra.run.smithi125.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-10-06T03:03:26.209 INFO:teuthology.orchestra.run.smithi125.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T03:03:26.209 INFO:teuthology.orchestra.run.smithi125.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T03:03:26.209 INFO:teuthology.orchestra.run.smithi125.stdout: openblas-0.3.15-4.el8.x86_64 2023-10-06T03:03:26.209 INFO:teuthology.orchestra.run.smithi125.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-10-06T03:03:26.209 INFO:teuthology.orchestra.run.smithi125.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-10-06T03:03:26.210 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-10-06T03:03:26.210 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-10-06T03:03:26.210 INFO:teuthology.orchestra.run.smithi125.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-10-06T03:03:26.210 INFO:teuthology.orchestra.run.smithi125.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T03:03:26.210 INFO:teuthology.orchestra.run.smithi125.stdout: python3-babel-2.5.1-7.el8.noarch 2023-10-06T03:03:26.210 INFO:teuthology.orchestra.run.smithi125.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T03:03:26.210 INFO:teuthology.orchestra.run.smithi125.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T03:03:26.210 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T03:03:26.210 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.210 INFO:teuthology.orchestra.run.smithi125.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.210 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.211 INFO:teuthology.orchestra.run.smithi125.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T03:03:26.211 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-10-06T03:03:26.211 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T03:03:26.211 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T03:03:26.211 INFO:teuthology.orchestra.run.smithi125.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-10-06T03:03:26.211 INFO:teuthology.orchestra.run.smithi125.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T03:03:26.211 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T03:03:26.211 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T03:03:26.211 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-10-06T03:03:26.211 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T03:03:26.211 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T03:03:26.211 INFO:teuthology.orchestra.run.smithi125.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T03:03:26.212 INFO:teuthology.orchestra.run.smithi125.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T03:03:26.212 INFO:teuthology.orchestra.run.smithi125.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T03:03:26.212 INFO:teuthology.orchestra.run.smithi125.stdout: python3-mako-1.0.6-14.el8.noarch 2023-10-06T03:03:26.212 INFO:teuthology.orchestra.run.smithi125.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T03:03:26.212 INFO:teuthology.orchestra.run.smithi125.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T03:03:26.212 INFO:teuthology.orchestra.run.smithi125.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T03:03:26.212 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-10-06T03:03:26.212 INFO:teuthology.orchestra.run.smithi125.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-10-06T03:03:26.212 INFO:teuthology.orchestra.run.smithi125.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T03:03:26.212 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T03:03:26.212 INFO:teuthology.orchestra.run.smithi125.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T03:03:26.213 INFO:teuthology.orchestra.run.smithi125.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T03:03:26.213 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-10-06T03:03:26.213 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T03:03:26.213 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T03:03:26.213 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pycparser-2.14-14.el8.noarch 2023-10-06T03:03:26.213 INFO:teuthology.orchestra.run.smithi125.stdout: python3-pytz-2017.2-11.el8.noarch 2023-10-06T03:03:26.213 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.213 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.213 INFO:teuthology.orchestra.run.smithi125.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T03:03:26.213 INFO:teuthology.orchestra.run.smithi125.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T03:03:26.214 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.214 INFO:teuthology.orchestra.run.smithi125.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T03:03:26.214 INFO:teuthology.orchestra.run.smithi125.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T03:03:26.214 INFO:teuthology.orchestra.run.smithi125.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-10-06T03:03:26.214 INFO:teuthology.orchestra.run.smithi125.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T03:03:26.214 INFO:teuthology.orchestra.run.smithi125.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T03:03:26.214 INFO:teuthology.orchestra.run.smithi125.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T03:03:26.214 INFO:teuthology.orchestra.run.smithi125.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T03:03:26.214 INFO:teuthology.orchestra.run.smithi125.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T03:03:26.214 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T03:03:26.214 INFO:teuthology.orchestra.run.smithi125.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T03:03:26.215 INFO:teuthology.orchestra.run.smithi125.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T03:03:26.215 INFO:teuthology.orchestra.run.smithi125.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T03:03:26.215 INFO:teuthology.orchestra.run.smithi125.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T03:03:26.215 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.215 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.215 INFO:teuthology.orchestra.run.smithi125.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T03:03:26.215 INFO:teuthology.orchestra.run.smithi125.stdout: socat-1.7.4.1-1.el8.x86_64 2023-10-06T03:03:26.215 INFO:teuthology.orchestra.run.smithi125.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T03:03:26.215 INFO:teuthology.orchestra.run.smithi125.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-10-06T03:03:26.216 INFO:teuthology.orchestra.run.smithi125.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T03:03:26.216 INFO:teuthology.orchestra.run.smithi125.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-10-06T03:03:26.216 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:26.216 INFO:teuthology.orchestra.run.smithi125.stdout:Complete! 2023-10-06T03:03:26.466 DEBUG:teuthology.parallel:result is None 2023-10-06T03:03:26.467 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T03:03:26.704 DEBUG:teuthology.orchestra.run.smithi125:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T03:03:26.728 INFO:teuthology.orchestra.run.smithi125.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T03:03:26.728 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T03:03:26.729 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T03:03:26.729 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T03:03:26.876 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T03:03:26.904 INFO:teuthology.orchestra.run.smithi130.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T03:03:26.904 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T03:03:26.905 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T03:03:26.905 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T03:03:26.905 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:03:26.905 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T03:03:26.936 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:03:26.937 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T03:03:26.979 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T03:03:26.979 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:03:26.979 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T03:03:27.006 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T03:03:27.075 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:03:27.075 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T03:03:27.106 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T03:03:27.175 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T03:03:27.175 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:03:27.175 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T03:03:27.201 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T03:03:27.268 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:03:27.269 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T03:03:27.297 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T03:03:27.365 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T03:03:27.366 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:03:27.366 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T03:03:27.393 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T03:03:27.462 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:03:27.462 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T03:03:27.490 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T03:03:27.558 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T03:03:27.630 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T03:03:27.630 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 777 /var/log/ceph 2023-10-06T03:03:27.632 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 777 /var/log/ceph 2023-10-06T03:03:27.660 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T03:03:27.660 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T03:03:27.700 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T03:03:27.727 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T03:03:27.727 DEBUG:teuthology.orchestra.run.smithi125:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T03:03:27.768 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T03:03:27.801 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T03:03:27.801 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T03:03:27.801 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T03:03:27.801 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:03:27.802 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T03:03:27.852 DEBUG:teuthology.orchestra.run.smithi125:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:27.964 DEBUG:teuthology.orchestra.run.smithi125:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:27.993 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:03:27.993 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T03:03:28.011 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:28.123 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:28.155 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T03:03:28.155 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T03:03:28.156 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412180', 'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412180', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7519, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f', 'targets': {'smithi125.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLMm0/tC54OqctW/6NOr0JjGFyBYJQrLYamtDn1HVZ/PGppy0ZiOxmlxcCmEhC+q/g/akDf7LHSEuo9zZob1UuE=', 'smithi130.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAZtS6KUubNiYH/E/d3hs3JkgqTG/TbcaWtWLghQmDL/qv0IggKGQ38iK1ZqMzBew/GzoyV652PrLfwE0fSJvxE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_pool_perm']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:52:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T03:03:28.156 DEBUG:teuthology.orchestra.run.smithi125:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T03:03:28.158 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T03:03:28.208 DEBUG:teuthology.orchestra.run.smithi125:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T03:03:28.216 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T03:03:28.275 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:03:28.275 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T03:03:28.299 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T03:03:28.299 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_1 2023-10-06T03:03:28.357 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T03:03:28.357 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:03:28.357 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 6h/6d Inode: 393765 Links: 1 2023-10-06T03:03:28.357 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:03:28.358 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:03:28.358 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-10-06 03:03:23.771281845 +0000 2023-10-06T03:03:28.358 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-10-06 03:00:16.538873423 +0000 2023-10-06T03:03:28.358 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-10-06 03:00:16.538873423 +0000 2023-10-06T03:03:28.358 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-10-06T03:03:28.358 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T03:03:28.422 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-10-06T03:03:28.423 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-10-06T03:03:28.423 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000226178 s, 2.3 MB/s 2023-10-06T03:03:28.424 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T03:03:28.483 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_2 2023-10-06T03:03:28.541 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T03:03:28.541 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:03:28.541 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 6h/6d Inode: 393898 Links: 1 2023-10-06T03:03:28.541 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:03:28.541 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:03:28.541 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-10-06 03:03:23.771281845 +0000 2023-10-06T03:03:28.541 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-10-06 03:00:17.056864924 +0000 2023-10-06T03:03:28.541 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-10-06 03:00:17.056864924 +0000 2023-10-06T03:03:28.542 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-10-06T03:03:28.542 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T03:03:28.606 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-10-06T03:03:28.606 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-10-06T03:03:28.607 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000209686 s, 2.4 MB/s 2023-10-06T03:03:28.608 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T03:03:28.668 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_3 2023-10-06T03:03:28.726 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T03:03:28.726 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:03:28.726 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 6h/6d Inode: 392096 Links: 1 2023-10-06T03:03:28.726 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:03:28.726 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:03:28.726 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-10-06 03:03:23.771281845 +0000 2023-10-06T03:03:28.726 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-10-06 03:00:17.557856705 +0000 2023-10-06T03:03:28.727 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-10-06 03:00:17.557856705 +0000 2023-10-06T03:03:28.727 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-10-06T03:03:28.727 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T03:03:28.793 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-10-06T03:03:28.793 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-10-06T03:03:28.793 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000219815 s, 2.3 MB/s 2023-10-06T03:03:28.794 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T03:03:28.854 DEBUG:teuthology.orchestra.run.smithi125:> stat /dev/vg_nvme/lv_4 2023-10-06T03:03:28.912 INFO:teuthology.orchestra.run.smithi125.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T03:03:28.912 INFO:teuthology.orchestra.run.smithi125.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:03:28.912 INFO:teuthology.orchestra.run.smithi125.stdout:Device: 6h/6d Inode: 395105 Links: 1 2023-10-06T03:03:28.913 INFO:teuthology.orchestra.run.smithi125.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:03:28.913 INFO:teuthology.orchestra.run.smithi125.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:03:28.913 INFO:teuthology.orchestra.run.smithi125.stdout:Access: 2023-10-06 03:03:23.771281845 +0000 2023-10-06T03:03:28.913 INFO:teuthology.orchestra.run.smithi125.stdout:Modify: 2023-10-06 03:00:18.056848518 +0000 2023-10-06T03:03:28.913 INFO:teuthology.orchestra.run.smithi125.stdout:Change: 2023-10-06 03:00:18.056848518 +0000 2023-10-06T03:03:28.913 INFO:teuthology.orchestra.run.smithi125.stdout: Birth: - 2023-10-06T03:03:28.913 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T03:03:28.977 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records in 2023-10-06T03:03:28.977 INFO:teuthology.orchestra.run.smithi125.stderr:1+0 records out 2023-10-06T03:03:28.977 INFO:teuthology.orchestra.run.smithi125.stderr:512 bytes copied, 0.000228446 s, 2.2 MB/s 2023-10-06T03:03:28.978 DEBUG:teuthology.orchestra.run.smithi125:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T03:03:29.037 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:03:29.037 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:03:29.037 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T03:03:29.058 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T03:03:29.058 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_1 2023-10-06T03:03:29.119 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T03:03:29.119 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:03:29.119 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 394721 Links: 1 2023-10-06T03:03:29.119 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:03:29.119 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:03:29.119 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-10-06 03:03:19.433349341 +0000 2023-10-06T03:03:29.120 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-10-06 03:00:16.535865386 +0000 2023-10-06T03:03:29.120 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-10-06 03:00:16.535865386 +0000 2023-10-06T03:03:29.120 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2023-10-06T03:03:29.120 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T03:03:29.188 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-10-06T03:03:29.188 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-10-06T03:03:29.188 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000248464 s, 2.1 MB/s 2023-10-06T03:03:29.190 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T03:03:29.251 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_2 2023-10-06T03:03:29.311 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T03:03:29.311 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:03:29.311 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 397795 Links: 1 2023-10-06T03:03:29.311 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:03:29.311 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:03:29.311 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-10-06 03:03:19.433349341 +0000 2023-10-06T03:03:29.311 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-10-06 03:00:17.051856379 +0000 2023-10-06T03:03:29.311 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-10-06 03:00:17.051856379 +0000 2023-10-06T03:03:29.312 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2023-10-06T03:03:29.312 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T03:03:29.379 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-10-06T03:03:29.379 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-10-06T03:03:29.379 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000225025 s, 2.3 MB/s 2023-10-06T03:03:29.380 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T03:03:29.440 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_3 2023-10-06T03:03:29.498 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T03:03:29.498 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:03:29.499 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 392558 Links: 1 2023-10-06T03:03:29.499 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:03:29.499 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:03:29.499 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-10-06 03:03:19.433349341 +0000 2023-10-06T03:03:29.499 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-10-06 03:00:17.553847617 +0000 2023-10-06T03:03:29.499 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-10-06 03:00:17.553847617 +0000 2023-10-06T03:03:29.499 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2023-10-06T03:03:29.499 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T03:03:29.566 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-10-06T03:03:29.566 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-10-06T03:03:29.566 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000196507 s, 2.6 MB/s 2023-10-06T03:03:29.567 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T03:03:29.626 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_4 2023-10-06T03:03:29.686 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T03:03:29.686 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T03:03:29.687 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 6h/6d Inode: 398019 Links: 1 2023-10-06T03:03:29.687 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T03:03:29.687 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T03:03:29.687 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2023-10-06 03:03:19.434349324 +0000 2023-10-06T03:03:29.687 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2023-10-06 03:00:18.059838785 +0000 2023-10-06T03:03:29.687 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2023-10-06 03:00:18.059838785 +0000 2023-10-06T03:03:29.687 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: - 2023-10-06T03:03:29.688 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T03:03:29.752 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2023-10-06T03:03:29.752 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2023-10-06T03:03:29.752 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000228207 s, 2.2 MB/s 2023-10-06T03:03:29.753 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T03:03:29.812 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:03:29.812 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi125.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T03:03:29.812 INFO:tasks.ceph:Generating config... 2023-10-06T03:03:29.813 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T03:03:29.813 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T03:03:29.814 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T03:03:29.814 INFO:tasks.ceph:[client] pid file = 2023-10-06T03:03:29.814 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T03:03:29.814 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T03:03:29.814 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T03:03:29.814 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T03:03:29.814 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T03:03:29.814 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T03:03:29.814 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T03:03:29.814 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T03:03:29.815 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T03:03:29.815 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T03:03:29.815 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T03:03:29.815 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T03:03:29.815 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T03:03:29.815 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T03:03:29.815 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T03:03:29.815 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T03:03:29.815 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T03:03:29.815 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T03:03:29.816 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T03:03:29.816 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-06T03:03:29.816 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-06T03:03:29.816 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T03:03:29.816 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T03:03:29.816 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-06T03:03:29.816 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T03:03:29.816 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T03:03:29.816 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T03:03:29.816 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T03:03:29.816 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T03:03:29.817 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T03:03:29.817 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T03:03:29.817 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T03:03:29.878 INFO:teuthology.orchestra.run.smithi125.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T03:03:29.880 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T03:03:29.923 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T03:03:29.990 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.125'), ('mon.b', '172.21.15.130'), ('mon.c', '[v2:172.21.15.130:3301,v1:172.21.15.130:6790]')] 2023-10-06T03:03:29.991 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.125,172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T03:03:29.991 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:03:29.992 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T03:03:30.048 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.125 --add b 172.21.15.130 --addv c '[v2:172.21.15.130:3301,v1:172.21.15.130:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:03:30.133 INFO:teuthology.orchestra.run.smithi125.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:03:30.134 INFO:teuthology.orchestra.run.smithi125.stdout:monmaptool: generated fsid c8556660-0880-4430-a03a-c140780d46e7 2023-10-06T03:03:30.134 INFO:teuthology.orchestra.run.smithi125.stdout:setting min_mon_release = octopus 2023-10-06T03:03:30.134 INFO:teuthology.orchestra.run.smithi125.stdout:epoch 0 2023-10-06T03:03:30.134 INFO:teuthology.orchestra.run.smithi125.stdout:fsid c8556660-0880-4430-a03a-c140780d46e7 2023-10-06T03:03:30.134 INFO:teuthology.orchestra.run.smithi125.stdout:last_changed 2023-10-06T03:03:30.133667+0000 2023-10-06T03:03:30.134 INFO:teuthology.orchestra.run.smithi125.stdout:created 2023-10-06T03:03:30.133667+0000 2023-10-06T03:03:30.134 INFO:teuthology.orchestra.run.smithi125.stdout:min_mon_release 15 (octopus) 2023-10-06T03:03:30.134 INFO:teuthology.orchestra.run.smithi125.stdout:election_strategy: 1 2023-10-06T03:03:30.134 INFO:teuthology.orchestra.run.smithi125.stdout:0: [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] mon.a 2023-10-06T03:03:30.135 INFO:teuthology.orchestra.run.smithi125.stdout:1: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2023-10-06T03:03:30.135 INFO:teuthology.orchestra.run.smithi125.stdout:2: [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] mon.c 2023-10-06T03:03:30.135 INFO:teuthology.orchestra.run.smithi125.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T03:03:30.136 DEBUG:teuthology.orchestra.run.smithi125:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T03:03:30.153 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c8556660-0880-4430-a03a-c140780d46e7... 2023-10-06T03:03:30.155 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:03:30.197 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T03:03:30.239 INFO:teuthology.orchestra.run.smithi125.stdout:[global] 2023-10-06T03:03:30.239 INFO:teuthology.orchestra.run.smithi125.stdout: chdir = "" 2023-10-06T03:03:30.239 INFO:teuthology.orchestra.run.smithi125.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:03:30.239 INFO:teuthology.orchestra.run.smithi125.stdout: auth supported = cephx 2023-10-06T03:03:30.239 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.239 INFO:teuthology.orchestra.run.smithi125.stdout: filestore xattr use omap = true 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi125.stdout: mon clock drift allowed = 1.000 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi125.stdout: osd crush chooseleaf type = 0 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi125.stdout: auth debug = true 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on old message = true 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi125.stdout: ms die on bug = true 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi125.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:03:30.240 INFO:teuthology.orchestra.run.smithi125.stdout: mon pg warn max object skew = 0 2023-10-06T03:03:30.241 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.241 INFO:teuthology.orchestra.run.smithi125.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:03:30.241 INFO:teuthology.orchestra.run.smithi125.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:03:30.241 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.241 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default size = 2 2023-10-06T03:03:30.241 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.241 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow primary affinity = true 2023-10-06T03:03:30.241 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd allow pg remap = true 2023-10-06T03:03:30.241 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:03:30.241 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:03:30.241 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on no sortbitwise = false 2023-10-06T03:03:30.241 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:03:30.241 INFO:teuthology.orchestra.run.smithi125.stdout: mon warn on too few osds = false 2023-10-06T03:03:30.242 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:03:30.242 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:03:30.242 INFO:teuthology.orchestra.run.smithi125.stdout: mon_allow_pool_size_one = true 2023-10-06T03:03:30.242 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.242 INFO:teuthology.orchestra.run.smithi125.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:03:30.242 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.242 INFO:teuthology.orchestra.run.smithi125.stdout: osd default data pool replay window = 5 2023-10-06T03:03:30.242 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.242 INFO:teuthology.orchestra.run.smithi125.stdout: mon allow pool delete = true 2023-10-06T03:03:30.242 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.242 INFO:teuthology.orchestra.run.smithi125.stdout: mon cluster log file level = debug 2023-10-06T03:03:30.243 INFO:teuthology.orchestra.run.smithi125.stdout: debug asserts on shutdown = true 2023-10-06T03:03:30.243 INFO:teuthology.orchestra.run.smithi125.stdout: mon health detail to clog = false 2023-10-06T03:03:30.243 INFO:teuthology.orchestra.run.smithi125.stdout: mon host = "172.21.15.125,172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790]" 2023-10-06T03:03:30.243 INFO:teuthology.orchestra.run.smithi125.stdout: fsid = c8556660-0880-4430-a03a-c140780d46e7 2023-10-06T03:03:30.243 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.243 INFO:teuthology.orchestra.run.smithi125.stdout:[osd] 2023-10-06T03:03:30.243 INFO:teuthology.orchestra.run.smithi125.stdout: osd journal size = 100 2023-10-06T03:03:30.243 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.243 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub load threshold = 5.0 2023-10-06T03:03:30.243 INFO:teuthology.orchestra.run.smithi125.stdout: osd scrub max interval = 600 2023-10-06T03:03:30.243 INFO:teuthology.orchestra.run.smithi125.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:03:30.243 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.244 INFO:teuthology.orchestra.run.smithi125.stdout: osd recover clone overlap = true 2023-10-06T03:03:30.244 INFO:teuthology.orchestra.run.smithi125.stdout: osd recovery max chunk = 1048576 2023-10-06T03:03:30.244 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.244 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug shutdown = true 2023-10-06T03:03:30.244 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug op order = true 2023-10-06T03:03:30.244 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug verify stray on activate = true 2023-10-06T03:03:30.244 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.244 INFO:teuthology.orchestra.run.smithi125.stdout: osd open classes on start = true 2023-10-06T03:03:30.244 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug pg log writeout = true 2023-10-06T03:03:30.244 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.244 INFO:teuthology.orchestra.run.smithi125.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:03:30.244 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.245 INFO:teuthology.orchestra.run.smithi125.stdout: osd map max advance = 10 2023-10-06T03:03:30.245 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.245 INFO:teuthology.orchestra.run.smithi125.stdout: journal zero on create = true 2023-10-06T03:03:30.245 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.245 INFO:teuthology.orchestra.run.smithi125.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:03:30.245 INFO:teuthology.orchestra.run.smithi125.stdout: filestore apply finisher threads = 3 2023-10-06T03:03:30.245 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.245 INFO:teuthology.orchestra.run.smithi125.stdout: bdev debug aio = true 2023-10-06T03:03:30.245 INFO:teuthology.orchestra.run.smithi125.stdout: osd debug misdirected ops = true 2023-10-06T03:03:30.245 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore block size = 96636764160 2023-10-06T03:03:30.245 INFO:teuthology.orchestra.run.smithi125.stdout: bluestore fsck on mount = True 2023-10-06T03:03:30.245 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluefs = 20 2023-10-06T03:03:30.246 INFO:teuthology.orchestra.run.smithi125.stdout: debug bluestore = 20 2023-10-06T03:03:30.246 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-10-06T03:03:30.246 INFO:teuthology.orchestra.run.smithi125.stdout: debug osd = 20 2023-10-06T03:03:30.246 INFO:teuthology.orchestra.run.smithi125.stdout: debug rocksdb = 10 2023-10-06T03:03:30.246 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:03:30.246 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd full ratio = 0.9 2023-10-06T03:03:30.246 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:03:30.246 INFO:teuthology.orchestra.run.smithi125.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:03:30.246 INFO:teuthology.orchestra.run.smithi125.stdout: osd objectstore = bluestore 2023-10-06T03:03:30.246 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2023-10-06T03:03:30.246 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr] 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi125.stdout: debug mgr = 20 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi125.stdout: mgr/telemetry/nag = false 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi125.stdout:[mon] 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi125.stdout: debug mon = 20 2023-10-06T03:03:30.247 INFO:teuthology.orchestra.run.smithi125.stdout: debug paxos = 20 2023-10-06T03:03:30.248 INFO:teuthology.orchestra.run.smithi125.stdout: debug auth = 20 2023-10-06T03:03:30.248 INFO:teuthology.orchestra.run.smithi125.stdout: mon data avail warn = 5 2023-10-06T03:03:30.248 INFO:teuthology.orchestra.run.smithi125.stdout: mon mgr mkfs grace = 240 2023-10-06T03:03:30.248 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:03:30.248 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd reporter subtree level = osd 2023-10-06T03:03:30.248 INFO:teuthology.orchestra.run.smithi125.stdout: mon osd prime pg temp = true 2023-10-06T03:03:30.248 INFO:teuthology.orchestra.run.smithi125.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:03:30.248 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.248 INFO:teuthology.orchestra.run.smithi125.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:03:30.248 INFO:teuthology.orchestra.run.smithi125.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:03:30.248 INFO:teuthology.orchestra.run.smithi125.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:03:30.248 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.249 INFO:teuthology.orchestra.run.smithi125.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:03:30.249 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:03:30.249 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:03:30.249 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.249 INFO:teuthology.orchestra.run.smithi125.stdout: # 1m isn't quite enough 2023-10-06T03:03:30.249 INFO:teuthology.orchestra.run.smithi125.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:03:30.249 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.249 INFO:teuthology.orchestra.run.smithi125.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:03:30.249 INFO:teuthology.orchestra.run.smithi125.stdout: mon op complaint time = 120 2023-10-06T03:03:30.249 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:03:30.249 INFO:teuthology.orchestra.run.smithi125.stdout:[client] 2023-10-06T03:03:30.249 INFO:teuthology.orchestra.run.smithi125.stdout: rgw cache enabled = true 2023-10-06T03:03:30.250 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable ops log = true 2023-10-06T03:03:30.250 INFO:teuthology.orchestra.run.smithi125.stdout: rgw enable usage log = true 2023-10-06T03:03:30.250 INFO:teuthology.orchestra.run.smithi125.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:03:30.250 INFO:teuthology.orchestra.run.smithi125.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:03:30.250 INFO:teuthology.orchestra.run.smithi125.stdout: client mount timeout = 600 2023-10-06T03:03:30.250 INFO:teuthology.orchestra.run.smithi125.stdout: debug client = 20 2023-10-06T03:03:30.250 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-10-06T03:03:30.250 INFO:teuthology.orchestra.run.smithi125.stdout: pid file = "" 2023-10-06T03:03:30.250 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 900 2023-10-06T03:03:30.250 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 900 2023-10-06T03:03:30.250 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.a] 2023-10-06T03:03:30.250 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.b] 2023-10-06T03:03:30.251 INFO:teuthology.orchestra.run.smithi125.stdout:[mon.c] 2023-10-06T03:03:30.251 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.a] 2023-10-06T03:03:30.251 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.c] 2023-10-06T03:03:30.251 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.b] 2023-10-06T03:03:30.251 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.d] 2023-10-06T03:03:30.251 INFO:teuthology.orchestra.run.smithi125.stdout:[mds] 2023-10-06T03:03:30.251 INFO:teuthology.orchestra.run.smithi125.stdout: debug mds = 20 2023-10-06T03:03:30.251 INFO:teuthology.orchestra.run.smithi125.stdout: debug ms = 1 2023-10-06T03:03:30.251 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug frag = True 2023-10-06T03:03:30.251 INFO:teuthology.orchestra.run.smithi125.stdout: mds debug scatterstat = True 2023-10-06T03:03:30.251 INFO:teuthology.orchestra.run.smithi125.stdout: mds op complaint time = 180 2023-10-06T03:03:30.251 INFO:teuthology.orchestra.run.smithi125.stdout: mds verify scatter = True 2023-10-06T03:03:30.253 INFO:teuthology.orchestra.run.smithi125.stdout: osd op complaint time = 180 2023-10-06T03:03:30.253 INFO:teuthology.orchestra.run.smithi125.stdout: rados mon op timeout = 900 2023-10-06T03:03:30.253 INFO:teuthology.orchestra.run.smithi125.stdout: rados osd op timeout = 900 2023-10-06T03:03:30.253 INFO:teuthology.orchestra.run.smithi130.stdout:[global] 2023-10-06T03:03:30.254 INFO:teuthology.orchestra.run.smithi130.stdout: chdir = "" 2023-10-06T03:03:30.254 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T03:03:30.254 INFO:teuthology.orchestra.run.smithi130.stdout: auth supported = cephx 2023-10-06T03:03:30.254 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.254 INFO:teuthology.orchestra.run.smithi130.stdout: filestore xattr use omap = true 2023-10-06T03:03:30.255 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.255 INFO:teuthology.orchestra.run.smithi130.stdout: mon clock drift allowed = 1.000 2023-10-06T03:03:30.255 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.255 INFO:teuthology.orchestra.run.smithi130.stdout: osd crush chooseleaf type = 0 2023-10-06T03:03:30.256 INFO:teuthology.orchestra.run.smithi130.stdout: auth debug = true 2023-10-06T03:03:30.256 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.256 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on old message = true 2023-10-06T03:03:30.256 INFO:teuthology.orchestra.run.smithi130.stdout: ms die on bug = true 2023-10-06T03:03:30.256 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.257 INFO:teuthology.orchestra.run.smithi130.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T03:03:30.257 INFO:teuthology.orchestra.run.smithi130.stdout: mon pg warn max object skew = 0 2023-10-06T03:03:30.257 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.257 INFO:teuthology.orchestra.run.smithi130.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T03:03:30.257 INFO:teuthology.orchestra.run.smithi130.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T03:03:30.257 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.258 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default size = 2 2023-10-06T03:03:30.258 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.258 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow primary affinity = true 2023-10-06T03:03:30.258 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd allow pg remap = true 2023-10-06T03:03:30.258 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on legacy crush tunables = false 2023-10-06T03:03:30.258 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on crush straw calc version zero = false 2023-10-06T03:03:30.258 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on no sortbitwise = false 2023-10-06T03:03:30.258 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on osd down out interval zero = false 2023-10-06T03:03:30.259 INFO:teuthology.orchestra.run.smithi130.stdout: mon warn on too few osds = false 2023-10-06T03:03:30.259 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T03:03:30.259 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T03:03:30.259 INFO:teuthology.orchestra.run.smithi130.stdout: mon_allow_pool_size_one = true 2023-10-06T03:03:30.259 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.259 INFO:teuthology.orchestra.run.smithi130.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T03:03:30.259 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.259 INFO:teuthology.orchestra.run.smithi130.stdout: osd default data pool replay window = 5 2023-10-06T03:03:30.259 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.259 INFO:teuthology.orchestra.run.smithi130.stdout: mon allow pool delete = true 2023-10-06T03:03:30.259 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.260 INFO:teuthology.orchestra.run.smithi130.stdout: mon cluster log file level = debug 2023-10-06T03:03:30.260 INFO:teuthology.orchestra.run.smithi130.stdout: debug asserts on shutdown = true 2023-10-06T03:03:30.260 INFO:teuthology.orchestra.run.smithi130.stdout: mon health detail to clog = false 2023-10-06T03:03:30.260 INFO:teuthology.orchestra.run.smithi130.stdout: mon host = "172.21.15.125,172.21.15.130,[v2:172.21.15.130:3301,v1:172.21.15.130:6790]" 2023-10-06T03:03:30.260 INFO:teuthology.orchestra.run.smithi130.stdout: fsid = c8556660-0880-4430-a03a-c140780d46e7 2023-10-06T03:03:30.260 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.260 INFO:teuthology.orchestra.run.smithi130.stdout:[osd] 2023-10-06T03:03:30.261 INFO:teuthology.orchestra.run.smithi130.stdout: osd journal size = 100 2023-10-06T03:03:30.261 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.261 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub load threshold = 5.0 2023-10-06T03:03:30.261 INFO:teuthology.orchestra.run.smithi130.stdout: osd scrub max interval = 600 2023-10-06T03:03:30.261 INFO:teuthology.orchestra.run.smithi130.stdout: osd mclock profile = high_recovery_ops 2023-10-06T03:03:30.261 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.261 INFO:teuthology.orchestra.run.smithi130.stdout: osd recover clone overlap = true 2023-10-06T03:03:30.261 INFO:teuthology.orchestra.run.smithi130.stdout: osd recovery max chunk = 1048576 2023-10-06T03:03:30.261 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.261 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug shutdown = true 2023-10-06T03:03:30.261 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug op order = true 2023-10-06T03:03:30.261 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug verify stray on activate = true 2023-10-06T03:03:30.262 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.262 INFO:teuthology.orchestra.run.smithi130.stdout: osd open classes on start = true 2023-10-06T03:03:30.262 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug pg log writeout = true 2023-10-06T03:03:30.262 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.262 INFO:teuthology.orchestra.run.smithi130.stdout: osd deep scrub update digest min age = 30 2023-10-06T03:03:30.262 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.263 INFO:teuthology.orchestra.run.smithi130.stdout: osd map max advance = 10 2023-10-06T03:03:30.263 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.263 INFO:teuthology.orchestra.run.smithi130.stdout: journal zero on create = true 2023-10-06T03:03:30.263 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.263 INFO:teuthology.orchestra.run.smithi130.stdout: filestore ondisk finisher threads = 3 2023-10-06T03:03:30.263 INFO:teuthology.orchestra.run.smithi130.stdout: filestore apply finisher threads = 3 2023-10-06T03:03:30.264 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.264 INFO:teuthology.orchestra.run.smithi130.stdout: bdev debug aio = true 2023-10-06T03:03:30.264 INFO:teuthology.orchestra.run.smithi130.stdout: osd debug misdirected ops = true 2023-10-06T03:03:30.264 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore block size = 96636764160 2023-10-06T03:03:30.264 INFO:teuthology.orchestra.run.smithi130.stdout: bluestore fsck on mount = True 2023-10-06T03:03:30.264 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluefs = 20 2023-10-06T03:03:30.264 INFO:teuthology.orchestra.run.smithi130.stdout: debug bluestore = 20 2023-10-06T03:03:30.264 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-10-06T03:03:30.265 INFO:teuthology.orchestra.run.smithi130.stdout: debug osd = 20 2023-10-06T03:03:30.265 INFO:teuthology.orchestra.run.smithi130.stdout: debug rocksdb = 10 2023-10-06T03:03:30.265 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T03:03:30.265 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd full ratio = 0.9 2023-10-06T03:03:30.265 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd nearfull ratio = 0.8 2023-10-06T03:03:30.265 INFO:teuthology.orchestra.run.smithi130.stdout: osd failsafe full ratio = 0.95 2023-10-06T03:03:30.265 INFO:teuthology.orchestra.run.smithi130.stdout: osd objectstore = bluestore 2023-10-06T03:03:30.266 INFO:teuthology.orchestra.run.smithi130.stdout: osd op complaint time = 180 2023-10-06T03:03:30.266 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.266 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr] 2023-10-06T03:03:30.266 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-10-06T03:03:30.266 INFO:teuthology.orchestra.run.smithi130.stdout: debug mgr = 20 2023-10-06T03:03:30.266 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2023-10-06T03:03:30.266 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2023-10-06T03:03:30.266 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:03:30.266 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:03:30.267 INFO:teuthology.orchestra.run.smithi130.stdout: mgr/telemetry/nag = false 2023-10-06T03:03:30.267 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.267 INFO:teuthology.orchestra.run.smithi130.stdout:[mon] 2023-10-06T03:03:30.267 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-10-06T03:03:30.267 INFO:teuthology.orchestra.run.smithi130.stdout: debug mon = 20 2023-10-06T03:03:30.267 INFO:teuthology.orchestra.run.smithi130.stdout: debug paxos = 20 2023-10-06T03:03:30.267 INFO:teuthology.orchestra.run.smithi130.stdout: debug auth = 20 2023-10-06T03:03:30.267 INFO:teuthology.orchestra.run.smithi130.stdout: mon data avail warn = 5 2023-10-06T03:03:30.267 INFO:teuthology.orchestra.run.smithi130.stdout: mon mgr mkfs grace = 240 2023-10-06T03:03:30.267 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min pgs per osd = 4 2023-10-06T03:03:30.267 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd reporter subtree level = osd 2023-10-06T03:03:30.267 INFO:teuthology.orchestra.run.smithi130.stdout: mon osd prime pg temp = true 2023-10-06T03:03:30.268 INFO:teuthology.orchestra.run.smithi130.stdout: mon reweight min bytes per osd = 10 2023-10-06T03:03:30.268 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.268 INFO:teuthology.orchestra.run.smithi130.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T03:03:30.268 INFO:teuthology.orchestra.run.smithi130.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T03:03:30.268 INFO:teuthology.orchestra.run.smithi130.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T03:03:30.268 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.268 INFO:teuthology.orchestra.run.smithi130.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T03:03:30.268 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T03:03:30.268 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T03:03:30.269 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.269 INFO:teuthology.orchestra.run.smithi130.stdout: # 1m isn't quite enough 2023-10-06T03:03:30.269 INFO:teuthology.orchestra.run.smithi130.stdout: mon_down_mkfs_grace = 2m 2023-10-06T03:03:30.269 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.269 INFO:teuthology.orchestra.run.smithi130.stdout: mon_warn_on_filestore_osds = false 2023-10-06T03:03:30.269 INFO:teuthology.orchestra.run.smithi130.stdout: mon op complaint time = 120 2023-10-06T03:03:30.269 INFO:teuthology.orchestra.run.smithi130.stdout: 2023-10-06T03:03:30.269 INFO:teuthology.orchestra.run.smithi130.stdout:[client] 2023-10-06T03:03:30.269 INFO:teuthology.orchestra.run.smithi130.stdout: rgw cache enabled = true 2023-10-06T03:03:30.269 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable ops log = true 2023-10-06T03:03:30.270 INFO:teuthology.orchestra.run.smithi130.stdout: rgw enable usage log = true 2023-10-06T03:03:30.270 INFO:teuthology.orchestra.run.smithi130.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T03:03:30.270 INFO:teuthology.orchestra.run.smithi130.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T03:03:30.270 INFO:teuthology.orchestra.run.smithi130.stdout: client mount timeout = 600 2023-10-06T03:03:30.270 INFO:teuthology.orchestra.run.smithi130.stdout: debug client = 20 2023-10-06T03:03:30.270 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-10-06T03:03:30.270 INFO:teuthology.orchestra.run.smithi130.stdout: pid file = "" 2023-10-06T03:03:30.270 INFO:teuthology.orchestra.run.smithi130.stdout: rados mon op timeout = 900 2023-10-06T03:03:30.270 INFO:teuthology.orchestra.run.smithi130.stdout: rados osd op timeout = 900 2023-10-06T03:03:30.270 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.a] 2023-10-06T03:03:30.270 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.b] 2023-10-06T03:03:30.271 INFO:teuthology.orchestra.run.smithi130.stdout:[mon.c] 2023-10-06T03:03:30.271 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.a] 2023-10-06T03:03:30.271 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.c] 2023-10-06T03:03:30.271 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.b] 2023-10-06T03:03:30.271 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.d] 2023-10-06T03:03:30.271 INFO:teuthology.orchestra.run.smithi130.stdout:[mds] 2023-10-06T03:03:30.271 INFO:teuthology.orchestra.run.smithi130.stdout: debug mds = 20 2023-10-06T03:03:30.271 INFO:teuthology.orchestra.run.smithi130.stdout: debug ms = 1 2023-10-06T03:03:30.271 INFO:teuthology.orchestra.run.smithi130.stdout: mds debug frag = True 2023-10-06T03:03:30.271 INFO:teuthology.orchestra.run.smithi130.stdout: mds debug scatterstat = True 2023-10-06T03:03:30.271 INFO:teuthology.orchestra.run.smithi130.stdout: mds op complaint time = 180 2023-10-06T03:03:30.271 INFO:teuthology.orchestra.run.smithi130.stdout: mds verify scatter = True 2023-10-06T03:03:30.271 INFO:teuthology.orchestra.run.smithi130.stdout: osd op complaint time = 180 2023-10-06T03:03:30.272 INFO:teuthology.orchestra.run.smithi130.stdout: rados mon op timeout = 900 2023-10-06T03:03:30.272 INFO:teuthology.orchestra.run.smithi130.stdout: rados osd op timeout = 900 2023-10-06T03:03:30.273 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T03:03:30.273 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T03:03:30.366 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T03:03:30.366 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:03:30.366 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T03:03:30.385 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:03:30.385 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T03:03:30.443 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:03:30.444 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:03:30.444 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T03:03:30.444 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T03:03:30.519 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:03:30.520 DEBUG:teuthology.orchestra.run.smithi125:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:03:30.577 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi130.front.sepia.ceph.com 2023-10-06T03:03:30.577 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:03:30.577 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T03:03:30.578 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T03:03:30.619 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:03:30.619 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:03:30.678 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T03:03:30.678 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T03:03:30.679 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T03:03:30.728 INFO:teuthology.orchestra.run.smithi125.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T03:03:30.731 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T03:03:30.833 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T03:03:30.835 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T03:03:30.836 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T03:03:30.886 INFO:teuthology.orchestra.run.smithi125.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T03:03:30.888 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T03:03:30.915 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T03:03:31.005 INFO:teuthology.orchestra.run.smithi125.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T03:03:31.007 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T03:03:31.034 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T03:03:31.089 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T03:03:31.091 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T03:03:31.119 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T03:03:31.210 INFO:teuthology.orchestra.run.smithi130.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T03:03:31.212 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T03:03:31.238 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T03:03:31.238 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T03:03:31.279 INFO:teuthology.orchestra.run.smithi125.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T03:03:31.291 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T03:03:31.371 INFO:teuthology.orchestra.run.smithi125.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T03:03:31.383 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T03:03:31.424 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T03:03:31.436 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T03:03:31.516 INFO:teuthology.orchestra.run.smithi130.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T03:03:31.528 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T03:03:31.529 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi125.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi130.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T03:03:31.529 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T03:03:31.556 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:03:31.556 INFO:tasks.ceph:role: osd.0 2023-10-06T03:03:31.556 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:03:31.556 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T03:03:31.631 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:03:31.631 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:03:31.631 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:03:31.631 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T03:03:31.631 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:03:31.631 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:03:31.631 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:03:31.631 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:03:31.632 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:03:31.632 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:03:32.067 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2023-10-06T03:03:32.068 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-10-06T03:03:32.068 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T03:03:32.209 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T03:03:32.245 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T03:03:32.314 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:03:32.314 INFO:tasks.ceph:role: osd.1 2023-10-06T03:03:32.314 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:03:32.314 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T03:03:32.389 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:03:32.390 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:03:32.390 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:03:32.390 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T03:03:32.390 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:03:32.390 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:03:32.390 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:03:32.390 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:03:32.390 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:03:32.391 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:03:32.811 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2023-10-06T03:03:32.812 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-10-06T03:03:32.812 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T03:03:32.896 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T03:03:32.967 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T03:03:33.034 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:03:33.034 INFO:tasks.ceph:role: osd.2 2023-10-06T03:03:33.034 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:03:33.035 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T03:03:33.108 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:03:33.108 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:03:33.108 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:03:33.108 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T03:03:33.109 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:03:33.109 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:03:33.109 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:03:33.109 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:03:33.109 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:03:33.109 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:03:33.559 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2023-10-06T03:03:33.559 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-10-06T03:03:33.560 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T03:03:33.679 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T03:03:33.712 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T03:03:33.780 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T03:03:33.781 INFO:tasks.ceph:role: osd.3 2023-10-06T03:03:33.781 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:03:33.781 DEBUG:teuthology.orchestra.run.smithi125:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T03:03:33.856 INFO:teuthology.orchestra.run.smithi125.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:03:33.857 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:03:33.857 INFO:teuthology.orchestra.run.smithi125.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:03:33.857 INFO:teuthology.orchestra.run.smithi125.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T03:03:33.857 INFO:teuthology.orchestra.run.smithi125.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:03:33.857 INFO:teuthology.orchestra.run.smithi125.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:03:33.857 INFO:teuthology.orchestra.run.smithi125.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:03:33.857 INFO:teuthology.orchestra.run.smithi125.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:03:33.857 INFO:teuthology.orchestra.run.smithi125.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:03:33.857 INFO:teuthology.orchestra.run.smithi125.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:03:34.292 INFO:teuthology.orchestra.run.smithi125.stdout:Discarding blocks...Done. 2023-10-06T03:03:34.294 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi125.front.sepia.ceph.com -o noatime 2023-10-06T03:03:34.294 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T03:03:34.452 DEBUG:teuthology.orchestra.run.smithi125:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T03:03:34.486 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:03:34.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:34.608+0000 7f7771998540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T03:03:34.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:34.611+0000 7f7771998540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T03:03:34.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:34.611+0000 7f7771998540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T03:03:34.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:34.611+0000 7f7771998540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T03:03:34.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:34.611+0000 7f7771998540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T03:03:34.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:34.613+0000 7f7771998540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T03:03:35.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:35.138+0000 7f7771998540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:35.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:35.903+0000 7f7771998540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:36.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:36.669+0000 7f7771998540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:37.468 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T03:03:37.502 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:03:37.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:37.591+0000 7ffbb040c540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T03:03:37.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:37.591+0000 7ffbb040c540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T03:03:37.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:37.591+0000 7ffbb040c540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T03:03:37.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:37.591+0000 7ffbb040c540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T03:03:37.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:37.591+0000 7ffbb040c540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T03:03:37.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:37.592+0000 7ffbb040c540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T03:03:38.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:38.115+0000 7ffbb040c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:38.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:38.882+0000 7ffbb040c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:39.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:39.643+0000 7ffbb040c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:40.440 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T03:03:40.475 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:03:40.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:40.568+0000 7f772cbf5540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T03:03:40.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:40.568+0000 7f772cbf5540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T03:03:40.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:40.568+0000 7f772cbf5540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T03:03:40.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:40.568+0000 7f772cbf5540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T03:03:40.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:40.568+0000 7f772cbf5540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T03:03:40.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:40.569+0000 7f772cbf5540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T03:03:41.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:41.095+0000 7f772cbf5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:41.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:41.858+0000 7f772cbf5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:42.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:42.620+0000 7f772cbf5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:43.418 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T03:03:43.448 DEBUG:teuthology.orchestra.run.smithi125:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:03:43.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:43.535+0000 7f6c436fe540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T03:03:43.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:43.536+0000 7f6c436fe540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T03:03:43.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:43.536+0000 7f6c436fe540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T03:03:43.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:43.536+0000 7f6c436fe540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T03:03:43.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:43.536+0000 7f6c436fe540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T03:03:43.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:43.536+0000 7f6c436fe540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T03:03:44.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:44.064+0000 7f6c436fe540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:44.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:44.828+0000 7f6c436fe540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:45.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:03:45.589+0000 7f6c436fe540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:46.392 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T03:03:46.427 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T03:03:46.462 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:03:46.462 INFO:tasks.ceph:role: osd.4 2023-10-06T03:03:46.462 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-06T03:03:46.462 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T03:03:46.541 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:03:46.541 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:03:46.541 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:03:46.541 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T03:03:46.541 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:03:46.542 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:03:46.542 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:03:46.542 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:03:46.542 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:03:46.542 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:03:46.969 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2023-10-06T03:03:46.971 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2023-10-06T03:03:46.971 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T03:03:47.141 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T03:03:47.178 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T03:03:47.249 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:03:47.249 INFO:tasks.ceph:role: osd.5 2023-10-06T03:03:47.249 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-06T03:03:47.249 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T03:03:47.326 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:03:47.326 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:03:47.326 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:03:47.326 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T03:03:47.326 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:03:47.326 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:03:47.327 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:03:47.327 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:03:47.327 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:03:47.327 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:03:47.743 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2023-10-06T03:03:47.746 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2023-10-06T03:03:47.746 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T03:03:47.868 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T03:03:47.902 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T03:03:47.971 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:03:47.971 INFO:tasks.ceph:role: osd.6 2023-10-06T03:03:47.972 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-06T03:03:47.972 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T03:03:48.048 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:03:48.048 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:03:48.048 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:03:48.048 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T03:03:48.048 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:03:48.048 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:03:48.048 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:03:48.048 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:03:48.048 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:03:48.048 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:03:48.485 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2023-10-06T03:03:48.487 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2023-10-06T03:03:48.487 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T03:03:48.639 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T03:03:48.675 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T03:03:48.744 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T03:03:48.744 INFO:tasks.ceph:role: osd.7 2023-10-06T03:03:48.744 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-06T03:03:48.744 DEBUG:teuthology.orchestra.run.smithi130:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T03:03:48.820 INFO:teuthology.orchestra.run.smithi130.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T03:03:48.820 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T03:03:48.820 INFO:teuthology.orchestra.run.smithi130.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T03:03:48.820 INFO:teuthology.orchestra.run.smithi130.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-10-06T03:03:48.820 INFO:teuthology.orchestra.run.smithi130.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T03:03:48.821 INFO:teuthology.orchestra.run.smithi130.stdout: = sunit=0 swidth=0 blks 2023-10-06T03:03:48.821 INFO:teuthology.orchestra.run.smithi130.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T03:03:48.821 INFO:teuthology.orchestra.run.smithi130.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T03:03:48.821 INFO:teuthology.orchestra.run.smithi130.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T03:03:48.821 INFO:teuthology.orchestra.run.smithi130.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T03:03:49.267 INFO:teuthology.orchestra.run.smithi130.stdout:Discarding blocks...Done. 2023-10-06T03:03:49.268 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi130.front.sepia.ceph.com -o noatime 2023-10-06T03:03:49.268 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T03:03:49.429 DEBUG:teuthology.orchestra.run.smithi130:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T03:03:49.464 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:03:49.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:49.557+0000 7fa584c51540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T03:03:49.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:49.557+0000 7fa584c51540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T03:03:49.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:49.557+0000 7fa584c51540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T03:03:49.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:49.557+0000 7fa584c51540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T03:03:49.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:49.557+0000 7fa584c51540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T03:03:49.559 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:49.558+0000 7fa584c51540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T03:03:50.083 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:50.082+0000 7fa584c51540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:50.852 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:50.851+0000 7fa584c51540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:51.619 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:51.617+0000 7fa584c51540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:52.418 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T03:03:52.451 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:03:52.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:52.541+0000 7f3df6bfe540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T03:03:52.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:52.542+0000 7f3df6bfe540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T03:03:52.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:52.542+0000 7f3df6bfe540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T03:03:52.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:52.542+0000 7f3df6bfe540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T03:03:52.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:52.542+0000 7f3df6bfe540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T03:03:52.544 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:52.542+0000 7f3df6bfe540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T03:03:53.069 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:53.067+0000 7f3df6bfe540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:53.833 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:53.832+0000 7f3df6bfe540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:54.596 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:54.594+0000 7f3df6bfe540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:55.395 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T03:03:55.427 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:03:55.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:55.514+0000 7fae56e01540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T03:03:55.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:55.514+0000 7fae56e01540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T03:03:55.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:55.515+0000 7fae56e01540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T03:03:55.516 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:55.515+0000 7fae56e01540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T03:03:55.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:55.515+0000 7fae56e01540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T03:03:55.517 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:55.515+0000 7fae56e01540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T03:03:56.046 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:56.045+0000 7fae56e01540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:56.810 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:56.809+0000 7fae56e01540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:57.577 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:57.575+0000 7fae56e01540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:58.157 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:58.160 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:03:58.374 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T03:03:58.407 DEBUG:teuthology.orchestra.run.smithi130:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:03:58.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:58.494+0000 7f5b884e8540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T03:03:58.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:58.494+0000 7f5b884e8540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T03:03:58.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:58.494+0000 7f5b884e8540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T03:03:58.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:58.494+0000 7f5b884e8540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T03:03:58.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:58.494+0000 7f5b884e8540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T03:03:58.496 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:58.495+0000 7f5b884e8540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T03:03:59.019 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:59.018+0000 7f5b884e8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:03:59.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:03:59.779+0000 7f5b884e8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:04:00.543 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:00.542+0000 7f5b884e8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T03:04:01.341 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T03:04:01.371 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T03:04:01.372 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:04:01.372 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T03:04:01.405 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:04:01.405 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T03:04:01.478 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:04:01.478 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T03:04:01.551 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:04:01.552 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T03:04:01.624 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:04:01.624 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T03:04:01.698 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:04:01.698 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T03:04:01.771 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:04:01.771 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T03:04:01.845 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:04:01.845 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T03:04:01.878 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:04:01.878 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T03:04:01.949 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:04:01.949 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T03:04:02.019 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:04:02.019 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T03:04:02.088 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:04:02.089 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T03:04:02.157 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:04:02.157 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T03:04:02.225 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:04:02.225 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T03:04:02.292 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:04:02.292 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T03:04:02.315 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:04:02.315 DEBUG:teuthology.orchestra.run.smithi125:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T03:04:02.377 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:04:02.377 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T03:04:02.396 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:04:02.396 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T03:04:02.454 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T03:04:02.454 DEBUG:teuthology.orchestra.run.smithi125:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T03:04:02.457 DEBUG:teuthology.orchestra.run.smithi130:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T03:04:02.497 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr.y] 2023-10-06T03:04:02.497 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQACeR9lMBVuKxAA79aCZvxIP8SQ0uAHUhMoTw== 2023-10-06T03:04:02.498 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.a] 2023-10-06T03:04:02.498 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQACeR9lloXSNBAAkd4p8EX8hsbmaj2RtvpTfQ== 2023-10-06T03:04:02.498 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.c] 2023-10-06T03:04:02.498 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQADeR9lBnBUABAA2iux/fQycX1zhICh6deYGw== 2023-10-06T03:04:02.498 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.0] 2023-10-06T03:04:02.499 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQAGeR9lUBtFJBAAFWDaLc1yPAPAiE/b9XQz6Q== 2023-10-06T03:04:02.499 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.1] 2023-10-06T03:04:02.499 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQAJeR9lzLNAIxAAZvAeW1kgSS22S2ODNu9t5g== 2023-10-06T03:04:02.499 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.2] 2023-10-06T03:04:02.499 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQAMeR9lzW7lIRAAoTH53SsCdqg2Eqa6usyNsw== 2023-10-06T03:04:02.499 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.3] 2023-10-06T03:04:02.500 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQAPeR9lMHoBIBAABNg2tnpIkx1vAzE5Kyu2RA== 2023-10-06T03:04:02.500 INFO:teuthology.orchestra.run.smithi125.stdout:[mgr.x] 2023-10-06T03:04:02.500 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQACeR9lEgqqMRAANWCEvP6tlNAHrd170s3xTw== 2023-10-06T03:04:02.500 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.b] 2023-10-06T03:04:02.500 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQADeR9laBRSBRAAz9jzUg+VFVG1z9PAO0Bcpw== 2023-10-06T03:04:02.500 INFO:teuthology.orchestra.run.smithi125.stdout:[mds.d] 2023-10-06T03:04:02.500 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQADeR9l9PCGDBAAl8luWnwki83v799sqGJFDA== 2023-10-06T03:04:02.501 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.4] 2023-10-06T03:04:02.501 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQAVeR9lprxMIRAA15Qi61mgKUyCpIS1XsYQRQ== 2023-10-06T03:04:02.501 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.5] 2023-10-06T03:04:02.501 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQAYeR9lk5hfIBAAI/Z6Z6sckq0MUvmXtEqCXg== 2023-10-06T03:04:02.501 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.6] 2023-10-06T03:04:02.501 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQAbeR9l8yLBHhAARHwk/X1wTrgZILmOilO4Zw== 2023-10-06T03:04:02.501 INFO:teuthology.orchestra.run.smithi125.stdout:[osd.7] 2023-10-06T03:04:02.501 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQAeeR9l9oGIHRAAtNRSqb/lHdSUjkTc+8iCOw== 2023-10-06T03:04:02.502 INFO:teuthology.orchestra.run.smithi125.stdout:[client.0] 2023-10-06T03:04:02.502 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQADeR9lYyykEBAAbm74uo9KpHwsa7BJ80s73Q== 2023-10-06T03:04:02.502 INFO:teuthology.orchestra.run.smithi125.stdout:[client.2] 2023-10-06T03:04:02.502 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQADeR9lugwkFhAABBonfXirjsQIY76fNW79Uw== 2023-10-06T03:04:02.502 INFO:teuthology.orchestra.run.smithi125.stdout:[client.1] 2023-10-06T03:04:02.502 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQADeR9lyE1DGRAA6/HFA4rX/Gas70IcoIieBw== 2023-10-06T03:04:02.502 INFO:teuthology.orchestra.run.smithi125.stdout:[client.3] 2023-10-06T03:04:02.502 INFO:teuthology.orchestra.run.smithi125.stdout: key = AQADeR9lnA7NHhAAfuAxtddpoSbQzk57JvpbuQ== 2023-10-06T03:04:02.519 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.y] 2023-10-06T03:04:02.520 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQACeR9lMBVuKxAA79aCZvxIP8SQ0uAHUhMoTw== 2023-10-06T03:04:02.520 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.a] 2023-10-06T03:04:02.520 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQACeR9lloXSNBAAkd4p8EX8hsbmaj2RtvpTfQ== 2023-10-06T03:04:02.520 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.c] 2023-10-06T03:04:02.520 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQADeR9lBnBUABAA2iux/fQycX1zhICh6deYGw== 2023-10-06T03:04:02.520 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.0] 2023-10-06T03:04:02.520 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAGeR9lUBtFJBAAFWDaLc1yPAPAiE/b9XQz6Q== 2023-10-06T03:04:02.521 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.1] 2023-10-06T03:04:02.521 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAJeR9lzLNAIxAAZvAeW1kgSS22S2ODNu9t5g== 2023-10-06T03:04:02.521 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.2] 2023-10-06T03:04:02.521 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAMeR9lzW7lIRAAoTH53SsCdqg2Eqa6usyNsw== 2023-10-06T03:04:02.521 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.3] 2023-10-06T03:04:02.521 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAPeR9lMHoBIBAABNg2tnpIkx1vAzE5Kyu2RA== 2023-10-06T03:04:02.521 INFO:teuthology.orchestra.run.smithi130.stdout:[mgr.x] 2023-10-06T03:04:02.522 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQACeR9lEgqqMRAANWCEvP6tlNAHrd170s3xTw== 2023-10-06T03:04:02.522 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.b] 2023-10-06T03:04:02.522 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQADeR9laBRSBRAAz9jzUg+VFVG1z9PAO0Bcpw== 2023-10-06T03:04:02.522 INFO:teuthology.orchestra.run.smithi130.stdout:[mds.d] 2023-10-06T03:04:02.522 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQADeR9l9PCGDBAAl8luWnwki83v799sqGJFDA== 2023-10-06T03:04:02.522 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.4] 2023-10-06T03:04:02.522 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAVeR9lprxMIRAA15Qi61mgKUyCpIS1XsYQRQ== 2023-10-06T03:04:02.523 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.5] 2023-10-06T03:04:02.523 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAYeR9lk5hfIBAAI/Z6Z6sckq0MUvmXtEqCXg== 2023-10-06T03:04:02.523 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.6] 2023-10-06T03:04:02.523 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAbeR9l8yLBHhAARHwk/X1wTrgZILmOilO4Zw== 2023-10-06T03:04:02.523 INFO:teuthology.orchestra.run.smithi130.stdout:[osd.7] 2023-10-06T03:04:02.523 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQAeeR9l9oGIHRAAtNRSqb/lHdSUjkTc+8iCOw== 2023-10-06T03:04:02.523 INFO:teuthology.orchestra.run.smithi130.stdout:[client.0] 2023-10-06T03:04:02.523 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQADeR9lYyykEBAAbm74uo9KpHwsa7BJ80s73Q== 2023-10-06T03:04:02.524 INFO:teuthology.orchestra.run.smithi130.stdout:[client.2] 2023-10-06T03:04:02.524 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQADeR9lugwkFhAABBonfXirjsQIY76fNW79Uw== 2023-10-06T03:04:02.524 INFO:teuthology.orchestra.run.smithi130.stdout:[client.1] 2023-10-06T03:04:02.524 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQADeR9lyE1DGRAA6/HFA4rX/Gas70IcoIieBw== 2023-10-06T03:04:02.524 INFO:teuthology.orchestra.run.smithi130.stdout:[client.3] 2023-10-06T03:04:02.524 INFO:teuthology.orchestra.run.smithi130.stdout: key = AQADeR9lnA7NHhAAfuAxtddpoSbQzk57JvpbuQ== 2023-10-06T03:04:02.525 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:04:02.547 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:04:02.615 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:04:02.617 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:04:02.671 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:04:02.673 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:04:02.728 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:04:02.731 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:04:02.781 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:04:02.783 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:04:02.833 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:04:02.835 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:04:02.885 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:04:02.887 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:04:02.937 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:04:02.939 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T03:04:02.989 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:04:02.991 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:04:03.044 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:04:03.046 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T03:04:03.099 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:04:03.101 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:04:03.151 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:04:03.153 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:04:03.203 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:04:03.205 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:04:03.255 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:04:03.258 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T03:04:03.308 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:04:03.310 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:04:03.363 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:04:03.365 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:04:03.417 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:04:03.419 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:04:03.472 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:04:03.475 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T03:04:03.528 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T03:04:03.542 DEBUG:teuthology.orchestra.run.smithi125:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T03:04:03.569 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T03:04:03.664 DEBUG:teuthology.orchestra.run.smithi125:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T03:04:03.691 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T03:04:03.719 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T03:04:03.814 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T03:04:03.841 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T03:04:03.908 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T03:04:04.003 DEBUG:teuthology.orchestra.run.smithi130:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T03:04:04.029 DEBUG:teuthology.orchestra.run.smithi125:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:04:04.032 DEBUG:teuthology.orchestra.run.smithi130:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T03:04:04.087 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T03:04:04.088 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T03:04:04.088 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T03:04:04.090 INFO:tasks.ceph.mon.a:Started 2023-10-06T03:04:04.090 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T03:04:04.090 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T03:04:04.129 INFO:tasks.ceph.mon.b:Started 2023-10-06T03:04:04.130 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T03:04:04.130 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T03:04:04.132 INFO:tasks.ceph.mon.c:Started 2023-10-06T03:04:04.132 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T03:04:04.132 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T03:04:04.132 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T03:04:04.134 INFO:tasks.ceph.mgr.y:Started 2023-10-06T03:04:04.134 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T03:04:04.134 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T03:04:04.136 INFO:tasks.ceph.mgr.x:Started 2023-10-06T03:04:04.136 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T03:04:04.137 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T03:04:04.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.255+0000 7f7d3748c700 1 Processor -- start 2023-10-06T03:04:04.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.255+0000 7f7d3748c700 1 -- start start 2023-10-06T03:04:04.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.256+0000 7f7d3748c700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d3015cb00 0x7f7d300b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.256+0000 7f7d3748c700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7d30068ba0 0x7f7d300cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.256+0000 7f7d3748c700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d300ca670 con 0x7f7d30067610 2023-10-06T03:04:04.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.256+0000 7f7d3748c700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d30068320 con 0x7f7d30068ba0 2023-10-06T03:04:04.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.256+0000 7f7d3748c700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30067a80 con 0x7f7d3015cb00 2023-10-06T03:04:04.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.256+0000 7f7d35228700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d3015cb00 0x7f7d300b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.256+0000 7f7d35a29700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7d30068ba0 0x7f7d300cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.256+0000 7f7d35a29700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7d30068ba0 0x7f7d300cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:35896/0 (socket says 172.21.15.125:35896) 2023-10-06T03:04:04.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.256+0000 7f7d35228700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d3015cb00 0x7f7d300b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:37490/0 (socket says 172.21.15.125:37490) 2023-10-06T03:04:04.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.256+0000 7f7d35a29700 1 -- 172.21.15.125:0/1389462297 learned_addr learned my addr 172.21.15.125:0/1389462297 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:04.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.256+0000 7f7d34a27700 1 --1- 172.21.15.125:0/1389462297 >> v1:172.21.15.130:6789/0 conn(0x7f7d30067610 0x7f7d30068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:53210/0 (socket says 172.21.15.125:53210) 2023-10-06T03:04:04.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.256+0000 7f7d35a29700 1 -- 172.21.15.125:0/1389462297 >> v2:172.21.15.130:3300/0 conn(0x7f7d30068ba0 msgr2=0x7f7d300cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-06T03:04:04.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.256+0000 7f7d35228700 1 -- 172.21.15.125:0/1389462297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d3015cb00 msgr2=0x7f7d300b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T03:04:04.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.256+0000 7f7d35a29700 1 -- 172.21.15.125:0/1389462297 >> v2:172.21.15.130:3300/0 conn(0x7f7d30068ba0 msgr2=0x7f7d300cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:04:04.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.256+0000 7f7d35228700 1 -- 172.21.15.125:0/1389462297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d3015cb00 msgr2=0x7f7d300b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T03:04:04.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.256+0000 7f7d35228700 1 --2- 172.21.15.125:0/1389462297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d3015cb00 0x7f7d300b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:04:04.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.256+0000 7f7d35a29700 1 --2- 172.21.15.125:0/1389462297 >> v2:172.21.15.130:3300/0 conn(0x7f7d30068ba0 0x7f7d300cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T03:04:04.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.256+0000 7f7d35228700 1 --2- 172.21.15.125:0/1389462297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d3015cb00 0x7f7d300b0240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:04:04.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.256+0000 7f7d35a29700 1 --2- 172.21.15.125:0/1389462297 >> v2:172.21.15.130:3300/0 conn(0x7f7d30068ba0 0x7f7d300cab00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T03:04:04.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.441+0000 7f7d27fff700 1 -- 172.21.15.125:0/1389462297 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2142112669 0 0) 0x7f7d300ca670 con 0x7f7d30067610 2023-10-06T03:04:04.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.441+0000 7f7d27fff700 1 -- 172.21.15.125:0/1389462297 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d1c003570 con 0x7f7d30067610 2023-10-06T03:04:04.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d27fff700 1 -- 172.21.15.125:0/1389462297 <== mon.1 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4031688143 0 0) 0x7f7d1c003570 con 0x7f7d30067610 2023-10-06T03:04:04.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d27fff700 1 -- 172.21.15.125:0/1389462297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d3015cb00 msgr2=0x7f7d300b0240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:04:04.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d27fff700 1 --2- 172.21.15.125:0/1389462297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d3015cb00 0x7f7d300b0240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d27fff700 1 -- 172.21.15.125:0/1389462297 >> v2:172.21.15.130:3300/0 conn(0x7f7d30068ba0 msgr2=0x7f7d300cab00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:04:04.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d27fff700 1 --2- 172.21.15.125:0/1389462297 >> v2:172.21.15.130:3300/0 conn(0x7f7d30068ba0 0x7f7d300cab00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d27fff700 1 -- 172.21.15.125:0/1389462297 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d30067d60 con 0x7f7d30067610 2023-10-06T03:04:04.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d27fff700 1 -- 172.21.15.125:0/1389462297 <== mon.1 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f7d20001470 con 0x7f7d30067610 2023-10-06T03:04:04.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d27fff700 1 -- 172.21.15.125:0/1389462297 >> v1:172.21.15.130:6789/0 conn(0x7f7d30067610 legacy=0x7f7d30068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d27fff700 1 --2- 172.21.15.125:0/1389462297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d1c003ae0 0x7f7d1c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d27fff700 1 --2- 172.21.15.125:0/1389462297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d3015cb00 0x7f7d1c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d27fff700 1 --2- 172.21.15.125:0/1389462297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d1c004d50 0x7f7d1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d27fff700 1 -- 172.21.15.125:0/1389462297 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30068320 con 0x7f7d1c004d50 2023-10-06T03:04:04.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d27fff700 1 -- 172.21.15.125:0/1389462297 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30067a80 con 0x7f7d1c003ae0 2023-10-06T03:04:04.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d27fff700 1 -- 172.21.15.125:0/1389462297 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1c00bcc0 con 0x7f7d3015cb00 2023-10-06T03:04:04.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d35a29700 1 --2- 172.21.15.125:0/1389462297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d1c004d50 0x7f7d1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d35228700 1 --2- 172.21.15.125:0/1389462297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d1c003ae0 0x7f7d1c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d34a27700 1 --2- 172.21.15.125:0/1389462297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d3015cb00 0x7f7d1c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d35a29700 1 -- 172.21.15.125:0/1389462297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d3015cb00 msgr2=0x7f7d1c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:04.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d35a29700 1 --2- 172.21.15.125:0/1389462297 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d3015cb00 0x7f7d1c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d35a29700 1 -- 172.21.15.125:0/1389462297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d1c003ae0 msgr2=0x7f7d1c003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:04.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d35a29700 1 --2- 172.21.15.125:0/1389462297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d1c003ae0 0x7f7d1c003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.442+0000 7f7d35a29700 1 -- 172.21.15.125:0/1389462297 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1c003570 con 0x7f7d1c004d50 2023-10-06T03:04:04.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.443+0000 7f7d35a29700 1 --2- 172.21.15.125:0/1389462297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d1c004d50 0x7f7d1c0051c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009650 tx=0x7f7d280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4000fa63006bdbd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:04.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.443+0000 7f7d27fff700 1 -- 172.21.15.125:0/1389462297 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28017070 con 0x7f7d1c004d50 2023-10-06T03:04:04.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.443+0000 7f7d27fff700 1 -- 172.21.15.125:0/1389462297 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2800f040 con 0x7f7d1c004d50 2023-10-06T03:04:04.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.443+0000 7f7d27fff700 1 -- 172.21.15.125:0/1389462297 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280097a0 con 0x7f7d1c004d50 2023-10-06T03:04:04.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.444+0000 7f7d3748c700 1 -- 172.21.15.125:0/1389462297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d1c004d50 msgr2=0x7f7d1c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.444+0000 7f7d3748c700 1 --2- 172.21.15.125:0/1389462297 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d1c004d50 0x7f7d1c0051c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009650 tx=0x7f7d280091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.444+0000 7f7d35a29700 1 -- 172.21.15.125:0/1389462297 reap_dead start 2023-10-06T03:04:04.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.444+0000 7f7d3748c700 1 -- 172.21.15.125:0/1389462297 shutdown_connections 2023-10-06T03:04:04.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.444+0000 7f7d3748c700 1 -- 172.21.15.125:0/1389462297 >> 172.21.15.125:0/1389462297 conn(0x7f7d300af730 msgr2=0x7f7d300afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:04.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.444+0000 7f7d3748c700 1 -- 172.21.15.125:0/1389462297 shutdown_connections 2023-10-06T03:04:04.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.444+0000 7f7d3748c700 1 -- 172.21.15.125:0/1389462297 wait complete. 2023-10-06T03:04:04.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.445+0000 7f7d3748c700 1 Processor -- start 2023-10-06T03:04:04.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.445+0000 7f7d3748c700 1 -- start start 2023-10-06T03:04:04.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.447+0000 7f7d3748c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d1c004d50 0x7f7d301560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.447+0000 7f7d3748c700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d300c5f30 0x7f7d300cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.447+0000 7f7d3748c700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d300cc510 0x7f7d300c7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:04.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.447+0000 7f7d3748c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d300c7f80 con 0x7f7d1c004d50 2023-10-06T03:04:04.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.447+0000 7f7d3748c700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d30156a40 con 0x7f7d300c5f30 2023-10-06T03:04:04.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.447+0000 7f7d3748c700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d300cc960 con 0x7f7d300cc510 2023-10-06T03:04:04.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.447+0000 7f7d35a29700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d300cc510 0x7f7d300c7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.447+0000 7f7d35a29700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d300cc510 0x7f7d300c7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:37534/0 (socket says 172.21.15.125:37534) 2023-10-06T03:04:04.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.447+0000 7f7d35a29700 1 -- 172.21.15.125:0/2199155209 learned_addr learned my addr 172.21.15.125:0/2199155209 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:04.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.447+0000 7f7d35228700 1 --2- 172.21.15.125:0/2199155209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d1c004d50 0x7f7d301560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:04.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.447+0000 7f7d35a29700 1 -- 172.21.15.125:0/2199155209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d300c5f30 msgr2=0x7f7d300cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.447+0000 7f7d35a29700 1 --2- 172.21.15.125:0/2199155209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d300c5f30 0x7f7d300cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.447+0000 7f7d35a29700 1 -- 172.21.15.125:0/2199155209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d1c004d50 msgr2=0x7f7d301560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.447+0000 7f7d35a29700 1 --2- 172.21.15.125:0/2199155209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d1c004d50 0x7f7d301560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.447+0000 7f7d35a29700 1 -- 172.21.15.125:0/2199155209 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d301550b0 con 0x7f7d300cc510 2023-10-06T03:04:04.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.447+0000 7f7d35a29700 1 --2- 172.21.15.125:0/2199155209 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d300cc510 0x7f7d300c7370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009fd0 tx=0x7f7d28017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:04.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.448+0000 7f7d257fa700 1 -- 172.21.15.125:0/2199155209 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d28009720 con 0x7f7d300cc510 2023-10-06T03:04:04.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.448+0000 7f7d257fa700 1 -- 172.21.15.125:0/2199155209 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d28026420 con 0x7f7d300cc510 2023-10-06T03:04:04.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.448+0000 7f7d3748c700 1 -- 172.21.15.125:0/2199155209 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d30155330 con 0x7f7d300cc510 2023-10-06T03:04:04.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.448+0000 7f7d257fa700 1 -- 172.21.15.125:0/2199155209 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d280267a0 con 0x7f7d300cc510 2023-10-06T03:04:04.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.448+0000 7f7d3748c700 1 -- 172.21.15.125:0/2199155209 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d301558f0 con 0x7f7d300cc510 2023-10-06T03:04:04.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.448+0000 7f7d257fa700 1 -- 172.21.15.125:0/2199155209 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7d28024070 con 0x7f7d300cc510 2023-10-06T03:04:04.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.448+0000 7f7d257fa700 1 -- 172.21.15.125:0/2199155209 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7d280303f0 con 0x7f7d300cc510 2023-10-06T03:04:04.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.449+0000 7f7d3748c700 1 -- 172.21.15.125:0/2199155209 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d30066510 con 0x7f7d300cc510 2023-10-06T03:04:04.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.451+0000 7f7d257fa700 1 -- 172.21.15.125:0/2199155209 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7d2802b020 con 0x7f7d300cc510 2023-10-06T03:04:04.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.526+0000 7f7d3748c700 1 -- 172.21.15.125:0/2199155209 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7d30068040 con 0x7f7d300cc510 2023-10-06T03:04:04.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.530+0000 7f7d257fa700 1 -- 172.21.15.125:0/2199155209 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7d28030600 con 0x7f7d300cc510 2023-10-06T03:04:04.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.530+0000 7f7d3748c700 1 -- 172.21.15.125:0/2199155209 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d300cc510 msgr2=0x7f7d300c7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:04.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.530+0000 7f7d3748c700 1 --2- 172.21.15.125:0/2199155209 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d300cc510 0x7f7d300c7370 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7d28009fd0 tx=0x7f7d28017000 comp rx=0 tx=0).stop 2023-10-06T03:04:04.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.530+0000 7f7d3748c700 1 -- 172.21.15.125:0/2199155209 shutdown_connections 2023-10-06T03:04:04.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.530+0000 7f7d3748c700 1 --2- 172.21.15.125:0/2199155209 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d300cc510 0x7f7d300c7370 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.530+0000 7f7d3748c700 1 --2- 172.21.15.125:0/2199155209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d1c004d50 0x7f7d301560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.530+0000 7f7d3748c700 1 --2- 172.21.15.125:0/2199155209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d300c5f30 0x7f7d300cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:04.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.530+0000 7f7d3748c700 1 -- 172.21.15.125:0/2199155209 >> 172.21.15.125:0/2199155209 conn(0x7f7d300af730 msgr2=0x7f7d30158310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:04.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.531+0000 7f7d3748c700 1 -- 172.21.15.125:0/2199155209 shutdown_connections 2023-10-06T03:04:04.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:04.531+0000 7f7d3748c700 1 -- 172.21.15.125:0/2199155209 wait complete. 2023-10-06T03:04:04.533 INFO:teuthology.orchestra.run.smithi125.stderr:adjusted tunables profile to default 2023-10-06T03:04:04.544 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T03:04:04.544 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:04:04.544 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T03:04:04.569 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:04.568+0000 7f55c47ea1c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T03:04:04.570 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:04.568+0000 7fc4153411c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T03:04:04.571 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:04:04.571 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T03:04:04.638 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:04:04.638 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T03:04:04.716 DEBUG:teuthology.orchestra.run.smithi125:> set -ex 2023-10-06T03:04:04.717 DEBUG:teuthology.orchestra.run.smithi125:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T03:04:04.738 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:04.737+0000 7f55c47ea1c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T03:04:04.739 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:04.737+0000 7fc4153411c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T03:04:04.765 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:04:04.766 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T03:04:04.793 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:04:04.793 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T03:04:04.859 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:04:04.860 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T03:04:04.928 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2023-10-06T03:04:04.928 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T03:04:04.995 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 7048f99f-fcc5-4f1c-87a5-7824304cda3d 0 2023-10-06T03:04:05.073 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:05.072+0000 7fc4153411c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T03:04:05.104 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:05.103+0000 7f55c47ea1c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T03:04:05.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.153+0000 7f3023eab700 1 Processor -- start 2023-10-06T03:04:05.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.153+0000 7f3023eab700 1 -- start start 2023-10-06T03:04:05.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.154+0000 7f3023eab700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f301c0c98a0 0x7f301c0c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.161 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.154+0000 7f3023eab700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f301c0caba0 0x7f301c0cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.154+0000 7f3023eab700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301c158570 con 0x7f301c140c50 2023-10-06T03:04:05.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.154+0000 7f3023eab700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f301c157770 con 0x7f301c0caba0 2023-10-06T03:04:05.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.154+0000 7f3023eab700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301c0ca250 con 0x7f301c0c98a0 2023-10-06T03:04:05.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.154+0000 7f3021446700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f301c0c98a0 0x7f301c0c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.154+0000 7f3022448700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f301c0caba0 0x7f301c0cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.154+0000 7f3021446700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f301c0c98a0 0x7f301c0c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:50136/0 (socket says 172.21.15.130:50136) 2023-10-06T03:04:05.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.154+0000 7f3022448700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f301c0caba0 0x7f301c0cb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57534/0 (socket says 172.21.15.130:57534) 2023-10-06T03:04:05.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.154+0000 7f3021446700 1 -- 172.21.15.130:0/1002807761 learned_addr learned my addr 172.21.15.130:0/1002807761 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-06T03:04:05.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.154+0000 7f3022448700 1 -- 172.21.15.130:0/1002807761 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f301c0c98a0 msgr2=0x7f301c0c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:05.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.154+0000 7f3022448700 1 --2- 172.21.15.130:0/1002807761 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f301c0c98a0 0x7f301c0c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.162 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.154+0000 7f3022448700 1 -- 172.21.15.130:0/1002807761 >> v1:172.21.15.130:6789/0 conn(0x7f301c140c50 legacy=0x7f301c0cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.154+0000 7f3020c45700 1 -- 172.21.15.130:0/1002807761 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267898880 0 0) 0x7f301c158570 con 0x7f301c140c50 2023-10-06T03:04:05.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.154+0000 7f3022448700 1 -- 172.21.15.130:0/1002807761 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301c158920 con 0x7f301c0caba0 2023-10-06T03:04:05.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.154+0000 7f3021446700 1 --2- 172.21.15.130:0/1002807761 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f301c0c98a0 0x7f301c0c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:05.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.154+0000 7f3022448700 1 --2- 172.21.15.130:0/1002807761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f301c0caba0 0x7f301c0cb020 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3014009e60 tx=0x7f3014009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74d95720fe6ad2a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:05.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.155+0000 7f3020c45700 1 -- 172.21.15.130:0/1002807761 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301400e070 con 0x7f301c0caba0 2023-10-06T03:04:05.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.155+0000 7f3020c45700 1 -- 172.21.15.130:0/1002807761 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301400bb60 con 0x7f301c0caba0 2023-10-06T03:04:05.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.155+0000 7f3020c45700 1 -- 172.21.15.130:0/1002807761 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3014012430 con 0x7f301c0caba0 2023-10-06T03:04:05.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.155+0000 7f3023eab700 1 -- 172.21.15.130:0/1002807761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f301c0caba0 msgr2=0x7f301c0cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.155+0000 7f3023eab700 1 --2- 172.21.15.130:0/1002807761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f301c0caba0 0x7f301c0cb020 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3014009e60 tx=0x7f3014009780 comp rx=0 tx=0).stop 2023-10-06T03:04:05.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.155+0000 7f3023eab700 1 -- 172.21.15.130:0/1002807761 shutdown_connections 2023-10-06T03:04:05.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.155+0000 7f3023eab700 1 --2- 172.21.15.130:0/1002807761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f301c0caba0 0x7f301c0cb020 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.163 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.155+0000 7f3023eab700 1 --2- 172.21.15.130:0/1002807761 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f301c0c98a0 0x7f301c0c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.155+0000 7f3023eab700 1 -- 172.21.15.130:0/1002807761 >> 172.21.15.130:0/1002807761 conn(0x7f301c096120 msgr2=0x7f301c068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:05.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.155+0000 7f3023eab700 1 -- 172.21.15.130:0/1002807761 shutdown_connections 2023-10-06T03:04:05.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.155+0000 7f3023eab700 1 -- 172.21.15.130:0/1002807761 wait complete. 2023-10-06T03:04:05.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.156+0000 7f3023eab700 1 Processor -- start 2023-10-06T03:04:05.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.156+0000 7f3023eab700 1 -- start start 2023-10-06T03:04:05.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.157+0000 7f3023eab700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f301c0c98a0 0x7f301c167610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.157+0000 7f3023eab700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f301c0caba0 0x7f301c13f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.157+0000 7f3023eab700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f301c140c50 0x7f301c1695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.157+0000 7f3023eab700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301c13a190 con 0x7f301c0c98a0 2023-10-06T03:04:05.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.157+0000 7f3023eab700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301c167b50 con 0x7f301c0caba0 2023-10-06T03:04:05.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.157+0000 7f3023eab700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301c13a3e0 con 0x7f301c140c50 2023-10-06T03:04:05.164 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.157+0000 7f3022448700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f301c140c50 0x7f301c1695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.157+0000 7f3022448700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f301c140c50 0x7f301c1695e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:50152/0 (socket says 172.21.15.130:50152) 2023-10-06T03:04:05.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.157+0000 7f3022448700 1 -- 172.21.15.130:0/1276635135 learned_addr learned my addr 172.21.15.130:0/1276635135 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-06T03:04:05.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.157+0000 7f3021446700 1 --2- 172.21.15.130:0/1276635135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f301c0caba0 0x7f301c13f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.157+0000 7f3021c47700 1 --2- 172.21.15.130:0/1276635135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f301c0c98a0 0x7f301c167610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.158+0000 7f3022448700 1 -- 172.21.15.130:0/1276635135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f301c0caba0 msgr2=0x7f301c13f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.158+0000 7f3022448700 1 --2- 172.21.15.130:0/1276635135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f301c0caba0 0x7f301c13f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.158+0000 7f3022448700 1 -- 172.21.15.130:0/1276635135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f301c0c98a0 msgr2=0x7f301c167610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.158+0000 7f3022448700 1 --2- 172.21.15.130:0/1276635135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f301c0c98a0 0x7f301c167610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.158+0000 7f3022448700 1 -- 172.21.15.130:0/1276635135 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300c0094f0 con 0x7f301c140c50 2023-10-06T03:04:05.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.158+0000 7f3021446700 1 --2- 172.21.15.130:0/1276635135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f301c0caba0 0x7f301c13f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:05.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.158+0000 7f3022448700 1 --2- 172.21.15.130:0/1276635135 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f301c140c50 0x7f301c1695e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f301400b6c0 tx=0x7f3014019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:05.165 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.158+0000 7f3011ffb700 1 -- 172.21.15.130:0/1276635135 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3014027470 con 0x7f301c140c50 2023-10-06T03:04:05.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.158+0000 7f3011ffb700 1 -- 172.21.15.130:0/1276635135 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30140275f0 con 0x7f301c140c50 2023-10-06T03:04:05.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.158+0000 7f3023eab700 1 -- 172.21.15.130:0/1276635135 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3014009a20 con 0x7f301c140c50 2023-10-06T03:04:05.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.158+0000 7f3011ffb700 1 -- 172.21.15.130:0/1276635135 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30140279b0 con 0x7f301c140c50 2023-10-06T03:04:05.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.158+0000 7f3023eab700 1 -- 172.21.15.130:0/1276635135 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f301c13a770 con 0x7f301c140c50 2023-10-06T03:04:05.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.158+0000 7f3011ffb700 1 -- 172.21.15.130:0/1276635135 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3014024070 con 0x7f301c140c50 2023-10-06T03:04:05.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.159+0000 7f3011ffb700 1 -- 172.21.15.130:0/1276635135 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f301401d900 con 0x7f301c140c50 2023-10-06T03:04:05.166 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.159+0000 7f3023eab700 1 -- 172.21.15.130:0/1276635135 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f301c066510 con 0x7f301c140c50 2023-10-06T03:04:05.167 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.161+0000 7f3011ffb700 1 -- 172.21.15.130:0/1276635135 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f30140466d0 con 0x7f301c140c50 2023-10-06T03:04:05.255 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.253+0000 7f3023eab700 1 -- 172.21.15.130:0/1276635135 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7048f99f-fcc5-4f1c-87a5-7824304cda3d", "id": 0} v 0) v1 -- 0x7f301c157960 con 0x7f301c140c50 2023-10-06T03:04:05.260 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.259+0000 7f3011ffb700 1 -- 172.21.15.130:0/1276635135 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7048f99f-fcc5-4f1c-87a5-7824304cda3d", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3014035030 con 0x7f301c140c50 2023-10-06T03:04:05.260 INFO:teuthology.orchestra.run.smithi130.stdout:0 2023-10-06T03:04:05.261 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.260+0000 7f3023eab700 1 -- 172.21.15.130:0/1276635135 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f301c140c50 msgr2=0x7f301c1695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.260+0000 7f3023eab700 1 --2- 172.21.15.130:0/1276635135 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f301c140c50 0x7f301c1695e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f301400b6c0 tx=0x7f3014019000 comp rx=0 tx=0).stop 2023-10-06T03:04:05.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.260+0000 7f3023eab700 1 -- 172.21.15.130:0/1276635135 shutdown_connections 2023-10-06T03:04:05.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.260+0000 7f3023eab700 1 --2- 172.21.15.130:0/1276635135 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f301c140c50 0x7f301c1695e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.260+0000 7f3023eab700 1 --2- 172.21.15.130:0/1276635135 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f301c0c98a0 0x7f301c167610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.260+0000 7f3023eab700 1 --2- 172.21.15.130:0/1276635135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f301c0caba0 0x7f301c13f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.260+0000 7f3023eab700 1 -- 172.21.15.130:0/1276635135 >> 172.21.15.130:0/1276635135 conn(0x7f301c096120 msgr2=0x7f301c06cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:05.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.260+0000 7f3023eab700 1 -- 172.21.15.130:0/1276635135 shutdown_connections 2023-10-06T03:04:05.262 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.260+0000 7f3023eab700 1 -- 172.21.15.130:0/1276635135 wait complete. 2023-10-06T03:04:05.273 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new a7aa419c-25ca-4cff-adb8-ceb167c3c018 1 2023-10-06T03:04:05.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.391+0000 7faec4950700 1 Processor -- start 2023-10-06T03:04:05.393 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.391+0000 7faec4950700 1 -- start start 2023-10-06T03:04:05.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.393+0000 7faec4950700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faec00af320 0x7faec00cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.393+0000 7faec4950700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faec00c8320 0x7faec00c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.393+0000 7faec4950700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec00c9470 con 0x7faec00cb880 2023-10-06T03:04:05.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.393+0000 7faec4950700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec00c9b40 con 0x7faec00c8320 2023-10-06T03:04:05.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.393+0000 7faec4950700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec00c8860 con 0x7faec00af320 2023-10-06T03:04:05.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.393+0000 7faebe59c700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faec00af320 0x7faec00cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.393+0000 7faebe59c700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7faec00af320 0x7faec00cb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57552/0 (socket says 172.21.15.130:57552) 2023-10-06T03:04:05.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.393+0000 7faebe59c700 1 -- 172.21.15.130:0/1725542198 learned_addr learned my addr 172.21.15.130:0/1725542198 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-06T03:04:05.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.393+0000 7faebed9d700 1 --2- 172.21.15.130:0/1725542198 >> v2:172.21.15.125:3300/0 conn(0x7faec00c8320 0x7faec00c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.393+0000 7faebe59c700 1 -- 172.21.15.130:0/1725542198 >> v2:172.21.15.125:3300/0 conn(0x7faec00c8320 msgr2=0x7faec00c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:05.396 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.393+0000 7faebe59c700 1 --2- 172.21.15.130:0/1725542198 >> v2:172.21.15.125:3300/0 conn(0x7faec00c8320 0x7faec00c1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.393+0000 7faebe59c700 1 -- 172.21.15.130:0/1725542198 >> v1:172.21.15.125:6789/0 conn(0x7faec00cb880 legacy=0x7faec00c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.393+0000 7faebe59c700 1 -- 172.21.15.130:0/1725542198 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec00cbcf0 con 0x7faec00af320 2023-10-06T03:04:05.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.393+0000 7faebe59c700 1 --2- 172.21.15.130:0/1725542198 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faec00af320 0x7faec00cb340 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faec00cce30 tx=0x7faeb0009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31582da962dba569 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:05.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.393+0000 7faebd59a700 1 -- 172.21.15.130:0/1725542198 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb0005c10 con 0x7faec00af320 2023-10-06T03:04:05.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.393+0000 7faebd59a700 1 -- 172.21.15.130:0/1725542198 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb0005d70 con 0x7faec00af320 2023-10-06T03:04:05.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.393+0000 7faebd59a700 1 -- 172.21.15.130:0/1725542198 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb0006260 con 0x7faec00af320 2023-10-06T03:04:05.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.394+0000 7faec4950700 1 -- 172.21.15.130:0/1725542198 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faec00af320 msgr2=0x7faec00cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.394+0000 7faec4950700 1 --2- 172.21.15.130:0/1725542198 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faec00af320 0x7faec00cb340 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7faec00cce30 tx=0x7faeb0009220 comp rx=0 tx=0).stop 2023-10-06T03:04:05.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.394+0000 7faec4950700 1 -- 172.21.15.130:0/1725542198 shutdown_connections 2023-10-06T03:04:05.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.394+0000 7faec4950700 1 --2- 172.21.15.130:0/1725542198 >> v2:172.21.15.125:3300/0 conn(0x7faec00c8320 0x7faec00c1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.394+0000 7faec4950700 1 --2- 172.21.15.130:0/1725542198 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faec00af320 0x7faec00cb340 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.397 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.394+0000 7faec4950700 1 -- 172.21.15.130:0/1725542198 >> 172.21.15.130:0/1725542198 conn(0x7faec0096120 msgr2=0x7faec0068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:05.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.394+0000 7faec4950700 1 -- 172.21.15.130:0/1725542198 shutdown_connections 2023-10-06T03:04:05.398 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.394+0000 7faec4950700 1 -- 172.21.15.130:0/1725542198 wait complete. 2023-10-06T03:04:05.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.395+0000 7faec4950700 1 Processor -- start 2023-10-06T03:04:05.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.395+0000 7faec4950700 1 -- start start 2023-10-06T03:04:05.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.396+0000 7faec4950700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faec00af320 0x7faec00c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.396+0000 7faec4950700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faec00c8320 0x7faec015a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.400 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.396+0000 7faec4950700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faec00cb880 0x7faec0154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.396+0000 7faec4950700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec015a5e0 con 0x7faec00af320 2023-10-06T03:04:05.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.396+0000 7faec4950700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec015a8b0 con 0x7faec00cb880 2023-10-06T03:04:05.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.396+0000 7faec4950700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec015ab90 con 0x7faec00c8320 2023-10-06T03:04:05.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.396+0000 7faebed9d700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faec00cb880 0x7faec0154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.396+0000 7faebe59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faec00af320 0x7faec00c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.396+0000 7faebdd9b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faec00c8320 0x7faec015a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.396+0000 7faebed9d700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faec00cb880 0x7faec0154ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57560/0 (socket says 172.21.15.130:57560) 2023-10-06T03:04:05.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.396+0000 7faebe59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faec00af320 0x7faec00c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.130:34920/0 (socket says 172.21.15.130:34920) 2023-10-06T03:04:05.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.396+0000 7faebed9d700 1 -- 172.21.15.130:0/1438768700 learned_addr learned my addr 172.21.15.130:0/1438768700 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-06T03:04:05.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.397+0000 7faebdd9b700 1 -- 172.21.15.130:0/1438768700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faec00cb880 msgr2=0x7faec0154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.397+0000 7faebdd9b700 1 --2- 172.21.15.130:0/1438768700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faec00cb880 0x7faec0154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.401 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.397+0000 7faebdd9b700 1 -- 172.21.15.130:0/1438768700 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faec00af320 msgr2=0x7faec00c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.397+0000 7faebdd9b700 1 --2- 172.21.15.130:0/1438768700 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faec00af320 0x7faec00c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.397+0000 7faebdd9b700 1 -- 172.21.15.130:0/1438768700 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb0009480 con 0x7faec00c8320 2023-10-06T03:04:05.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.397+0000 7faebed9d700 1 --2- 172.21.15.130:0/1438768700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faec00cb880 0x7faec0154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:05.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.397+0000 7faebe59c700 1 --2- 172.21.15.130:0/1438768700 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faec00af320 0x7faec00c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:05.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.397+0000 7faebdd9b700 1 --2- 172.21.15.130:0/1438768700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faec00c8320 0x7faec015a0a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faeb400c490 tx=0x7faeb4007ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:05.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.397+0000 7faeae7fc700 1 -- 172.21.15.130:0/1438768700 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb400ce40 con 0x7faec00c8320 2023-10-06T03:04:05.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.397+0000 7faeae7fc700 1 -- 172.21.15.130:0/1438768700 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb4011590 con 0x7faec00c8320 2023-10-06T03:04:05.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.397+0000 7faec4950700 1 -- 172.21.15.130:0/1438768700 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec015ae70 con 0x7faec00c8320 2023-10-06T03:04:05.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.397+0000 7faeae7fc700 1 -- 172.21.15.130:0/1438768700 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb4011950 con 0x7faec00c8320 2023-10-06T03:04:05.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.397+0000 7faec4950700 1 -- 172.21.15.130:0/1438768700 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec00afc70 con 0x7faec00c8320 2023-10-06T03:04:05.402 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.397+0000 7faeae7fc700 1 -- 172.21.15.130:0/1438768700 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7faeb401c440 con 0x7faec00c8320 2023-10-06T03:04:05.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.397+0000 7faeae7fc700 1 -- 172.21.15.130:0/1438768700 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7faeb40127e0 con 0x7faec00c8320 2023-10-06T03:04:05.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.398+0000 7faec4950700 1 -- 172.21.15.130:0/1438768700 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec00afe90 con 0x7faec00c8320 2023-10-06T03:04:05.403 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.400+0000 7faeae7fc700 1 -- 172.21.15.130:0/1438768700 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7faeb4017070 con 0x7faec00c8320 2023-10-06T03:04:05.486 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.484+0000 7faec4950700 1 -- 172.21.15.130:0/1438768700 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a7aa419c-25ca-4cff-adb8-ceb167c3c018", "id": 1} v 0) v1 -- 0x7faec0066510 con 0x7faec00c8320 2023-10-06T03:04:05.493 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.492+0000 7faeae7fc700 1 -- 172.21.15.130:0/1438768700 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7aa419c-25ca-4cff-adb8-ceb167c3c018", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7faeb4000fe0 con 0x7faec00c8320 2023-10-06T03:04:05.493 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-10-06T03:04:05.494 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.493+0000 7faec4950700 1 -- 172.21.15.130:0/1438768700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faec00c8320 msgr2=0x7faec015a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.493+0000 7faec4950700 1 --2- 172.21.15.130:0/1438768700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faec00c8320 0x7faec015a0a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faeb400c490 tx=0x7faeb4007ec0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.493+0000 7faec4950700 1 -- 172.21.15.130:0/1438768700 shutdown_connections 2023-10-06T03:04:05.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.493+0000 7faec4950700 1 --2- 172.21.15.130:0/1438768700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faec00cb880 0x7faec0154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.493+0000 7faec4950700 1 --2- 172.21.15.130:0/1438768700 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faec00af320 0x7faec00c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.493+0000 7faec4950700 1 --2- 172.21.15.130:0/1438768700 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faec00c8320 0x7faec015a0a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.493+0000 7faec4950700 1 -- 172.21.15.130:0/1438768700 >> 172.21.15.130:0/1438768700 conn(0x7faec0096120 msgr2=0x7faec0067610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:05.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.493+0000 7faec4950700 1 -- 172.21.15.130:0/1438768700 shutdown_connections 2023-10-06T03:04:05.495 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.493+0000 7faec4950700 1 -- 172.21.15.130:0/1438768700 wait complete. 2023-10-06T03:04:05.506 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 267967b9-c8b2-4986-a03c-c0c6fdd9f904 2 2023-10-06T03:04:05.561 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:05.560+0000 7fc4153411c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T03:04:05.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.622+0000 7ff86e5c4700 1 Processor -- start 2023-10-06T03:04:05.624 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.622+0000 7ff86e5c4700 1 -- start start 2023-10-06T03:04:05.625 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.623+0000 7ff86e5c4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff868067610 0x7ff8680b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.623+0000 7ff86e5c4700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff868068ba0 0x7ff8680cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.623+0000 7ff86e5c4700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8680ca670 con 0x7ff86815cb00 2023-10-06T03:04:05.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.623+0000 7ff86e5c4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff868068320 con 0x7ff868067610 2023-10-06T03:04:05.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.623+0000 7ff86e5c4700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff868067a80 con 0x7ff868068ba0 2023-10-06T03:04:05.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.623+0000 7ff867fff700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff86815cb00 0x7ff868068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:57834/0 (socket says 172.21.15.130:57834) 2023-10-06T03:04:05.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.623+0000 7ff86cb61700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff868068ba0 0x7ff8680cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.623+0000 7ff867fff700 1 -- 172.21.15.130:0/1712089197 learned_addr learned my addr 172.21.15.130:0/1712089197 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-10-06T03:04:05.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.624+0000 7ff8677fe700 1 --2- 172.21.15.130:0/1712089197 >> v2:172.21.15.125:3300/0 conn(0x7ff868067610 0x7ff8680b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.626 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.624+0000 7ff86cb61700 1 -- 172.21.15.130:0/1712089197 >> v2:172.21.15.125:3300/0 conn(0x7ff868067610 msgr2=0x7ff8680b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:05.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.624+0000 7ff86cb61700 1 --2- 172.21.15.130:0/1712089197 >> v2:172.21.15.125:3300/0 conn(0x7ff868067610 0x7ff8680b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.624+0000 7ff86cb61700 1 -- 172.21.15.130:0/1712089197 >> v1:172.21.15.130:6789/0 conn(0x7ff86815cb00 legacy=0x7ff868068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.624+0000 7ff86cb61700 1 -- 172.21.15.130:0/1712089197 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff868067d60 con 0x7ff868068ba0 2023-10-06T03:04:05.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.624+0000 7ff866ffd700 1 -- 172.21.15.130:0/1712089197 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053223642 0 0) 0x7ff8680ca670 con 0x7ff86815cb00 2023-10-06T03:04:05.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.624+0000 7ff86cb61700 1 --2- 172.21.15.130:0/1712089197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff868068ba0 0x7ff8680cab00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff86806ea90 tx=0x7ff860009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cef4fcf0b04393cb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:05.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.624+0000 7ff866ffd700 1 -- 172.21.15.130:0/1712089197 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86000e070 con 0x7ff868068ba0 2023-10-06T03:04:05.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.624+0000 7ff866ffd700 1 -- 172.21.15.130:0/1712089197 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86000bb60 con 0x7ff868068ba0 2023-10-06T03:04:05.627 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.624+0000 7ff866ffd700 1 -- 172.21.15.130:0/1712089197 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff860012430 con 0x7ff868068ba0 2023-10-06T03:04:05.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.625+0000 7ff86e5c4700 1 -- 172.21.15.130:0/1712089197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff868068ba0 msgr2=0x7ff8680cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.630 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.625+0000 7ff86e5c4700 1 --2- 172.21.15.130:0/1712089197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff868068ba0 0x7ff8680cab00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff86806ea90 tx=0x7ff860009780 comp rx=0 tx=0).stop 2023-10-06T03:04:05.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.625+0000 7ff86e5c4700 1 -- 172.21.15.130:0/1712089197 shutdown_connections 2023-10-06T03:04:05.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.625+0000 7ff86e5c4700 1 --2- 172.21.15.130:0/1712089197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff868068ba0 0x7ff8680cab00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.625+0000 7ff86e5c4700 1 --2- 172.21.15.130:0/1712089197 >> v2:172.21.15.125:3300/0 conn(0x7ff868067610 0x7ff8680b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.625+0000 7ff86e5c4700 1 -- 172.21.15.130:0/1712089197 >> 172.21.15.130:0/1712089197 conn(0x7ff8680af730 msgr2=0x7ff8680afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:05.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.625+0000 7ff86e5c4700 1 -- 172.21.15.130:0/1712089197 shutdown_connections 2023-10-06T03:04:05.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.625+0000 7ff86e5c4700 1 -- 172.21.15.130:0/1712089197 wait complete. 2023-10-06T03:04:05.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.626+0000 7ff86e5c4700 1 Processor -- start 2023-10-06T03:04:05.631 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.626+0000 7ff86e5c4700 1 -- start start 2023-10-06T03:04:05.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.627+0000 7ff86e5c4700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff868067610 0x7ff86815ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.627+0000 7ff86e5c4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff868068ba0 0x7ff86814e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.627+0000 7ff86e5c4700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff86815cb00 0x7ff8680cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.627+0000 7ff86e5c4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8681500b0 con 0x7ff868068ba0 2023-10-06T03:04:05.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.627+0000 7ff86e5c4700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8680c66e0 con 0x7ff868067610 2023-10-06T03:04:05.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.627+0000 7ff86e5c4700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86815d560 con 0x7ff86815cb00 2023-10-06T03:04:05.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.627+0000 7ff867fff700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff868067610 0x7ff86815ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.627+0000 7ff867fff700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff868067610 0x7ff86815ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57578/0 (socket says 172.21.15.130:57578) 2023-10-06T03:04:05.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.627+0000 7ff867fff700 1 -- 172.21.15.130:0/3752397416 learned_addr learned my addr 172.21.15.130:0/3752397416 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-06T03:04:05.632 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.627+0000 7ff86cb61700 1 --2- 172.21.15.130:0/3752397416 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff86815cb00 0x7ff8680cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.627+0000 7ff8677fe700 1 --2- 172.21.15.130:0/3752397416 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff868068ba0 0x7ff86814e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.627+0000 7ff867fff700 1 -- 172.21.15.130:0/3752397416 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff86815cb00 msgr2=0x7ff8680cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.627+0000 7ff867fff700 1 --2- 172.21.15.130:0/3752397416 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff86815cb00 0x7ff8680cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.627+0000 7ff867fff700 1 -- 172.21.15.130:0/3752397416 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff868068ba0 msgr2=0x7ff86814e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.627+0000 7ff867fff700 1 --2- 172.21.15.130:0/3752397416 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff868068ba0 0x7ff86814e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.627+0000 7ff867fff700 1 -- 172.21.15.130:0/3752397416 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff860009a20 con 0x7ff868067610 2023-10-06T03:04:05.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.627+0000 7ff86cb61700 1 --2- 172.21.15.130:0/3752397416 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff86815cb00 0x7ff8680cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:05.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.627+0000 7ff8677fe700 1 --2- 172.21.15.130:0/3752397416 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff868068ba0 0x7ff86814e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:05.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.627+0000 7ff867fff700 1 --2- 172.21.15.130:0/3752397416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff868067610 0x7ff86815ced0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff85800c5e0 tx=0x7ff858007e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:05.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.628+0000 7ff84ffff700 1 -- 172.21.15.130:0/3752397416 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8580072e0 con 0x7ff868067610 2023-10-06T03:04:05.633 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.628+0000 7ff84ffff700 1 -- 172.21.15.130:0/3752397416 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff858007460 con 0x7ff868067610 2023-10-06T03:04:05.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.628+0000 7ff84ffff700 1 -- 172.21.15.130:0/3752397416 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8580057f0 con 0x7ff868067610 2023-10-06T03:04:05.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.628+0000 7ff86e5c4700 1 -- 172.21.15.130:0/3752397416 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff86815d840 con 0x7ff868067610 2023-10-06T03:04:05.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.628+0000 7ff86e5c4700 1 -- 172.21.15.130:0/3752397416 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86815de00 con 0x7ff868067610 2023-10-06T03:04:05.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.628+0000 7ff84ffff700 1 -- 172.21.15.130:0/3752397416 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff85801c440 con 0x7ff868067610 2023-10-06T03:04:05.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.628+0000 7ff84ffff700 1 -- 172.21.15.130:0/3752397416 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7ff858012830 con 0x7ff868067610 2023-10-06T03:04:05.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.629+0000 7ff86e5c4700 1 -- 172.21.15.130:0/3752397416 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff868066510 con 0x7ff868067610 2023-10-06T03:04:05.634 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.632+0000 7ff84ffff700 1 -- 172.21.15.130:0/3752397416 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff858017070 con 0x7ff868067610 2023-10-06T03:04:05.636 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:05.635+0000 7f55c47ea1c0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T03:04:05.698 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:05.696+0000 7fc4153411c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T03:04:05.715 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.714+0000 7ff86e5c4700 1 -- 172.21.15.130:0/3752397416 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "267967b9-c8b2-4986-a03c-c0c6fdd9f904", "id": 2} v 0) v1 -- 0x7ff868068040 con 0x7ff868067610 2023-10-06T03:04:05.723 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.722+0000 7ff84ffff700 1 -- 172.21.15.130:0/3752397416 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "267967b9-c8b2-4986-a03c-c0c6fdd9f904", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff85801c920 con 0x7ff868067610 2023-10-06T03:04:05.723 INFO:teuthology.orchestra.run.smithi130.stdout:2 2023-10-06T03:04:05.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.722+0000 7ff86e5c4700 1 -- 172.21.15.130:0/3752397416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff868067610 msgr2=0x7ff86815ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.724 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.722+0000 7ff86e5c4700 1 --2- 172.21.15.130:0/3752397416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff868067610 0x7ff86815ced0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff85800c5e0 tx=0x7ff858007e80 comp rx=0 tx=0).stop 2023-10-06T03:04:05.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.722+0000 7ff86e5c4700 1 -- 172.21.15.130:0/3752397416 shutdown_connections 2023-10-06T03:04:05.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.722+0000 7ff86e5c4700 1 --2- 172.21.15.130:0/3752397416 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff86815cb00 0x7ff8680cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.722+0000 7ff86e5c4700 1 --2- 172.21.15.130:0/3752397416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff868067610 0x7ff86815ced0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.722+0000 7ff86e5c4700 1 --2- 172.21.15.130:0/3752397416 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff868068ba0 0x7ff86814e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.723+0000 7ff86e5c4700 1 -- 172.21.15.130:0/3752397416 >> 172.21.15.130:0/3752397416 conn(0x7ff8680af730 msgr2=0x7ff86814f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:05.725 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.723+0000 7ff86e5c4700 1 -- 172.21.15.130:0/3752397416 shutdown_connections 2023-10-06T03:04:05.726 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.723+0000 7ff86e5c4700 1 -- 172.21.15.130:0/3752397416 wait complete. 2023-10-06T03:04:05.735 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb 3 2023-10-06T03:04:05.781 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:05.780+0000 7f55c47ea1c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T03:04:05.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.855+0000 7fec736db700 1 Processor -- start 2023-10-06T03:04:05.857 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.855+0000 7fec736db700 1 -- start start 2023-10-06T03:04:05.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.856+0000 7fec736db700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fec6c0ccaf0 0x7fec6c0b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.856+0000 7fec736db700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6c0b0020 con 0x7fec6c0692e0 2023-10-06T03:04:05.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.856+0000 7fec736db700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec6c0697b0 con 0x7fec6c0b2290 2023-10-06T03:04:05.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.856+0000 7fec736db700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec6c069a90 con 0x7fec6c0ccaf0 2023-10-06T03:04:05.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.856+0000 7fec71c78700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fec6c0ccaf0 0x7fec6c0b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.856+0000 7fec71c78700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fec6c0ccaf0 0x7fec6c0b2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57584/0 (socket says 172.21.15.130:57584) 2023-10-06T03:04:05.860 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.856+0000 7fec71477700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fec6c0b2290 0x7fec6c068bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:57840/0 (socket says 172.21.15.130:57840) 2023-10-06T03:04:05.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.856+0000 7fec71c78700 1 -- 172.21.15.130:0/831037491 learned_addr learned my addr 172.21.15.130:0/831037491 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-06T03:04:05.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.856+0000 7fec71c78700 1 -- 172.21.15.130:0/831037491 >> v1:172.21.15.130:6789/0 conn(0x7fec6c0b2290 legacy=0x7fec6c068bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.856+0000 7fec71c78700 1 -- 172.21.15.130:0/831037491 >> v1:172.21.15.125:6789/0 conn(0x7fec6c0692e0 legacy=0x7fec6c158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.856+0000 7fec71c78700 1 -- 172.21.15.130:0/831037491 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec6c0cb000 con 0x7fec6c0ccaf0 2023-10-06T03:04:05.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.856+0000 7fec71c78700 1 --2- 172.21.15.130:0/831037491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec6c0ccaf0 0x7fec6c0b2660 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fec64009f20 tx=0x7fec64009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9f2c32f1a10d839 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:05.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.857+0000 7fec63fff700 1 -- 172.21.15.130:0/831037491 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6400e070 con 0x7fec6c0ccaf0 2023-10-06T03:04:05.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.857+0000 7fec63fff700 1 -- 172.21.15.130:0/831037491 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6400ba80 con 0x7fec6c0ccaf0 2023-10-06T03:04:05.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.857+0000 7fec63fff700 1 -- 172.21.15.130:0/831037491 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec640092e0 con 0x7fec6c0ccaf0 2023-10-06T03:04:05.861 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.857+0000 7fec736db700 1 -- 172.21.15.130:0/831037491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec6c0ccaf0 msgr2=0x7fec6c0b2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.857+0000 7fec736db700 1 --2- 172.21.15.130:0/831037491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec6c0ccaf0 0x7fec6c0b2660 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fec64009f20 tx=0x7fec64009840 comp rx=0 tx=0).stop 2023-10-06T03:04:05.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.857+0000 7fec736db700 1 -- 172.21.15.130:0/831037491 shutdown_connections 2023-10-06T03:04:05.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.857+0000 7fec736db700 1 --2- 172.21.15.130:0/831037491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec6c0ccaf0 0x7fec6c0b2660 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.857+0000 7fec736db700 1 -- 172.21.15.130:0/831037491 >> 172.21.15.130:0/831037491 conn(0x7fec6c06ed40 msgr2=0x7fec6c06f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:05.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.857+0000 7fec736db700 1 -- 172.21.15.130:0/831037491 shutdown_connections 2023-10-06T03:04:05.862 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.857+0000 7fec736db700 1 -- 172.21.15.130:0/831037491 wait complete. 2023-10-06T03:04:05.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.859+0000 7fec736db700 1 Processor -- start 2023-10-06T03:04:05.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.859+0000 7fec736db700 1 -- start start 2023-10-06T03:04:05.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.860+0000 7fec736db700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec6c0692e0 0x7fec6c1698f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.860+0000 7fec736db700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec6c0b2290 0x7fec6c0b3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.860+0000 7fec736db700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec6c0ccaf0 0x7fec6c16c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:05.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.860+0000 7fec736db700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c0c7d50 con 0x7fec6c0692e0 2023-10-06T03:04:05.866 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.860+0000 7fec736db700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c0ca010 con 0x7fec6c0ccaf0 2023-10-06T03:04:05.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.860+0000 7fec736db700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6c169e30 con 0x7fec6c0b2290 2023-10-06T03:04:05.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.860+0000 7fec71c78700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec6c0ccaf0 0x7fec6c16c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.860+0000 7fec70c76700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec6c0b2290 0x7fec6c0b3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:05.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.860+0000 7fec71c78700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec6c0ccaf0 0x7fec6c16c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57586/0 (socket says 172.21.15.130:57586) 2023-10-06T03:04:05.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.860+0000 7fec71c78700 1 -- 172.21.15.130:0/1260903206 learned_addr learned my addr 172.21.15.130:0/1260903206 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-06T03:04:05.867 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.860+0000 7fec71c78700 1 -- 172.21.15.130:0/1260903206 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec6c0b2290 msgr2=0x7fec6c0b3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.860+0000 7fec71c78700 1 --2- 172.21.15.130:0/1260903206 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec6c0b2290 0x7fec6c0b3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.860+0000 7fec71c78700 1 -- 172.21.15.130:0/1260903206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec6c0692e0 msgr2=0x7fec6c1698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.860+0000 7fec71c78700 1 --2- 172.21.15.130:0/1260903206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec6c0692e0 0x7fec6c1698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.860+0000 7fec71c78700 1 -- 172.21.15.130:0/1260903206 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec64009ae0 con 0x7fec6c0ccaf0 2023-10-06T03:04:05.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.860+0000 7fec71c78700 1 --2- 172.21.15.130:0/1260903206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec6c0ccaf0 0x7fec6c16c2a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0cff80 tx=0x7fec64018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:05.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.861+0000 7fec617fa700 1 -- 172.21.15.130:0/1260903206 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec64008dd0 con 0x7fec6c0ccaf0 2023-10-06T03:04:05.868 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.861+0000 7fec617fa700 1 -- 172.21.15.130:0/1260903206 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec64026460 con 0x7fec6c0ccaf0 2023-10-06T03:04:05.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.861+0000 7fec736db700 1 -- 172.21.15.130:0/1260903206 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec6c159660 con 0x7fec6c0ccaf0 2023-10-06T03:04:05.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.861+0000 7fec617fa700 1 -- 172.21.15.130:0/1260903206 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec64026800 con 0x7fec6c0ccaf0 2023-10-06T03:04:05.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.861+0000 7fec736db700 1 -- 172.21.15.130:0/1260903206 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6c159ca0 con 0x7fec6c0ccaf0 2023-10-06T03:04:05.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.861+0000 7fec617fa700 1 -- 172.21.15.130:0/1260903206 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fec64003040 con 0x7fec6c0ccaf0 2023-10-06T03:04:05.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.861+0000 7fec617fa700 1 -- 172.21.15.130:0/1260903206 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7fec6401d960 con 0x7fec6c0ccaf0 2023-10-06T03:04:05.869 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.862+0000 7fec56ffd700 1 -- 172.21.15.130:0/1260903206 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec440052b0 con 0x7fec6c0ccaf0 2023-10-06T03:04:05.870 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.864+0000 7fec617fa700 1 -- 172.21.15.130:0/1260903206 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fec64021070 con 0x7fec6c0ccaf0 2023-10-06T03:04:05.948 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.946+0000 7fec56ffd700 1 -- 172.21.15.130:0/1260903206 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb", "id": 3} v 0) v1 -- 0x7fec44005870 con 0x7fec6c0ccaf0 2023-10-06T03:04:05.955 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.954+0000 7fec617fa700 1 -- 172.21.15.130:0/1260903206 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fec64026bf0 con 0x7fec6c0ccaf0 2023-10-06T03:04:05.955 INFO:teuthology.orchestra.run.smithi130.stdout:3 2023-10-06T03:04:05.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.955+0000 7fec56ffd700 1 -- 172.21.15.130:0/1260903206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec6c0ccaf0 msgr2=0x7fec6c16c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:05.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.955+0000 7fec56ffd700 1 --2- 172.21.15.130:0/1260903206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec6c0ccaf0 0x7fec6c16c2a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fec6c0cff80 tx=0x7fec64018000 comp rx=0 tx=0).stop 2023-10-06T03:04:05.956 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.955+0000 7fec56ffd700 1 -- 172.21.15.130:0/1260903206 shutdown_connections 2023-10-06T03:04:05.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.955+0000 7fec56ffd700 1 --2- 172.21.15.130:0/1260903206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec6c0ccaf0 0x7fec6c16c2a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.955+0000 7fec56ffd700 1 --2- 172.21.15.130:0/1260903206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec6c0692e0 0x7fec6c1698f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.955+0000 7fec56ffd700 1 --2- 172.21.15.130:0/1260903206 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec6c0b2290 0x7fec6c0b3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:05.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.955+0000 7fec56ffd700 1 -- 172.21.15.130:0/1260903206 >> 172.21.15.130:0/1260903206 conn(0x7fec6c06ed40 msgr2=0x7fec6c06f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:05.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.955+0000 7fec56ffd700 1 -- 172.21.15.130:0/1260903206 shutdown_connections 2023-10-06T03:04:05.957 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:05.955+0000 7fec56ffd700 1 -- 172.21.15.130:0/1260903206 wait complete. 2023-10-06T03:04:05.968 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 1767280f-d693-4502-b223-abed8add890b 4 2023-10-06T03:04:06.046 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:06.045+0000 7fc4153411c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T03:04:06.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.085+0000 7f60ad58b700 1 Processor -- start 2023-10-06T03:04:06.086 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.085+0000 7f60ad58b700 1 -- start start 2023-10-06T03:04:06.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.086+0000 7f60ad58b700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f60a80af320 0x7f60a80cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.086+0000 7f60ad58b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60a80cb880 0x7f60a80c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.086+0000 7f60ad58b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a80c9470 con 0x7f60a80c8150 2023-10-06T03:04:06.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.086+0000 7f60ad58b700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a80c9b40 con 0x7f60a80af320 2023-10-06T03:04:06.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.086+0000 7f60ad58b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a80c85a0 con 0x7f60a80cb880 2023-10-06T03:04:06.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.086+0000 7f60a67fc700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60a80cb880 0x7f60a80c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.089 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.086+0000 7f60a6ffd700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f60a80af320 0x7f60a80cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.086+0000 7f60a67fc700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60a80cb880 0x7f60a80c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:50198/0 (socket says 172.21.15.130:50198) 2023-10-06T03:04:06.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.086+0000 7f60a67fc700 1 -- 172.21.15.130:0/924081434 learned_addr learned my addr 172.21.15.130:0/924081434 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-06T03:04:06.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.086+0000 7f60a67fc700 1 -- 172.21.15.130:0/924081434 >> v2:172.21.15.130:3300/0 conn(0x7f60a80af320 msgr2=0x7f60a80cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:06.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.086+0000 7f60a67fc700 1 --2- 172.21.15.130:0/924081434 >> v2:172.21.15.130:3300/0 conn(0x7f60a80af320 0x7f60a80cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.086+0000 7f60a67fc700 1 -- 172.21.15.130:0/924081434 >> v1:172.21.15.125:6789/0 conn(0x7f60a80c8150 legacy=0x7f60a81565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.086+0000 7f60a67fc700 1 -- 172.21.15.130:0/924081434 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a80cbcf0 con 0x7f60a80cb880 2023-10-06T03:04:06.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.086+0000 7f60a6ffd700 1 --2- 172.21.15.130:0/924081434 >> v2:172.21.15.130:3300/0 conn(0x7f60a80af320 0x7f60a80cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:06.090 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.086+0000 7f60a67fc700 1 --2- 172.21.15.130:0/924081434 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60a80cb880 0x7f60a80c7c10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f609c0099b0 tx=0x7f609c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0a50a70c4103e2c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:06.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.086+0000 7f60a5ffb700 1 -- 172.21.15.130:0/924081434 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c009ea0 con 0x7f60a80cb880 2023-10-06T03:04:06.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.087+0000 7f60a5ffb700 1 -- 172.21.15.130:0/924081434 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c00b860 con 0x7f60a80cb880 2023-10-06T03:04:06.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.087+0000 7f60a5ffb700 1 -- 172.21.15.130:0/924081434 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c00bc00 con 0x7f60a80cb880 2023-10-06T03:04:06.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.087+0000 7f60ad58b700 1 -- 172.21.15.130:0/924081434 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60a80cb880 msgr2=0x7f60a80c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.087+0000 7f60ad58b700 1 --2- 172.21.15.130:0/924081434 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60a80cb880 0x7f60a80c7c10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f609c0099b0 tx=0x7f609c009250 comp rx=0 tx=0).stop 2023-10-06T03:04:06.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.087+0000 7f60ad58b700 1 -- 172.21.15.130:0/924081434 shutdown_connections 2023-10-06T03:04:06.091 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.087+0000 7f60ad58b700 1 --2- 172.21.15.130:0/924081434 >> v2:172.21.15.130:3300/0 conn(0x7f60a80af320 0x7f60a80cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.087+0000 7f60ad58b700 1 --2- 172.21.15.130:0/924081434 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60a80cb880 0x7f60a80c7c10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.087+0000 7f60ad58b700 1 -- 172.21.15.130:0/924081434 >> 172.21.15.130:0/924081434 conn(0x7f60a8096120 msgr2=0x7f60a8068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:06.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.087+0000 7f60ad58b700 1 -- 172.21.15.130:0/924081434 shutdown_connections 2023-10-06T03:04:06.092 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.087+0000 7f60ad58b700 1 -- 172.21.15.130:0/924081434 wait complete. 2023-10-06T03:04:06.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.088+0000 7f60ad58b700 1 Processor -- start 2023-10-06T03:04:06.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.088+0000 7f60ad58b700 1 -- start start 2023-10-06T03:04:06.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.089+0000 7f60ad58b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60a80af320 0x7f60a814b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.089+0000 7f60ad58b700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a80c8150 0x7f60a8146750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.089+0000 7f60ad58b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60a80cb880 0x7f60a80c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.089+0000 7f60ad58b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a80b25d0 con 0x7f60a80af320 2023-10-06T03:04:06.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.089+0000 7f60ad58b700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a814baa0 con 0x7f60a80c8150 2023-10-06T03:04:06.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.089+0000 7f60ad58b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a80b19c0 con 0x7f60a80cb880 2023-10-06T03:04:06.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.089+0000 7f60a67fc700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a80c8150 0x7f60a8146750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.095 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.089+0000 7f60a77fe700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60a80cb880 0x7f60a80c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.089+0000 7f60a67fc700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a80c8150 0x7f60a8146750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57610/0 (socket says 172.21.15.130:57610) 2023-10-06T03:04:06.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.089+0000 7f60a67fc700 1 -- 172.21.15.130:0/200883837 learned_addr learned my addr 172.21.15.130:0/200883837 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-06T03:04:06.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.089+0000 7f60a6ffd700 1 --2- 172.21.15.130:0/200883837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60a80af320 0x7f60a814b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.090+0000 7f60a67fc700 1 -- 172.21.15.130:0/200883837 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60a80cb880 msgr2=0x7f60a80c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.090+0000 7f60a67fc700 1 --2- 172.21.15.130:0/200883837 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60a80cb880 0x7f60a80c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.090+0000 7f60a67fc700 1 -- 172.21.15.130:0/200883837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60a80af320 msgr2=0x7f60a814b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.090+0000 7f60a67fc700 1 --2- 172.21.15.130:0/200883837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60a80af320 0x7f60a814b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.090+0000 7f60a67fc700 1 -- 172.21.15.130:0/200883837 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60980093c0 con 0x7f60a80c8150 2023-10-06T03:04:06.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.090+0000 7f60a77fe700 1 --2- 172.21.15.130:0/200883837 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60a80cb880 0x7f60a80c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:06.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.090+0000 7f60a67fc700 1 --2- 172.21.15.130:0/200883837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a80c8150 0x7f60a8146750 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f60a80c86e0 tx=0x7f609c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:06.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.090+0000 7f608effd700 1 -- 172.21.15.130:0/200883837 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c000d10 con 0x7f60a80c8150 2023-10-06T03:04:06.096 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.090+0000 7f608effd700 1 -- 172.21.15.130:0/200883837 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c00bbe0 con 0x7f60a80c8150 2023-10-06T03:04:06.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.090+0000 7f60ad58b700 1 -- 172.21.15.130:0/200883837 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609c0094f0 con 0x7f60a80c8150 2023-10-06T03:04:06.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.090+0000 7f608effd700 1 -- 172.21.15.130:0/200883837 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c011650 con 0x7f60a80c8150 2023-10-06T03:04:06.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.090+0000 7f60ad58b700 1 -- 172.21.15.130:0/200883837 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a80b1f80 con 0x7f60a80c8150 2023-10-06T03:04:06.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.090+0000 7f608effd700 1 -- 172.21.15.130:0/200883837 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f609c011d00 con 0x7f60a80c8150 2023-10-06T03:04:06.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.090+0000 7f608effd700 1 -- 172.21.15.130:0/200883837 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f609c02ed60 con 0x7f60a80c8150 2023-10-06T03:04:06.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.091+0000 7f60ad58b700 1 -- 172.21.15.130:0/200883837 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a8066510 con 0x7f60a80c8150 2023-10-06T03:04:06.097 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.093+0000 7f608effd700 1 -- 172.21.15.130:0/200883837 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f609c033060 con 0x7f60a80c8150 2023-10-06T03:04:06.134 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:06.133+0000 7f55c47ea1c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T03:04:06.177 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.175+0000 7f60ad58b700 1 -- 172.21.15.130:0/200883837 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1767280f-d693-4502-b223-abed8add890b", "id": 4} v 0) v1 -- 0x7f60a806b290 con 0x7f60a80c8150 2023-10-06T03:04:06.184 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.183+0000 7f608effd700 1 -- 172.21.15.130:0/200883837 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1767280f-d693-4502-b223-abed8add890b", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f609c015020 con 0x7f60a80c8150 2023-10-06T03:04:06.185 INFO:teuthology.orchestra.run.smithi130.stdout:4 2023-10-06T03:04:06.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.184+0000 7f60ad58b700 1 -- 172.21.15.130:0/200883837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a80c8150 msgr2=0x7f60a8146750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.184+0000 7f60ad58b700 1 --2- 172.21.15.130:0/200883837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a80c8150 0x7f60a8146750 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f60a80c86e0 tx=0x7f609c017000 comp rx=0 tx=0).stop 2023-10-06T03:04:06.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.184+0000 7f60ad58b700 1 -- 172.21.15.130:0/200883837 shutdown_connections 2023-10-06T03:04:06.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.184+0000 7f60ad58b700 1 --2- 172.21.15.130:0/200883837 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f60a80cb880 0x7f60a80c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.184+0000 7f60ad58b700 1 --2- 172.21.15.130:0/200883837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f60a80af320 0x7f60a814b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.184+0000 7f60ad58b700 1 --2- 172.21.15.130:0/200883837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f60a80c8150 0x7f60a8146750 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.184+0000 7f60ad58b700 1 -- 172.21.15.130:0/200883837 >> 172.21.15.130:0/200883837 conn(0x7f60a8096120 msgr2=0x7f60a80cabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:06.186 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.184+0000 7f60ad58b700 1 -- 172.21.15.130:0/200883837 shutdown_connections 2023-10-06T03:04:06.187 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.184+0000 7f60ad58b700 1 -- 172.21.15.130:0/200883837 wait complete. 2023-10-06T03:04:06.198 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new b92692cd-bad6-44b2-8db9-6f350aa59ec5 5 2023-10-06T03:04:06.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.316+0000 7f0ffee6d700 1 Processor -- start 2023-10-06T03:04:06.317 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.316+0000 7f0ffee6d700 1 -- start start 2023-10-06T03:04:06.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.317+0000 7f0ffee6d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff80af320 0x7f0ff80cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.317+0000 7f0ffee6d700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0ff80cb880 0x7f0ff80c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.317+0000 7f0ffee6d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f0ff80c8150 0x7f0ff81565e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.317+0000 7f0ffee6d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff80c9470 con 0x7f0ff80c8150 2023-10-06T03:04:06.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.317+0000 7f0ffee6d700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff80cbcf0 con 0x7f0ff80cb880 2023-10-06T03:04:06.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.317+0000 7f0ffee6d700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff80c9b40 con 0x7f0ff80af320 2023-10-06T03:04:06.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.317+0000 7f0ffcc09700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff80af320 0x7f0ff80cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.317+0000 7f0ff7fff700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0ff80cb880 0x7f0ff80c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.317+0000 7f0ffcc09700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff80af320 0x7f0ff80cb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:50202/0 (socket says 172.21.15.130:50202) 2023-10-06T03:04:06.320 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.317+0000 7f0ffcc09700 1 -- 172.21.15.130:0/3146880947 learned_addr learned my addr 172.21.15.130:0/3146880947 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-06T03:04:06.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.317+0000 7f0ffd40a700 1 --2- 172.21.15.130:0/3146880947 >> v2:172.21.15.125:3300/0 conn(0x7f0ff80c8150 0x7f0ff81565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.317+0000 7f0ffcc09700 1 -- 172.21.15.130:0/3146880947 >> v2:172.21.15.130:3300/0 conn(0x7f0ff80cb880 msgr2=0x7f0ff80c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:06.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.317+0000 7f0ffcc09700 1 --2- 172.21.15.130:0/3146880947 >> v2:172.21.15.130:3300/0 conn(0x7f0ff80cb880 0x7f0ff80c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.317+0000 7f0ffcc09700 1 -- 172.21.15.130:0/3146880947 >> v2:172.21.15.125:3300/0 conn(0x7f0ff80c8150 msgr2=0x7f0ff81565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:06.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.317+0000 7f0ffcc09700 1 --2- 172.21.15.130:0/3146880947 >> v2:172.21.15.125:3300/0 conn(0x7f0ff80c8150 0x7f0ff81565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.317+0000 7f0ffcc09700 1 -- 172.21.15.130:0/3146880947 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80c85a0 con 0x7f0ff80af320 2023-10-06T03:04:06.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.317+0000 7f0ff7fff700 1 --2- 172.21.15.130:0/3146880947 >> v2:172.21.15.130:3300/0 conn(0x7f0ff80cb880 0x7f0ff80c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:06.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.317+0000 7f0ffcc09700 1 --2- 172.21.15.130:0/3146880947 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff80af320 0x7f0ff80cb340 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0ff806dec0 tx=0x7f0fec009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6a21a0c3e32b5a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:06.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.317+0000 7f0ff77fe700 1 -- 172.21.15.130:0/3146880947 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec005c10 con 0x7f0ff80af320 2023-10-06T03:04:06.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.318+0000 7f0ff77fe700 1 -- 172.21.15.130:0/3146880947 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec005d70 con 0x7f0ff80af320 2023-10-06T03:04:06.321 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.318+0000 7f0ff77fe700 1 -- 172.21.15.130:0/3146880947 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec006260 con 0x7f0ff80af320 2023-10-06T03:04:06.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.318+0000 7f0ffee6d700 1 -- 172.21.15.130:0/3146880947 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff80af320 msgr2=0x7f0ff80cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.318+0000 7f0ffee6d700 1 --2- 172.21.15.130:0/3146880947 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff80af320 0x7f0ff80cb340 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0ff806dec0 tx=0x7f0fec009220 comp rx=0 tx=0).stop 2023-10-06T03:04:06.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.318+0000 7f0ffee6d700 1 -- 172.21.15.130:0/3146880947 shutdown_connections 2023-10-06T03:04:06.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.318+0000 7f0ffee6d700 1 --2- 172.21.15.130:0/3146880947 >> v2:172.21.15.125:3300/0 conn(0x7f0ff80c8150 0x7f0ff81565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.318+0000 7f0ffee6d700 1 --2- 172.21.15.130:0/3146880947 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff80af320 0x7f0ff80cb340 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.318+0000 7f0ffee6d700 1 --2- 172.21.15.130:0/3146880947 >> v2:172.21.15.130:3300/0 conn(0x7f0ff80cb880 0x7f0ff80c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.318+0000 7f0ffee6d700 1 -- 172.21.15.130:0/3146880947 >> 172.21.15.130:0/3146880947 conn(0x7f0ff8096120 msgr2=0x7f0ff8068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:06.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.318+0000 7f0ffee6d700 1 -- 172.21.15.130:0/3146880947 shutdown_connections 2023-10-06T03:04:06.322 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.318+0000 7f0ffee6d700 1 -- 172.21.15.130:0/3146880947 wait complete. 2023-10-06T03:04:06.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.319+0000 7f0ffee6d700 1 Processor -- start 2023-10-06T03:04:06.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.319+0000 7f0ffee6d700 1 -- start start 2023-10-06T03:04:06.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.320+0000 7f0ffee6d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff80af320 0x7f0ff814bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.320+0000 7f0ffee6d700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ff80c8150 0x7f0ff80c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.320+0000 7f0ffee6d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ff80cb880 0x7f0ff80c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.320+0000 7f0ffee6d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff814f8e0 con 0x7f0ff80cb880 2023-10-06T03:04:06.325 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.320+0000 7f0ffee6d700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff814ec60 con 0x7f0ff80c8150 2023-10-06T03:04:06.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.320+0000 7f0ffee6d700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff814ef40 con 0x7f0ff80af320 2023-10-06T03:04:06.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.320+0000 7f0ffcc09700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff80af320 0x7f0ff814bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.320+0000 7f0ffcc09700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff80af320 0x7f0ff814bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:50206/0 (socket says 172.21.15.130:50206) 2023-10-06T03:04:06.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.320+0000 7f0ffcc09700 1 -- 172.21.15.130:0/3292664626 learned_addr learned my addr 172.21.15.130:0/3292664626 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-06T03:04:06.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.320+0000 7f0ff7fff700 1 --2- 172.21.15.130:0/3292664626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ff80c8150 0x7f0ff80c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.320+0000 7f0ffd40a700 1 --2- 172.21.15.130:0/3292664626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ff80cb880 0x7f0ff80c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.321+0000 7f0ffcc09700 1 -- 172.21.15.130:0/3292664626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ff80c8150 msgr2=0x7f0ff80c2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.321+0000 7f0ffcc09700 1 --2- 172.21.15.130:0/3292664626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ff80c8150 0x7f0ff80c2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.321+0000 7f0ffcc09700 1 -- 172.21.15.130:0/3292664626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ff80cb880 msgr2=0x7f0ff80c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.326 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.321+0000 7f0ffcc09700 1 --2- 172.21.15.130:0/3292664626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ff80cb880 0x7f0ff80c2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.321+0000 7f0ffcc09700 1 -- 172.21.15.130:0/3292664626 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe4009420 con 0x7f0ff80af320 2023-10-06T03:04:06.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.321+0000 7f0ff7fff700 1 --2- 172.21.15.130:0/3292664626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ff80c8150 0x7f0ff80c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:06.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.321+0000 7f0ffcc09700 1 --2- 172.21.15.130:0/3292664626 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff80af320 0x7f0ff814bb80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0fec009f50 tx=0x7f0fec016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:06.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.321+0000 7f0ff4ff9700 1 -- 172.21.15.130:0/3292664626 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec011640 con 0x7f0ff80af320 2023-10-06T03:04:06.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.321+0000 7f0ff4ff9700 1 -- 172.21.15.130:0/3292664626 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec020070 con 0x7f0ff80af320 2023-10-06T03:04:06.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.321+0000 7f0ffee6d700 1 -- 172.21.15.130:0/3292664626 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fec009480 con 0x7f0ff80af320 2023-10-06T03:04:06.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.321+0000 7f0ff4ff9700 1 -- 172.21.15.130:0/3292664626 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec011a10 con 0x7f0ff80af320 2023-10-06T03:04:06.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.321+0000 7f0ffee6d700 1 -- 172.21.15.130:0/3292664626 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff814f500 con 0x7f0ff80af320 2023-10-06T03:04:06.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.321+0000 7f0ff4ff9700 1 -- 172.21.15.130:0/3292664626 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0fec022030 con 0x7f0ff80af320 2023-10-06T03:04:06.327 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.321+0000 7f0ff4ff9700 1 -- 172.21.15.130:0/3292664626 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f0fec011e40 con 0x7f0ff80af320 2023-10-06T03:04:06.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.322+0000 7f0ffee6d700 1 -- 172.21.15.130:0/3292664626 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff8066510 con 0x7f0ff80af320 2023-10-06T03:04:06.328 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.324+0000 7f0ff4ff9700 1 -- 172.21.15.130:0/3292664626 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0fec02e8a0 con 0x7f0ff80af320 2023-10-06T03:04:06.409 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.407+0000 7f0ffee6d700 1 -- 172.21.15.130:0/3292664626 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b92692cd-bad6-44b2-8db9-6f350aa59ec5", "id": 5} v 0) v1 -- 0x7f0ff80c8860 con 0x7f0ff80af320 2023-10-06T03:04:06.416 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.415+0000 7f0ff4ff9700 1 -- 172.21.15.130:0/3292664626 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b92692cd-bad6-44b2-8db9-6f350aa59ec5", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0fec02ea40 con 0x7f0ff80af320 2023-10-06T03:04:06.416 INFO:teuthology.orchestra.run.smithi130.stdout:5 2023-10-06T03:04:06.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.416+0000 7f0ffee6d700 1 -- 172.21.15.130:0/3292664626 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff80af320 msgr2=0x7f0ff814bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.416+0000 7f0ffee6d700 1 --2- 172.21.15.130:0/3292664626 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff80af320 0x7f0ff814bb80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f0fec009f50 tx=0x7f0fec016000 comp rx=0 tx=0).stop 2023-10-06T03:04:06.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.416+0000 7f0ffee6d700 1 -- 172.21.15.130:0/3292664626 shutdown_connections 2023-10-06T03:04:06.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.416+0000 7f0ffee6d700 1 --2- 172.21.15.130:0/3292664626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0ff80cb880 0x7f0ff80c2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.416+0000 7f0ffee6d700 1 --2- 172.21.15.130:0/3292664626 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0ff80af320 0x7f0ff814bb80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.416+0000 7f0ffee6d700 1 --2- 172.21.15.130:0/3292664626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ff80c8150 0x7f0ff80c2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.416+0000 7f0ffee6d700 1 -- 172.21.15.130:0/3292664626 >> 172.21.15.130:0/3292664626 conn(0x7f0ff8096120 msgr2=0x7f0ff80c1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:06.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.416+0000 7f0ffee6d700 1 -- 172.21.15.130:0/3292664626 shutdown_connections 2023-10-06T03:04:06.418 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.416+0000 7f0ffee6d700 1 -- 172.21.15.130:0/3292664626 wait complete. 2023-10-06T03:04:06.429 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new edf6cb3e-d501-4ca8-b58a-f38fb7407de4 6 2023-10-06T03:04:06.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.545+0000 7fed7c569700 1 Processor -- start 2023-10-06T03:04:06.547 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.545+0000 7fed7c569700 1 -- start start 2023-10-06T03:04:06.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.546+0000 7fed7c569700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed74156de0 0x7fed741571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.548 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.546+0000 7fed7c569700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed740cd300 con 0x7fed740cd790 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.546+0000 7fed7c569700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed740cc6f0 con 0x7fed740cc060 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.546+0000 7fed7c569700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed740cc4d0 con 0x7fed74156de0 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.546+0000 7fed7a305700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed74156de0 0x7fed741571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.546+0000 7fed79b04700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fed740cc060 0x7fed7415b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:57852/0 (socket says 172.21.15.130:57852) 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.546+0000 7fed79b04700 1 -- 172.21.15.130:0/3077090789 learned_addr learned my addr 172.21.15.130:0/3077090789 (peer_addr_for_me v1:172.21.15.130:0/0) 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.547+0000 7fed7a305700 1 -- 172.21.15.130:0/3077090789 >> v1:172.21.15.130:6789/0 conn(0x7fed740cc060 legacy=0x7fed7415b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.547+0000 7fed79303700 1 -- 172.21.15.130:0/3077090789 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84198352 0 0) 0x7fed740cc6f0 con 0x7fed740cc060 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.547+0000 7fed7a305700 1 -- 172.21.15.130:0/3077090789 >> v1:172.21.15.125:6789/0 conn(0x7fed740cd790 legacy=0x7fed740ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.547+0000 7fed7a305700 1 -- 172.21.15.130:0/3077090789 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed740cc9d0 con 0x7fed74156de0 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.547+0000 7fed7a305700 1 --2- 172.21.15.130:0/3077090789 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed74156de0 0x7fed741571b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fed70009910 tx=0x7fed700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69d9a568f890402c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.547+0000 7fed79303700 1 -- 172.21.15.130:0/3077090789 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7000b860 con 0x7fed74156de0 2023-10-06T03:04:06.549 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.547+0000 7fed79303700 1 -- 172.21.15.130:0/3077090789 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7000b9c0 con 0x7fed74156de0 2023-10-06T03:04:06.550 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.547+0000 7fed79303700 1 -- 172.21.15.130:0/3077090789 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7000bd60 con 0x7fed74156de0 2023-10-06T03:04:06.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.548+0000 7fed7c569700 1 -- 172.21.15.130:0/3077090789 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed74156de0 msgr2=0x7fed741571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.548+0000 7fed7c569700 1 --2- 172.21.15.130:0/3077090789 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed74156de0 0x7fed741571b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fed70009910 tx=0x7fed700091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.548+0000 7fed7c569700 1 -- 172.21.15.130:0/3077090789 shutdown_connections 2023-10-06T03:04:06.552 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.548+0000 7fed7c569700 1 --2- 172.21.15.130:0/3077090789 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed74156de0 0x7fed741571b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.548+0000 7fed7c569700 1 -- 172.21.15.130:0/3077090789 >> 172.21.15.130:0/3077090789 conn(0x7fed740cdf80 msgr2=0x7fed740ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:06.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.548+0000 7fed7c569700 1 -- 172.21.15.130:0/3077090789 shutdown_connections 2023-10-06T03:04:06.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.548+0000 7fed7c569700 1 -- 172.21.15.130:0/3077090789 wait complete. 2023-10-06T03:04:06.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.549+0000 7fed7c569700 1 Processor -- start 2023-10-06T03:04:06.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.549+0000 7fed7c569700 1 -- start start 2023-10-06T03:04:06.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.549+0000 7fed7c569700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed740cc060 0x7fed74151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.549+0000 7fed7c569700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed740cd790 0x7fed740c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.549+0000 7fed7c569700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed74156de0 0x7fed740c6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.549+0000 7fed7c569700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed740c7d80 con 0x7fed740cc060 2023-10-06T03:04:06.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.549+0000 7fed7c569700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed74151180 con 0x7fed740cd790 2023-10-06T03:04:06.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.549+0000 7fed7c569700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed74151460 con 0x7fed74156de0 2023-10-06T03:04:06.553 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.550+0000 7fed7ab06700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed74156de0 0x7fed740c6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.550+0000 7fed79b04700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed740cd790 0x7fed740c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.550+0000 7fed7ab06700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed74156de0 0x7fed740c6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:50218/0 (socket says 172.21.15.130:50218) 2023-10-06T03:04:06.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.550+0000 7fed7a305700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed740cc060 0x7fed74151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.550+0000 7fed7ab06700 1 -- 172.21.15.130:0/2101205674 learned_addr learned my addr 172.21.15.130:0/2101205674 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-06T03:04:06.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.550+0000 7fed79b04700 1 -- 172.21.15.130:0/2101205674 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed74156de0 msgr2=0x7fed740c6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.550+0000 7fed79b04700 1 --2- 172.21.15.130:0/2101205674 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed74156de0 0x7fed740c6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.550+0000 7fed79b04700 1 -- 172.21.15.130:0/2101205674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed740cc060 msgr2=0x7fed74151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.550+0000 7fed79b04700 1 --2- 172.21.15.130:0/2101205674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed740cc060 0x7fed74151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.550+0000 7fed79b04700 1 -- 172.21.15.130:0/2101205674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed70009420 con 0x7fed740cd790 2023-10-06T03:04:06.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.550+0000 7fed7ab06700 1 --2- 172.21.15.130:0/2101205674 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed74156de0 0x7fed740c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:06.554 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.550+0000 7fed79b04700 1 --2- 172.21.15.130:0/2101205674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed740cd790 0x7fed740c76c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fed640011e0 tx=0x7fed64007d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:06.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.550+0000 7fed6a7fc700 1 -- 172.21.15.130:0/2101205674 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed64005b30 con 0x7fed740cd790 2023-10-06T03:04:06.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.550+0000 7fed6a7fc700 1 -- 172.21.15.130:0/2101205674 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed64005cb0 con 0x7fed740cd790 2023-10-06T03:04:06.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.550+0000 7fed7c569700 1 -- 172.21.15.130:0/2101205674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed74151740 con 0x7fed740cd790 2023-10-06T03:04:06.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.550+0000 7fed6a7fc700 1 -- 172.21.15.130:0/2101205674 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed64007320 con 0x7fed740cd790 2023-10-06T03:04:06.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.550+0000 7fed7c569700 1 -- 172.21.15.130:0/2101205674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed740c6a90 con 0x7fed740cd790 2023-10-06T03:04:06.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.550+0000 7fed6a7fc700 1 -- 172.21.15.130:0/2101205674 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fed6401c6c0 con 0x7fed740cd790 2023-10-06T03:04:06.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.550+0000 7fed6a7fc700 1 -- 172.21.15.130:0/2101205674 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fed64005e20 con 0x7fed740cd790 2023-10-06T03:04:06.555 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.551+0000 7fed7c569700 1 -- 172.21.15.130:0/2101205674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed740c6c50 con 0x7fed740cd790 2023-10-06T03:04:06.556 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.555+0000 7fed6a7fc700 1 -- 172.21.15.130:0/2101205674 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fed740c6c50 con 0x7fed740cd790 2023-10-06T03:04:06.638 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.637+0000 7fed7c569700 1 -- 172.21.15.130:0/2101205674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd new", "uuid": "edf6cb3e-d501-4ca8-b58a-f38fb7407de4", "id": 6} v 0) v1 -- 0x7fed74066510 con 0x7fed740cd790 2023-10-06T03:04:06.645 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.643+0000 7fed6a7fc700 1 -- 172.21.15.130:0/2101205674 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "edf6cb3e-d501-4ca8-b58a-f38fb7407de4", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fed64021060 con 0x7fed740cd790 2023-10-06T03:04:06.645 INFO:teuthology.orchestra.run.smithi130.stdout:6 2023-10-06T03:04:06.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.645+0000 7fed7c569700 1 -- 172.21.15.130:0/2101205674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed740cd790 msgr2=0x7fed740c76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.645+0000 7fed7c569700 1 --2- 172.21.15.130:0/2101205674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed740cd790 0x7fed740c76c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fed640011e0 tx=0x7fed64007d10 comp rx=0 tx=0).stop 2023-10-06T03:04:06.646 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.645+0000 7fed7c569700 1 -- 172.21.15.130:0/2101205674 shutdown_connections 2023-10-06T03:04:06.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.645+0000 7fed7c569700 1 --2- 172.21.15.130:0/2101205674 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fed74156de0 0x7fed740c6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.645+0000 7fed7c569700 1 --2- 172.21.15.130:0/2101205674 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fed740cc060 0x7fed74151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.645+0000 7fed7c569700 1 --2- 172.21.15.130:0/2101205674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed740cd790 0x7fed740c76c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.645+0000 7fed7c569700 1 -- 172.21.15.130:0/2101205674 >> 172.21.15.130:0/2101205674 conn(0x7fed740cdf80 msgr2=0x7fed74152670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:06.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.645+0000 7fed7c569700 1 -- 172.21.15.130:0/2101205674 shutdown_connections 2023-10-06T03:04:06.647 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.645+0000 7fed7c569700 1 -- 172.21.15.130:0/2101205674 wait complete. 2023-10-06T03:04:06.658 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --cluster ceph osd new 50227222-b109-4145-808b-e55357c49222 7 2023-10-06T03:04:06.759 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:06.758+0000 7fc4153411c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T03:04:06.778 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.777+0000 7fd870359700 1 Processor -- start 2023-10-06T03:04:06.779 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.777+0000 7fd870359700 1 -- start start 2023-10-06T03:04:06.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.778+0000 7fd870359700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd868157300 0x7fd8680b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.781 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.778+0000 7fd870359700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd8681576d0 0x7fd8680684c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.778+0000 7fd870359700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd868068e20 con 0x7fd868068a00 2023-10-06T03:04:06.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.778+0000 7fd870359700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8680aa760 con 0x7fd868157300 2023-10-06T03:04:06.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.778+0000 7fd870359700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8680aaa40 con 0x7fd8681576d0 2023-10-06T03:04:06.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.778+0000 7fd86d8f4700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd8681576d0 0x7fd8680684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.779+0000 7fd86d8f4700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd8681576d0 0x7fd8680684c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57656/0 (socket says 172.21.15.130:57656) 2023-10-06T03:04:06.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.779+0000 7fd86d8f4700 1 -- 172.21.15.130:0/2406943916 learned_addr learned my addr 172.21.15.130:0/2406943916 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-06T03:04:06.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.779+0000 7fd86e8f6700 1 --1- 172.21.15.130:0/2406943916 >> v1:172.21.15.130:6789/0 conn(0x7fd868068a00 0x7fd8680a92e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.130:57854/0 (socket says 172.21.15.130:57854) 2023-10-06T03:04:06.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.779+0000 7fd86e0f5700 1 --2- 172.21.15.130:0/2406943916 >> v2:172.21.15.125:3300/0 conn(0x7fd868157300 0x7fd8680b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.779+0000 7fd86d8f4700 1 -- 172.21.15.130:0/2406943916 >> v2:172.21.15.125:3300/0 conn(0x7fd868157300 msgr2=0x7fd8680b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:06.782 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.779+0000 7fd86d8f4700 1 --2- 172.21.15.130:0/2406943916 >> v2:172.21.15.125:3300/0 conn(0x7fd868157300 0x7fd8680b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.779+0000 7fd86d8f4700 1 -- 172.21.15.130:0/2406943916 >> v1:172.21.15.130:6789/0 conn(0x7fd868068a00 legacy=0x7fd8680a92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.779+0000 7fd86d8f4700 1 -- 172.21.15.130:0/2406943916 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8680aad20 con 0x7fd8681576d0 2023-10-06T03:04:06.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.779+0000 7fd86d8f4700 1 --2- 172.21.15.130:0/2406943916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8681576d0 0x7fd8680684c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd8680b0780 tx=0x7fd858009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f4f10fec28e2af3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:06.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.779+0000 7fd86d0f3700 1 -- 172.21.15.130:0/2406943916 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd858009e70 con 0x7fd8681576d0 2023-10-06T03:04:06.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.779+0000 7fd86d0f3700 1 -- 172.21.15.130:0/2406943916 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85800b860 con 0x7fd8681576d0 2023-10-06T03:04:06.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.779+0000 7fd86d0f3700 1 -- 172.21.15.130:0/2406943916 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85800bc00 con 0x7fd8681576d0 2023-10-06T03:04:06.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.780+0000 7fd870359700 1 -- 172.21.15.130:0/2406943916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8681576d0 msgr2=0x7fd8680684c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.780+0000 7fd870359700 1 --2- 172.21.15.130:0/2406943916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8681576d0 0x7fd8680684c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd8680b0780 tx=0x7fd858009250 comp rx=0 tx=0).stop 2023-10-06T03:04:06.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.780+0000 7fd870359700 1 -- 172.21.15.130:0/2406943916 shutdown_connections 2023-10-06T03:04:06.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.780+0000 7fd870359700 1 --2- 172.21.15.130:0/2406943916 >> v2:172.21.15.125:3300/0 conn(0x7fd868157300 0x7fd8680b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.783 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.780+0000 7fd870359700 1 --2- 172.21.15.130:0/2406943916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8681576d0 0x7fd8680684c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.780+0000 7fd870359700 1 -- 172.21.15.130:0/2406943916 >> 172.21.15.130:0/2406943916 conn(0x7fd8680af730 msgr2=0x7fd8680afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:06.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.780+0000 7fd870359700 1 -- 172.21.15.130:0/2406943916 shutdown_connections 2023-10-06T03:04:06.784 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.780+0000 7fd870359700 1 -- 172.21.15.130:0/2406943916 wait complete. 2023-10-06T03:04:06.786 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.781+0000 7fd870359700 1 Processor -- start 2023-10-06T03:04:06.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.782+0000 7fd870359700 1 -- start start 2023-10-06T03:04:06.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.782+0000 7fd870359700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd868068a00 0x7fd8680c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.782+0000 7fd870359700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd868157300 0x7fd868154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.782+0000 7fd870359700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8681576d0 0x7fd86816ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:06.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.782+0000 7fd870359700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd868158870 con 0x7fd868068a00 2023-10-06T03:04:06.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.782+0000 7fd870359700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8680c88f0 con 0x7fd8681576d0 2023-10-06T03:04:06.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.782+0000 7fd870359700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8680c8bd0 con 0x7fd868157300 2023-10-06T03:04:06.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd86e8f6700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8681576d0 0x7fd86816ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd86d8f4700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd868157300 0x7fd868154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.787 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd86e0f5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd868068a00 0x7fd8680c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:06.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd86e8f6700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8681576d0 0x7fd86816ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57660/0 (socket says 172.21.15.130:57660) 2023-10-06T03:04:06.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd86d8f4700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd868157300 0x7fd868154120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.130:50234/0 (socket says 172.21.15.130:50234) 2023-10-06T03:04:06.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd86e0f5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd868068a00 0x7fd8680c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.130:35030/0 (socket says 172.21.15.130:35030) 2023-10-06T03:04:06.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd86e8f6700 1 -- 172.21.15.130:0/1285272773 learned_addr learned my addr 172.21.15.130:0/1285272773 (peer_addr_for_me v2:172.21.15.130:0/0) 2023-10-06T03:04:06.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd86e0f5700 1 -- 172.21.15.130:0/1285272773 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd868157300 msgr2=0x7fd868154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd86e0f5700 1 --2- 172.21.15.130:0/1285272773 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd868157300 0x7fd868154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd86e0f5700 1 -- 172.21.15.130:0/1285272773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8681576d0 msgr2=0x7fd86816ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd86e0f5700 1 --2- 172.21.15.130:0/1285272773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8681576d0 0x7fd86816ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd86e0f5700 1 -- 172.21.15.130:0/1285272773 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8580094f0 con 0x7fd868068a00 2023-10-06T03:04:06.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd86e8f6700 1 --2- 172.21.15.130:0/1285272773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8681576d0 0x7fd86816ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:06.788 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd86d8f4700 1 --2- 172.21.15.130:0/1285272773 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd868157300 0x7fd868154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:06.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd86e0f5700 1 --2- 172.21.15.130:0/1285272773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd868068a00 0x7fd8680c9c70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd86400ea50 tx=0x7fd864009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:06.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd85e7fc700 1 -- 172.21.15.130:0/1285272773 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86400c640 con 0x7fd868068a00 2023-10-06T03:04:06.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd85e7fc700 1 -- 172.21.15.130:0/1285272773 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86400c7a0 con 0x7fd868068a00 2023-10-06T03:04:06.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd870359700 1 -- 172.21.15.130:0/1285272773 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8680c8eb0 con 0x7fd868068a00 2023-10-06T03:04:06.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd85e7fc700 1 -- 172.21.15.130:0/1285272773 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86400cb40 con 0x7fd868068a00 2023-10-06T03:04:06.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.783+0000 7fd870359700 1 -- 172.21.15.130:0/1285272773 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8680c9470 con 0x7fd868068a00 2023-10-06T03:04:06.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.784+0000 7fd85e7fc700 1 -- 172.21.15.130:0/1285272773 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd8640136f0 con 0x7fd868068a00 2023-10-06T03:04:06.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.784+0000 7fd85e7fc700 1 -- 172.21.15.130:0/1285272773 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fd86401cb60 con 0x7fd868068a00 2023-10-06T03:04:06.789 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.784+0000 7fd870359700 1 -- 172.21.15.130:0/1285272773 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd868066510 con 0x7fd868068a00 2023-10-06T03:04:06.790 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.787+0000 7fd85e7fc700 1 -- 172.21.15.130:0/1285272773 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd864021060 con 0x7fd868068a00 2023-10-06T03:04:06.830 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:06.829+0000 7fc4153411c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T03:04:06.871 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.869+0000 7fd870359700 1 -- 172.21.15.130:0/1285272773 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd new", "uuid": "50227222-b109-4145-808b-e55357c49222", "id": 7} v 0) v1 -- 0x7fd8680ab000 con 0x7fd868068a00 2023-10-06T03:04:06.874 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.873+0000 7fd85e7fc700 1 -- 172.21.15.130:0/1285272773 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "50227222-b109-4145-808b-e55357c49222", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd86402a020 con 0x7fd868068a00 2023-10-06T03:04:06.874 INFO:teuthology.orchestra.run.smithi130.stdout:7 2023-10-06T03:04:06.875 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.874+0000 7fd870359700 1 -- 172.21.15.130:0/1285272773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd868068a00 msgr2=0x7fd8680c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:06.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.874+0000 7fd870359700 1 --2- 172.21.15.130:0/1285272773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd868068a00 0x7fd8680c9c70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd86400ea50 tx=0x7fd864009120 comp rx=0 tx=0).stop 2023-10-06T03:04:06.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.874+0000 7fd870359700 1 -- 172.21.15.130:0/1285272773 shutdown_connections 2023-10-06T03:04:06.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.874+0000 7fd870359700 1 --2- 172.21.15.130:0/1285272773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8681576d0 0x7fd86816ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.874+0000 7fd870359700 1 --2- 172.21.15.130:0/1285272773 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd868068a00 0x7fd8680c9c70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.874+0000 7fd870359700 1 --2- 172.21.15.130:0/1285272773 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd868157300 0x7fd868154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:06.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.874+0000 7fd870359700 1 -- 172.21.15.130:0/1285272773 >> 172.21.15.130:0/1285272773 conn(0x7fd8680af730 msgr2=0x7fd8681552c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:06.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.874+0000 7fd870359700 1 -- 172.21.15.130:0/1285272773 shutdown_connections 2023-10-06T03:04:06.876 INFO:teuthology.orchestra.run.smithi130.stderr:2023-10-06T03:04:06.874+0000 7fd870359700 1 -- 172.21.15.130:0/1285272773 wait complete. 2023-10-06T03:04:06.887 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T03:04:06.888 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T03:04:06.890 INFO:tasks.ceph.osd.0:Started 2023-10-06T03:04:06.890 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T03:04:06.890 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T03:04:06.892 INFO:tasks.ceph.osd.1:Started 2023-10-06T03:04:06.892 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T03:04:06.893 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T03:04:06.894 INFO:tasks.ceph.osd.2:Started 2023-10-06T03:04:06.894 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T03:04:06.895 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T03:04:06.895 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:06.894+0000 7f55c47ea1c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T03:04:06.896 INFO:tasks.ceph.osd.3:Started 2023-10-06T03:04:06.896 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T03:04:06.897 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T03:04:06.898 INFO:tasks.ceph.osd.4:Started 2023-10-06T03:04:06.899 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T03:04:06.899 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T03:04:06.900 INFO:tasks.ceph.osd.5:Started 2023-10-06T03:04:06.901 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T03:04:06.901 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T03:04:06.903 INFO:tasks.ceph.osd.6:Started 2023-10-06T03:04:06.903 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T03:04:06.903 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T03:04:06.905 INFO:tasks.ceph.osd.7:Started 2023-10-06T03:04:06.905 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:04:06.985 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:06.984+0000 7f55c47ea1c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T03:04:06.987 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:06.986+0000 7fc4153411c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T03:04:07.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.045+0000 7f1b34b7d700 1 Processor -- start 2023-10-06T03:04:07.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.045+0000 7f1b34b7d700 1 -- start start 2023-10-06T03:04:07.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.046+0000 7f1b34b7d700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1b300cc8f0 0x7f1b30069300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:07.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.046+0000 7f1b34b7d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1b30067d20 0x7f1b30159d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:07.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.046+0000 7f1b34b7d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b300cccc0 con 0x7f1b300caa40 2023-10-06T03:04:07.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.046+0000 7f1b34b7d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b300caee0 con 0x7f1b30067d20 2023-10-06T03:04:07.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.046+0000 7f1b34b7d700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b301585c0 con 0x7f1b300cc8f0 2023-10-06T03:04:07.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.046+0000 7f1b2ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1b30067d20 0x7f1b30159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:07.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.046+0000 7f1b2dd9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1b300caa40 0x7f1b30067610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49028/0 (socket says 172.21.15.125:49028) 2023-10-06T03:04:07.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.046+0000 7f1b2dd9b700 1 -- 172.21.15.125:0/3601607529 learned_addr learned my addr 172.21.15.125:0/3601607529 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:07.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.046+0000 7f1b2e59c700 1 --2- 172.21.15.125:0/3601607529 >> v2:172.21.15.130:3300/0 conn(0x7f1b300cc8f0 0x7f1b30069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:07.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.046+0000 7f1b2ed9d700 1 -- 172.21.15.125:0/3601607529 >> v2:172.21.15.130:3300/0 conn(0x7f1b300cc8f0 msgr2=0x7f1b30069300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:07.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.046+0000 7f1b2ed9d700 1 --2- 172.21.15.125:0/3601607529 >> v2:172.21.15.130:3300/0 conn(0x7f1b300cc8f0 0x7f1b30069300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:07.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.046+0000 7f1b2ed9d700 1 -- 172.21.15.125:0/3601607529 >> v1:172.21.15.125:6789/0 conn(0x7f1b300caa40 legacy=0x7f1b30067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:07.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.046+0000 7f1b2ed9d700 1 -- 172.21.15.125:0/3601607529 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b30158cd0 con 0x7f1b30067d20 2023-10-06T03:04:07.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.046+0000 7f1b2d59a700 1 -- 172.21.15.125:0/3601607529 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3444519922 0 0) 0x7f1b300cccc0 con 0x7f1b300caa40 2023-10-06T03:04:07.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.046+0000 7f1b2ed9d700 1 --2- 172.21.15.125:0/3601607529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b30067d20 0x7f1b30159d70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1b3006e8f0 tx=0x7f1b28009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40878c1203dcfbfe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:07.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.046+0000 7f1b2d59a700 1 -- 172.21.15.125:0/3601607529 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2800e070 con 0x7f1b30067d20 2023-10-06T03:04:07.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.046+0000 7f1b2d59a700 1 -- 172.21.15.125:0/3601607529 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2800bb60 con 0x7f1b30067d20 2023-10-06T03:04:07.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.046+0000 7f1b2d59a700 1 -- 172.21.15.125:0/3601607529 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28012430 con 0x7f1b30067d20 2023-10-06T03:04:07.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.047+0000 7f1b34b7d700 1 -- 172.21.15.125:0/3601607529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b30067d20 msgr2=0x7f1b30159d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:07.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.047+0000 7f1b34b7d700 1 --2- 172.21.15.125:0/3601607529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b30067d20 0x7f1b30159d70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1b3006e8f0 tx=0x7f1b28009780 comp rx=0 tx=0).stop 2023-10-06T03:04:07.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.047+0000 7f1b34b7d700 1 -- 172.21.15.125:0/3601607529 shutdown_connections 2023-10-06T03:04:07.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.047+0000 7f1b34b7d700 1 --2- 172.21.15.125:0/3601607529 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b30067d20 0x7f1b30159d70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:07.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.047+0000 7f1b34b7d700 1 --2- 172.21.15.125:0/3601607529 >> v2:172.21.15.130:3300/0 conn(0x7f1b300cc8f0 0x7f1b30069300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:07.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.047+0000 7f1b34b7d700 1 -- 172.21.15.125:0/3601607529 >> 172.21.15.125:0/3601607529 conn(0x7f1b30068f00 msgr2=0x7f1b300cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:07.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.047+0000 7f1b34b7d700 1 -- 172.21.15.125:0/3601607529 shutdown_connections 2023-10-06T03:04:07.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.047+0000 7f1b34b7d700 1 -- 172.21.15.125:0/3601607529 wait complete. 2023-10-06T03:04:07.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.048+0000 7f1b34b7d700 1 Processor -- start 2023-10-06T03:04:07.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.049+0000 7f1b34b7d700 1 -- start start 2023-10-06T03:04:07.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.049+0000 7f1b34b7d700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b30067d20 0x7f1b30156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:07.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.049+0000 7f1b34b7d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b300caa40 0x7f1b3006ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:07.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.049+0000 7f1b34b7d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b300cc8f0 0x7f1b3006b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:07.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.049+0000 7f1b34b7d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b301676c0 con 0x7f1b300caa40 2023-10-06T03:04:07.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.049+0000 7f1b34b7d700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b300b2920 con 0x7f1b30067d20 2023-10-06T03:04:07.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.049+0000 7f1b34b7d700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b30167070 con 0x7f1b300cc8f0 2023-10-06T03:04:07.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.050+0000 7f1b2dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b300caa40 0x7f1b3006ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:07.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.050+0000 7f1b2dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b300caa40 0x7f1b3006ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44796/0 (socket says 172.21.15.125:44796) 2023-10-06T03:04:07.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.050+0000 7f1b2dd9b700 1 -- 172.21.15.125:0/1044885121 learned_addr learned my addr 172.21.15.125:0/1044885121 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:07.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.050+0000 7f1b2e59c700 1 --2- 172.21.15.125:0/1044885121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b30067d20 0x7f1b30156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:07.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.050+0000 7f1b2ed9d700 1 --2- 172.21.15.125:0/1044885121 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b300cc8f0 0x7f1b3006b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:07.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.050+0000 7f1b2dd9b700 1 -- 172.21.15.125:0/1044885121 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b300cc8f0 msgr2=0x7f1b3006b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:07.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.050+0000 7f1b2dd9b700 1 --2- 172.21.15.125:0/1044885121 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b300cc8f0 0x7f1b3006b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:07.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.050+0000 7f1b2dd9b700 1 -- 172.21.15.125:0/1044885121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b30067d20 msgr2=0x7f1b30156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:07.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.050+0000 7f1b2dd9b700 1 --2- 172.21.15.125:0/1044885121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b30067d20 0x7f1b30156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:07.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.050+0000 7f1b2dd9b700 1 -- 172.21.15.125:0/1044885121 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b28009a20 con 0x7f1b300caa40 2023-10-06T03:04:07.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.050+0000 7f1b2dd9b700 1 --2- 172.21.15.125:0/1044885121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b300caa40 0x7f1b3006ac90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1b2400c7e0 tx=0x7f1b24007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:07.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.050+0000 7f1b1e7fc700 1 -- 172.21.15.125:0/1044885121 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24005b30 con 0x7f1b300caa40 2023-10-06T03:04:07.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.050+0000 7f1b1e7fc700 1 -- 172.21.15.125:0/1044885121 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b24005c90 con 0x7f1b300caa40 2023-10-06T03:04:07.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.050+0000 7f1b34b7d700 1 -- 172.21.15.125:0/1044885121 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b30167350 con 0x7f1b300caa40 2023-10-06T03:04:07.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.050+0000 7f1b1e7fc700 1 -- 172.21.15.125:0/1044885121 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24007300 con 0x7f1b300caa40 2023-10-06T03:04:07.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.050+0000 7f1b34b7d700 1 -- 172.21.15.125:0/1044885121 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b30167b50 con 0x7f1b300caa40 2023-10-06T03:04:07.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.050+0000 7f1b1e7fc700 1 -- 172.21.15.125:0/1044885121 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1b2401c440 con 0x7f1b300caa40 2023-10-06T03:04:07.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.050+0000 7f1b1e7fc700 1 -- 172.21.15.125:0/1044885121 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f1b24005e00 con 0x7f1b300caa40 2023-10-06T03:04:07.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.051+0000 7f1b34b7d700 1 -- 172.21.15.125:0/1044885121 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b30066510 con 0x7f1b300caa40 2023-10-06T03:04:07.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.053+0000 7f1b1e7fc700 1 -- 172.21.15.125:0/1044885121 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1b24017070 con 0x7f1b300caa40 2023-10-06T03:04:07.062 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:07.061+0000 7fc4153411c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T03:04:07.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.121+0000 7f1b34b7d700 1 -- 172.21.15.125:0/1044885121 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b30167800 con 0x7f1b300caa40 2023-10-06T03:04:07.124 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:07.121+0000 7f55c47ea1c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T03:04:07.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.122+0000 7f1b1e7fc700 1 -- 172.21.15.125:0/1044885121 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f1b2401c6f0 con 0x7f1b300caa40 2023-10-06T03:04:07.124 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:07.125 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":10,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:06.871476+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:04:07.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.123+0000 7f1b34b7d700 1 -- 172.21.15.125:0/1044885121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b300caa40 msgr2=0x7f1b3006ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:07.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.123+0000 7f1b34b7d700 1 --2- 172.21.15.125:0/1044885121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b300caa40 0x7f1b3006ac90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1b2400c7e0 tx=0x7f1b24007df0 comp rx=0 tx=0).stop 2023-10-06T03:04:07.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.123+0000 7f1b34b7d700 1 -- 172.21.15.125:0/1044885121 shutdown_connections 2023-10-06T03:04:07.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.123+0000 7f1b34b7d700 1 --2- 172.21.15.125:0/1044885121 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1b300cc8f0 0x7f1b3006b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:07.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.123+0000 7f1b34b7d700 1 --2- 172.21.15.125:0/1044885121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b30067d20 0x7f1b30156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:07.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.123+0000 7f1b34b7d700 1 --2- 172.21.15.125:0/1044885121 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1b300caa40 0x7f1b3006ac90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:07.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.123+0000 7f1b34b7d700 1 -- 172.21.15.125:0/1044885121 >> 172.21.15.125:0/1044885121 conn(0x7f1b30068f00 msgr2=0x7f1b30067610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:07.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.123+0000 7f1b34b7d700 1 -- 172.21.15.125:0/1044885121 shutdown_connections 2023-10-06T03:04:07.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:07.123+0000 7f1b34b7d700 1 -- 172.21.15.125:0/1044885121 wait complete. 2023-10-06T03:04:07.137 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T03:04:07.137 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T03:04:07.189 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:07.188+0000 7f55c47ea1c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T03:04:07.243 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:07.241+0000 7fc4153411c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T03:04:07.320 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:07.319+0000 7fc4153411c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T03:04:07.370 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:07.368+0000 7f55c47ea1c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T03:04:07.395 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:07.393+0000 7fc4153411c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T03:04:07.445 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:07.444+0000 7f55c47ea1c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T03:04:07.471 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:07.470+0000 7fc4153411c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T03:04:07.504 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-06T03:04:07.503+0000 7fedcacb0540 -1 Falling back to public interface 2023-10-06T03:04:07.509 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-06T03:04:07.508+0000 7f75b16c3540 -1 Falling back to public interface 2023-10-06T03:04:07.515 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-06T03:04:07.514+0000 7f8a6c90e540 -1 Falling back to public interface 2023-10-06T03:04:07.520 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-06T03:04:07.519+0000 7f0f1cfa9540 -1 Falling back to public interface 2023-10-06T03:04:07.520 INFO:tasks.ceph.osd.1.smithi125.stderr:2023-10-06T03:04:07.519+0000 7f7a70530540 -1 Falling back to public interface 2023-10-06T03:04:07.520 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-10-06T03:04:07.519+0000 7fe4e17f1540 -1 Falling back to public interface 2023-10-06T03:04:07.521 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-06T03:04:07.519+0000 7f035b232540 -1 Falling back to public interface 2023-10-06T03:04:07.521 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-06T03:04:07.519+0000 7f0f173b5700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-10-06T03:04:07.522 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-06T03:04:07.519+0000 7f035563e700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-10-06T03:04:07.522 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-10-06T03:04:07.519+0000 7fe4dbbfd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-10-06T03:04:07.522 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-06T03:04:07.519+0000 7f0f173b5700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6802/0: (98) Address already in use 2023-10-06T03:04:07.523 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-06T03:04:07.519+0000 7f0f173b5700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6803/0: (98) Address already in use 2023-10-06T03:04:07.523 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-06T03:04:07.519+0000 7f0f173b5700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6804/0: (98) Address already in use 2023-10-06T03:04:07.523 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-06T03:04:07.520+0000 7feacba08540 -1 Falling back to public interface 2023-10-06T03:04:07.525 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:07.524+0000 7f55c47ea1c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T03:04:07.616 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:07.615+0000 7f55c47ea1c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T03:04:07.650 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:07.649+0000 7fc4153411c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T03:04:07.728 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:07.727+0000 7fc4153411c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T03:04:07.794 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:07.792+0000 7f55c47ea1c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T03:04:07.873 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:07.872+0000 7f55c47ea1c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T03:04:07.943 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T03:04:08.013 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:08.011+0000 7fc4153411c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T03:04:08.054 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.052+0000 7f05956c4700 1 Processor -- start 2023-10-06T03:04:08.054 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.052+0000 7f05956c4700 1 -- start start 2023-10-06T03:04:08.056 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.053+0000 7f05956c4700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f05901591a0 0x7f059006d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:08.056 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.053+0000 7f05956c4700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0590159570 0x7f0590067660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:08.056 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.053+0000 7f05956c4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05900af850 con 0x7f05900ca000 2023-10-06T03:04:08.056 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.053+0000 7f05956c4700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05901599e0 con 0x7f05901591a0 2023-10-06T03:04:08.056 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.053+0000 7f05956c4700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05900c9b70 con 0x7f0590159570 2023-10-06T03:04:08.057 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.053+0000 7f058f7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f05900ca000 0x7f05900cb760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:49038/0 (socket says 172.21.15.125:49038) 2023-10-06T03:04:08.057 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.053+0000 7f058f7fe700 1 -- 172.21.15.125:0/2852630138 learned_addr learned my addr 172.21.15.125:0/2852630138 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:08.057 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.053+0000 7f058effd700 1 --2- 172.21.15.125:0/2852630138 >> v2:172.21.15.130:3300/0 conn(0x7f05901591a0 0x7f059006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:08.057 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.053+0000 7f058e7fc700 1 --2- 172.21.15.125:0/2852630138 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0590159570 0x7f0590067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:08.057 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.053+0000 7f058dffb700 1 -- 172.21.15.125:0/2852630138 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617335196 0 0) 0x7f05900af850 con 0x7f05900ca000 2023-10-06T03:04:08.057 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.053+0000 7f058dffb700 1 -- 172.21.15.125:0/2852630138 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0578003570 con 0x7f05900ca000 2023-10-06T03:04:08.057 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.054+0000 7f058e7fc700 1 -- 172.21.15.125:0/2852630138 >> v2:172.21.15.130:3300/0 conn(0x7f05901591a0 msgr2=0x7f059006d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:08.057 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.054+0000 7f058e7fc700 1 --2- 172.21.15.125:0/2852630138 >> v2:172.21.15.130:3300/0 conn(0x7f05901591a0 0x7f059006d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:08.058 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.054+0000 7f058e7fc700 1 -- 172.21.15.125:0/2852630138 >> v1:172.21.15.125:6789/0 conn(0x7f05900ca000 legacy=0x7f05900cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:08.058 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.054+0000 7f058e7fc700 1 -- 172.21.15.125:0/2852630138 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0590067ba0 con 0x7f0590159570 2023-10-06T03:04:08.058 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.054+0000 7f058effd700 1 --2- 172.21.15.125:0/2852630138 >> v2:172.21.15.130:3300/0 conn(0x7f05901591a0 0x7f059006d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:08.058 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.054+0000 7f058e7fc700 1 --2- 172.21.15.125:0/2852630138 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0590159570 0x7f0590067660 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f05840098e0 tx=0x7f05840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e69c24848fd61a7c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:08.058 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.054+0000 7f058dffb700 1 -- 172.21.15.125:0/2852630138 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584011630 con 0x7f0590159570 2023-10-06T03:04:08.058 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.054+0000 7f058dffb700 1 -- 172.21.15.125:0/2852630138 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0584011790 con 0x7f0590159570 2023-10-06T03:04:08.058 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.054+0000 7f058dffb700 1 -- 172.21.15.125:0/2852630138 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584011b30 con 0x7f0590159570 2023-10-06T03:04:08.058 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.054+0000 7f05956c4700 1 -- 172.21.15.125:0/2852630138 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0590159570 msgr2=0x7f0590067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:08.059 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.054+0000 7f05956c4700 1 --2- 172.21.15.125:0/2852630138 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0590159570 0x7f0590067660 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f05840098e0 tx=0x7f05840091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:08.059 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.055+0000 7f05956c4700 1 -- 172.21.15.125:0/2852630138 shutdown_connections 2023-10-06T03:04:08.059 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.055+0000 7f05956c4700 1 --2- 172.21.15.125:0/2852630138 >> v2:172.21.15.130:3300/0 conn(0x7f05901591a0 0x7f059006d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:08.059 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.055+0000 7f05956c4700 1 --2- 172.21.15.125:0/2852630138 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0590159570 0x7f0590067660 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:08.059 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.055+0000 7f05956c4700 1 -- 172.21.15.125:0/2852630138 >> 172.21.15.125:0/2852630138 conn(0x7f05900cd960 msgr2=0x7f0590068770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:08.059 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.055+0000 7f05956c4700 1 -- 172.21.15.125:0/2852630138 shutdown_connections 2023-10-06T03:04:08.059 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.055+0000 7f05956c4700 1 -- 172.21.15.125:0/2852630138 wait complete. 2023-10-06T03:04:08.061 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.056+0000 7f05956c4700 1 Processor -- start 2023-10-06T03:04:08.062 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.056+0000 7f05956c4700 1 -- start start 2023-10-06T03:04:08.062 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f05956c4700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05900ca000 0x7f05900c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:08.062 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f05956c4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05901591a0 0x7f059015a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:08.062 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f05956c4700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0590159570 0x7f059015a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:08.062 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f05956c4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05900b1770 con 0x7f05901591a0 2023-10-06T03:04:08.062 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f05956c4700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05900afed0 con 0x7f0590159570 2023-10-06T03:04:08.062 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f05956c4700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059015adb0 con 0x7f05900ca000 2023-10-06T03:04:08.062 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f058e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05901591a0 0x7f059015a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:08.063 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f058e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05901591a0 0x7f059015a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44812/0 (socket says 172.21.15.125:44812) 2023-10-06T03:04:08.063 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f058e7fc700 1 -- 172.21.15.125:0/2180858672 learned_addr learned my addr 172.21.15.125:0/2180858672 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:08.063 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f058effd700 1 --2- 172.21.15.125:0/2180858672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05900ca000 0x7f05900c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:08.063 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f058f7fe700 1 --2- 172.21.15.125:0/2180858672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0590159570 0x7f059015a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:08.063 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f058e7fc700 1 -- 172.21.15.125:0/2180858672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05900ca000 msgr2=0x7f05900c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:08.063 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f058e7fc700 1 --2- 172.21.15.125:0/2180858672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05900ca000 0x7f05900c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:08.063 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f058e7fc700 1 -- 172.21.15.125:0/2180858672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0590159570 msgr2=0x7f059015a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:08.063 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f058e7fc700 1 --2- 172.21.15.125:0/2180858672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0590159570 0x7f059015a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:08.063 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f058e7fc700 1 -- 172.21.15.125:0/2180858672 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0580009420 con 0x7f05901591a0 2023-10-06T03:04:08.063 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f058effd700 1 --2- 172.21.15.125:0/2180858672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05900ca000 0x7f05900c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:08.064 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f058e7fc700 1 --2- 172.21.15.125:0/2180858672 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05901591a0 0x7f059015a240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f05900c9cb0 tx=0x7f0584017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:08.064 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f0576ffd700 1 -- 172.21.15.125:0/2180858672 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584000c40 con 0x7f05901591a0 2023-10-06T03:04:08.064 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f0576ffd700 1 -- 172.21.15.125:0/2180858672 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0584011900 con 0x7f05901591a0 2023-10-06T03:04:08.064 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f05956c4700 1 -- 172.21.15.125:0/2180858672 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0584009420 con 0x7f05901591a0 2023-10-06T03:04:08.064 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f0576ffd700 1 -- 172.21.15.125:0/2180858672 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584025420 con 0x7f05901591a0 2023-10-06T03:04:08.064 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.057+0000 7f05956c4700 1 -- 172.21.15.125:0/2180858672 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059015b370 con 0x7f05901591a0 2023-10-06T03:04:08.064 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.058+0000 7f0576ffd700 1 -- 172.21.15.125:0/2180858672 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0584023070 con 0x7f05901591a0 2023-10-06T03:04:08.064 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.058+0000 7f0576ffd700 1 -- 172.21.15.125:0/2180858672 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f058402ea90 con 0x7f05901591a0 2023-10-06T03:04:08.064 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.058+0000 7f05956c4700 1 -- 172.21.15.125:0/2180858672 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059004c3c0 con 0x7f05901591a0 2023-10-06T03:04:08.064 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.060+0000 7f0576ffd700 1 -- 172.21.15.125:0/2180858672 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f058402a070 con 0x7f05901591a0 2023-10-06T03:04:08.085 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:08.084+0000 7fc4153411c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T03:04:08.131 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.130+0000 7f05956c4700 1 -- 172.21.15.125:0/2180858672 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05900b18b0 con 0x7f05901591a0 2023-10-06T03:04:08.132 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.131+0000 7f0576ffd700 1 -- 172.21.15.125:0/2180858672 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f0584015020 con 0x7f05901591a0 2023-10-06T03:04:08.132 INFO:teuthology.misc.health.smithi125.stdout: 2023-10-06T03:04:08.132 INFO:teuthology.misc.health.smithi125.stdout:{"epoch":10,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:06.871476+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:04:08.133 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.131+0000 7f05956c4700 1 -- 172.21.15.125:0/2180858672 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05901591a0 msgr2=0x7f059015a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:08.133 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.131+0000 7f05956c4700 1 --2- 172.21.15.125:0/2180858672 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05901591a0 0x7f059015a240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f05900c9cb0 tx=0x7f0584017000 comp rx=0 tx=0).stop 2023-10-06T03:04:08.134 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.131+0000 7f05956c4700 1 -- 172.21.15.125:0/2180858672 shutdown_connections 2023-10-06T03:04:08.134 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.131+0000 7f05956c4700 1 --2- 172.21.15.125:0/2180858672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0590159570 0x7f059015a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:08.134 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.131+0000 7f05956c4700 1 --2- 172.21.15.125:0/2180858672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f05900ca000 0x7f05900c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:08.134 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.131+0000 7f05956c4700 1 --2- 172.21.15.125:0/2180858672 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05901591a0 0x7f059015a240 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:08.134 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.132+0000 7f05956c4700 1 -- 172.21.15.125:0/2180858672 >> 172.21.15.125:0/2180858672 conn(0x7f05900cd960 msgr2=0x7f0590157aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:08.134 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.132+0000 7f05956c4700 1 -- 172.21.15.125:0/2180858672 shutdown_connections 2023-10-06T03:04:08.134 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:08.132+0000 7f05956c4700 1 -- 172.21.15.125:0/2180858672 wait complete. 2023-10-06T03:04:08.144 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T03:04:08.158 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:08.157+0000 7f55c47ea1c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T03:04:08.226 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:08.225+0000 7f55c47ea1c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T03:04:08.590 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:08.589+0000 7fc4153411c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T03:04:08.731 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:08.730+0000 7f55c47ea1c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T03:04:08.905 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:08.904+0000 7fc4153411c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T03:04:09.043 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:09.042+0000 7fc4153411c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:04:09.044 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:09.043+0000 7f55c47ea1c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T03:04:09.185 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:09.183+0000 7f55c47ea1c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:04:09.395 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:09.394+0000 7fc4153411c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T03:04:09.539 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:09.538+0000 7fc4153411c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:04:09.541 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:09.540+0000 7f55c47ea1c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T03:04:09.682 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:09.680+0000 7f55c47ea1c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T03:04:09.685 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:09.684+0000 7fc4153411c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T03:04:09.786 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:09.785+0000 7fc4153411c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T03:04:09.831 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:09.830+0000 7f55c47ea1c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T03:04:09.932 INFO:tasks.ceph.mgr.x.smithi130.stderr:2023-10-06T03:04:09.930+0000 7f55c47ea1c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T03:04:10.809 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:10.808+0000 7fc3d9a22700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T03:04:10.812 INFO:tasks.ceph.mgr.y.smithi125.stderr:2023-10-06T03:04:10.811+0000 7fc3d9a22700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T03:04:11.022 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-06T03:04:11.020+0000 7fedcacb0540 -1 osd.7 0 log_to_monitors true 2023-10-06T03:04:11.024 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-06T03:04:11.023+0000 7f035b232540 -1 osd.3 0 log_to_monitors true 2023-10-06T03:04:11.026 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-10-06T03:04:11.025+0000 7fe4e17f1540 -1 osd.2 0 log_to_monitors true 2023-10-06T03:04:11.031 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-06T03:04:11.030+0000 7feacba08540 -1 osd.6 0 log_to_monitors true 2023-10-06T03:04:11.037 INFO:tasks.ceph.osd.1.smithi125.stderr:2023-10-06T03:04:11.036+0000 7f7a70530540 -1 osd.1 0 log_to_monitors true 2023-10-06T03:04:11.044 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-06T03:04:11.043+0000 7f0f1cfa9540 -1 osd.0 0 log_to_monitors true 2023-10-06T03:04:11.054 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-06T03:04:11.053+0000 7f75b16c3540 -1 osd.5 0 log_to_monitors true 2023-10-06T03:04:11.055 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-06T03:04:11.054+0000 7f8a6c90e540 -1 osd.4 0 log_to_monitors true 2023-10-06T03:04:14.747 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-06T03:04:14.742+0000 7feac260d700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T03:04:14.749 INFO:tasks.ceph.osd.6.smithi130.stderr:2023-10-06T03:04:14.748+0000 7feabb404700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:04:14.794 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-06T03:04:14.793+0000 7f8a63513700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T03:04:14.802 INFO:tasks.ceph.osd.4.smithi130.stderr:2023-10-06T03:04:14.800+0000 7f8a5c30a700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:04:14.802 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-06T03:04:14.799+0000 7f75a82c8700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T03:04:14.805 INFO:tasks.ceph.osd.5.smithi130.stderr:2023-10-06T03:04:14.803+0000 7f75a10bf700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:04:14.825 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-06T03:04:14.824+0000 7fedc18b5700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T03:04:14.831 INFO:tasks.ceph.osd.7.smithi130.stderr:2023-10-06T03:04:14.830+0000 7fedba6ac700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:04:14.927 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-10-06T03:04:14.924+0000 7fe4d83f6700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T03:04:14.929 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-06T03:04:14.926+0000 7f0f13bae700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T03:04:14.929 INFO:tasks.ceph.osd.2.smithi125.stderr:2023-10-06T03:04:14.928+0000 7fe4d11ed700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:04:14.933 INFO:tasks.ceph.osd.1.smithi125.stderr:2023-10-06T03:04:14.930+0000 7f7a67135700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T03:04:14.935 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-06T03:04:14.932+0000 7f0351e37700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T03:04:14.935 INFO:tasks.ceph.osd.0.smithi125.stderr:2023-10-06T03:04:14.934+0000 7f0f0c9a5700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:04:14.938 INFO:tasks.ceph.osd.1.smithi125.stderr:2023-10-06T03:04:14.937+0000 7f7a5ff2c700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:04:14.939 INFO:tasks.ceph.osd.3.smithi125.stderr:2023-10-06T03:04:14.937+0000 7f034ac2e700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T03:04:14.950 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T03:04:15.057 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.056+0000 7f6638bb4700 1 Processor -- start 2023-10-06T03:04:15.058 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.056+0000 7f6638bb4700 1 -- start start 2023-10-06T03:04:15.067 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.057+0000 7f6638bb4700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f663406eb00 0x7f66340c9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:15.067 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.057+0000 7f6638bb4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f663406eed0 0x7f6634155120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:15.067 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.057+0000 7f6638bb4700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66340af440 con 0x7f66340abb70 2023-10-06T03:04:15.067 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.057+0000 7f6638bb4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6634067d70 con 0x7f663406eed0 2023-10-06T03:04:15.068 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.057+0000 7f6638bb4700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6634067f60 con 0x7f663406eb00 2023-10-06T03:04:15.068 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.057+0000 7f6632d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f663406eed0 0x7f6634155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:15.068 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.057+0000 7f6632d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f663406eed0 0x7f6634155120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44908/0 (socket says 172.21.15.125:44908) 2023-10-06T03:04:15.068 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.057+0000 7f6632d9d700 1 -- 172.21.15.125:0/861788961 learned_addr learned my addr 172.21.15.125:0/861788961 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:15.068 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.058+0000 7f663259c700 1 --2- 172.21.15.125:0/861788961 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f663406eb00 0x7f66340c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:15.068 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.058+0000 7f6632d9d700 1 -- 172.21.15.125:0/861788961 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f663406eb00 msgr2=0x7f66340c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:15.069 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.058+0000 7f6632d9d700 1 --2- 172.21.15.125:0/861788961 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f663406eb00 0x7f66340c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:15.069 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.058+0000 7f6632d9d700 1 -- 172.21.15.125:0/861788961 >> v1:172.21.15.130:6789/0 conn(0x7f66340abb70 legacy=0x7f6634067660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:15.069 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.058+0000 7f6632d9d700 1 -- 172.21.15.125:0/861788961 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6634068240 con 0x7f663406eed0 2023-10-06T03:04:15.069 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.058+0000 7f663259c700 1 --2- 172.21.15.125:0/861788961 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f663406eb00 0x7f66340c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:04:15.069 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.058+0000 7f6632d9d700 1 --2- 172.21.15.125:0/861788961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f663406eed0 0x7f6634155120 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f662c009f20 tx=0x7f662c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be74a79d3f80dc94 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:15.070 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.058+0000 7f663159a700 1 -- 172.21.15.125:0/861788961 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c00e070 con 0x7f663406eed0 2023-10-06T03:04:15.070 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.058+0000 7f663159a700 1 -- 172.21.15.125:0/861788961 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662c00ba40 con 0x7f663406eed0 2023-10-06T03:04:15.070 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.058+0000 7f663159a700 1 -- 172.21.15.125:0/861788961 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662c0092e0 con 0x7f663406eed0 2023-10-06T03:04:15.070 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.058+0000 7f6638bb4700 1 -- 172.21.15.125:0/861788961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f663406eed0 msgr2=0x7f6634155120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:15.070 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.058+0000 7f6638bb4700 1 --2- 172.21.15.125:0/861788961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f663406eed0 0x7f6634155120 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f662c009f20 tx=0x7f662c009840 comp rx=0 tx=0).stop 2023-10-06T03:04:15.071 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.059+0000 7f6638bb4700 1 -- 172.21.15.125:0/861788961 shutdown_connections 2023-10-06T03:04:15.071 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.059+0000 7f6638bb4700 1 --2- 172.21.15.125:0/861788961 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f663406eed0 0x7f6634155120 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:15.071 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.059+0000 7f6638bb4700 1 --2- 172.21.15.125:0/861788961 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f663406eb00 0x7f66340c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:15.071 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.059+0000 7f6638bb4700 1 -- 172.21.15.125:0/861788961 >> 172.21.15.125:0/861788961 conn(0x7f66340cc620 msgr2=0x7f66340cca20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:15.071 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.059+0000 7f6638bb4700 1 -- 172.21.15.125:0/861788961 shutdown_connections 2023-10-06T03:04:15.071 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.059+0000 7f6638bb4700 1 -- 172.21.15.125:0/861788961 wait complete. 2023-10-06T03:04:15.072 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.060+0000 7f6638bb4700 1 Processor -- start 2023-10-06T03:04:15.072 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.060+0000 7f6638bb4700 1 -- start start 2023-10-06T03:04:15.072 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.060+0000 7f6638bb4700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f663406eb00 0x7f66340a6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:15.072 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.060+0000 7f6638bb4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f663406eed0 0x7f66340a7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:15.072 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.060+0000 7f6638bb4700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66340abb70 0x7f6634168110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:15.073 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.060+0000 7f6638bb4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66340a7860 con 0x7f663406eed0 2023-10-06T03:04:15.073 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.060+0000 7f6638bb4700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66340a5140 con 0x7f663406eb00 2023-10-06T03:04:15.073 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.060+0000 7f6638bb4700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66340a4530 con 0x7f66340abb70 2023-10-06T03:04:15.073 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.061+0000 7f6631d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f663406eed0 0x7f66340a7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:15.073 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.061+0000 7f6631d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f663406eed0 0x7f66340a7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44910/0 (socket says 172.21.15.125:44910) 2023-10-06T03:04:15.073 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.061+0000 7f6631d9b700 1 -- 172.21.15.125:0/2210442040 learned_addr learned my addr 172.21.15.125:0/2210442040 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:15.073 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.061+0000 7f663259c700 1 --2- 172.21.15.125:0/2210442040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f663406eb00 0x7f66340a6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:15.074 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.061+0000 7f6632d9d700 1 --2- 172.21.15.125:0/2210442040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66340abb70 0x7f6634168110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:15.074 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.061+0000 7f6631d9b700 1 -- 172.21.15.125:0/2210442040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66340abb70 msgr2=0x7f6634168110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:15.074 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.061+0000 7f6631d9b700 1 --2- 172.21.15.125:0/2210442040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66340abb70 0x7f6634168110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:15.074 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.061+0000 7f6631d9b700 1 -- 172.21.15.125:0/2210442040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f663406eb00 msgr2=0x7f66340a6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:15.074 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.061+0000 7f6631d9b700 1 --2- 172.21.15.125:0/2210442040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f663406eb00 0x7f66340a6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:15.074 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.061+0000 7f6631d9b700 1 -- 172.21.15.125:0/2210442040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662c009ae0 con 0x7f663406eed0 2023-10-06T03:04:15.074 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.061+0000 7f6631d9b700 1 --2- 172.21.15.125:0/2210442040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f663406eed0 0x7f66340a7320 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f662800b5e0 tx=0x7f6628009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:15.075 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.061+0000 7f66227fc700 1 -- 172.21.15.125:0/2210442040 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662800f510 con 0x7f663406eed0 2023-10-06T03:04:15.075 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.061+0000 7f66227fc700 1 -- 172.21.15.125:0/2210442040 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662800f670 con 0x7f663406eed0 2023-10-06T03:04:15.075 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.061+0000 7f6638bb4700 1 -- 172.21.15.125:0/2210442040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66340a4810 con 0x7f663406eed0 2023-10-06T03:04:15.075 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.061+0000 7f66227fc700 1 -- 172.21.15.125:0/2210442040 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662800fa30 con 0x7f663406eed0 2023-10-06T03:04:15.075 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.061+0000 7f6638bb4700 1 -- 172.21.15.125:0/2210442040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66340a4dd0 con 0x7f663406eed0 2023-10-06T03:04:15.075 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.062+0000 7f6638bb4700 1 -- 172.21.15.125:0/2210442040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66340a52d0 con 0x7f663406eed0 2023-10-06T03:04:15.075 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.062+0000 7f66227fc700 1 -- 172.21.15.125:0/2210442040 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f662801a400 con 0x7f663406eed0 2023-10-06T03:04:15.075 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.063+0000 7f66227fc700 1 --2- 172.21.15.125:0/2210442040 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6614066ea0 0x7f6614069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:15.076 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.063+0000 7f66227fc700 1 -- 172.21.15.125:0/2210442040 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f6628083170 con 0x7f663406eed0 2023-10-06T03:04:15.076 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.063+0000 7f663259c700 1 --2- 172.21.15.125:0/2210442040 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6614066ea0 0x7f6614069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:15.076 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.063+0000 7f663259c700 1 --2- 172.21.15.125:0/2210442040 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6614066ea0 0x7f6614069350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f662400ac00 tx=0x7f6624006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:15.076 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.068+0000 7f66227fc700 1 -- 172.21.15.125:0/2210442040 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66280512d0 con 0x7f663406eed0 2023-10-06T03:04:15.251 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.249+0000 7f6638bb4700 1 -- 172.21.15.125:0/2210442040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f663404c3c0 con 0x7f663406eed0 2023-10-06T03:04:15.251 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.250+0000 7f66227fc700 1 -- 172.21.15.125:0/2210442040 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f66280548f0 con 0x7f663406eed0 2023-10-06T03:04:15.251 INFO:teuthology.misc.health.smithi125.stdout: 2023-10-06T03:04:15.252 INFO:teuthology.misc.health.smithi125.stdout:{"epoch":12,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:12.805438+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:04:15.253 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.252+0000 7f6638bb4700 1 -- 172.21.15.125:0/2210442040 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6614066ea0 msgr2=0x7f6614069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:15.254 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.252+0000 7f6638bb4700 1 --2- 172.21.15.125:0/2210442040 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6614066ea0 0x7f6614069350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f662400ac00 tx=0x7f6624006f90 comp rx=0 tx=0).stop 2023-10-06T03:04:15.254 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.252+0000 7f6638bb4700 1 -- 172.21.15.125:0/2210442040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f663406eed0 msgr2=0x7f66340a7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:15.254 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.252+0000 7f6638bb4700 1 --2- 172.21.15.125:0/2210442040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f663406eed0 0x7f66340a7320 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f662800b5e0 tx=0x7f6628009120 comp rx=0 tx=0).stop 2023-10-06T03:04:15.254 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.252+0000 7f6638bb4700 1 -- 172.21.15.125:0/2210442040 shutdown_connections 2023-10-06T03:04:15.254 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.252+0000 7f6638bb4700 1 --2- 172.21.15.125:0/2210442040 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6614066ea0 0x7f6614069350 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:15.254 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.252+0000 7f6638bb4700 1 --2- 172.21.15.125:0/2210442040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66340abb70 0x7f6634168110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:15.254 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.252+0000 7f6638bb4700 1 --2- 172.21.15.125:0/2210442040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f663406eb00 0x7f66340a6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:15.254 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.252+0000 7f6638bb4700 1 --2- 172.21.15.125:0/2210442040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f663406eed0 0x7f66340a7320 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:15.254 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.252+0000 7f6638bb4700 1 -- 172.21.15.125:0/2210442040 >> 172.21.15.125:0/2210442040 conn(0x7f66340cc620 msgr2=0x7f66340cbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:15.255 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.252+0000 7f6638bb4700 1 -- 172.21.15.125:0/2210442040 shutdown_connections 2023-10-06T03:04:15.255 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:15.252+0000 7f6638bb4700 1 -- 172.21.15.125:0/2210442040 wait complete. 2023-10-06T03:04:15.264 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T03:04:22.070 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T03:04:22.193 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.191+0000 7f588752a700 1 Processor -- start 2023-10-06T03:04:22.193 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.192+0000 7f588752a700 1 -- start start 2023-10-06T03:04:22.196 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.192+0000 7f588752a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58800689c0 0x7f588015d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.197 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.192+0000 7f588752a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5880068240 0x7f588015d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.197 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.192+0000 7f588752a700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58800b1650 con 0x7f58800a86d0 2023-10-06T03:04:22.197 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.192+0000 7f588752a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58800afd60 con 0x7f5880068240 2023-10-06T03:04:22.197 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.192+0000 7f588752a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58800b0040 con 0x7f58800689c0 2023-10-06T03:04:22.197 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.193+0000 7f5884ac5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5880068240 0x7f588015d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:22.197 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.193+0000 7f5884ac5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5880068240 0x7f588015d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46534/0 (socket says 172.21.15.125:46534) 2023-10-06T03:04:22.197 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.193+0000 7f5884ac5700 1 -- 172.21.15.125:0/3931210013 learned_addr learned my addr 172.21.15.125:0/3931210013 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:22.197 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.193+0000 7f58852c6700 1 --2- 172.21.15.125:0/3931210013 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58800689c0 0x7f588015d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:22.197 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.193+0000 7f5884ac5700 1 -- 172.21.15.125:0/3931210013 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58800689c0 msgr2=0x7f588015d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:22.198 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.193+0000 7f5884ac5700 1 --2- 172.21.15.125:0/3931210013 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58800689c0 0x7f588015d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.198 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.193+0000 7f5884ac5700 1 -- 172.21.15.125:0/3931210013 >> v1:172.21.15.130:6789/0 conn(0x7f58800a86d0 legacy=0x7f58800ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:22.198 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.193+0000 7f5884ac5700 1 -- 172.21.15.125:0/3931210013 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58800b0320 con 0x7f5880068240 2023-10-06T03:04:22.198 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.193+0000 7f58852c6700 1 --2- 172.21.15.125:0/3931210013 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58800689c0 0x7f588015d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:22.198 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.193+0000 7f5884ac5700 1 --2- 172.21.15.125:0/3931210013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5880068240 0x7f588015d7c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f58700099b0 tx=0x7f5870009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee980e92c7a979c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:22.198 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.193+0000 7f5877fff700 1 -- 172.21.15.125:0/3931210013 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587000b860 con 0x7f5880068240 2023-10-06T03:04:22.198 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.193+0000 7f5877fff700 1 -- 172.21.15.125:0/3931210013 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587000b9c0 con 0x7f5880068240 2023-10-06T03:04:22.198 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.193+0000 7f5877fff700 1 -- 172.21.15.125:0/3931210013 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587000bd60 con 0x7f5880068240 2023-10-06T03:04:22.198 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.194+0000 7f588752a700 1 -- 172.21.15.125:0/3931210013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5880068240 msgr2=0x7f588015d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:22.198 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.194+0000 7f588752a700 1 --2- 172.21.15.125:0/3931210013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5880068240 0x7f588015d7c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f58700099b0 tx=0x7f5870009250 comp rx=0 tx=0).stop 2023-10-06T03:04:22.199 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.194+0000 7f588752a700 1 -- 172.21.15.125:0/3931210013 shutdown_connections 2023-10-06T03:04:22.199 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.194+0000 7f588752a700 1 --2- 172.21.15.125:0/3931210013 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58800689c0 0x7f588015d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.199 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.194+0000 7f588752a700 1 --2- 172.21.15.125:0/3931210013 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5880068240 0x7f588015d7c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.199 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.194+0000 7f588752a700 1 -- 172.21.15.125:0/3931210013 >> 172.21.15.125:0/3931210013 conn(0x7f5880067e40 msgr2=0x7f58800cdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:22.199 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.194+0000 7f588752a700 1 -- 172.21.15.125:0/3931210013 shutdown_connections 2023-10-06T03:04:22.199 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.194+0000 7f588752a700 1 -- 172.21.15.125:0/3931210013 wait complete. 2023-10-06T03:04:22.199 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.195+0000 7f588752a700 1 Processor -- start 2023-10-06T03:04:22.199 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.195+0000 7f588752a700 1 -- start start 2023-10-06T03:04:22.202 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.196+0000 7f588752a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5880068240 0x7f5880151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.202 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.196+0000 7f588752a700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58800689c0 0x7f5880152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.202 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.196+0000 7f588752a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58800a86d0 0x7f5880157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.202 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.196+0000 7f588752a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58800997e0 con 0x7f5880068240 2023-10-06T03:04:22.202 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.196+0000 7f588752a700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5880098bd0 con 0x7f58800689c0 2023-10-06T03:04:22.202 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.196+0000 7f588752a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5880098eb0 con 0x7f58800a86d0 2023-10-06T03:04:22.202 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.196+0000 7f58852c6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5880068240 0x7f5880151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:22.202 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.196+0000 7f58852c6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5880068240 0x7f5880151f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46550/0 (socket says 172.21.15.125:46550) 2023-10-06T03:04:22.203 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.196+0000 7f58852c6700 1 -- 172.21.15.125:0/1002412024 learned_addr learned my addr 172.21.15.125:0/1002412024 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:22.203 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.196+0000 7f58852c6700 1 -- 172.21.15.125:0/1002412024 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58800a86d0 msgr2=0x7f5880157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:22.203 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.196+0000 7f58852c6700 1 --2- 172.21.15.125:0/1002412024 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58800a86d0 0x7f5880157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.203 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.196+0000 7f58852c6700 1 -- 172.21.15.125:0/1002412024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58800689c0 msgr2=0x7f5880152890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:22.203 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.196+0000 7f58852c6700 1 --2- 172.21.15.125:0/1002412024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58800689c0 0x7f5880152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.203 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.196+0000 7f58852c6700 1 -- 172.21.15.125:0/1002412024 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58700094f0 con 0x7f5880068240 2023-10-06T03:04:22.203 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.196+0000 7f58852c6700 1 --2- 172.21.15.125:0/1002412024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5880068240 0x7f5880151f30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f587c00e920 tx=0x7f587c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:22.203 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.197+0000 7f58757fa700 1 -- 172.21.15.125:0/1002412024 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c005a00 con 0x7f5880068240 2023-10-06T03:04:22.203 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.197+0000 7f58757fa700 1 -- 172.21.15.125:0/1002412024 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587c005b60 con 0x7f5880068240 2023-10-06T03:04:22.203 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.197+0000 7f588752a700 1 -- 172.21.15.125:0/1002412024 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5880099190 con 0x7f5880068240 2023-10-06T03:04:22.204 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.197+0000 7f58757fa700 1 -- 172.21.15.125:0/1002412024 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587c006020 con 0x7f5880068240 2023-10-06T03:04:22.204 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.197+0000 7f588752a700 1 -- 172.21.15.125:0/1002412024 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5880152470 con 0x7f5880068240 2023-10-06T03:04:22.204 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.198+0000 7f588752a700 1 -- 172.21.15.125:0/1002412024 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588004c3c0 con 0x7f5880068240 2023-10-06T03:04:22.204 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.198+0000 7f58757fa700 1 -- 172.21.15.125:0/1002412024 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f587c006410 con 0x7f5880068240 2023-10-06T03:04:22.204 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.198+0000 7f58757fa700 1 --2- 172.21.15.125:0/1002412024 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5864066f30 0x7f58640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.204 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.198+0000 7f58757fa700 1 -- 172.21.15.125:0/1002412024 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f587c084310 con 0x7f5880068240 2023-10-06T03:04:22.204 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.198+0000 7f5884ac5700 1 --2- 172.21.15.125:0/1002412024 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5864066f30 0x7f58640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:22.204 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.199+0000 7f5884ac5700 1 --2- 172.21.15.125:0/1002412024 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5864066f30 0x7f58640693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f58700099b0 tx=0x7f5870017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:22.204 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.203+0000 7f58757fa700 1 -- 172.21.15.125:0/1002412024 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f587c0518d0 con 0x7f5880068240 2023-10-06T03:04:22.388 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.386+0000 7f588752a700 1 -- 172.21.15.125:0/1002412024 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58800b0600 con 0x7f5880068240 2023-10-06T03:04:22.388 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.387+0000 7f58757fa700 1 -- 172.21.15.125:0/1002412024 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12271 (secure 0 0 0) 0x7f587c054ef0 con 0x7f5880068240 2023-10-06T03:04:22.389 INFO:teuthology.misc.health.smithi125.stdout: 2023-10-06T03:04:22.389 INFO:teuthology.misc.health.smithi125.stdout:{"epoch":16,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:18.774160+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:04:22.391 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.389+0000 7f588752a700 1 -- 172.21.15.125:0/1002412024 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5864066f30 msgr2=0x7f58640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:22.391 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.389+0000 7f588752a700 1 --2- 172.21.15.125:0/1002412024 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5864066f30 0x7f58640693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f58700099b0 tx=0x7f5870017000 comp rx=0 tx=0).stop 2023-10-06T03:04:22.391 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.389+0000 7f588752a700 1 -- 172.21.15.125:0/1002412024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5880068240 msgr2=0x7f5880151f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:22.391 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.389+0000 7f588752a700 1 --2- 172.21.15.125:0/1002412024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5880068240 0x7f5880151f30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f587c00e920 tx=0x7f587c008040 comp rx=0 tx=0).stop 2023-10-06T03:04:22.391 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.389+0000 7f588752a700 1 -- 172.21.15.125:0/1002412024 shutdown_connections 2023-10-06T03:04:22.391 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.389+0000 7f588752a700 1 --2- 172.21.15.125:0/1002412024 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5864066f30 0x7f58640693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.391 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.389+0000 7f588752a700 1 --2- 172.21.15.125:0/1002412024 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58800a86d0 0x7f5880157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.392 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.389+0000 7f588752a700 1 --2- 172.21.15.125:0/1002412024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5880068240 0x7f5880151f30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.392 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.389+0000 7f588752a700 1 --2- 172.21.15.125:0/1002412024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58800689c0 0x7f5880152890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.392 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.389+0000 7f588752a700 1 -- 172.21.15.125:0/1002412024 >> 172.21.15.125:0/1002412024 conn(0x7f5880067e40 msgr2=0x7f58800af2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:22.392 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.389+0000 7f588752a700 1 -- 172.21.15.125:0/1002412024 shutdown_connections 2023-10-06T03:04:22.392 INFO:teuthology.misc.health.smithi125.stderr:2023-10-06T03:04:22.389+0000 7f588752a700 1 -- 172.21.15.125:0/1002412024 wait complete. 2023-10-06T03:04:22.401 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T03:04:22.402 INFO:tasks.ceph:Creating RBD pool 2023-10-06T03:04:22.402 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T03:04:22.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.517+0000 7f1963cc3700 1 Processor -- start 2023-10-06T03:04:22.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.518+0000 7f1963cc3700 1 -- start start 2023-10-06T03:04:22.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.518+0000 7f1963cc3700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f195c0af320 0x7f195c0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.518+0000 7f1963cc3700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f195c067d20 0x7f195c0c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.518+0000 7f1963cc3700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195c0cafe0 con 0x7f195c0ca190 2023-10-06T03:04:22.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.518+0000 7f1963cc3700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195c0c3b40 con 0x7f195c067d20 2023-10-06T03:04:22.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.518+0000 7f1963cc3700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0ca710 con 0x7f195c0af320 2023-10-06T03:04:22.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.519+0000 7f1961a5f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f195c0af320 0x7f195c0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:22.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.519+0000 7f1962260700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f195c067d20 0x7f195c0c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:22.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.519+0000 7f196125e700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f195c0ca190 0x7f195c067610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:55158/0 (socket says 172.21.15.125:55158) 2023-10-06T03:04:22.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.519+0000 7f196125e700 1 -- 172.21.15.125:0/1950983867 learned_addr learned my addr 172.21.15.125:0/1950983867 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:22.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.519+0000 7f1961a5f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f195c0af320 0x7f195c0caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:55948/0 (socket says 172.21.15.125:55948) 2023-10-06T03:04:22.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.519+0000 7f1962260700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f195c067d20 0x7f195c0c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:49618/0 (socket says 172.21.15.125:49618) 2023-10-06T03:04:22.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.519+0000 7f1961a5f700 1 -- 172.21.15.125:0/1950983867 >> v2:172.21.15.130:3300/0 conn(0x7f195c067d20 msgr2=0x7f195c0c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:22.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.519+0000 7f1961a5f700 1 --2- 172.21.15.125:0/1950983867 >> v2:172.21.15.130:3300/0 conn(0x7f195c067d20 0x7f195c0c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.519+0000 7f1961a5f700 1 -- 172.21.15.125:0/1950983867 >> v1:172.21.15.130:6789/0 conn(0x7f195c0ca190 legacy=0x7f195c067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:22.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.519+0000 7f1961a5f700 1 -- 172.21.15.125:0/1950983867 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c0cc750 con 0x7f195c0af320 2023-10-06T03:04:22.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.519+0000 7f1962260700 1 --2- 172.21.15.125:0/1950983867 >> v2:172.21.15.130:3300/0 conn(0x7f195c067d20 0x7f195c0c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:22.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.519+0000 7f1961a5f700 1 --2- 172.21.15.125:0/1950983867 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f195c0af320 0x7f195c0caaa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1958009900 tx=0x7f1958009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22f2c238538f7355 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:22.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.519+0000 7f1960a5d700 1 -- 172.21.15.125:0/1950983867 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958005c10 con 0x7f195c0af320 2023-10-06T03:04:22.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.519+0000 7f1960a5d700 1 -- 172.21.15.125:0/1950983867 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1958005d70 con 0x7f195c0af320 2023-10-06T03:04:22.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.519+0000 7f1960a5d700 1 -- 172.21.15.125:0/1950983867 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958006280 con 0x7f195c0af320 2023-10-06T03:04:22.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.520+0000 7f1963cc3700 1 -- 172.21.15.125:0/1950983867 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f195c0af320 msgr2=0x7f195c0caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:22.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.520+0000 7f1963cc3700 1 --2- 172.21.15.125:0/1950983867 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f195c0af320 0x7f195c0caaa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1958009900 tx=0x7f1958009120 comp rx=0 tx=0).stop 2023-10-06T03:04:22.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.520+0000 7f1963cc3700 1 -- 172.21.15.125:0/1950983867 shutdown_connections 2023-10-06T03:04:22.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.520+0000 7f1963cc3700 1 --2- 172.21.15.125:0/1950983867 >> v2:172.21.15.130:3300/0 conn(0x7f195c067d20 0x7f195c0c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.520+0000 7f1963cc3700 1 --2- 172.21.15.125:0/1950983867 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f195c0af320 0x7f195c0caaa0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.520+0000 7f1963cc3700 1 -- 172.21.15.125:0/1950983867 >> 172.21.15.125:0/1950983867 conn(0x7f195c096120 msgr2=0x7f195c068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:22.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.520+0000 7f1963cc3700 1 -- 172.21.15.125:0/1950983867 shutdown_connections 2023-10-06T03:04:22.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.520+0000 7f1963cc3700 1 -- 172.21.15.125:0/1950983867 wait complete. 2023-10-06T03:04:22.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.521+0000 7f1963cc3700 1 Processor -- start 2023-10-06T03:04:22.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.521+0000 7f1963cc3700 1 -- start start 2023-10-06T03:04:22.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.522+0000 7f1963cc3700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f195c067d20 0x7f195c155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.522+0000 7f1963cc3700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c0af320 0x7f195c154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.522+0000 7f1963cc3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f195c0ca190 0x7f195c16c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.522+0000 7f1963cc3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0c40b0 con 0x7f195c0ca190 2023-10-06T03:04:22.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.522+0000 7f1963cc3700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195c154e80 con 0x7f195c0af320 2023-10-06T03:04:22.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.522+0000 7f1963cc3700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f195c0b0f60 con 0x7f195c067d20 2023-10-06T03:04:22.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.522+0000 7f1962260700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f195c0ca190 0x7f195c16c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:22.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.522+0000 7f1962260700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f195c0ca190 0x7f195c16c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46556/0 (socket says 172.21.15.125:46556) 2023-10-06T03:04:22.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.522+0000 7f1962260700 1 -- 172.21.15.125:0/2480409957 learned_addr learned my addr 172.21.15.125:0/2480409957 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:22.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.522+0000 7f196125e700 1 --2- 172.21.15.125:0/2480409957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c0af320 0x7f195c154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:22.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.522+0000 7f1961a5f700 1 --2- 172.21.15.125:0/2480409957 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f195c067d20 0x7f195c155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:22.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.522+0000 7f1962260700 1 -- 172.21.15.125:0/2480409957 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f195c067d20 msgr2=0x7f195c155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:22.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.522+0000 7f1962260700 1 --2- 172.21.15.125:0/2480409957 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f195c067d20 0x7f195c155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.522+0000 7f1962260700 1 -- 172.21.15.125:0/2480409957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c0af320 msgr2=0x7f195c154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:22.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.522+0000 7f1962260700 1 --2- 172.21.15.125:0/2480409957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c0af320 0x7f195c154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.522+0000 7f1962260700 1 -- 172.21.15.125:0/2480409957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1954009a20 con 0x7f195c0ca190 2023-10-06T03:04:22.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.522+0000 7f196125e700 1 --2- 172.21.15.125:0/2480409957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c0af320 0x7f195c154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:22.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.523+0000 7f1962260700 1 --2- 172.21.15.125:0/2480409957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f195c0ca190 0x7f195c16c870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1954009ec0 tx=0x7f195400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:22.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.523+0000 7f1951ffb700 1 -- 172.21.15.125:0/2480409957 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195400cb70 con 0x7f195c0ca190 2023-10-06T03:04:22.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.523+0000 7f1951ffb700 1 -- 172.21.15.125:0/2480409957 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195400f040 con 0x7f195c0ca190 2023-10-06T03:04:22.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.523+0000 7f1951ffb700 1 -- 172.21.15.125:0/2480409957 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1954014480 con 0x7f195c0ca190 2023-10-06T03:04:22.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.523+0000 7f1963cc3700 1 -- 172.21.15.125:0/2480409957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19580093c0 con 0x7f195c0ca190 2023-10-06T03:04:22.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.523+0000 7f1963cc3700 1 -- 172.21.15.125:0/2480409957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195c0b1520 con 0x7f195c0ca190 2023-10-06T03:04:22.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.524+0000 7f1963cc3700 1 -- 172.21.15.125:0/2480409957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195c0c4220 con 0x7f195c0ca190 2023-10-06T03:04:22.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.524+0000 7f1951ffb700 1 -- 172.21.15.125:0/2480409957 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19540147f0 con 0x7f195c0ca190 2023-10-06T03:04:22.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.524+0000 7f1951ffb700 1 --2- 172.21.15.125:0/2480409957 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1940066f30 0x7f19400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.525+0000 7f1951ffb700 1 -- 172.21.15.125:0/2480409957 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1954084ec0 con 0x7f195c0ca190 2023-10-06T03:04:22.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.525+0000 7f1961a5f700 1 --2- 172.21.15.125:0/2480409957 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1940066f30 0x7f19400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:22.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.525+0000 7f1961a5f700 1 --2- 172.21.15.125:0/2480409957 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1940066f30 0x7f19400693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1958009fd0 tx=0x7f1958016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:22.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.529+0000 7f1951ffb700 1 -- 172.21.15.125:0/2480409957 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f195c0c4220 con 0x7f195c0ca190 2023-10-06T03:04:22.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.711+0000 7f1963cc3700 1 -- 172.21.15.125:0/2480409957 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f195c0c41f0 con 0x7f195c0ca190 2023-10-06T03:04:22.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.796+0000 7f1951ffb700 1 -- 172.21.15.125:0/2480409957 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f19540180a0 con 0x7f195c0ca190 2023-10-06T03:04:22.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.799+0000 7f1963cc3700 1 -- 172.21.15.125:0/2480409957 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1940066f30 msgr2=0x7f19400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:22.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.799+0000 7f1963cc3700 1 --2- 172.21.15.125:0/2480409957 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1940066f30 0x7f19400693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1958009fd0 tx=0x7f1958016000 comp rx=0 tx=0).stop 2023-10-06T03:04:22.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.799+0000 7f1963cc3700 1 -- 172.21.15.125:0/2480409957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f195c0ca190 msgr2=0x7f195c16c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:22.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.799+0000 7f1963cc3700 1 --2- 172.21.15.125:0/2480409957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f195c0ca190 0x7f195c16c870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1954009ec0 tx=0x7f195400b040 comp rx=0 tx=0).stop 2023-10-06T03:04:22.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.799+0000 7f1963cc3700 1 -- 172.21.15.125:0/2480409957 shutdown_connections 2023-10-06T03:04:22.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.799+0000 7f1963cc3700 1 --2- 172.21.15.125:0/2480409957 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1940066f30 0x7f19400693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.799+0000 7f1963cc3700 1 --2- 172.21.15.125:0/2480409957 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f195c0ca190 0x7f195c16c870 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.799+0000 7f1963cc3700 1 --2- 172.21.15.125:0/2480409957 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f195c067d20 0x7f195c155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.799+0000 7f1963cc3700 1 --2- 172.21.15.125:0/2480409957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f195c0af320 0x7f195c154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.799+0000 7f1963cc3700 1 -- 172.21.15.125:0/2480409957 >> 172.21.15.125:0/2480409957 conn(0x7f195c096120 msgr2=0x7f195c0c1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:22.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.799+0000 7f1963cc3700 1 -- 172.21.15.125:0/2480409957 shutdown_connections 2023-10-06T03:04:22.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.799+0000 7f1963cc3700 1 -- 172.21.15.125:0/2480409957 wait complete. 2023-10-06T03:04:22.802 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'rbd' created 2023-10-06T03:04:22.812 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T03:04:22.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.930+0000 7f19a491a700 1 Processor -- start 2023-10-06T03:04:22.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.930+0000 7f19a491a700 1 -- start start 2023-10-06T03:04:22.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.931+0000 7f19a491a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19a006efe0 0x7f19a0164230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.931+0000 7f19a491a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a00cb7e0 con 0x7f19a01590a0 2023-10-06T03:04:22.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.931+0000 7f19a491a700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a00cabd0 con 0x7f19a00ca5f0 2023-10-06T03:04:22.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.931+0000 7f19a491a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00caeb0 con 0x7f19a006efe0 2023-10-06T03:04:22.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.931+0000 7f199e59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f19a01590a0 0x7f19a0159470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35312/0 (socket says 172.21.15.125:35312) 2023-10-06T03:04:22.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.931+0000 7f199e59c700 1 -- 172.21.15.125:0/994755035 learned_addr learned my addr 172.21.15.125:0/994755035 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:22.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.931+0000 7f199ed9d700 1 --2- 172.21.15.125:0/994755035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19a006efe0 0x7f19a0164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:22.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199d59a700 1 -- 172.21.15.125:0/994755035 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231378203 0 0) 0x7f19a00cb7e0 con 0x7f19a01590a0 2023-10-06T03:04:22.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199d59a700 1 -- 172.21.15.125:0/994755035 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1988003570 con 0x7f19a01590a0 2023-10-06T03:04:22.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199d59a700 1 -- 172.21.15.125:0/994755035 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 820606617 0 0) 0x7f1988003570 con 0x7f19a01590a0 2023-10-06T03:04:22.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199d59a700 1 -- 172.21.15.125:0/994755035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19a006efe0 msgr2=0x7f19a0164230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:22.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199d59a700 1 --2- 172.21.15.125:0/994755035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19a006efe0 0x7f19a0164230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199d59a700 1 -- 172.21.15.125:0/994755035 >> v1:172.21.15.130:6789/0 conn(0x7f19a00ca5f0 legacy=0x7f19a006e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:22.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199d59a700 1 -- 172.21.15.125:0/994755035 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a00cb190 con 0x7f19a01590a0 2023-10-06T03:04:22.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199d59a700 1 -- 172.21.15.125:0/994755035 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f1994001470 con 0x7f19a01590a0 2023-10-06T03:04:22.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199d59a700 1 -- 172.21.15.125:0/994755035 >> v1:172.21.15.125:6789/0 conn(0x7f19a01590a0 legacy=0x7f19a0159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:22.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199d59a700 1 --2- 172.21.15.125:0/994755035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1988003a90 0x7f1988003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199d59a700 1 --2- 172.21.15.125:0/994755035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1988004810 0x7f1988004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199d59a700 1 --2- 172.21.15.125:0/994755035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19a006efe0 0x7f19880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199d59a700 1 -- 172.21.15.125:0/994755035 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00caeb0 con 0x7f1988003a90 2023-10-06T03:04:22.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199d59a700 1 -- 172.21.15.125:0/994755035 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198800bb40 con 0x7f1988004810 2023-10-06T03:04:22.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199d59a700 1 -- 172.21.15.125:0/994755035 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198800bd00 con 0x7f19a006efe0 2023-10-06T03:04:22.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199e59c700 1 --2- 172.21.15.125:0/994755035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1988003a90 0x7f1988003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:22.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199ed9d700 1 --2- 172.21.15.125:0/994755035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19a006efe0 0x7f19880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:22.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199dd9b700 1 --2- 172.21.15.125:0/994755035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1988004810 0x7f1988004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:22.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199e59c700 1 -- 172.21.15.125:0/994755035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19a006efe0 msgr2=0x7f19880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:22.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199e59c700 1 --2- 172.21.15.125:0/994755035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19a006efe0 0x7f19880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199e59c700 1 -- 172.21.15.125:0/994755035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1988004810 msgr2=0x7f1988004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:22.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199e59c700 1 --2- 172.21.15.125:0/994755035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1988004810 0x7f1988004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199e59c700 1 -- 172.21.15.125:0/994755035 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1988003570 con 0x7f1988003a90 2023-10-06T03:04:22.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199ed9d700 1 --2- 172.21.15.125:0/994755035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19a006efe0 0x7f19880051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:22.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199e59c700 1 --2- 172.21.15.125:0/994755035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1988003a90 0x7f1988003e60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f199400c3c0 tx=0x7f1994001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830ca8bcdc038df4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:22.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199d59a700 1 -- 172.21.15.125:0/994755035 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199400cc90 con 0x7f1988003a90 2023-10-06T03:04:22.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.932+0000 7f199d59a700 1 -- 172.21.15.125:0/994755035 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199400ce10 con 0x7f1988003a90 2023-10-06T03:04:22.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.933+0000 7f199d59a700 1 -- 172.21.15.125:0/994755035 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994005b70 con 0x7f1988003a90 2023-10-06T03:04:22.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.933+0000 7f19a491a700 1 -- 172.21.15.125:0/994755035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1988003a90 msgr2=0x7f1988003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:22.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.933+0000 7f19a491a700 1 --2- 172.21.15.125:0/994755035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1988003a90 0x7f1988003e60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f199400c3c0 tx=0x7f1994001e70 comp rx=0 tx=0).stop 2023-10-06T03:04:22.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.933+0000 7f199ed9d700 1 -- 172.21.15.125:0/994755035 reap_dead start 2023-10-06T03:04:22.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.933+0000 7f19a491a700 1 -- 172.21.15.125:0/994755035 shutdown_connections 2023-10-06T03:04:22.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.933+0000 7f19a491a700 1 -- 172.21.15.125:0/994755035 >> 172.21.15.125:0/994755035 conn(0x7f19a006b3b0 msgr2=0x7f19a00cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:22.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.933+0000 7f19a491a700 1 -- 172.21.15.125:0/994755035 shutdown_connections 2023-10-06T03:04:22.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.933+0000 7f19a491a700 1 -- 172.21.15.125:0/994755035 wait complete. 2023-10-06T03:04:22.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.934+0000 7f19a491a700 1 Processor -- start 2023-10-06T03:04:22.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.934+0000 7f19a491a700 1 -- start start 2023-10-06T03:04:22.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.935+0000 7f19a491a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1988003a90 0x7f19a0156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.935+0000 7f19a491a700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19a00c7a40 0x7f19a00c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.935+0000 7f19a491a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19a00c3f00 0x7f19a00c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.935+0000 7f19a491a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00c83f0 con 0x7f1988003a90 2023-10-06T03:04:22.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.935+0000 7f19a491a700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00c4c30 con 0x7f19a00c7a40 2023-10-06T03:04:22.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.935+0000 7f19a491a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a015c8c0 con 0x7f19a00c3f00 2023-10-06T03:04:22.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.935+0000 7f199e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1988003a90 0x7f19a0156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:22.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.935+0000 7f199e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1988003a90 0x7f19a0156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46576/0 (socket says 172.21.15.125:46576) 2023-10-06T03:04:22.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.935+0000 7f199e59c700 1 -- 172.21.15.125:0/842300485 learned_addr learned my addr 172.21.15.125:0/842300485 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:22.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.935+0000 7f199dd9b700 1 --2- 172.21.15.125:0/842300485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19a00c7a40 0x7f19a00c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:22.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.935+0000 7f199ed9d700 1 --2- 172.21.15.125:0/842300485 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19a00c3f00 0x7f19a00c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:22.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.935+0000 7f199e59c700 1 -- 172.21.15.125:0/842300485 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19a00c3f00 msgr2=0x7f19a00c4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:22.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.935+0000 7f199e59c700 1 --2- 172.21.15.125:0/842300485 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19a00c3f00 0x7f19a00c4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.935+0000 7f199e59c700 1 -- 172.21.15.125:0/842300485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19a00c7a40 msgr2=0x7f19a00c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:22.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.935+0000 7f199e59c700 1 --2- 172.21.15.125:0/842300485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19a00c7a40 0x7f19a00c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:22.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.935+0000 7f199e59c700 1 -- 172.21.15.125:0/842300485 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a015cd50 con 0x7f1988003a90 2023-10-06T03:04:22.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.935+0000 7f199e59c700 1 --2- 172.21.15.125:0/842300485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1988003a90 0x7f19a0156180 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f198800bb10 tx=0x7f1994015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:22.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.936+0000 7f198e7fc700 1 -- 172.21.15.125:0/842300485 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994000ed0 con 0x7f1988003a90 2023-10-06T03:04:22.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.936+0000 7f198e7fc700 1 -- 172.21.15.125:0/842300485 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199400cc90 con 0x7f1988003a90 2023-10-06T03:04:22.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.936+0000 7f19a491a700 1 -- 172.21.15.125:0/842300485 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a015bf90 con 0x7f1988003a90 2023-10-06T03:04:22.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.936+0000 7f198e7fc700 1 -- 172.21.15.125:0/842300485 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994007530 con 0x7f1988003a90 2023-10-06T03:04:22.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.936+0000 7f19a491a700 1 -- 172.21.15.125:0/842300485 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a015c550 con 0x7f1988003a90 2023-10-06T03:04:22.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.936+0000 7f19a491a700 1 -- 172.21.15.125:0/842300485 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a006d830 con 0x7f1988003a90 2023-10-06T03:04:22.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.937+0000 7f198e7fc700 1 -- 172.21.15.125:0/842300485 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1994019030 con 0x7f1988003a90 2023-10-06T03:04:22.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.937+0000 7f198e7fc700 1 --2- 172.21.15.125:0/842300485 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1980066f30 0x7f19800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:22.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.937+0000 7f198e7fc700 1 -- 172.21.15.125:0/842300485 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f19940853c0 con 0x7f1988003a90 2023-10-06T03:04:22.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.937+0000 7f199dd9b700 1 --2- 172.21.15.125:0/842300485 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1980066f30 0x7f19800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:22.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.938+0000 7f199dd9b700 1 --2- 172.21.15.125:0/842300485 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1980066f30 0x7f19800693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1990003a50 tx=0x7f1990009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:22.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:22.942+0000 7f198e7fc700 1 -- 172.21.15.125:0/842300485 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19940528e0 con 0x7f1988003a90 2023-10-06T03:04:23.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.125+0000 7f19a491a700 1 -- 172.21.15.125:0/842300485 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f19a00c83f0 con 0x7f1988003a90 2023-10-06T03:04:23.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.800+0000 7f198e7fc700 1 -- 172.21.15.125:0/842300485 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f1994055f00 con 0x7f1988003a90 2023-10-06T03:04:23.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.802+0000 7f19a491a700 1 -- 172.21.15.125:0/842300485 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1980066f30 msgr2=0x7f19800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:23.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.802+0000 7f19a491a700 1 --2- 172.21.15.125:0/842300485 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1980066f30 0x7f19800693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1990003a50 tx=0x7f1990009040 comp rx=0 tx=0).stop 2023-10-06T03:04:23.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.802+0000 7f19a491a700 1 -- 172.21.15.125:0/842300485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1988003a90 msgr2=0x7f19a0156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:23.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.802+0000 7f19a491a700 1 --2- 172.21.15.125:0/842300485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1988003a90 0x7f19a0156180 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f198800bb10 tx=0x7f1994015000 comp rx=0 tx=0).stop 2023-10-06T03:04:23.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.802+0000 7f19a491a700 1 -- 172.21.15.125:0/842300485 shutdown_connections 2023-10-06T03:04:23.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.802+0000 7f19a491a700 1 --2- 172.21.15.125:0/842300485 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1980066f30 0x7f19800693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:23.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.802+0000 7f19a491a700 1 --2- 172.21.15.125:0/842300485 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19a00c3f00 0x7f19a00c4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:23.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.802+0000 7f19a491a700 1 --2- 172.21.15.125:0/842300485 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1988003a90 0x7f19a0156180 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:23.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.802+0000 7f19a491a700 1 --2- 172.21.15.125:0/842300485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19a00c7a40 0x7f19a00c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:23.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.802+0000 7f19a491a700 1 -- 172.21.15.125:0/842300485 >> 172.21.15.125:0/842300485 conn(0x7f19a006b3b0 msgr2=0x7f19a01580f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:23.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.803+0000 7f19a491a700 1 -- 172.21.15.125:0/842300485 shutdown_connections 2023-10-06T03:04:23.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.803+0000 7f19a491a700 1 -- 172.21.15.125:0/842300485 wait complete. 2023-10-06T03:04:23.806 INFO:teuthology.orchestra.run.smithi125.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T03:04:23.817 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T03:04:23.818 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:04:23.818 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:04:23.820 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:04:23.820 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:04:23.820 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:04:23.822 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:04:23.823 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:04:23.823 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:04:23.825 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:04:23.825 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:04:23.826 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:04:23.828 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:04:23.828 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T03:04:23.828 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:04:23.898 INFO:tasks.ceph.mds.c.smithi125.stdout:starting mds.c at 2023-10-06T03:04:23.898 INFO:tasks.ceph.mds.a.smithi125.stdout:starting mds.a at 2023-10-06T03:04:23.910 INFO:tasks.ceph.mds.d.smithi130.stdout:starting mds.d at 2023-10-06T03:04:23.911 INFO:tasks.ceph.mds.b.smithi130.stdout:starting mds.b at 2023-10-06T03:04:23.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.953+0000 7f06095e1700 1 Processor -- start 2023-10-06T03:04:23.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.953+0000 7f06095e1700 1 -- start start 2023-10-06T03:04:23.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.953+0000 7f06095e1700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0604067d20 0x7f0604069300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:23.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f06095e1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06040cccc0 con 0x7f06040cc8f0 2023-10-06T03:04:23.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f06095e1700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06040cae70 con 0x7f06040caa40 2023-10-06T03:04:23.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f06095e1700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06041585c0 con 0x7f0604067d20 2023-10-06T03:04:23.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f0602ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f06040cc8f0 0x7f0604067610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35338/0 (socket says 172.21.15.125:35338) 2023-10-06T03:04:23.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f0602ffd700 1 -- 172.21.15.125:0/424341446 learned_addr learned my addr 172.21.15.125:0/424341446 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:23.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f0601ffb700 1 -- 172.21.15.125:0/424341446 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430798948 0 0) 0x7f06040cccc0 con 0x7f06040cc8f0 2023-10-06T03:04:23.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f0601ffb700 1 -- 172.21.15.125:0/424341446 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05ec003570 con 0x7f06040cc8f0 2023-10-06T03:04:23.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f06027fc700 1 --2- 172.21.15.125:0/424341446 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0604067d20 0x7f0604069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:23.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f0601ffb700 1 -- 172.21.15.125:0/424341446 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 721590600 0 0) 0x7f05ec003570 con 0x7f06040cc8f0 2023-10-06T03:04:23.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f0601ffb700 1 -- 172.21.15.125:0/424341446 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0604067d20 msgr2=0x7f0604069300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:23.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f0601ffb700 1 --2- 172.21.15.125:0/424341446 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0604067d20 0x7f0604069300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:23.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f0601ffb700 1 -- 172.21.15.125:0/424341446 >> v1:172.21.15.130:6789/0 conn(0x7f06040caa40 legacy=0x7f0604159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:23.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f0601ffb700 1 -- 172.21.15.125:0/424341446 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0604158cd0 con 0x7f06040cc8f0 2023-10-06T03:04:23.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f0601ffb700 1 -- 172.21.15.125:0/424341446 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f05f40015f0 con 0x7f06040cc8f0 2023-10-06T03:04:23.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f0601ffb700 1 -- 172.21.15.125:0/424341446 >> v1:172.21.15.125:6789/0 conn(0x7f06040cc8f0 legacy=0x7f0604067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:23.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f0601ffb700 1 --2- 172.21.15.125:0/424341446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05ec003a90 0x7f05ec003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:23.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f0601ffb700 1 --2- 172.21.15.125:0/424341446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05ec004810 0x7f05ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:23.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f0601ffb700 1 --2- 172.21.15.125:0/424341446 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0604067d20 0x7f05ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:23.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f0601ffb700 1 -- 172.21.15.125:0/424341446 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06041585c0 con 0x7f05ec004810 2023-10-06T03:04:23.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f0601ffb700 1 -- 172.21.15.125:0/424341446 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec00bb40 con 0x7f05ec003a90 2023-10-06T03:04:23.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f0601ffb700 1 -- 172.21.15.125:0/424341446 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec00bd00 con 0x7f0604067d20 2023-10-06T03:04:23.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f06027fc700 1 --2- 172.21.15.125:0/424341446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05ec004810 0x7f05ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:23.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f0602ffd700 1 --2- 172.21.15.125:0/424341446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05ec003a90 0x7f05ec003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:23.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.954+0000 7f06037fe700 1 --2- 172.21.15.125:0/424341446 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0604067d20 0x7f05ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:23.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.955+0000 7f06027fc700 1 -- 172.21.15.125:0/424341446 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0604067d20 msgr2=0x7f05ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:23.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.955+0000 7f06027fc700 1 --2- 172.21.15.125:0/424341446 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0604067d20 0x7f05ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:23.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.955+0000 7f06027fc700 1 -- 172.21.15.125:0/424341446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05ec003a90 msgr2=0x7f05ec003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:23.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.955+0000 7f06027fc700 1 --2- 172.21.15.125:0/424341446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05ec003a90 0x7f05ec003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:23.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.955+0000 7f06027fc700 1 -- 172.21.15.125:0/424341446 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec003570 con 0x7f05ec004810 2023-10-06T03:04:23.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.955+0000 7f06027fc700 1 --2- 172.21.15.125:0/424341446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05ec004810 0x7f05ec004c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009be0 tx=0x7f05f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9513ab90a87cedba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:23.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.955+0000 7f0601ffb700 1 -- 172.21.15.125:0/424341446 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f800e710 con 0x7f05ec004810 2023-10-06T03:04:23.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.955+0000 7f0601ffb700 1 -- 172.21.15.125:0/424341446 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f800e870 con 0x7f05ec004810 2023-10-06T03:04:23.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.955+0000 7f0601ffb700 1 -- 172.21.15.125:0/424341446 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f800ec30 con 0x7f05ec004810 2023-10-06T03:04:23.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.955+0000 7f06095e1700 1 -- 172.21.15.125:0/424341446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05ec004810 msgr2=0x7f05ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:23.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.955+0000 7f06095e1700 1 --2- 172.21.15.125:0/424341446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f05ec004810 0x7f05ec004c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f05f8009be0 tx=0x7f05f80091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:23.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.955+0000 7f06037fe700 1 -- 172.21.15.125:0/424341446 reap_dead start 2023-10-06T03:04:23.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.955+0000 7f06095e1700 1 -- 172.21.15.125:0/424341446 shutdown_connections 2023-10-06T03:04:23.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.955+0000 7f06095e1700 1 -- 172.21.15.125:0/424341446 >> 172.21.15.125:0/424341446 conn(0x7f0604068f00 msgr2=0x7f06040cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:23.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.955+0000 7f06095e1700 1 -- 172.21.15.125:0/424341446 shutdown_connections 2023-10-06T03:04:23.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.955+0000 7f06095e1700 1 -- 172.21.15.125:0/424341446 wait complete. 2023-10-06T03:04:23.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.957+0000 7f06095e1700 1 Processor -- start 2023-10-06T03:04:23.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.957+0000 7f06095e1700 1 -- start start 2023-10-06T03:04:23.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.958+0000 7f06095e1700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05ec004810 0x7f06040c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:23.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.958+0000 7f06095e1700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0604156a30 0x7f06040ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:23.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.958+0000 7f06095e1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06040ad5f0 0x7f06040ada60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:23.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.958+0000 7f06095e1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06040c4050 con 0x7f06040ad5f0 2023-10-06T03:04:23.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.958+0000 7f06095e1700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06040adfa0 con 0x7f05ec004810 2023-10-06T03:04:23.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.958+0000 7f06095e1700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060409a440 con 0x7f0604156a30 2023-10-06T03:04:23.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.958+0000 7f06037fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06040ad5f0 0x7f06040ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:23.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.958+0000 7f06037fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06040ad5f0 0x7f06040ada60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46648/0 (socket says 172.21.15.125:46648) 2023-10-06T03:04:23.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.958+0000 7f06037fe700 1 -- 172.21.15.125:0/1008207232 learned_addr learned my addr 172.21.15.125:0/1008207232 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:23.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.958+0000 7f06027fc700 1 --2- 172.21.15.125:0/1008207232 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0604156a30 0x7f06040ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:23.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.958+0000 7f0602ffd700 1 --2- 172.21.15.125:0/1008207232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05ec004810 0x7f06040c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:23.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.958+0000 7f06037fe700 1 -- 172.21.15.125:0/1008207232 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0604156a30 msgr2=0x7f06040ac6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:23.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.958+0000 7f06037fe700 1 --2- 172.21.15.125:0/1008207232 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0604156a30 0x7f06040ac6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:23.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.958+0000 7f06037fe700 1 -- 172.21.15.125:0/1008207232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05ec004810 msgr2=0x7f06040c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:23.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.958+0000 7f06037fe700 1 --2- 172.21.15.125:0/1008207232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05ec004810 0x7f06040c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:23.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.958+0000 7f06037fe700 1 -- 172.21.15.125:0/1008207232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060409a720 con 0x7f06040ad5f0 2023-10-06T03:04:23.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.958+0000 7f0602ffd700 1 --2- 172.21.15.125:0/1008207232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05ec004810 0x7f06040c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:23.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.959+0000 7f06037fe700 1 --2- 172.21.15.125:0/1008207232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06040ad5f0 0x7f06040ada60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f06040c8600 tx=0x7f05fc0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:23.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.959+0000 7f05eaffd700 1 -- 172.21.15.125:0/1008207232 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc018070 con 0x7f06040ad5f0 2023-10-06T03:04:23.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.959+0000 7f05eaffd700 1 -- 172.21.15.125:0/1008207232 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05fc00c7e0 con 0x7f06040ad5f0 2023-10-06T03:04:23.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.959+0000 7f05eaffd700 1 -- 172.21.15.125:0/1008207232 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05fc00cb80 con 0x7f06040ad5f0 2023-10-06T03:04:23.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.959+0000 7f06095e1700 1 -- 172.21.15.125:0/1008207232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06040acbe0 con 0x7f06040ad5f0 2023-10-06T03:04:23.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.959+0000 7f06095e1700 1 -- 172.21.15.125:0/1008207232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0604156ea0 con 0x7f06040ad5f0 2023-10-06T03:04:23.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.960+0000 7f06095e1700 1 -- 172.21.15.125:0/1008207232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06040c41c0 con 0x7f06040ad5f0 2023-10-06T03:04:23.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.960+0000 7f05eaffd700 1 -- 172.21.15.125:0/1008207232 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f05fc014480 con 0x7f06040ad5f0 2023-10-06T03:04:23.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.961+0000 7f05eaffd700 1 --2- 172.21.15.125:0/1008207232 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f05f0066f30 0x7f05f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:23.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.961+0000 7f05eaffd700 1 -- 172.21.15.125:0/1008207232 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f05fc084190 con 0x7f06040ad5f0 2023-10-06T03:04:23.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.961+0000 7f0602ffd700 1 --2- 172.21.15.125:0/1008207232 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f05f0066f30 0x7f05f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:23.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.961+0000 7f0602ffd700 1 --2- 172.21.15.125:0/1008207232 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f05f0066f30 0x7f05f00693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f05f4000e10 tx=0x7f05f4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:23.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:23.965+0000 7f05eaffd700 1 -- 172.21.15.125:0/1008207232 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06040c41c0 con 0x7f06040ad5f0 2023-10-06T03:04:24.149 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.148+0000 7f06095e1700 1 -- 172.21.15.125:0/1008207232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06040697e0 con 0x7f06040ad5f0 2023-10-06T03:04:24.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.149+0000 7f05eaffd700 1 -- 172.21.15.125:0/1008207232 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13804 (secure 0 0 0) 0x7f05fc051610 con 0x7f06040ad5f0 2023-10-06T03:04:24.151 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:24.151 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":18,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:23.795883+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:04:24.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.151+0000 7f06095e1700 1 -- 172.21.15.125:0/1008207232 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f05f0066f30 msgr2=0x7f05f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:24.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.151+0000 7f06095e1700 1 --2- 172.21.15.125:0/1008207232 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f05f0066f30 0x7f05f00693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f05f4000e10 tx=0x7f05f4009040 comp rx=0 tx=0).stop 2023-10-06T03:04:24.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.151+0000 7f06095e1700 1 -- 172.21.15.125:0/1008207232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06040ad5f0 msgr2=0x7f06040ada60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:24.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.151+0000 7f06095e1700 1 --2- 172.21.15.125:0/1008207232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06040ad5f0 0x7f06040ada60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f06040c8600 tx=0x7f05fc0016d0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.151+0000 7f06095e1700 1 -- 172.21.15.125:0/1008207232 shutdown_connections 2023-10-06T03:04:24.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.151+0000 7f06095e1700 1 --2- 172.21.15.125:0/1008207232 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f05f0066f30 0x7f05f00693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.151+0000 7f06095e1700 1 --2- 172.21.15.125:0/1008207232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f06040ad5f0 0x7f06040ada60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.151+0000 7f06095e1700 1 --2- 172.21.15.125:0/1008207232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05ec004810 0x7f06040c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.151+0000 7f06095e1700 1 --2- 172.21.15.125:0/1008207232 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0604156a30 0x7f06040ac6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.151+0000 7f06095e1700 1 -- 172.21.15.125:0/1008207232 >> 172.21.15.125:0/1008207232 conn(0x7f0604068f00 msgr2=0x7f060406c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:24.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.151+0000 7f06095e1700 1 -- 172.21.15.125:0/1008207232 shutdown_connections 2023-10-06T03:04:24.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.151+0000 7f06095e1700 1 -- 172.21.15.125:0/1008207232 wait complete. 2023-10-06T03:04:24.164 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:04:15.845430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:04:22.729795+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T03:04:24.164 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:04:24.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.283+0000 7f1674876700 1 Processor -- start 2023-10-06T03:04:24.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.283+0000 7f1674876700 1 -- start start 2023-10-06T03:04:24.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.284+0000 7f1674876700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f16701574b0 0x7f1670067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.284+0000 7f1674876700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f16700c6eb0 0x7f16700c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.284+0000 7f1674876700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1670067b50 con 0x7f16700b0240 2023-10-06T03:04:24.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.284+0000 7f1674876700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16700c7f70 con 0x7f16700c6eb0 2023-10-06T03:04:24.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.284+0000 7f1674876700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16700c8210 con 0x7f16701574b0 2023-10-06T03:04:24.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.284+0000 7f166ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f16700c6eb0 0x7f16700c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:24.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.284+0000 7f166ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f16700c6eb0 0x7f16700c95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46658/0 (socket says 172.21.15.125:46658) 2023-10-06T03:04:24.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.284+0000 7f166ed9d700 1 -- 172.21.15.125:0/226258894 learned_addr learned my addr 172.21.15.125:0/226258894 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:24.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.284+0000 7f166e59c700 1 --2- 172.21.15.125:0/226258894 >> v2:172.21.15.130:3300/0 conn(0x7f16701574b0 0x7f1670067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:24.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.285+0000 7f166ed9d700 1 -- 172.21.15.125:0/226258894 >> v2:172.21.15.130:3300/0 conn(0x7f16701574b0 msgr2=0x7f1670067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:24.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.285+0000 7f166ed9d700 1 --2- 172.21.15.125:0/226258894 >> v2:172.21.15.130:3300/0 conn(0x7f16701574b0 0x7f1670067610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.285+0000 7f166ed9d700 1 -- 172.21.15.125:0/226258894 >> v1:172.21.15.130:6789/0 conn(0x7f16700b0240 legacy=0x7f16700cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:24.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.285+0000 7f166ed9d700 1 -- 172.21.15.125:0/226258894 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16700c8b00 con 0x7f16700c6eb0 2023-10-06T03:04:24.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.285+0000 7f166ed9d700 1 --2- 172.21.15.125:0/226258894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16700c6eb0 0x7f16700c95e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f167006fdf0 tx=0x7f1668009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c376c92fc94ccf37 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:24.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.285+0000 7f166d59a700 1 -- 172.21.15.125:0/226258894 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f166800e070 con 0x7f16700c6eb0 2023-10-06T03:04:24.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.285+0000 7f166d59a700 1 -- 172.21.15.125:0/226258894 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f166800ba20 con 0x7f16700c6eb0 2023-10-06T03:04:24.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.285+0000 7f166d59a700 1 -- 172.21.15.125:0/226258894 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16680092e0 con 0x7f16700c6eb0 2023-10-06T03:04:24.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.285+0000 7f1674876700 1 -- 172.21.15.125:0/226258894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16700c6eb0 msgr2=0x7f16700c95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:24.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.285+0000 7f1674876700 1 --2- 172.21.15.125:0/226258894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16700c6eb0 0x7f16700c95e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f167006fdf0 tx=0x7f1668009840 comp rx=0 tx=0).stop 2023-10-06T03:04:24.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.285+0000 7f1674876700 1 -- 172.21.15.125:0/226258894 shutdown_connections 2023-10-06T03:04:24.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.285+0000 7f1674876700 1 --2- 172.21.15.125:0/226258894 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16700c6eb0 0x7f16700c95e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.285+0000 7f1674876700 1 --2- 172.21.15.125:0/226258894 >> v2:172.21.15.130:3300/0 conn(0x7f16701574b0 0x7f1670067610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.286+0000 7f1674876700 1 -- 172.21.15.125:0/226258894 >> 172.21.15.125:0/226258894 conn(0x7f16700af730 msgr2=0x7f16700afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:24.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.286+0000 7f1674876700 1 -- 172.21.15.125:0/226258894 shutdown_connections 2023-10-06T03:04:24.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.286+0000 7f1674876700 1 -- 172.21.15.125:0/226258894 wait complete. 2023-10-06T03:04:24.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.287+0000 7f1674876700 1 Processor -- start 2023-10-06T03:04:24.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.287+0000 7f1674876700 1 -- start start 2023-10-06T03:04:24.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.287+0000 7f1674876700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16700b0240 0x7f1670150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.287+0000 7f1674876700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f16700c6eb0 0x7f16700c2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.287+0000 7f1674876700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16701574b0 0x7f16700c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.287+0000 7f1674876700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16700ad920 con 0x7f16701574b0 2023-10-06T03:04:24.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.287+0000 7f1674876700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167015b380 con 0x7f16700b0240 2023-10-06T03:04:24.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.287+0000 7f1674876700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167015d840 con 0x7f16700c6eb0 2023-10-06T03:04:24.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.287+0000 7f166ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16701574b0 0x7f16700c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:24.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.288+0000 7f166ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16701574b0 0x7f16700c31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46662/0 (socket says 172.21.15.125:46662) 2023-10-06T03:04:24.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.288+0000 7f166ed9d700 1 -- 172.21.15.125:0/4271669737 learned_addr learned my addr 172.21.15.125:0/4271669737 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:24.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.288+0000 7f166e59c700 1 --2- 172.21.15.125:0/4271669737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16700b0240 0x7f1670150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:24.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.288+0000 7f166dd9b700 1 --2- 172.21.15.125:0/4271669737 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f16700c6eb0 0x7f16700c2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:24.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.288+0000 7f166ed9d700 1 -- 172.21.15.125:0/4271669737 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f16700c6eb0 msgr2=0x7f16700c2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:24.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.288+0000 7f166ed9d700 1 --2- 172.21.15.125:0/4271669737 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f16700c6eb0 0x7f16700c2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.288+0000 7f166ed9d700 1 -- 172.21.15.125:0/4271669737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16700b0240 msgr2=0x7f1670150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:24.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.288+0000 7f166ed9d700 1 --2- 172.21.15.125:0/4271669737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16700b0240 0x7f1670150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.288+0000 7f166ed9d700 1 -- 172.21.15.125:0/4271669737 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1668009ae0 con 0x7f16701574b0 2023-10-06T03:04:24.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.288+0000 7f166ed9d700 1 --2- 172.21.15.125:0/4271669737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16701574b0 0x7f16700c31d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1668009880 tx=0x7f1668018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:24.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.288+0000 7f165e7fc700 1 -- 172.21.15.125:0/4271669737 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668008a80 con 0x7f16701574b0 2023-10-06T03:04:24.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.288+0000 7f165e7fc700 1 -- 172.21.15.125:0/4271669737 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1668008c00 con 0x7f16701574b0 2023-10-06T03:04:24.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.288+0000 7f165e7fc700 1 -- 172.21.15.125:0/4271669737 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1668026460 con 0x7f16701574b0 2023-10-06T03:04:24.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.288+0000 7f1674876700 1 -- 172.21.15.125:0/4271669737 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f167015db20 con 0x7f16701574b0 2023-10-06T03:04:24.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.288+0000 7f1674876700 1 -- 172.21.15.125:0/4271669737 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1670150750 con 0x7f16701574b0 2023-10-06T03:04:24.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.289+0000 7f1674876700 1 -- 172.21.15.125:0/4271669737 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16700ad6f0 con 0x7f16701574b0 2023-10-06T03:04:24.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.290+0000 7f165e7fc700 1 -- 172.21.15.125:0/4271669737 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1668003040 con 0x7f16701574b0 2023-10-06T03:04:24.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.290+0000 7f165e7fc700 1 --2- 172.21.15.125:0/4271669737 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1650066f30 0x7f16500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.290+0000 7f165e7fc700 1 -- 172.21.15.125:0/4271669737 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f16680861f0 con 0x7f16701574b0 2023-10-06T03:04:24.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.290+0000 7f166e59c700 1 --2- 172.21.15.125:0/4271669737 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1650066f30 0x7f16500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:24.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.291+0000 7f166e59c700 1 --2- 172.21.15.125:0/4271669737 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1650066f30 0x7f16500693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1664009d00 tx=0x7f1664009120 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:24.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.294+0000 7f165e7fc700 1 -- 172.21.15.125:0/4271669737 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1668053630 con 0x7f16701574b0 2023-10-06T03:04:24.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.475+0000 7f1674876700 1 -- 172.21.15.125:0/4271669737 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f16700ad6f0 con 0x7f16701574b0 2023-10-06T03:04:24.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.476+0000 7f165e7fc700 1 -- 172.21.15.125:0/4271669737 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f16700ad6f0 con 0x7f16701574b0 2023-10-06T03:04:24.478 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-06T03:04:24.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.478+0000 7f1674876700 1 -- 172.21.15.125:0/4271669737 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1650066f30 msgr2=0x7f16500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:24.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.478+0000 7f1674876700 1 --2- 172.21.15.125:0/4271669737 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1650066f30 0x7f16500693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1664009d00 tx=0x7f1664009120 comp rx=0 tx=0).stop 2023-10-06T03:04:24.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.478+0000 7f1674876700 1 -- 172.21.15.125:0/4271669737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16701574b0 msgr2=0x7f16700c31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:24.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.478+0000 7f1674876700 1 --2- 172.21.15.125:0/4271669737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16701574b0 0x7f16700c31d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1668009880 tx=0x7f1668018000 comp rx=0 tx=0).stop 2023-10-06T03:04:24.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.478+0000 7f1674876700 1 -- 172.21.15.125:0/4271669737 shutdown_connections 2023-10-06T03:04:24.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.478+0000 7f1674876700 1 --2- 172.21.15.125:0/4271669737 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1650066f30 0x7f16500693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.478+0000 7f1674876700 1 --2- 172.21.15.125:0/4271669737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f16701574b0 0x7f16700c31d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.478+0000 7f1674876700 1 --2- 172.21.15.125:0/4271669737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f16700b0240 0x7f1670150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.478+0000 7f1674876700 1 --2- 172.21.15.125:0/4271669737 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f16700c6eb0 0x7f16700c2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.478+0000 7f1674876700 1 -- 172.21.15.125:0/4271669737 >> 172.21.15.125:0/4271669737 conn(0x7f16700af730 msgr2=0x7f16700cd090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:24.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.478+0000 7f1674876700 1 -- 172.21.15.125:0/4271669737 shutdown_connections 2023-10-06T03:04:24.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.478+0000 7f1674876700 1 -- 172.21.15.125:0/4271669737 wait complete. 2023-10-06T03:04:24.491 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:04:24.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.609+0000 7f7656ec8700 1 Processor -- start 2023-10-06T03:04:24.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.610+0000 7f7656ec8700 1 -- start start 2023-10-06T03:04:24.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.610+0000 7f7656ec8700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f765015cb00 0x7f76500b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.610+0000 7f7656ec8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7650068ba0 0x7f76500cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.610+0000 7f7656ec8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76500ca670 con 0x7f7650067610 2023-10-06T03:04:24.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.610+0000 7f7656ec8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7650068320 con 0x7f7650068ba0 2023-10-06T03:04:24.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.610+0000 7f7656ec8700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7650067a80 con 0x7f765015cb00 2023-10-06T03:04:24.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.610+0000 7f7655465700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7650068ba0 0x7f76500cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:24.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.610+0000 7f764ffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7650067610 0x7f7650068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35344/0 (socket says 172.21.15.125:35344) 2023-10-06T03:04:24.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.610+0000 7f764ffff700 1 -- 172.21.15.125:0/2087847159 learned_addr learned my addr 172.21.15.125:0/2087847159 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:24.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.611+0000 7f7654c64700 1 --2- 172.21.15.125:0/2087847159 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f765015cb00 0x7f76500b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:24.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.611+0000 7f7655465700 1 -- 172.21.15.125:0/2087847159 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f765015cb00 msgr2=0x7f76500b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:24.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.611+0000 7f7655465700 1 --2- 172.21.15.125:0/2087847159 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f765015cb00 0x7f76500b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.611+0000 7f7655465700 1 -- 172.21.15.125:0/2087847159 >> v1:172.21.15.125:6789/0 conn(0x7f7650067610 legacy=0x7f7650068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:24.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.611+0000 7f7655465700 1 -- 172.21.15.125:0/2087847159 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7650067d60 con 0x7f7650068ba0 2023-10-06T03:04:24.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.611+0000 7f764f7fe700 1 -- 172.21.15.125:0/2087847159 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523143881 0 0) 0x7f76500ca670 con 0x7f7650067610 2023-10-06T03:04:24.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.611+0000 7f7655465700 1 --2- 172.21.15.125:0/2087847159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7650068ba0 0x7f76500cab00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7648009e60 tx=0x7f7648009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e1476b22abb84f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:24.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.611+0000 7f764f7fe700 1 -- 172.21.15.125:0/2087847159 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764800e070 con 0x7f7650068ba0 2023-10-06T03:04:24.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.611+0000 7f764f7fe700 1 -- 172.21.15.125:0/2087847159 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764800bb60 con 0x7f7650068ba0 2023-10-06T03:04:24.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.611+0000 7f764f7fe700 1 -- 172.21.15.125:0/2087847159 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648012430 con 0x7f7650068ba0 2023-10-06T03:04:24.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.612+0000 7f7656ec8700 1 -- 172.21.15.125:0/2087847159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7650068ba0 msgr2=0x7f76500cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:24.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.612+0000 7f7656ec8700 1 --2- 172.21.15.125:0/2087847159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7650068ba0 0x7f76500cab00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7648009e60 tx=0x7f7648009780 comp rx=0 tx=0).stop 2023-10-06T03:04:24.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.612+0000 7f7656ec8700 1 -- 172.21.15.125:0/2087847159 shutdown_connections 2023-10-06T03:04:24.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.612+0000 7f7656ec8700 1 --2- 172.21.15.125:0/2087847159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7650068ba0 0x7f76500cab00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.612+0000 7f7656ec8700 1 --2- 172.21.15.125:0/2087847159 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f765015cb00 0x7f76500b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.612+0000 7f7656ec8700 1 -- 172.21.15.125:0/2087847159 >> 172.21.15.125:0/2087847159 conn(0x7f76500af730 msgr2=0x7f76500afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:24.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.612+0000 7f7656ec8700 1 -- 172.21.15.125:0/2087847159 shutdown_connections 2023-10-06T03:04:24.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.612+0000 7f7656ec8700 1 -- 172.21.15.125:0/2087847159 wait complete. 2023-10-06T03:04:24.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.613+0000 7f7656ec8700 1 Processor -- start 2023-10-06T03:04:24.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.613+0000 7f7656ec8700 1 -- start start 2023-10-06T03:04:24.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f7656ec8700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7650067610 0x7f765014f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f7656ec8700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7650068ba0 0x7f765015ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f7656ec8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f765015cb00 0x7f76501506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f7656ec8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76500c4380 con 0x7f765015cb00 2023-10-06T03:04:24.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f7656ec8700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765015f4c0 con 0x7f7650068ba0 2023-10-06T03:04:24.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f7656ec8700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76500c3a50 con 0x7f7650067610 2023-10-06T03:04:24.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f7655465700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f765015cb00 0x7f76501506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:24.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f7655465700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f765015cb00 0x7f76501506a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46684/0 (socket says 172.21.15.125:46684) 2023-10-06T03:04:24.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f7655465700 1 -- 172.21.15.125:0/2154707361 learned_addr learned my addr 172.21.15.125:0/2154707361 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:24.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f7654c64700 1 --2- 172.21.15.125:0/2154707361 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7650067610 0x7f765014f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:24.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f764ffff700 1 --2- 172.21.15.125:0/2154707361 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7650068ba0 0x7f765015ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:24.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f7655465700 1 -- 172.21.15.125:0/2154707361 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7650067610 msgr2=0x7f765014f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:24.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f7655465700 1 --2- 172.21.15.125:0/2154707361 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7650067610 0x7f765014f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f7655465700 1 -- 172.21.15.125:0/2154707361 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7650068ba0 msgr2=0x7f765015ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:24.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f7655465700 1 --2- 172.21.15.125:0/2154707361 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7650068ba0 0x7f765015ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f7655465700 1 -- 172.21.15.125:0/2154707361 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7648009a20 con 0x7f765015cb00 2023-10-06T03:04:24.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f7655465700 1 --2- 172.21.15.125:0/2154707361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f765015cb00 0x7f76501506a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f764800b6c0 tx=0x7f7648019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:24.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f764cff9700 1 -- 172.21.15.125:0/2154707361 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648027470 con 0x7f765015cb00 2023-10-06T03:04:24.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f764cff9700 1 -- 172.21.15.125:0/2154707361 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76480275f0 con 0x7f765015cb00 2023-10-06T03:04:24.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f764cff9700 1 -- 172.21.15.125:0/2154707361 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76480279b0 con 0x7f765015cb00 2023-10-06T03:04:24.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f7656ec8700 1 -- 172.21.15.125:0/2154707361 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76500c3d30 con 0x7f765015cb00 2023-10-06T03:04:24.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.614+0000 7f7656ec8700 1 -- 172.21.15.125:0/2154707361 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765015f790 con 0x7f765015cb00 2023-10-06T03:04:24.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.615+0000 7f7656ec8700 1 -- 172.21.15.125:0/2154707361 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76500c4530 con 0x7f765015cb00 2023-10-06T03:04:24.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.616+0000 7f764cff9700 1 -- 172.21.15.125:0/2154707361 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7648024070 con 0x7f765015cb00 2023-10-06T03:04:24.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.616+0000 7f764cff9700 1 --2- 172.21.15.125:0/2154707361 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7634066f30 0x7f76340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.616+0000 7f7654c64700 1 --2- 172.21.15.125:0/2154707361 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7634066f30 0x7f76340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:24.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.616+0000 7f764cff9700 1 -- 172.21.15.125:0/2154707361 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7648086c90 con 0x7f765015cb00 2023-10-06T03:04:24.621 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.616+0000 7f7654c64700 1 --2- 172.21.15.125:0/2154707361 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7634066f30 0x7f76340693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7644009d00 tx=0x7f7644009120 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:24.622 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.620+0000 7f764cff9700 1 -- 172.21.15.125:0/2154707361 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76500c4530 con 0x7f765015cb00 2023-10-06T03:04:24.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.801+0000 7f7656ec8700 1 -- 172.21.15.125:0/2154707361 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7650066510 con 0x7f765015cb00 2023-10-06T03:04:24.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.802+0000 7f764cff9700 1 -- 172.21.15.125:0/2154707361 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f76480540f0 con 0x7f765015cb00 2023-10-06T03:04:24.803 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-06T03:04:24.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.804+0000 7f7656ec8700 1 -- 172.21.15.125:0/2154707361 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7634066f30 msgr2=0x7f76340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:24.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.804+0000 7f7656ec8700 1 --2- 172.21.15.125:0/2154707361 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7634066f30 0x7f76340693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7644009d00 tx=0x7f7644009120 comp rx=0 tx=0).stop 2023-10-06T03:04:24.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.804+0000 7f7656ec8700 1 -- 172.21.15.125:0/2154707361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f765015cb00 msgr2=0x7f76501506a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:24.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.804+0000 7f7656ec8700 1 --2- 172.21.15.125:0/2154707361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f765015cb00 0x7f76501506a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f764800b6c0 tx=0x7f7648019000 comp rx=0 tx=0).stop 2023-10-06T03:04:24.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.804+0000 7f7656ec8700 1 -- 172.21.15.125:0/2154707361 shutdown_connections 2023-10-06T03:04:24.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.804+0000 7f7656ec8700 1 --2- 172.21.15.125:0/2154707361 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7634066f30 0x7f76340693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.804+0000 7f7656ec8700 1 --2- 172.21.15.125:0/2154707361 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f765015cb00 0x7f76501506a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.804+0000 7f7656ec8700 1 --2- 172.21.15.125:0/2154707361 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7650067610 0x7f765014f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.804+0000 7f7656ec8700 1 --2- 172.21.15.125:0/2154707361 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7650068ba0 0x7f765015ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.804+0000 7f7656ec8700 1 -- 172.21.15.125:0/2154707361 >> 172.21.15.125:0/2154707361 conn(0x7f76500af730 msgr2=0x7f765006c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:24.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.804+0000 7f7656ec8700 1 -- 172.21.15.125:0/2154707361 shutdown_connections 2023-10-06T03:04:24.806 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.804+0000 7f7656ec8700 1 -- 172.21.15.125:0/2154707361 wait complete. 2023-10-06T03:04:24.817 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:04:24.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.934+0000 7f266801a700 1 Processor -- start 2023-10-06T03:04:24.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.934+0000 7f266801a700 1 -- start start 2023-10-06T03:04:24.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.935+0000 7f266801a700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f2660069c10 0x7f26600c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.935+0000 7f266801a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26600c2d80 0x7f26600c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.935+0000 7f266801a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2660069780 con 0x7f26600cc730 2023-10-06T03:04:24.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.935+0000 7f266801a700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266006a0b0 con 0x7f2660069c10 2023-10-06T03:04:24.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.935+0000 7f266801a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26600c9270 con 0x7f26600c2d80 2023-10-06T03:04:24.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.935+0000 7f2665db6700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f26600cc730 0x7f26600c8620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35348/0 (socket says 172.21.15.125:35348) 2023-10-06T03:04:24.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.935+0000 7f2665db6700 1 -- 172.21.15.125:0/28263797 learned_addr learned my addr 172.21.15.125:0/28263797 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:24.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f26665b7700 1 --2- 172.21.15.125:0/28263797 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26600c2d80 0x7f26600c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:24.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f26655b5700 1 --2- 172.21.15.125:0/28263797 >> v2:172.21.15.130:3300/0 conn(0x7f2660069c10 0x7f26600c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:24.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f2664db4700 1 -- 172.21.15.125:0/28263797 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267165687 0 0) 0x7f2660069780 con 0x7f26600cc730 2023-10-06T03:04:24.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f2664db4700 1 -- 172.21.15.125:0/28263797 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f264c003570 con 0x7f26600cc730 2023-10-06T03:04:24.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f2664db4700 1 -- 172.21.15.125:0/28263797 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 260237438 0 0) 0x7f264c003570 con 0x7f26600cc730 2023-10-06T03:04:24.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f2664db4700 1 -- 172.21.15.125:0/28263797 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26600c2d80 msgr2=0x7f26600c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:24.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f2664db4700 1 --2- 172.21.15.125:0/28263797 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26600c2d80 0x7f26600c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f2664db4700 1 -- 172.21.15.125:0/28263797 >> v2:172.21.15.130:3300/0 conn(0x7f2660069c10 msgr2=0x7f26600c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:24.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f2664db4700 1 --2- 172.21.15.125:0/28263797 >> v2:172.21.15.130:3300/0 conn(0x7f2660069c10 0x7f26600c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f2664db4700 1 -- 172.21.15.125:0/28263797 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26600c4130 con 0x7f26600cc730 2023-10-06T03:04:24.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f2664db4700 1 -- 172.21.15.125:0/28263797 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f26500015f0 con 0x7f26600cc730 2023-10-06T03:04:24.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f2664db4700 1 -- 172.21.15.125:0/28263797 >> v1:172.21.15.125:6789/0 conn(0x7f26600cc730 legacy=0x7f26600c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:24.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f2664db4700 1 --2- 172.21.15.125:0/28263797 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26600c2d80 0x7f264c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f2664db4700 1 --2- 172.21.15.125:0/28263797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f264c003fe0 0x7f264c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f2664db4700 1 --2- 172.21.15.125:0/28263797 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f264c004d50 0x7f264c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f2664db4700 1 -- 172.21.15.125:0/28263797 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266006a0b0 con 0x7f264c004d50 2023-10-06T03:04:24.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f2664db4700 1 -- 172.21.15.125:0/28263797 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26600c9270 con 0x7f264c003fe0 2023-10-06T03:04:24.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f2664db4700 1 -- 172.21.15.125:0/28263797 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f264c00ba90 con 0x7f26600c2d80 2023-10-06T03:04:24.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f26665b7700 1 --2- 172.21.15.125:0/28263797 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f264c004d50 0x7f264c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:24.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f2665db6700 1 --2- 172.21.15.125:0/28263797 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26600c2d80 0x7f264c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:24.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f26655b5700 1 --2- 172.21.15.125:0/28263797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f264c003fe0 0x7f264c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:24.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f26665b7700 1 -- 172.21.15.125:0/28263797 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26600c2d80 msgr2=0x7f264c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:24.942 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f26665b7700 1 --2- 172.21.15.125:0/28263797 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26600c2d80 0x7f264c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f26665b7700 1 -- 172.21.15.125:0/28263797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f264c003fe0 msgr2=0x7f264c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:24.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f26665b7700 1 --2- 172.21.15.125:0/28263797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f264c003fe0 0x7f264c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f26665b7700 1 -- 172.21.15.125:0/28263797 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c003570 con 0x7f264c004d50 2023-10-06T03:04:24.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f26655b5700 1 --2- 172.21.15.125:0/28263797 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f264c003fe0 0x7f264c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:24.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f2665db6700 1 --2- 172.21.15.125:0/28263797 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26600c2d80 0x7f264c003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:24.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.936+0000 7f26665b7700 1 --2- 172.21.15.125:0/28263797 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f264c004d50 0x7f264c0051c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f265800e210 tx=0x7f265800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4bd3cf6750d24b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:24.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.937+0000 7f2664db4700 1 -- 172.21.15.125:0/28263797 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265800ea60 con 0x7f264c004d50 2023-10-06T03:04:24.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.937+0000 7f2664db4700 1 -- 172.21.15.125:0/28263797 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265800f040 con 0x7f264c004d50 2023-10-06T03:04:24.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.937+0000 7f2664db4700 1 -- 172.21.15.125:0/28263797 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265800ee10 con 0x7f264c004d50 2023-10-06T03:04:24.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.937+0000 7f266801a700 1 -- 172.21.15.125:0/28263797 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f264c004d50 msgr2=0x7f264c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:24.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.937+0000 7f266801a700 1 --2- 172.21.15.125:0/28263797 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f264c004d50 0x7f264c0051c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f265800e210 tx=0x7f265800b040 comp rx=0 tx=0).stop 2023-10-06T03:04:24.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.937+0000 7f26665b7700 1 -- 172.21.15.125:0/28263797 reap_dead start 2023-10-06T03:04:24.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.937+0000 7f266801a700 1 -- 172.21.15.125:0/28263797 shutdown_connections 2023-10-06T03:04:24.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.937+0000 7f266801a700 1 -- 172.21.15.125:0/28263797 >> 172.21.15.125:0/28263797 conn(0x7f2660067df0 msgr2=0x7f26600cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:24.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.937+0000 7f266801a700 1 -- 172.21.15.125:0/28263797 shutdown_connections 2023-10-06T03:04:24.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.937+0000 7f266801a700 1 -- 172.21.15.125:0/28263797 wait complete. 2023-10-06T03:04:24.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.938+0000 7f266801a700 1 Processor -- start 2023-10-06T03:04:24.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.938+0000 7f266801a700 1 -- start start 2023-10-06T03:04:24.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.939+0000 7f266801a700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f264c004d50 0x7f266015bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.939+0000 7f266801a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26600ca600 0x7f26600afdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.939+0000 7f266801a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26600caa70 0x7f26600b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.939+0000 7f266801a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266015c500 con 0x7f26600caa70 2023-10-06T03:04:24.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.939+0000 7f266801a700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26600c95a0 con 0x7f264c004d50 2023-10-06T03:04:24.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.939+0000 7f266801a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26600c9840 con 0x7f26600ca600 2023-10-06T03:04:24.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.939+0000 7f26665b7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26600caa70 0x7f26600b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:24.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.939+0000 7f26665b7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26600caa70 0x7f26600b0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:46694/0 (socket says 172.21.15.125:46694) 2023-10-06T03:04:24.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.939+0000 7f26665b7700 1 -- 172.21.15.125:0/1322357787 learned_addr learned my addr 172.21.15.125:0/1322357787 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:24.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.939+0000 7f26665b7700 1 -- 172.21.15.125:0/1322357787 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26600ca600 msgr2=0x7f26600afdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:24.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.939+0000 7f26665b7700 1 --2- 172.21.15.125:0/1322357787 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26600ca600 0x7f26600afdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.939+0000 7f26665b7700 1 -- 172.21.15.125:0/1322357787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f264c004d50 msgr2=0x7f266015bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:24.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.939+0000 7f26665b7700 1 --2- 172.21.15.125:0/1322357787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f264c004d50 0x7f266015bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:24.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.939+0000 7f26665b7700 1 -- 172.21.15.125:0/1322357787 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26600c9b20 con 0x7f26600caa70 2023-10-06T03:04:24.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.940+0000 7f26665b7700 1 --2- 172.21.15.125:0/1322357787 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26600caa70 0x7f26600b0310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2658016000 tx=0x7f265801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:24.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.940+0000 7f2655ffb700 1 -- 172.21.15.125:0/1322357787 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265800ee60 con 0x7f26600caa70 2023-10-06T03:04:24.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.940+0000 7f2655ffb700 1 -- 172.21.15.125:0/1322357787 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2658022070 con 0x7f26600caa70 2023-10-06T03:04:24.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.940+0000 7f266801a700 1 -- 172.21.15.125:0/1322357787 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26600c9e00 con 0x7f26600caa70 2023-10-06T03:04:24.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.940+0000 7f2655ffb700 1 -- 172.21.15.125:0/1322357787 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2658027680 con 0x7f26600caa70 2023-10-06T03:04:24.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.940+0000 7f266801a700 1 -- 172.21.15.125:0/1322357787 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2660158060 con 0x7f26600caa70 2023-10-06T03:04:24.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.941+0000 7f266801a700 1 -- 172.21.15.125:0/1322357787 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2660069250 con 0x7f26600caa70 2023-10-06T03:04:24.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.941+0000 7f2655ffb700 1 -- 172.21.15.125:0/1322357787 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2658024030 con 0x7f26600caa70 2023-10-06T03:04:24.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.942+0000 7f2655ffb700 1 --2- 172.21.15.125:0/1322357787 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2644066f30 0x7f26440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:24.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.942+0000 7f2655ffb700 1 -- 172.21.15.125:0/1322357787 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2658085eb0 con 0x7f26600caa70 2023-10-06T03:04:24.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.942+0000 7f2665db6700 1 --2- 172.21.15.125:0/1322357787 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2644066f30 0x7f26440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:24.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.942+0000 7f2665db6700 1 --2- 172.21.15.125:0/1322357787 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2644066f30 0x7f26440693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2650000e10 tx=0x7f2650009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:24.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:24.946+0000 7f2655ffb700 1 -- 172.21.15.125:0/1322357787 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2658053310 con 0x7f26600caa70 2023-10-06T03:04:25.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.169+0000 7f266801a700 1 -- 172.21.15.125:0/1322357787 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2660066510 con 0x7f26600caa70 2023-10-06T03:04:25.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.170+0000 7f2655ffb700 1 -- 172.21.15.125:0/1322357787 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f2658018de0 con 0x7f26600caa70 2023-10-06T03:04:25.171 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:25.172 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/1260071130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1260071130},{"type":"v1","addr":"172.21.15.130:6834","nonce":1260071130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/63925154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":63925154},{"type":"v1","addr":"172.21.15.125:6836","nonce":63925154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/1057811891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1057811891},{"type":"v1","addr":"172.21.15.125:6837","nonce":1057811891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/4004582354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":4004582354},{"type":"v1","addr":"172.21.15.130:6835","nonce":4004582354}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T03:04:25.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.172+0000 7f266801a700 1 -- 172.21.15.125:0/1322357787 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2644066f30 msgr2=0x7f26440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:25.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.172+0000 7f266801a700 1 --2- 172.21.15.125:0/1322357787 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2644066f30 0x7f26440693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2650000e10 tx=0x7f2650009040 comp rx=0 tx=0).stop 2023-10-06T03:04:25.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.172+0000 7f266801a700 1 -- 172.21.15.125:0/1322357787 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26600caa70 msgr2=0x7f26600b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:25.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.172+0000 7f266801a700 1 --2- 172.21.15.125:0/1322357787 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26600caa70 0x7f26600b0310 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2658016000 tx=0x7f265801a000 comp rx=0 tx=0).stop 2023-10-06T03:04:25.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.172+0000 7f266801a700 1 -- 172.21.15.125:0/1322357787 shutdown_connections 2023-10-06T03:04:25.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.172+0000 7f266801a700 1 --2- 172.21.15.125:0/1322357787 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2644066f30 0x7f26440693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.172+0000 7f266801a700 1 --2- 172.21.15.125:0/1322357787 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26600caa70 0x7f26600b0310 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.172+0000 7f266801a700 1 --2- 172.21.15.125:0/1322357787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f264c004d50 0x7f266015bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.172+0000 7f266801a700 1 --2- 172.21.15.125:0/1322357787 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26600ca600 0x7f26600afdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.172+0000 7f266801a700 1 -- 172.21.15.125:0/1322357787 >> 172.21.15.125:0/1322357787 conn(0x7f2660067df0 msgr2=0x7f26600aab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:25.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.172+0000 7f266801a700 1 -- 172.21.15.125:0/1322357787 shutdown_connections 2023-10-06T03:04:25.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.172+0000 7f266801a700 1 -- 172.21.15.125:0/1322357787 wait complete. 2023-10-06T03:04:25.175 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 3 2023-10-06T03:04:25.185 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:04:25.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.300+0000 7f55c86a9700 1 Processor -- start 2023-10-06T03:04:25.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.300+0000 7f55c86a9700 1 -- start start 2023-10-06T03:04:25.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.301+0000 7f55c86a9700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f55c00ac670 0x7f55c00c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:25.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.301+0000 7f55c86a9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f55c006afd0 0x7f55c00c7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:25.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.301+0000 7f55c86a9700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c0067c70 con 0x7f55c01590d0 2023-10-06T03:04:25.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.301+0000 7f55c86a9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c00c75c0 con 0x7f55c006afd0 2023-10-06T03:04:25.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.301+0000 7f55c86a9700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c0069110 con 0x7f55c00ac670 2023-10-06T03:04:25.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.302+0000 7f55c6c46700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f55c006afd0 0x7f55c00c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:25.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.302+0000 7f55c6c46700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f55c006afd0 0x7f55c00c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44156/0 (socket says 172.21.15.125:44156) 2023-10-06T03:04:25.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.302+0000 7f55c6c46700 1 -- 172.21.15.125:0/6617663 learned_addr learned my addr 172.21.15.125:0/6617663 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:25.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.302+0000 7f55c5c44700 1 --2- 172.21.15.125:0/6617663 >> v2:172.21.15.130:3300/0 conn(0x7f55c00ac670 0x7f55c00c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:25.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.302+0000 7f55c6c46700 1 -- 172.21.15.125:0/6617663 >> v2:172.21.15.130:3300/0 conn(0x7f55c00ac670 msgr2=0x7f55c00c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:25.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.302+0000 7f55c6c46700 1 --2- 172.21.15.125:0/6617663 >> v2:172.21.15.130:3300/0 conn(0x7f55c00ac670 0x7f55c00c6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.302+0000 7f55c6c46700 1 -- 172.21.15.125:0/6617663 >> v1:172.21.15.130:6789/0 conn(0x7f55c01590d0 legacy=0x7f55c006a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:25.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.302+0000 7f55c6c46700 1 -- 172.21.15.125:0/6617663 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c00c77e0 con 0x7f55c006afd0 2023-10-06T03:04:25.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.302+0000 7f55c6c46700 1 --2- 172.21.15.125:0/6617663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55c006afd0 0x7f55c00c7080 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f55c00722e0 tx=0x7f55b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38033e0bd9b0d039 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:25.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.302+0000 7f55c5443700 1 -- 172.21.15.125:0/6617663 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b800e070 con 0x7f55c006afd0 2023-10-06T03:04:25.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.302+0000 7f55c5443700 1 -- 172.21.15.125:0/6617663 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b800b990 con 0x7f55c006afd0 2023-10-06T03:04:25.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.302+0000 7f55c5443700 1 -- 172.21.15.125:0/6617663 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b80092e0 con 0x7f55c006afd0 2023-10-06T03:04:25.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.303+0000 7f55c86a9700 1 -- 172.21.15.125:0/6617663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55c006afd0 msgr2=0x7f55c00c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:25.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.303+0000 7f55c86a9700 1 --2- 172.21.15.125:0/6617663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55c006afd0 0x7f55c00c7080 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f55c00722e0 tx=0x7f55b8009840 comp rx=0 tx=0).stop 2023-10-06T03:04:25.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.303+0000 7f55c86a9700 1 -- 172.21.15.125:0/6617663 shutdown_connections 2023-10-06T03:04:25.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.303+0000 7f55c86a9700 1 --2- 172.21.15.125:0/6617663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55c006afd0 0x7f55c00c7080 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.303+0000 7f55c86a9700 1 --2- 172.21.15.125:0/6617663 >> v2:172.21.15.130:3300/0 conn(0x7f55c00ac670 0x7f55c00c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.303+0000 7f55c86a9700 1 -- 172.21.15.125:0/6617663 >> 172.21.15.125:0/6617663 conn(0x7f55c00cc5a0 msgr2=0x7f55c00cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:25.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.303+0000 7f55c86a9700 1 -- 172.21.15.125:0/6617663 shutdown_connections 2023-10-06T03:04:25.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.303+0000 7f55c86a9700 1 -- 172.21.15.125:0/6617663 wait complete. 2023-10-06T03:04:25.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.304+0000 7f55c86a9700 1 Processor -- start 2023-10-06T03:04:25.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.304+0000 7f55c86a9700 1 -- start start 2023-10-06T03:04:25.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c86a9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55c006afd0 0x7f55c015c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:25.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c86a9700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55c00ac670 0x7f55c00b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:25.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c86a9700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55c01590d0 0x7f55c01594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:25.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c86a9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c015bdb0 con 0x7f55c006afd0 2023-10-06T03:04:25.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c86a9700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c00b1c50 con 0x7f55c01590d0 2023-10-06T03:04:25.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c86a9700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c015b1a0 con 0x7f55c00ac670 2023-10-06T03:04:25.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c6445700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55c006afd0 0x7f55c015c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:25.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c6445700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55c006afd0 0x7f55c015c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44172/0 (socket says 172.21.15.125:44172) 2023-10-06T03:04:25.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c6445700 1 -- 172.21.15.125:0/1728334869 learned_addr learned my addr 172.21.15.125:0/1728334869 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:25.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c6c46700 1 --2- 172.21.15.125:0/1728334869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55c01590d0 0x7f55c01594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:25.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c5c44700 1 --2- 172.21.15.125:0/1728334869 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55c00ac670 0x7f55c00b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:25.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c6445700 1 -- 172.21.15.125:0/1728334869 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55c00ac670 msgr2=0x7f55c00b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:25.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c6445700 1 --2- 172.21.15.125:0/1728334869 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55c00ac670 0x7f55c00b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c6445700 1 -- 172.21.15.125:0/1728334869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55c01590d0 msgr2=0x7f55c01594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:25.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c6445700 1 --2- 172.21.15.125:0/1728334869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55c01590d0 0x7f55c01594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c6445700 1 -- 172.21.15.125:0/1728334869 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b8009ae0 con 0x7f55c006afd0 2023-10-06T03:04:25.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c6c46700 1 --2- 172.21.15.125:0/1728334869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55c01590d0 0x7f55c01594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:25.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c6445700 1 --2- 172.21.15.125:0/1728334869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55c006afd0 0x7f55c015c240 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00c4e0 tx=0x7f55bc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:25.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55b67fc700 1 -- 172.21.15.125:0/1728334869 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc011590 con 0x7f55c006afd0 2023-10-06T03:04:25.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55b67fc700 1 -- 172.21.15.125:0/1728334869 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc011710 con 0x7f55c006afd0 2023-10-06T03:04:25.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c86a9700 1 -- 172.21.15.125:0/1728334869 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c015b480 con 0x7f55c006afd0 2023-10-06T03:04:25.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55b67fc700 1 -- 172.21.15.125:0/1728334869 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc011ad0 con 0x7f55c006afd0 2023-10-06T03:04:25.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.305+0000 7f55c86a9700 1 -- 172.21.15.125:0/1728334869 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c015ba40 con 0x7f55c006afd0 2023-10-06T03:04:25.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.306+0000 7f55c86a9700 1 -- 172.21.15.125:0/1728334869 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c015c090 con 0x7f55c006afd0 2023-10-06T03:04:25.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.307+0000 7f55b67fc700 1 -- 172.21.15.125:0/1728334869 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55bc01b3b0 con 0x7f55c006afd0 2023-10-06T03:04:25.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.307+0000 7f55b67fc700 1 --2- 172.21.15.125:0/1728334869 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f55a4066f30 0x7f55a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:25.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.307+0000 7f55b67fc700 1 -- 172.21.15.125:0/1728334869 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f55bc083850 con 0x7f55c006afd0 2023-10-06T03:04:25.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.307+0000 7f55c5c44700 1 --2- 172.21.15.125:0/1728334869 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f55a4066f30 0x7f55a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:25.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.308+0000 7f55c5c44700 1 --2- 172.21.15.125:0/1728334869 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f55a4066f30 0x7f55a40693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f55c0154960 tx=0x7f55b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:25.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.311+0000 7f55b67fc700 1 -- 172.21.15.125:0/1728334869 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55bc050cb0 con 0x7f55c006afd0 2023-10-06T03:04:25.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.493+0000 7f55c86a9700 1 -- 172.21.15.125:0/1728334869 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55c0066510 con 0x7f55c006afd0 2023-10-06T03:04:25.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.494+0000 7f55b67fc700 1 -- 172.21.15.125:0/1728334869 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13791 (secure 0 0 0) 0x7f55bc017070 con 0x7f55c006afd0 2023-10-06T03:04:25.496 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:25.496 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":19,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:24.800260+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:04:25.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.496+0000 7f55c86a9700 1 -- 172.21.15.125:0/1728334869 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f55a4066f30 msgr2=0x7f55a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:25.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.496+0000 7f55c86a9700 1 --2- 172.21.15.125:0/1728334869 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f55a4066f30 0x7f55a40693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f55c0154960 tx=0x7f55b0008040 comp rx=0 tx=0).stop 2023-10-06T03:04:25.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.496+0000 7f55c86a9700 1 -- 172.21.15.125:0/1728334869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55c006afd0 msgr2=0x7f55c015c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:25.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.496+0000 7f55c86a9700 1 --2- 172.21.15.125:0/1728334869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55c006afd0 0x7f55c015c240 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00c4e0 tx=0x7f55bc00c8a0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.496+0000 7f55c86a9700 1 -- 172.21.15.125:0/1728334869 shutdown_connections 2023-10-06T03:04:25.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.496+0000 7f55c86a9700 1 --2- 172.21.15.125:0/1728334869 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f55a4066f30 0x7f55a40693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.496+0000 7f55c86a9700 1 --2- 172.21.15.125:0/1728334869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55c01590d0 0x7f55c01594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.496+0000 7f55c86a9700 1 --2- 172.21.15.125:0/1728334869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f55c006afd0 0x7f55c015c240 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.496+0000 7f55c86a9700 1 --2- 172.21.15.125:0/1728334869 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f55c00ac670 0x7f55c00b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.496+0000 7f55c86a9700 1 -- 172.21.15.125:0/1728334869 >> 172.21.15.125:0/1728334869 conn(0x7f55c00cc5a0 msgr2=0x7f55c0155390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:25.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.496+0000 7f55c86a9700 1 -- 172.21.15.125:0/1728334869 shutdown_connections 2023-10-06T03:04:25.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.496+0000 7f55c86a9700 1 -- 172.21.15.125:0/1728334869 wait complete. 2023-10-06T03:04:25.509 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:04:15.845430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:04:22.729795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T03:04:25.510 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:04:25.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.628+0000 7f1309068700 1 Processor -- start 2023-10-06T03:04:25.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.628+0000 7f1309068700 1 -- start start 2023-10-06T03:04:25.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.629+0000 7f1309068700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13040c98a0 0x7f13040c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:25.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.629+0000 7f1309068700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13040caba0 0x7f13040cb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:25.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.629+0000 7f1309068700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1304158570 con 0x7f1304140c50 2023-10-06T03:04:25.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.629+0000 7f1309068700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1304157770 con 0x7f13040caba0 2023-10-06T03:04:25.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.629+0000 7f1309068700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13040ca250 con 0x7f13040c98a0 2023-10-06T03:04:25.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.629+0000 7f130359e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13040caba0 0x7f13040cb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:25.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.629+0000 7f130359e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f13040caba0 0x7f13040cb020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44188/0 (socket says 172.21.15.125:44188) 2023-10-06T03:04:25.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.629+0000 7f130359e700 1 -- 172.21.15.125:0/1831240130 learned_addr learned my addr 172.21.15.125:0/1831240130 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:25.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.629+0000 7f130259c700 1 --2- 172.21.15.125:0/1831240130 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13040c98a0 0x7f13040c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:25.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.629+0000 7f130359e700 1 -- 172.21.15.125:0/1831240130 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13040c98a0 msgr2=0x7f13040c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:25.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.629+0000 7f130359e700 1 --2- 172.21.15.125:0/1831240130 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13040c98a0 0x7f13040c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.629+0000 7f130359e700 1 -- 172.21.15.125:0/1831240130 >> v1:172.21.15.130:6789/0 conn(0x7f1304140c50 legacy=0x7f13040cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:25.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.629+0000 7f130359e700 1 -- 172.21.15.125:0/1831240130 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1304158920 con 0x7f13040caba0 2023-10-06T03:04:25.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.629+0000 7f130359e700 1 --2- 172.21.15.125:0/1831240130 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13040caba0 0x7f13040cb020 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f12fc009f20 tx=0x7f12fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15edb36cf9c4c9f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:25.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.629+0000 7f1301d9b700 1 -- 172.21.15.125:0/1831240130 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc00e070 con 0x7f13040caba0 2023-10-06T03:04:25.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.629+0000 7f1301d9b700 1 -- 172.21.15.125:0/1831240130 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc00ba40 con 0x7f13040caba0 2023-10-06T03:04:25.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.629+0000 7f1301d9b700 1 -- 172.21.15.125:0/1831240130 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0092e0 con 0x7f13040caba0 2023-10-06T03:04:25.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.630+0000 7f1309068700 1 -- 172.21.15.125:0/1831240130 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13040caba0 msgr2=0x7f13040cb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:25.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.630+0000 7f1309068700 1 --2- 172.21.15.125:0/1831240130 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13040caba0 0x7f13040cb020 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f12fc009f20 tx=0x7f12fc009840 comp rx=0 tx=0).stop 2023-10-06T03:04:25.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.630+0000 7f1309068700 1 -- 172.21.15.125:0/1831240130 shutdown_connections 2023-10-06T03:04:25.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.630+0000 7f1309068700 1 --2- 172.21.15.125:0/1831240130 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13040caba0 0x7f13040cb020 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.630+0000 7f1309068700 1 --2- 172.21.15.125:0/1831240130 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13040c98a0 0x7f13040c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.630+0000 7f1309068700 1 -- 172.21.15.125:0/1831240130 >> 172.21.15.125:0/1831240130 conn(0x7f1304096120 msgr2=0x7f1304068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:25.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.630+0000 7f1309068700 1 -- 172.21.15.125:0/1831240130 shutdown_connections 2023-10-06T03:04:25.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.630+0000 7f1309068700 1 -- 172.21.15.125:0/1831240130 wait complete. 2023-10-06T03:04:25.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.631+0000 7f1309068700 1 Processor -- start 2023-10-06T03:04:25.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.631+0000 7f1309068700 1 -- start start 2023-10-06T03:04:25.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.632+0000 7f1309068700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13040c98a0 0x7f1304155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:25.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.632+0000 7f1309068700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13040caba0 0x7f130416ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:25.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.632+0000 7f1309068700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1304140c50 0x7f130413ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:25.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.632+0000 7f1309068700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130413af20 con 0x7f13040caba0 2023-10-06T03:04:25.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.632+0000 7f1309068700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130416a8c0 con 0x7f1304140c50 2023-10-06T03:04:25.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.632+0000 7f1309068700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130413bb30 con 0x7f13040c98a0 2023-10-06T03:04:25.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.632+0000 7f130259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13040caba0 0x7f130416ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:25.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.632+0000 7f130259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13040caba0 0x7f130416ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44192/0 (socket says 172.21.15.125:44192) 2023-10-06T03:04:25.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.632+0000 7f130259c700 1 -- 172.21.15.125:0/1909266114 learned_addr learned my addr 172.21.15.125:0/1909266114 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:25.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.633+0000 7f130259c700 1 -- 172.21.15.125:0/1909266114 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13040c98a0 msgr2=0x7f1304155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:25.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.633+0000 7f130259c700 1 --2- 172.21.15.125:0/1909266114 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13040c98a0 0x7f1304155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.633+0000 7f130259c700 1 -- 172.21.15.125:0/1909266114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1304140c50 msgr2=0x7f130413ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:25.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.633+0000 7f130359e700 1 --2- 172.21.15.125:0/1909266114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1304140c50 0x7f130413ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:25.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.633+0000 7f130259c700 1 --2- 172.21.15.125:0/1909266114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1304140c50 0x7f130413ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.633+0000 7f130259c700 1 -- 172.21.15.125:0/1909266114 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc009ae0 con 0x7f13040caba0 2023-10-06T03:04:25.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.633+0000 7f130259c700 1 --2- 172.21.15.125:0/1909266114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13040caba0 0x7f130416ad50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f12f400c7d0 tx=0x7f12f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:25.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.633+0000 7f12eaffd700 1 -- 172.21.15.125:0/1909266114 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4011600 con 0x7f13040caba0 2023-10-06T03:04:25.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.633+0000 7f12eaffd700 1 -- 172.21.15.125:0/1909266114 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f4011760 con 0x7f13040caba0 2023-10-06T03:04:25.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.633+0000 7f1309068700 1 -- 172.21.15.125:0/1909266114 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130413be10 con 0x7f13040caba0 2023-10-06T03:04:25.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.633+0000 7f12eaffd700 1 -- 172.21.15.125:0/1909266114 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f4011b00 con 0x7f13040caba0 2023-10-06T03:04:25.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.633+0000 7f1309068700 1 -- 172.21.15.125:0/1909266114 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130416b290 con 0x7f13040caba0 2023-10-06T03:04:25.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.634+0000 7f1309068700 1 -- 172.21.15.125:0/1909266114 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1304066510 con 0x7f13040caba0 2023-10-06T03:04:25.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.634+0000 7f12eaffd700 1 -- 172.21.15.125:0/1909266114 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12f40193f0 con 0x7f13040caba0 2023-10-06T03:04:25.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.634+0000 7f12eaffd700 1 --2- 172.21.15.125:0/1909266114 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f12f0066f30 0x7f12f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:25.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.635+0000 7f12eaffd700 1 -- 172.21.15.125:0/1909266114 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f12f4084720 con 0x7f13040caba0 2023-10-06T03:04:25.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.635+0000 7f1302d9d700 1 --2- 172.21.15.125:0/1909266114 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f12f0066f30 0x7f12f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:25.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.635+0000 7f1302d9d700 1 --2- 172.21.15.125:0/1909266114 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f12f0066f30 0x7f12f00693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009720 tx=0x7f12f8006c30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:25.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.639+0000 7f12eaffd700 1 -- 172.21.15.125:0/1909266114 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12f4051b80 con 0x7f13040caba0 2023-10-06T03:04:25.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.822+0000 7f1309068700 1 -- 172.21.15.125:0/1909266114 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1304157960 con 0x7f13040caba0 2023-10-06T03:04:25.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.822+0000 7f12eaffd700 1 -- 172.21.15.125:0/1909266114 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f12f40551a0 con 0x7f13040caba0 2023-10-06T03:04:25.824 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-06T03:04:25.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.824+0000 7f1309068700 1 -- 172.21.15.125:0/1909266114 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f12f0066f30 msgr2=0x7f12f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:25.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.824+0000 7f1309068700 1 --2- 172.21.15.125:0/1909266114 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f12f0066f30 0x7f12f00693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009720 tx=0x7f12f8006c30 comp rx=0 tx=0).stop 2023-10-06T03:04:25.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.824+0000 7f1309068700 1 -- 172.21.15.125:0/1909266114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13040caba0 msgr2=0x7f130416ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:25.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.824+0000 7f1309068700 1 --2- 172.21.15.125:0/1909266114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13040caba0 0x7f130416ad50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f12f400c7d0 tx=0x7f12f4008040 comp rx=0 tx=0).stop 2023-10-06T03:04:25.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.824+0000 7f1309068700 1 -- 172.21.15.125:0/1909266114 shutdown_connections 2023-10-06T03:04:25.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.824+0000 7f1309068700 1 --2- 172.21.15.125:0/1909266114 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f12f0066f30 0x7f12f00693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.824+0000 7f1309068700 1 --2- 172.21.15.125:0/1909266114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1304140c50 0x7f130413ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.824+0000 7f1309068700 1 --2- 172.21.15.125:0/1909266114 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f13040c98a0 0x7f1304155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.824+0000 7f1309068700 1 --2- 172.21.15.125:0/1909266114 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f13040caba0 0x7f130416ad50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.824+0000 7f1309068700 1 -- 172.21.15.125:0/1909266114 >> 172.21.15.125:0/1909266114 conn(0x7f1304096120 msgr2=0x7f130406bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:25.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.824+0000 7f1309068700 1 -- 172.21.15.125:0/1909266114 shutdown_connections 2023-10-06T03:04:25.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.824+0000 7f1309068700 1 -- 172.21.15.125:0/1909266114 wait complete. 2023-10-06T03:04:25.837 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:04:25.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.955+0000 7f095fa55700 1 Processor -- start 2023-10-06T03:04:25.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.955+0000 7f095fa55700 1 -- start start 2023-10-06T03:04:25.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.956+0000 7f095fa55700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f09581595a0 0x7f09580b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:25.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.956+0000 7f095fa55700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09580cc7f0 0x7f09580ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:25.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.956+0000 7f095fa55700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09580cc360 con 0x7f09581591d0 2023-10-06T03:04:25.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.956+0000 7f095fa55700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09580cba70 con 0x7f09581595a0 2023-10-06T03:04:25.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.956+0000 7f095fa55700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09580b2740 con 0x7f09580cc7f0 2023-10-06T03:04:25.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.956+0000 7f095cff0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f09581595a0 0x7f09580b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:25.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.956+0000 7f095d7f1700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f09581591d0 0x7f09580b2030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35254/0 (socket says 172.21.15.125:35254) 2023-10-06T03:04:25.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.956+0000 7f095d7f1700 1 -- 172.21.15.125:0/2461089457 learned_addr learned my addr 172.21.15.125:0/2461089457 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:25.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.957+0000 7f095cff0700 1 -- 172.21.15.125:0/2461089457 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09580cc7f0 msgr2=0x7f09580ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:25.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.957+0000 7f095cff0700 1 --2- 172.21.15.125:0/2461089457 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09580cc7f0 0x7f09580ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.957+0000 7f095cff0700 1 -- 172.21.15.125:0/2461089457 >> v1:172.21.15.125:6789/0 conn(0x7f09581591d0 legacy=0x7f09580b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:25.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.957+0000 7f095cff0700 1 -- 172.21.15.125:0/2461089457 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09580cbd10 con 0x7f09581595a0 2023-10-06T03:04:25.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.957+0000 7f094ffff700 1 -- 172.21.15.125:0/2461089457 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450624378 0 0) 0x7f09580cc360 con 0x7f09581591d0 2023-10-06T03:04:25.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.957+0000 7f095cff0700 1 --2- 172.21.15.125:0/2461089457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09581595a0 0x7f09580b2f50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f09540098e0 tx=0x7f09540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd95aab863ab8c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:25.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.957+0000 7f094ffff700 1 -- 172.21.15.125:0/2461089457 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0954009e80 con 0x7f09581595a0 2023-10-06T03:04:25.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.957+0000 7f094ffff700 1 -- 172.21.15.125:0/2461089457 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095400b860 con 0x7f09581595a0 2023-10-06T03:04:25.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.957+0000 7f094ffff700 1 -- 172.21.15.125:0/2461089457 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095400bbe0 con 0x7f09581595a0 2023-10-06T03:04:25.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.957+0000 7f095fa55700 1 -- 172.21.15.125:0/2461089457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09581595a0 msgr2=0x7f09580b2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:25.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.957+0000 7f095fa55700 1 --2- 172.21.15.125:0/2461089457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09581595a0 0x7f09580b2f50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f09540098e0 tx=0x7f09540091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.957+0000 7f095fa55700 1 -- 172.21.15.125:0/2461089457 shutdown_connections 2023-10-06T03:04:25.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.957+0000 7f095fa55700 1 --2- 172.21.15.125:0/2461089457 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09580cc7f0 0x7f09580ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.958+0000 7f095fa55700 1 --2- 172.21.15.125:0/2461089457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09581595a0 0x7f09580b2f50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.958+0000 7f095fa55700 1 -- 172.21.15.125:0/2461089457 >> 172.21.15.125:0/2461089457 conn(0x7f095806ed40 msgr2=0x7f095806f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:25.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.958+0000 7f095fa55700 1 -- 172.21.15.125:0/2461089457 shutdown_connections 2023-10-06T03:04:25.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.958+0000 7f095fa55700 1 -- 172.21.15.125:0/2461089457 wait complete. 2023-10-06T03:04:25.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.959+0000 7f095fa55700 1 Processor -- start 2023-10-06T03:04:25.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.959+0000 7f095fa55700 1 -- start start 2023-10-06T03:04:25.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f095fa55700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09580cc7f0 0x7f09580c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:25.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f095fa55700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09581591d0 0x7f095815c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:25.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f095fa55700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09581595a0 0x7f09580c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:25.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f095fa55700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095815c730 con 0x7f09581595a0 2023-10-06T03:04:25.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f095fa55700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0958155be0 con 0x7f09581591d0 2023-10-06T03:04:25.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f095fa55700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09580c64d0 con 0x7f09580cc7f0 2023-10-06T03:04:25.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f095dff2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09581595a0 0x7f09580c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:25.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f095dff2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09581595a0 0x7f09580c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44214/0 (socket says 172.21.15.125:44214) 2023-10-06T03:04:25.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f095dff2700 1 -- 172.21.15.125:0/1280058587 learned_addr learned my addr 172.21.15.125:0/1280058587 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:25.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f095d7f1700 1 --2- 172.21.15.125:0/1280058587 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09580cc7f0 0x7f09580c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:25.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f095cff0700 1 --2- 172.21.15.125:0/1280058587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09581591d0 0x7f095815c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:25.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f095dff2700 1 -- 172.21.15.125:0/1280058587 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09580cc7f0 msgr2=0x7f09580c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:25.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f095dff2700 1 --2- 172.21.15.125:0/1280058587 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09580cc7f0 0x7f09580c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f095dff2700 1 -- 172.21.15.125:0/1280058587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09581591d0 msgr2=0x7f095815c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:25.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f095dff2700 1 --2- 172.21.15.125:0/1280058587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09581591d0 0x7f095815c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:25.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f095dff2700 1 -- 172.21.15.125:0/1280058587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0954009420 con 0x7f09581595a0 2023-10-06T03:04:25.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f095dff2700 1 --2- 172.21.15.125:0/1280058587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09581595a0 0x7f09580c5f90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f095000bc60 tx=0x7f0950009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:25.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f094d7fa700 1 -- 172.21.15.125:0/1280058587 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09500092e0 con 0x7f09581595a0 2023-10-06T03:04:25.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f094d7fa700 1 -- 172.21.15.125:0/1280058587 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095000c630 con 0x7f09581595a0 2023-10-06T03:04:25.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f095fa55700 1 -- 172.21.15.125:0/1280058587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09580c7820 con 0x7f09581595a0 2023-10-06T03:04:25.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f094d7fa700 1 -- 172.21.15.125:0/1280058587 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095000c9f0 con 0x7f09581595a0 2023-10-06T03:04:25.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.960+0000 7f095fa55700 1 -- 172.21.15.125:0/1280058587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09580c7de0 con 0x7f09581595a0 2023-10-06T03:04:25.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.961+0000 7f095fa55700 1 -- 172.21.15.125:0/1280058587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0958066510 con 0x7f09581595a0 2023-10-06T03:04:25.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.962+0000 7f094d7fa700 1 -- 172.21.15.125:0/1280058587 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0950012070 con 0x7f09581595a0 2023-10-06T03:04:25.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.962+0000 7f094d7fa700 1 --2- 172.21.15.125:0/1280058587 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f093c066f30 0x7f093c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:25.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.962+0000 7f094d7fa700 1 -- 172.21.15.125:0/1280058587 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0950083ea0 con 0x7f09581595a0 2023-10-06T03:04:25.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.962+0000 7f095d7f1700 1 --2- 172.21.15.125:0/1280058587 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f093c066f30 0x7f093c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:25.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.962+0000 7f095d7f1700 1 --2- 172.21.15.125:0/1280058587 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f093c066f30 0x7f093c0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0948001360 tx=0x7f0948009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:25.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:25.966+0000 7f094d7fa700 1 -- 172.21.15.125:0/1280058587 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0950051300 con 0x7f09581595a0 2023-10-06T03:04:26.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.150+0000 7f095fa55700 1 -- 172.21.15.125:0/1280058587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f09580cbff0 con 0x7f09581595a0 2023-10-06T03:04:26.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.151+0000 7f094d7fa700 1 -- 172.21.15.125:0/1280058587 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0950054920 con 0x7f09581595a0 2023-10-06T03:04:26.153 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-06T03:04:26.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.153+0000 7f095fa55700 1 -- 172.21.15.125:0/1280058587 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f093c066f30 msgr2=0x7f093c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:26.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.153+0000 7f095fa55700 1 --2- 172.21.15.125:0/1280058587 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f093c066f30 0x7f093c0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0948001360 tx=0x7f0948009040 comp rx=0 tx=0).stop 2023-10-06T03:04:26.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.153+0000 7f095fa55700 1 -- 172.21.15.125:0/1280058587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09581595a0 msgr2=0x7f09580c5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:26.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.153+0000 7f095fa55700 1 --2- 172.21.15.125:0/1280058587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09581595a0 0x7f09580c5f90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f095000bc60 tx=0x7f0950009840 comp rx=0 tx=0).stop 2023-10-06T03:04:26.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.153+0000 7f095fa55700 1 -- 172.21.15.125:0/1280058587 shutdown_connections 2023-10-06T03:04:26.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.153+0000 7f095fa55700 1 --2- 172.21.15.125:0/1280058587 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f093c066f30 0x7f093c0693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.153+0000 7f095fa55700 1 --2- 172.21.15.125:0/1280058587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09581595a0 0x7f09580c5f90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.153+0000 7f095fa55700 1 --2- 172.21.15.125:0/1280058587 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09580cc7f0 0x7f09580c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.153+0000 7f095fa55700 1 --2- 172.21.15.125:0/1280058587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f09581591d0 0x7f095815c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.153+0000 7f095fa55700 1 -- 172.21.15.125:0/1280058587 >> 172.21.15.125:0/1280058587 conn(0x7f095806ed40 msgr2=0x7f09580cec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:26.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.153+0000 7f095fa55700 1 -- 172.21.15.125:0/1280058587 shutdown_connections 2023-10-06T03:04:26.156 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.153+0000 7f095fa55700 1 -- 172.21.15.125:0/1280058587 wait complete. 2023-10-06T03:04:26.166 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:04:26.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.282+0000 7f5c4198b700 1 Processor -- start 2023-10-06T03:04:26.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.282+0000 7f5c4198b700 1 -- start start 2023-10-06T03:04:26.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.282+0000 7f5c4198b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5c3c1591f0 0x7f5c3c1595c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:26.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.282+0000 7f5c4198b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5c3c0b2f30 0x7f5c3c0b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:26.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.282+0000 7f5c4198b700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5c3c0ccc30 0x7f5c3c0cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:26.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.282+0000 7f5c4198b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c3c0afbf0 con 0x7f5c3c0b2f30 2023-10-06T03:04:26.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.282+0000 7f5c4198b700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c3c0cbb90 con 0x7f5c3c0ccc30 2023-10-06T03:04:26.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.282+0000 7f5c4198b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c0cbe70 con 0x7f5c3c1591f0 2023-10-06T03:04:26.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.283+0000 7f5c3a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5c3c0b2f30 0x7f5c3c0b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:26.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.283+0000 7f5c3a7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5c3c0b2f30 0x7f5c3c0b33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44216/0 (socket says 172.21.15.125:44216) 2023-10-06T03:04:26.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.283+0000 7f5c3a7fc700 1 -- 172.21.15.125:0/1154294289 learned_addr learned my addr 172.21.15.125:0/1154294289 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:26.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.283+0000 7f5c3affd700 1 --2- 172.21.15.125:0/1154294289 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5c3c1591f0 0x7f5c3c1595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:26.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.283+0000 7f5c3b7fe700 1 --2- 172.21.15.125:0/1154294289 >> v2:172.21.15.130:3300/0 conn(0x7f5c3c0ccc30 0x7f5c3c0cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:26.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.283+0000 7f5c3a7fc700 1 -- 172.21.15.125:0/1154294289 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5c3c1591f0 msgr2=0x7f5c3c1595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.283+0000 7f5c3a7fc700 1 --2- 172.21.15.125:0/1154294289 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5c3c1591f0 0x7f5c3c1595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.283+0000 7f5c3a7fc700 1 -- 172.21.15.125:0/1154294289 >> v2:172.21.15.130:3300/0 conn(0x7f5c3c0ccc30 msgr2=0x7f5c3c0cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.283+0000 7f5c3a7fc700 1 --2- 172.21.15.125:0/1154294289 >> v2:172.21.15.130:3300/0 conn(0x7f5c3c0ccc30 0x7f5c3c0cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.283+0000 7f5c3a7fc700 1 -- 172.21.15.125:0/1154294289 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c3c0cc150 con 0x7f5c3c0b2f30 2023-10-06T03:04:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.283+0000 7f5c3a7fc700 1 --2- 172.21.15.125:0/1154294289 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c3c0b2f30 0x7f5c3c0b33a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0ca660 tx=0x7f5c30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7529592886953fa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.283+0000 7f5c39ffb700 1 -- 172.21.15.125:0/1154294289 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3000b860 con 0x7f5c3c0b2f30 2023-10-06T03:04:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.283+0000 7f5c39ffb700 1 -- 172.21.15.125:0/1154294289 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3000b9c0 con 0x7f5c3c0b2f30 2023-10-06T03:04:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.283+0000 7f5c39ffb700 1 -- 172.21.15.125:0/1154294289 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3000bd60 con 0x7f5c3c0b2f30 2023-10-06T03:04:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.284+0000 7f5c4198b700 1 -- 172.21.15.125:0/1154294289 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c3c0b2f30 msgr2=0x7f5c3c0b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.284+0000 7f5c4198b700 1 --2- 172.21.15.125:0/1154294289 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c3c0b2f30 0x7f5c3c0b33a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0ca660 tx=0x7f5c30009250 comp rx=0 tx=0).stop 2023-10-06T03:04:26.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.284+0000 7f5c4198b700 1 -- 172.21.15.125:0/1154294289 shutdown_connections 2023-10-06T03:04:26.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.284+0000 7f5c4198b700 1 --2- 172.21.15.125:0/1154294289 >> v2:172.21.15.130:3300/0 conn(0x7f5c3c0ccc30 0x7f5c3c0cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.284+0000 7f5c4198b700 1 --2- 172.21.15.125:0/1154294289 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5c3c1591f0 0x7f5c3c1595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.284+0000 7f5c4198b700 1 --2- 172.21.15.125:0/1154294289 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c3c0b2f30 0x7f5c3c0b33a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.284+0000 7f5c4198b700 1 -- 172.21.15.125:0/1154294289 >> 172.21.15.125:0/1154294289 conn(0x7f5c3c06ed40 msgr2=0x7f5c3c06f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:26.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.284+0000 7f5c4198b700 1 -- 172.21.15.125:0/1154294289 shutdown_connections 2023-10-06T03:04:26.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.284+0000 7f5c4198b700 1 -- 172.21.15.125:0/1154294289 wait complete. 2023-10-06T03:04:26.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.285+0000 7f5c4198b700 1 Processor -- start 2023-10-06T03:04:26.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.285+0000 7f5c4198b700 1 -- start start 2023-10-06T03:04:26.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c4198b700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c3c0b2f30 0x7f5c3c0c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:26.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c4198b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c3c0ccc30 0x7f5c3c0c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:26.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c4198b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5c3c1591f0 0x7f5c3c0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:26.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c4198b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c0c9b80 con 0x7f5c3c0ccc30 2023-10-06T03:04:26.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c4198b700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c0ced30 con 0x7f5c3c0b2f30 2023-10-06T03:04:26.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c4198b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3c0cf900 con 0x7f5c3c1591f0 2023-10-06T03:04:26.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c3a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c3c0ccc30 0x7f5c3c0c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:26.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c3a7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c3c0ccc30 0x7f5c3c0c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44222/0 (socket says 172.21.15.125:44222) 2023-10-06T03:04:26.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c3a7fc700 1 -- 172.21.15.125:0/3369954370 learned_addr learned my addr 172.21.15.125:0/3369954370 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:26.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c3affd700 1 --2- 172.21.15.125:0/3369954370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c3c0b2f30 0x7f5c3c0c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:26.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c3b7fe700 1 --2- 172.21.15.125:0/3369954370 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5c3c1591f0 0x7f5c3c0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:26.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c3a7fc700 1 -- 172.21.15.125:0/3369954370 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5c3c1591f0 msgr2=0x7f5c3c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:26.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c3a7fc700 1 --2- 172.21.15.125:0/3369954370 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5c3c1591f0 0x7f5c3c0ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c3a7fc700 1 -- 172.21.15.125:0/3369954370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c3c0b2f30 msgr2=0x7f5c3c0c3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:26.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c3a7fc700 1 --2- 172.21.15.125:0/3369954370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c3c0b2f30 0x7f5c3c0c3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c3a7fc700 1 -- 172.21.15.125:0/3369954370 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c300094f0 con 0x7f5c3c0ccc30 2023-10-06T03:04:26.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c3b7fe700 1 --2- 172.21.15.125:0/3369954370 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5c3c1591f0 0x7f5c3c0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:26.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c3a7fc700 1 --2- 172.21.15.125:0/3369954370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c3c0ccc30 0x7f5c3c0c8ec0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5c30006fd0 tx=0x7f5c30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:26.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c22ffd700 1 -- 172.21.15.125:0/3369954370 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c30011e30 con 0x7f5c3c0ccc30 2023-10-06T03:04:26.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c22ffd700 1 -- 172.21.15.125:0/3369954370 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c30024440 con 0x7f5c3c0ccc30 2023-10-06T03:04:26.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c4198b700 1 -- 172.21.15.125:0/3369954370 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c3c0c95c0 con 0x7f5c3c0ccc30 2023-10-06T03:04:26.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c22ffd700 1 -- 172.21.15.125:0/3369954370 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c30024800 con 0x7f5c3c0ccc30 2023-10-06T03:04:26.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.286+0000 7f5c4198b700 1 -- 172.21.15.125:0/3369954370 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c3c0cf590 con 0x7f5c3c0ccc30 2023-10-06T03:04:26.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.287+0000 7f5c4198b700 1 -- 172.21.15.125:0/3369954370 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c3c0cf3f0 con 0x7f5c3c0ccc30 2023-10-06T03:04:26.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.288+0000 7f5c22ffd700 1 -- 172.21.15.125:0/3369954370 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c3001a420 con 0x7f5c3c0ccc30 2023-10-06T03:04:26.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.288+0000 7f5c22ffd700 1 --2- 172.21.15.125:0/3369954370 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5c28066f30 0x7f5c280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:26.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.288+0000 7f5c22ffd700 1 -- 172.21.15.125:0/3369954370 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5c30086290 con 0x7f5c3c0ccc30 2023-10-06T03:04:26.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.288+0000 7f5c3affd700 1 --2- 172.21.15.125:0/3369954370 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5c28066f30 0x7f5c280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:26.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.288+0000 7f5c3affd700 1 --2- 172.21.15.125:0/3369954370 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5c28066f30 0x7f5c280693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c006fd0 tx=0x7f5c2c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:26.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.292+0000 7f5c22ffd700 1 -- 172.21.15.125:0/3369954370 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c3c0cf3f0 con 0x7f5c3c0ccc30 2023-10-06T03:04:26.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.478+0000 7f5c4198b700 1 -- 172.21.15.125:0/3369954370 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5c3c0cf3f0 con 0x7f5c3c0ccc30 2023-10-06T03:04:26.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.478+0000 7f5c22ffd700 1 -- 172.21.15.125:0/3369954370 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5c3c0cf3f0 con 0x7f5c3c0ccc30 2023-10-06T03:04:26.480 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:26.480 INFO:teuthology.orchestra.run.smithi125.stdout:[ 2023-10-06T03:04:26.480 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:04:26.480 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 1, 2023-10-06T03:04:26.480 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": ".mgr" 2023-10-06T03:04:26.480 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:04:26.480 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:04:26.481 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 2, 2023-10-06T03:04:26.481 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": "rbd" 2023-10-06T03:04:26.481 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:04:26.481 INFO:teuthology.orchestra.run.smithi125.stdout:] 2023-10-06T03:04:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.480+0000 7f5c4198b700 1 -- 172.21.15.125:0/3369954370 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5c28066f30 msgr2=0x7f5c280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.480+0000 7f5c4198b700 1 --2- 172.21.15.125:0/3369954370 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5c28066f30 0x7f5c280693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c006fd0 tx=0x7f5c2c008040 comp rx=0 tx=0).stop 2023-10-06T03:04:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.480+0000 7f5c4198b700 1 -- 172.21.15.125:0/3369954370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c3c0ccc30 msgr2=0x7f5c3c0c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.480+0000 7f5c4198b700 1 --2- 172.21.15.125:0/3369954370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c3c0ccc30 0x7f5c3c0c8ec0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5c30006fd0 tx=0x7f5c30017000 comp rx=0 tx=0).stop 2023-10-06T03:04:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.480+0000 7f5c4198b700 1 -- 172.21.15.125:0/3369954370 shutdown_connections 2023-10-06T03:04:26.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.480+0000 7f5c4198b700 1 --2- 172.21.15.125:0/3369954370 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5c28066f30 0x7f5c280693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.480+0000 7f5c4198b700 1 --2- 172.21.15.125:0/3369954370 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5c3c1591f0 0x7f5c3c0ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.480+0000 7f5c4198b700 1 --2- 172.21.15.125:0/3369954370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c3c0b2f30 0x7f5c3c0c3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.480+0000 7f5c4198b700 1 --2- 172.21.15.125:0/3369954370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5c3c0ccc30 0x7f5c3c0c8ec0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.480+0000 7f5c4198b700 1 -- 172.21.15.125:0/3369954370 >> 172.21.15.125:0/3369954370 conn(0x7f5c3c06ed40 msgr2=0x7f5c3c15e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.480+0000 7f5c4198b700 1 -- 172.21.15.125:0/3369954370 shutdown_connections 2023-10-06T03:04:26.483 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.480+0000 7f5c4198b700 1 -- 172.21.15.125:0/3369954370 wait complete. 2023-10-06T03:04:26.493 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:04:26.493 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:04:26.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.613+0000 7ff7ac760700 1 Processor -- start 2023-10-06T03:04:26.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.613+0000 7ff7ac760700 1 -- start start 2023-10-06T03:04:26.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.614+0000 7ff7ac760700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff7a413f810 0x7ff7a40afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:26.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.614+0000 7ff7ac760700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7a413fbe0 0x7ff7a40692f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:26.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.614+0000 7ff7ac760700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a40cab30 con 0x7ff7a40c9100 2023-10-06T03:04:26.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.614+0000 7ff7ac760700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a40c75a0 con 0x7ff7a413f810 2023-10-06T03:04:26.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.614+0000 7ff7ac760700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a40c7880 con 0x7ff7a413fbe0 2023-10-06T03:04:26.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.614+0000 7ff7aa4fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff7a413f810 0x7ff7a40afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:26.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.614+0000 7ff7aacfd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff7a40c9100 0x7ff7a406c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35262/0 (socket says 172.21.15.125:35262) 2023-10-06T03:04:26.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.615+0000 7ff7aacfd700 1 -- 172.21.15.125:0/1318530764 learned_addr learned my addr 172.21.15.125:0/1318530764 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:26.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.615+0000 7ff7a9cfb700 1 --2- 172.21.15.125:0/1318530764 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7a413fbe0 0x7ff7a40692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:26.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.615+0000 7ff7aa4fc700 1 -- 172.21.15.125:0/1318530764 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7a413fbe0 msgr2=0x7ff7a40692f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:26.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.615+0000 7ff7aa4fc700 1 --2- 172.21.15.125:0/1318530764 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7a413fbe0 0x7ff7a40692f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.615+0000 7ff7aa4fc700 1 -- 172.21.15.125:0/1318530764 >> v1:172.21.15.125:6789/0 conn(0x7ff7a40c9100 legacy=0x7ff7a406c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:26.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.615+0000 7ff7aa4fc700 1 -- 172.21.15.125:0/1318530764 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a40cadd0 con 0x7ff7a413f810 2023-10-06T03:04:26.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.615+0000 7ff7a94fa700 1 -- 172.21.15.125:0/1318530764 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733339774 0 0) 0x7ff7a40cab30 con 0x7ff7a40c9100 2023-10-06T03:04:26.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.615+0000 7ff7a9cfb700 1 --2- 172.21.15.125:0/1318530764 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7a413fbe0 0x7ff7a40692f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:04:26.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.615+0000 7ff7aa4fc700 1 --2- 172.21.15.125:0/1318530764 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7a413f810 0x7ff7a40afc60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff794009910 tx=0x7ff7940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841b3018197cd0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:26.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.615+0000 7ff7a94fa700 1 -- 172.21.15.125:0/1318530764 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79400b820 con 0x7ff7a413f810 2023-10-06T03:04:26.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.615+0000 7ff7a94fa700 1 -- 172.21.15.125:0/1318530764 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79400b980 con 0x7ff7a413f810 2023-10-06T03:04:26.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.615+0000 7ff7a94fa700 1 -- 172.21.15.125:0/1318530764 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79400bd20 con 0x7ff7a413f810 2023-10-06T03:04:26.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.616+0000 7ff7ac760700 1 -- 172.21.15.125:0/1318530764 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7a413f810 msgr2=0x7ff7a40afc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:26.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.616+0000 7ff7ac760700 1 --2- 172.21.15.125:0/1318530764 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7a413f810 0x7ff7a40afc60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff794009910 tx=0x7ff7940091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.616+0000 7ff7ac760700 1 -- 172.21.15.125:0/1318530764 shutdown_connections 2023-10-06T03:04:26.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.616+0000 7ff7ac760700 1 --2- 172.21.15.125:0/1318530764 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7a413f810 0x7ff7a40afc60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.616+0000 7ff7ac760700 1 --2- 172.21.15.125:0/1318530764 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7a413fbe0 0x7ff7a40692f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.616+0000 7ff7ac760700 1 -- 172.21.15.125:0/1318530764 >> 172.21.15.125:0/1318530764 conn(0x7ff7a406b190 msgr2=0x7ff7a406b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:26.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.616+0000 7ff7ac760700 1 -- 172.21.15.125:0/1318530764 shutdown_connections 2023-10-06T03:04:26.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.616+0000 7ff7ac760700 1 -- 172.21.15.125:0/1318530764 wait complete. 2023-10-06T03:04:26.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.617+0000 7ff7ac760700 1 Processor -- start 2023-10-06T03:04:26.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.617+0000 7ff7ac760700 1 -- start start 2023-10-06T03:04:26.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff7ac760700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7a40c9100 0x7ff7a40c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:26.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff7ac760700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7a413f810 0x7ff7a4156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:26.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff7ac760700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7a413fbe0 0x7ff7a4156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:26.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff7ac760700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a40c5a80 con 0x7ff7a40c9100 2023-10-06T03:04:26.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff7ac760700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a40c50b0 con 0x7ff7a413f810 2023-10-06T03:04:26.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff7ac760700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a41559b0 con 0x7ff7a413fbe0 2023-10-06T03:04:26.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff7aa4fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7a40c9100 0x7ff7a40c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:26.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff7aa4fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7a40c9100 0x7ff7a40c5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44238/0 (socket says 172.21.15.125:44238) 2023-10-06T03:04:26.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff7aa4fc700 1 -- 172.21.15.125:0/4248273932 learned_addr learned my addr 172.21.15.125:0/4248273932 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:26.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff7aacfd700 1 --2- 172.21.15.125:0/4248273932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7a413fbe0 0x7ff7a4156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:26.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff7a9cfb700 1 --2- 172.21.15.125:0/4248273932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7a413f810 0x7ff7a4156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:26.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff7aa4fc700 1 -- 172.21.15.125:0/4248273932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7a413fbe0 msgr2=0x7ff7a4156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:26.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff7aa4fc700 1 --2- 172.21.15.125:0/4248273932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7a413fbe0 0x7ff7a4156e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff7aa4fc700 1 -- 172.21.15.125:0/4248273932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7a413f810 msgr2=0x7ff7a4156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:26.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff7aa4fc700 1 --2- 172.21.15.125:0/4248273932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7a413f810 0x7ff7a4156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:26.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff7aa4fc700 1 -- 172.21.15.125:0/4248273932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff794009420 con 0x7ff7a40c9100 2023-10-06T03:04:26.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff7aa4fc700 1 --2- 172.21.15.125:0/4248273932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7a40c9100 0x7ff7a40c5540 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff7a406af00 tx=0x7ff794017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:26.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff79a7fc700 1 -- 172.21.15.125:0/4248273932 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79401f070 con 0x7ff7a40c9100 2023-10-06T03:04:26.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff79a7fc700 1 -- 172.21.15.125:0/4248273932 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff794011e90 con 0x7ff7a40c9100 2023-10-06T03:04:26.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff7ac760700 1 -- 172.21.15.125:0/4248273932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a40af430 con 0x7ff7a40c9100 2023-10-06T03:04:26.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff79a7fc700 1 -- 172.21.15.125:0/4248273932 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79401a670 con 0x7ff7a40c9100 2023-10-06T03:04:26.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.618+0000 7ff7ac760700 1 -- 172.21.15.125:0/4248273932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a40c4dc0 con 0x7ff7a40c9100 2023-10-06T03:04:26.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.619+0000 7ff7ac760700 1 -- 172.21.15.125:0/4248273932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7a406e0e0 con 0x7ff7a40c9100 2023-10-06T03:04:26.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.620+0000 7ff79a7fc700 1 -- 172.21.15.125:0/4248273932 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff79401a9e0 con 0x7ff7a40c9100 2023-10-06T03:04:26.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.620+0000 7ff79a7fc700 1 --2- 172.21.15.125:0/4248273932 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff788066f30 0x7ff7880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:26.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.620+0000 7ff79a7fc700 1 -- 172.21.15.125:0/4248273932 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff794085820 con 0x7ff7a40c9100 2023-10-06T03:04:26.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.620+0000 7ff7a9cfb700 1 --2- 172.21.15.125:0/4248273932 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff788066f30 0x7ff7880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:26.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.620+0000 7ff7a9cfb700 1 --2- 172.21.15.125:0/4248273932 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff788066f30 0x7ff7880693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4156510 tx=0x7ff7a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:26.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.624+0000 7ff79a7fc700 1 -- 172.21.15.125:0/4248273932 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff794052c80 con 0x7ff7a40c9100 2023-10-06T03:04:26.811 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:26.809+0000 7ff7ac760700 1 -- 172.21.15.125:0/4248273932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff7a40c4b20 con 0x7ff7a40c9100 2023-10-06T03:04:27.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.817+0000 7ff79a7fc700 1 -- 172.21.15.125:0/4248273932 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff7940280b0 con 0x7ff7a40c9100 2023-10-06T03:04:27.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.821+0000 7ff7ac760700 1 -- 172.21.15.125:0/4248273932 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff788066f30 msgr2=0x7ff7880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:27.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.821+0000 7ff7ac760700 1 --2- 172.21.15.125:0/4248273932 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff788066f30 0x7ff7880693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4156510 tx=0x7ff7a0008040 comp rx=0 tx=0).stop 2023-10-06T03:04:27.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.821+0000 7ff7ac760700 1 -- 172.21.15.125:0/4248273932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7a40c9100 msgr2=0x7ff7a40c5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:27.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.821+0000 7ff7ac760700 1 --2- 172.21.15.125:0/4248273932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7a40c9100 0x7ff7a40c5540 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff7a406af00 tx=0x7ff794017000 comp rx=0 tx=0).stop 2023-10-06T03:04:27.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.821+0000 7ff7ac760700 1 -- 172.21.15.125:0/4248273932 shutdown_connections 2023-10-06T03:04:27.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.821+0000 7ff7ac760700 1 --2- 172.21.15.125:0/4248273932 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff788066f30 0x7ff7880693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.821+0000 7ff7ac760700 1 --2- 172.21.15.125:0/4248273932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff7a413fbe0 0x7ff7a4156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.821+0000 7ff7ac760700 1 --2- 172.21.15.125:0/4248273932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff7a40c9100 0x7ff7a40c5540 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.821+0000 7ff7ac760700 1 --2- 172.21.15.125:0/4248273932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7a413f810 0x7ff7a4156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.821+0000 7ff7ac760700 1 -- 172.21.15.125:0/4248273932 >> 172.21.15.125:0/4248273932 conn(0x7ff7a406b190 msgr2=0x7ff7a4067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:27.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.821+0000 7ff7ac760700 1 -- 172.21.15.125:0/4248273932 shutdown_connections 2023-10-06T03:04:27.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.821+0000 7ff7ac760700 1 -- 172.21.15.125:0/4248273932 wait complete. 2023-10-06T03:04:27.825 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_metadata' created 2023-10-06T03:04:27.838 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-06T03:04:27.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.966+0000 7f15d8a7d700 1 Processor -- start 2023-10-06T03:04:27.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.966+0000 7f15d8a7d700 1 -- start start 2023-10-06T03:04:27.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.967+0000 7f15d8a7d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15d40af320 0x7f15d40cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.967+0000 7f15d8a7d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d40c9470 con 0x7f15d40cb880 2023-10-06T03:04:27.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.967+0000 7f15d8a7d700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d40cbcf0 con 0x7f15d40c8320 2023-10-06T03:04:27.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.967+0000 7f15d8a7d700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d40c9b40 con 0x7f15d40af320 2023-10-06T03:04:27.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.967+0000 7f15d1d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f15d40cb880 0x7f15d40c7c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35276/0 (socket says 172.21.15.125:35276) 2023-10-06T03:04:27.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.967+0000 7f15d1d9b700 1 -- 172.21.15.125:0/1008273260 learned_addr learned my addr 172.21.15.125:0/1008273260 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:27.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d259c700 1 --2- 172.21.15.125:0/1008273260 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15d40af320 0x7f15d40cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d159a700 1 -- 172.21.15.125:0/1008273260 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172559220 0 0) 0x7f15d40c9470 con 0x7f15d40cb880 2023-10-06T03:04:27.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d159a700 1 -- 172.21.15.125:0/1008273260 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15bc003570 con 0x7f15d40cb880 2023-10-06T03:04:27.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d159a700 1 -- 172.21.15.125:0/1008273260 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2193197635 0 0) 0x7f15d40cbcf0 con 0x7f15d40c8320 2023-10-06T03:04:27.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d159a700 1 -- 172.21.15.125:0/1008273260 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15d40c9470 con 0x7f15d40c8320 2023-10-06T03:04:27.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d159a700 1 -- 172.21.15.125:0/1008273260 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 900167801 0 0) 0x7f15bc003570 con 0x7f15d40cb880 2023-10-06T03:04:27.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d159a700 1 -- 172.21.15.125:0/1008273260 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15d40af320 msgr2=0x7f15d40cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:27.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d159a700 1 --2- 172.21.15.125:0/1008273260 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15d40af320 0x7f15d40cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d159a700 1 -- 172.21.15.125:0/1008273260 >> v1:172.21.15.130:6789/0 conn(0x7f15d40c8320 legacy=0x7f15d40c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:27.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d159a700 1 -- 172.21.15.125:0/1008273260 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d40c8860 con 0x7f15d40cb880 2023-10-06T03:04:27.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d159a700 1 -- 172.21.15.125:0/1008273260 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f15c4001470 con 0x7f15d40cb880 2023-10-06T03:04:27.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d159a700 1 -- 172.21.15.125:0/1008273260 >> v1:172.21.15.125:6789/0 conn(0x7f15d40cb880 legacy=0x7f15d40c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:27.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d159a700 1 --2- 172.21.15.125:0/1008273260 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15d40af320 0x7f15bc003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d159a700 1 --2- 172.21.15.125:0/1008273260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15bc004180 0x7f15bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d159a700 1 --2- 172.21.15.125:0/1008273260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15bc004d50 0x7f15bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d159a700 1 -- 172.21.15.125:0/1008273260 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d40c9b40 con 0x7f15bc004d50 2023-10-06T03:04:27.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d159a700 1 -- 172.21.15.125:0/1008273260 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc00bba0 con 0x7f15bc004180 2023-10-06T03:04:27.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d159a700 1 -- 172.21.15.125:0/1008273260 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15bc00bd60 con 0x7f15d40af320 2023-10-06T03:04:27.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d2d9d700 1 --2- 172.21.15.125:0/1008273260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15bc004d50 0x7f15bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d259c700 1 --2- 172.21.15.125:0/1008273260 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15d40af320 0x7f15bc003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d1d9b700 1 --2- 172.21.15.125:0/1008273260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15bc004180 0x7f15bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d2d9d700 1 -- 172.21.15.125:0/1008273260 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15d40af320 msgr2=0x7f15bc003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:27.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d2d9d700 1 --2- 172.21.15.125:0/1008273260 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15d40af320 0x7f15bc003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d2d9d700 1 -- 172.21.15.125:0/1008273260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15bc004180 msgr2=0x7f15bc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:27.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d2d9d700 1 --2- 172.21.15.125:0/1008273260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15bc004180 0x7f15bc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.968+0000 7f15d2d9d700 1 -- 172.21.15.125:0/1008273260 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15bc003570 con 0x7f15bc004d50 2023-10-06T03:04:27.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.969+0000 7f15d2d9d700 1 --2- 172.21.15.125:0/1008273260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15bc004d50 0x7f15bc0051c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f15cc002160 tx=0x7f15cc0017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea4c812ee0558a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:27.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.969+0000 7f15d159a700 1 -- 172.21.15.125:0/1008273260 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc001af0 con 0x7f15bc004d50 2023-10-06T03:04:27.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.969+0000 7f15d159a700 1 -- 172.21.15.125:0/1008273260 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15cc00c980 con 0x7f15bc004d50 2023-10-06T03:04:27.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.969+0000 7f15d159a700 1 -- 172.21.15.125:0/1008273260 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc00cd20 con 0x7f15bc004d50 2023-10-06T03:04:27.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.969+0000 7f15d8a7d700 1 -- 172.21.15.125:0/1008273260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15bc004d50 msgr2=0x7f15bc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:27.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.969+0000 7f15d8a7d700 1 --2- 172.21.15.125:0/1008273260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15bc004d50 0x7f15bc0051c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f15cc002160 tx=0x7f15cc0017e0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.969+0000 7f15d2d9d700 1 -- 172.21.15.125:0/1008273260 reap_dead start 2023-10-06T03:04:27.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.969+0000 7f15d8a7d700 1 -- 172.21.15.125:0/1008273260 shutdown_connections 2023-10-06T03:04:27.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.969+0000 7f15d8a7d700 1 -- 172.21.15.125:0/1008273260 >> 172.21.15.125:0/1008273260 conn(0x7f15d4096120 msgr2=0x7f15d4068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:27.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.969+0000 7f15d8a7d700 1 -- 172.21.15.125:0/1008273260 shutdown_connections 2023-10-06T03:04:27.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.969+0000 7f15d8a7d700 1 -- 172.21.15.125:0/1008273260 wait complete. 2023-10-06T03:04:27.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.970+0000 7f15d8a7d700 1 Processor -- start 2023-10-06T03:04:27.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.970+0000 7f15d8a7d700 1 -- start start 2023-10-06T03:04:27.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.971+0000 7f15d8a7d700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15bc004d50 0x7f15d414b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.971+0000 7f15d8a7d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15d40c5300 0x7f15d40ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.971+0000 7f15d8a7d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15d40ae370 0x7f15d4067610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.971+0000 7f15d8a7d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d40ae7e0 con 0x7f15d40ae370 2023-10-06T03:04:27.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.971+0000 7f15d8a7d700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d4156560 con 0x7f15bc004d50 2023-10-06T03:04:27.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.971+0000 7f15d8a7d700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d4156840 con 0x7f15d40c5300 2023-10-06T03:04:27.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.971+0000 7f15d2d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15d40ae370 0x7f15d4067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.971+0000 7f15d2d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15d40ae370 0x7f15d4067610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44268/0 (socket says 172.21.15.125:44268) 2023-10-06T03:04:27.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.971+0000 7f15d2d9d700 1 -- 172.21.15.125:0/2735381113 learned_addr learned my addr 172.21.15.125:0/2735381113 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:27.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.971+0000 7f15d1d9b700 1 --2- 172.21.15.125:0/2735381113 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15d40c5300 0x7f15d40ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.971+0000 7f15d259c700 1 --2- 172.21.15.125:0/2735381113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15bc004d50 0x7f15d414b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.971+0000 7f15d2d9d700 1 -- 172.21.15.125:0/2735381113 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15d40c5300 msgr2=0x7f15d40ade30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:27.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.971+0000 7f15d2d9d700 1 --2- 172.21.15.125:0/2735381113 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15d40c5300 0x7f15d40ade30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.971+0000 7f15d2d9d700 1 -- 172.21.15.125:0/2735381113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15bc004d50 msgr2=0x7f15d414b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:27.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.971+0000 7f15d2d9d700 1 --2- 172.21.15.125:0/2735381113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15bc004d50 0x7f15d414b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:27.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.971+0000 7f15d2d9d700 1 -- 172.21.15.125:0/2735381113 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d4156b20 con 0x7f15d40ae370 2023-10-06T03:04:27.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.972+0000 7f15d2d9d700 1 --2- 172.21.15.125:0/2735381113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15d40ae370 0x7f15d4067610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f15cc003000 tx=0x7f15cc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:27.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.972+0000 7f15c27fc700 1 -- 172.21.15.125:0/2735381113 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc00c6d0 con 0x7f15d40ae370 2023-10-06T03:04:27.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.972+0000 7f15c27fc700 1 -- 172.21.15.125:0/2735381113 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15cc012e50 con 0x7f15d40ae370 2023-10-06T03:04:27.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.972+0000 7f15d8a7d700 1 -- 172.21.15.125:0/2735381113 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d4156e00 con 0x7f15d40ae370 2023-10-06T03:04:27.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.972+0000 7f15c27fc700 1 -- 172.21.15.125:0/2735381113 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc01f440 con 0x7f15d40ae370 2023-10-06T03:04:27.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.972+0000 7f15d8a7d700 1 -- 172.21.15.125:0/2735381113 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d414bf10 con 0x7f15d40ae370 2023-10-06T03:04:27.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.973+0000 7f15d8a7d700 1 -- 172.21.15.125:0/2735381113 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d4157320 con 0x7f15d40ae370 2023-10-06T03:04:27.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.973+0000 7f15c27fc700 1 -- 172.21.15.125:0/2735381113 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f15cc025020 con 0x7f15d40ae370 2023-10-06T03:04:27.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.974+0000 7f15c27fc700 1 --2- 172.21.15.125:0/2735381113 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f15b4066f30 0x7f15b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:27.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.974+0000 7f15c27fc700 1 -- 172.21.15.125:0/2735381113 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f15cc0866b0 con 0x7f15d40ae370 2023-10-06T03:04:27.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.974+0000 7f15d259c700 1 --2- 172.21.15.125:0/2735381113 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f15b4066f30 0x7f15b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:27.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.974+0000 7f15d259c700 1 --2- 172.21.15.125:0/2735381113 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f15b4066f30 0x7f15b40693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f15c8006ea0 tx=0x7f15c8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:27.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:27.978+0000 7f15c27fc700 1 -- 172.21.15.125:0/2735381113 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f15cc053a20 con 0x7f15d40ae370 2023-10-06T03:04:28.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.161+0000 7f15d8a7d700 1 -- 172.21.15.125:0/2735381113 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f15d4157320 con 0x7f15d40ae370 2023-10-06T03:04:28.242 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:28.245 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:28.825 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.823+0000 7f15c27fc700 1 -- 172.21.15.125:0/2735381113 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7f15d4157320 con 0x7f15d40ae370 2023-10-06T03:04:28.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.828+0000 7f15d8a7d700 1 -- 172.21.15.125:0/2735381113 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f15b4066f30 msgr2=0x7f15b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:28.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.829+0000 7f15d8a7d700 1 --2- 172.21.15.125:0/2735381113 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f15b4066f30 0x7f15b40693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f15c8006ea0 tx=0x7f15c8008040 comp rx=0 tx=0).stop 2023-10-06T03:04:28.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.829+0000 7f15d8a7d700 1 -- 172.21.15.125:0/2735381113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15d40ae370 msgr2=0x7f15d4067610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:28.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.829+0000 7f15d8a7d700 1 --2- 172.21.15.125:0/2735381113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15d40ae370 0x7f15d4067610 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f15cc003000 tx=0x7f15cc016000 comp rx=0 tx=0).stop 2023-10-06T03:04:28.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.829+0000 7f15d8a7d700 1 -- 172.21.15.125:0/2735381113 shutdown_connections 2023-10-06T03:04:28.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.829+0000 7f15d8a7d700 1 --2- 172.21.15.125:0/2735381113 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f15b4066f30 0x7f15b40693e0 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f15c8006ea0 tx=0x7f15c8008040 comp rx=0 tx=0).stop 2023-10-06T03:04:28.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.829+0000 7f15d8a7d700 1 --2- 172.21.15.125:0/2735381113 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15d40ae370 0x7f15d4067610 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.829+0000 7f15d8a7d700 1 --2- 172.21.15.125:0/2735381113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15bc004d50 0x7f15d414b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.829+0000 7f15d8a7d700 1 --2- 172.21.15.125:0/2735381113 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15d40c5300 0x7f15d40ade30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.831 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.829+0000 7f15d8a7d700 1 -- 172.21.15.125:0/2735381113 >> 172.21.15.125:0/2735381113 conn(0x7f15d4096120 msgr2=0x7f15d40c1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:28.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.833+0000 7f15d8a7d700 1 -- 172.21.15.125:0/2735381113 shutdown_connections 2023-10-06T03:04:28.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.833+0000 7f15d8a7d700 1 -- 172.21.15.125:0/2735381113 wait complete. 2023-10-06T03:04:28.837 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data' created 2023-10-06T03:04:28.852 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:04:28.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.971+0000 7f9638ad5700 1 Processor -- start 2023-10-06T03:04:28.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.971+0000 7f9638ad5700 1 -- start start 2023-10-06T03:04:28.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.972+0000 7f9638ad5700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9634067610 0x7f96340b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:28.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.972+0000 7f9638ad5700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9634068ba0 0x7f96340cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:28.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.972+0000 7f9638ad5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96340ca670 con 0x7f963415cb00 2023-10-06T03:04:28.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f9638ad5700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9634068320 con 0x7f9634067610 2023-10-06T03:04:28.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f9638ad5700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9634067a80 con 0x7f9634068ba0 2023-10-06T03:04:28.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f963259c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f963415cb00 0x7f9634068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35278/0 (socket says 172.21.15.125:35278) 2023-10-06T03:04:28.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f963259c700 1 -- 172.21.15.125:0/3075249601 learned_addr learned my addr 172.21.15.125:0/3075249601 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:28.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f9632d9d700 1 --2- 172.21.15.125:0/3075249601 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9634068ba0 0x7f96340cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:28.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f963159a700 1 -- 172.21.15.125:0/3075249601 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498047963 0 0) 0x7f96340ca670 con 0x7f963415cb00 2023-10-06T03:04:28.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f963159a700 1 -- 172.21.15.125:0/3075249601 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f961c003570 con 0x7f963415cb00 2023-10-06T03:04:28.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f9631d9b700 1 --2- 172.21.15.125:0/3075249601 >> v2:172.21.15.130:3300/0 conn(0x7f9634067610 0x7f96340b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:28.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f963159a700 1 -- 172.21.15.125:0/3075249601 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3616953752 0 0) 0x7f961c003570 con 0x7f963415cb00 2023-10-06T03:04:28.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f963159a700 1 -- 172.21.15.125:0/3075249601 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9634068ba0 msgr2=0x7f96340cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:28.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f963159a700 1 --2- 172.21.15.125:0/3075249601 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9634068ba0 0x7f96340cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f963159a700 1 -- 172.21.15.125:0/3075249601 >> v2:172.21.15.130:3300/0 conn(0x7f9634067610 msgr2=0x7f96340b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:28.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f963159a700 1 --2- 172.21.15.125:0/3075249601 >> v2:172.21.15.130:3300/0 conn(0x7f9634067610 0x7f96340b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f963159a700 1 -- 172.21.15.125:0/3075249601 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9634067d60 con 0x7f963415cb00 2023-10-06T03:04:28.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f963159a700 1 -- 172.21.15.125:0/3075249601 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f96280015f0 con 0x7f963415cb00 2023-10-06T03:04:28.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f963159a700 1 -- 172.21.15.125:0/3075249601 >> v1:172.21.15.125:6789/0 conn(0x7f963415cb00 legacy=0x7f9634068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:28.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f963159a700 1 --2- 172.21.15.125:0/3075249601 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9634068ba0 0x7f961c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:28.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f963159a700 1 --2- 172.21.15.125:0/3075249601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961c003fe0 0x7f961c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:28.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f963159a700 1 --2- 172.21.15.125:0/3075249601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961c004d50 0x7f961c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:28.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f963159a700 1 -- 172.21.15.125:0/3075249601 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9634068320 con 0x7f961c003fe0 2023-10-06T03:04:28.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f963159a700 1 -- 172.21.15.125:0/3075249601 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9634067a80 con 0x7f961c004d50 2023-10-06T03:04:28.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f963159a700 1 -- 172.21.15.125:0/3075249601 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961c00ba90 con 0x7f9634068ba0 2023-10-06T03:04:28.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f9631d9b700 1 --2- 172.21.15.125:0/3075249601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961c003fe0 0x7f961c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:28.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.973+0000 7f963259c700 1 --2- 172.21.15.125:0/3075249601 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9634068ba0 0x7f961c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:28.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.974+0000 7f9632d9d700 1 --2- 172.21.15.125:0/3075249601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961c004d50 0x7f961c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:28.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.974+0000 7f9631d9b700 1 -- 172.21.15.125:0/3075249601 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9634068ba0 msgr2=0x7f961c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:28.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.974+0000 7f9631d9b700 1 --2- 172.21.15.125:0/3075249601 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9634068ba0 0x7f961c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.974+0000 7f9631d9b700 1 -- 172.21.15.125:0/3075249601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961c004d50 msgr2=0x7f961c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:28.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.974+0000 7f9631d9b700 1 --2- 172.21.15.125:0/3075249601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961c004d50 0x7f961c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.974+0000 7f9631d9b700 1 -- 172.21.15.125:0/3075249601 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c003570 con 0x7f961c003fe0 2023-10-06T03:04:28.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.974+0000 7f9632d9d700 1 --2- 172.21.15.125:0/3075249601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961c004d50 0x7f961c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:04:28.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.974+0000 7f9631d9b700 1 --2- 172.21.15.125:0/3075249601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961c003fe0 0x7f961c004810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9624009c00 tx=0x7f96240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f850d023231664 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:28.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.974+0000 7f963159a700 1 -- 172.21.15.125:0/3075249601 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962400e6b0 con 0x7f961c003fe0 2023-10-06T03:04:28.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.974+0000 7f963159a700 1 -- 172.21.15.125:0/3075249601 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962400e810 con 0x7f961c003fe0 2023-10-06T03:04:28.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.974+0000 7f963159a700 1 -- 172.21.15.125:0/3075249601 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962400ebd0 con 0x7f961c003fe0 2023-10-06T03:04:28.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.974+0000 7f9638ad5700 1 -- 172.21.15.125:0/3075249601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961c003fe0 msgr2=0x7f961c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:28.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.974+0000 7f9638ad5700 1 --2- 172.21.15.125:0/3075249601 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961c003fe0 0x7f961c004810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9624009c00 tx=0x7f96240091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.974+0000 7f9632d9d700 1 -- 172.21.15.125:0/3075249601 reap_dead start 2023-10-06T03:04:28.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.974+0000 7f9638ad5700 1 -- 172.21.15.125:0/3075249601 shutdown_connections 2023-10-06T03:04:28.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.974+0000 7f9638ad5700 1 -- 172.21.15.125:0/3075249601 >> 172.21.15.125:0/3075249601 conn(0x7f96340af730 msgr2=0x7f96340afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:28.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.975+0000 7f9638ad5700 1 -- 172.21.15.125:0/3075249601 shutdown_connections 2023-10-06T03:04:28.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.975+0000 7f9638ad5700 1 -- 172.21.15.125:0/3075249601 wait complete. 2023-10-06T03:04:28.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.976+0000 7f9638ad5700 1 Processor -- start 2023-10-06T03:04:28.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.976+0000 7f9638ad5700 1 -- start start 2023-10-06T03:04:28.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.977+0000 7f9638ad5700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961c003fe0 0x7f963414ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:28.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.977+0000 7f9638ad5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9634150480 0x7f9634151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:28.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.977+0000 7f9638ad5700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9634152390 0x7f96341527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:28.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.977+0000 7f9638ad5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96340c6280 con 0x7f9634150480 2023-10-06T03:04:28.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.977+0000 7f9638ad5700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963413ce20 con 0x7f961c003fe0 2023-10-06T03:04:28.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.977+0000 7f9638ad5700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96341508f0 con 0x7f9634152390 2023-10-06T03:04:28.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.977+0000 7f9631d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9634150480 0x7f9634151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:28.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.977+0000 7f9631d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9634150480 0x7f9634151e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44282/0 (socket says 172.21.15.125:44282) 2023-10-06T03:04:28.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.977+0000 7f9631d9b700 1 -- 172.21.15.125:0/2276591326 learned_addr learned my addr 172.21.15.125:0/2276591326 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:28.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.977+0000 7f963259c700 1 --2- 172.21.15.125:0/2276591326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961c003fe0 0x7f963414ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:28.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.977+0000 7f9632d9d700 1 --2- 172.21.15.125:0/2276591326 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9634152390 0x7f96341527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:28.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.977+0000 7f9631d9b700 1 -- 172.21.15.125:0/2276591326 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9634152390 msgr2=0x7f96341527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:28.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.977+0000 7f9631d9b700 1 --2- 172.21.15.125:0/2276591326 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9634152390 0x7f96341527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.977+0000 7f9631d9b700 1 -- 172.21.15.125:0/2276591326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961c003fe0 msgr2=0x7f963414ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:28.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.977+0000 7f9631d9b700 1 --2- 172.21.15.125:0/2276591326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961c003fe0 0x7f963414ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:28.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.977+0000 7f9631d9b700 1 -- 172.21.15.125:0/2276591326 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9634152d20 con 0x7f9634150480 2023-10-06T03:04:28.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.977+0000 7f9631d9b700 1 --2- 172.21.15.125:0/2276591326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9634150480 0x7f9634151e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f962400e4b0 tx=0x7f962401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:28.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.978+0000 7f96227fc700 1 -- 172.21.15.125:0/2276591326 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9624022070 con 0x7f9634150480 2023-10-06T03:04:28.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.978+0000 7f96227fc700 1 -- 172.21.15.125:0/2276591326 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962400e980 con 0x7f9634150480 2023-10-06T03:04:28.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.978+0000 7f96227fc700 1 -- 172.21.15.125:0/2276591326 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962400e6b0 con 0x7f9634150480 2023-10-06T03:04:28.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.978+0000 7f9638ad5700 1 -- 172.21.15.125:0/2276591326 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96340c7900 con 0x7f9634150480 2023-10-06T03:04:28.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.978+0000 7f9638ad5700 1 -- 172.21.15.125:0/2276591326 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96340c7ec0 con 0x7f9634150480 2023-10-06T03:04:28.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.979+0000 7f9638ad5700 1 -- 172.21.15.125:0/2276591326 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9634066510 con 0x7f9634150480 2023-10-06T03:04:28.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.979+0000 7f96227fc700 1 -- 172.21.15.125:0/2276591326 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9624027680 con 0x7f9634150480 2023-10-06T03:04:28.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.979+0000 7f96227fc700 1 --2- 172.21.15.125:0/2276591326 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9614066f60 0x7f9614069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:28.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.979+0000 7f96227fc700 1 -- 172.21.15.125:0/2276591326 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f9624085ed0 con 0x7f9634150480 2023-10-06T03:04:28.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.979+0000 7f963259c700 1 --2- 172.21.15.125:0/2276591326 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9614066f60 0x7f9614069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:28.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.980+0000 7f963259c700 1 --2- 172.21.15.125:0/2276591326 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9614066f60 0x7f9614069410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9628001150 tx=0x7f9628009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:28.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:28.984+0000 7f96227fc700 1 -- 172.21.15.125:0/2276591326 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96240530f0 con 0x7f9634150480 2023-10-06T03:04:29.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.209+0000 7f9638ad5700 1 -- 172.21.15.125:0/2276591326 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9634068040 con 0x7f9634150480 2023-10-06T03:04:29.837 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.836+0000 7f96227fc700 1 -- 172.21.15.125:0/2276591326 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f96240170c0 con 0x7f9634150480 2023-10-06T03:04:29.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.838+0000 7f9638ad5700 1 -- 172.21.15.125:0/2276591326 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9614066f60 msgr2=0x7f9614069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:29.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.838+0000 7f9638ad5700 1 --2- 172.21.15.125:0/2276591326 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9614066f60 0x7f9614069410 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9628001150 tx=0x7f9628009040 comp rx=0 tx=0).stop 2023-10-06T03:04:29.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.838+0000 7f9638ad5700 1 -- 172.21.15.125:0/2276591326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9634150480 msgr2=0x7f9634151e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:29.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.838+0000 7f9638ad5700 1 --2- 172.21.15.125:0/2276591326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9634150480 0x7f9634151e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f962400e4b0 tx=0x7f962401a000 comp rx=0 tx=0).stop 2023-10-06T03:04:29.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.838+0000 7f9638ad5700 1 -- 172.21.15.125:0/2276591326 shutdown_connections 2023-10-06T03:04:29.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.838+0000 7f9638ad5700 1 --2- 172.21.15.125:0/2276591326 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9614066f60 0x7f9614069410 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:29.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.838+0000 7f9638ad5700 1 --2- 172.21.15.125:0/2276591326 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9634152390 0x7f96341527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:29.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.838+0000 7f9638ad5700 1 --2- 172.21.15.125:0/2276591326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961c003fe0 0x7f963414ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:29.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.838+0000 7f9638ad5700 1 --2- 172.21.15.125:0/2276591326 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9634150480 0x7f9634151e50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:29.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.838+0000 7f9638ad5700 1 -- 172.21.15.125:0/2276591326 >> 172.21.15.125:0/2276591326 conn(0x7f96340af730 msgr2=0x7f963414f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:29.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.838+0000 7f9638ad5700 1 -- 172.21.15.125:0/2276591326 shutdown_connections 2023-10-06T03:04:29.841 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.838+0000 7f9638ad5700 1 -- 172.21.15.125:0/2276591326 wait complete. 2023-10-06T03:04:29.841 INFO:teuthology.orchestra.run.smithi125.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T03:04:29.857 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-06T03:04:29.857 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-06T03:04:29.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.980+0000 7fcc50856700 1 Processor -- start 2023-10-06T03:04:29.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.980+0000 7fcc50856700 1 -- start start 2023-10-06T03:04:29.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.981+0000 7fcc50856700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcc4c1591d0 0x7fcc4c0c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:29.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.981+0000 7fcc50856700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcc4c1595a0 0x7fcc4c0caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:29.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.981+0000 7fcc50856700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc4c06c910 0x7fcc4c06cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:29.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.981+0000 7fcc50856700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc4c159a10 con 0x7fcc4c1591d0 2023-10-06T03:04:29.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.981+0000 7fcc50856700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc4c06d2b0 con 0x7fcc4c1595a0 2023-10-06T03:04:29.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.981+0000 7fcc50856700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c0c9130 con 0x7fcc4c06c910 2023-10-06T03:04:29.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.981+0000 7fcc4a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcc4c1591d0 0x7fcc4c0c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:29.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.981+0000 7fcc4a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcc4c1591d0 0x7fcc4c0c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44296/0 (socket says 172.21.15.125:44296) 2023-10-06T03:04:29.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.981+0000 7fcc4a59c700 1 -- 172.21.15.125:0/483152545 learned_addr learned my addr 172.21.15.125:0/483152545 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:29.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.982+0000 7fcc49d9b700 1 --2- 172.21.15.125:0/483152545 >> v2:172.21.15.130:3300/0 conn(0x7fcc4c1595a0 0x7fcc4c0caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:29.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.982+0000 7fcc4ad9d700 1 --2- 172.21.15.125:0/483152545 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc4c06c910 0x7fcc4c06cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:29.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.982+0000 7fcc4a59c700 1 -- 172.21.15.125:0/483152545 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc4c06c910 msgr2=0x7fcc4c06cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:29.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.982+0000 7fcc4a59c700 1 --2- 172.21.15.125:0/483152545 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc4c06c910 0x7fcc4c06cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:29.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.982+0000 7fcc4a59c700 1 -- 172.21.15.125:0/483152545 >> v2:172.21.15.130:3300/0 conn(0x7fcc4c1595a0 msgr2=0x7fcc4c0caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:29.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.982+0000 7fcc4a59c700 1 --2- 172.21.15.125:0/483152545 >> v2:172.21.15.130:3300/0 conn(0x7fcc4c1595a0 0x7fcc4c0caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:29.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.982+0000 7fcc4a59c700 1 -- 172.21.15.125:0/483152545 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4c0c8520 con 0x7fcc4c1591d0 2023-10-06T03:04:29.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.982+0000 7fcc49d9b700 1 --2- 172.21.15.125:0/483152545 >> v2:172.21.15.130:3300/0 conn(0x7fcc4c1595a0 0x7fcc4c0caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:29.986 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.982+0000 7fcc4a59c700 1 --2- 172.21.15.125:0/483152545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc4c1591d0 0x7fcc4c0c7f40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c06eb90 tx=0x7fcc40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c0294cb4af62bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:29.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.982+0000 7fcc4959a700 1 -- 172.21.15.125:0/483152545 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000b860 con 0x7fcc4c1591d0 2023-10-06T03:04:29.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.982+0000 7fcc4959a700 1 -- 172.21.15.125:0/483152545 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4000b9c0 con 0x7fcc4c1591d0 2023-10-06T03:04:29.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.982+0000 7fcc4959a700 1 -- 172.21.15.125:0/483152545 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000bd60 con 0x7fcc4c1591d0 2023-10-06T03:04:29.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.983+0000 7fcc50856700 1 -- 172.21.15.125:0/483152545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc4c1591d0 msgr2=0x7fcc4c0c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:29.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.983+0000 7fcc50856700 1 --2- 172.21.15.125:0/483152545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc4c1591d0 0x7fcc4c0c7f40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c06eb90 tx=0x7fcc40009250 comp rx=0 tx=0).stop 2023-10-06T03:04:29.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.983+0000 7fcc50856700 1 -- 172.21.15.125:0/483152545 shutdown_connections 2023-10-06T03:04:29.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.983+0000 7fcc50856700 1 --2- 172.21.15.125:0/483152545 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc4c06c910 0x7fcc4c06cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:29.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.983+0000 7fcc50856700 1 --2- 172.21.15.125:0/483152545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc4c1591d0 0x7fcc4c0c7f40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:29.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.983+0000 7fcc50856700 1 --2- 172.21.15.125:0/483152545 >> v2:172.21.15.130:3300/0 conn(0x7fcc4c1595a0 0x7fcc4c0caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:29.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.983+0000 7fcc50856700 1 -- 172.21.15.125:0/483152545 >> 172.21.15.125:0/483152545 conn(0x7fcc4c06b190 msgr2=0x7fcc4c06b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:29.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.983+0000 7fcc50856700 1 -- 172.21.15.125:0/483152545 shutdown_connections 2023-10-06T03:04:29.987 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.983+0000 7fcc50856700 1 -- 172.21.15.125:0/483152545 wait complete. 2023-10-06T03:04:29.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.984+0000 7fcc50856700 1 Processor -- start 2023-10-06T03:04:29.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.984+0000 7fcc50856700 1 -- start start 2023-10-06T03:04:29.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.984+0000 7fcc50856700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc4c06c910 0x7fcc4c0a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:29.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc50856700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc4c1591d0 0x7fcc4c155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:29.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc50856700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc4c1595a0 0x7fcc4c0ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:29.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc50856700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c16ccb0 con 0x7fcc4c1595a0 2023-10-06T03:04:29.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc50856700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c16cf00 con 0x7fcc4c1591d0 2023-10-06T03:04:29.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc50856700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c16d1e0 con 0x7fcc4c06c910 2023-10-06T03:04:29.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc4ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc4c1595a0 0x7fcc4c0ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:29.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc4ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc4c1595a0 0x7fcc4c0ae360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44304/0 (socket says 172.21.15.125:44304) 2023-10-06T03:04:29.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc4ad9d700 1 -- 172.21.15.125:0/2506670323 learned_addr learned my addr 172.21.15.125:0/2506670323 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:29.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc4a59c700 1 --2- 172.21.15.125:0/2506670323 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc4c06c910 0x7fcc4c0a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:29.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc49d9b700 1 --2- 172.21.15.125:0/2506670323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc4c1591d0 0x7fcc4c155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:29.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc4ad9d700 1 -- 172.21.15.125:0/2506670323 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc4c06c910 msgr2=0x7fcc4c0a9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:29.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc4ad9d700 1 --2- 172.21.15.125:0/2506670323 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc4c06c910 0x7fcc4c0a9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:29.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc4ad9d700 1 -- 172.21.15.125:0/2506670323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc4c1591d0 msgr2=0x7fcc4c155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:29.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc4ad9d700 1 --2- 172.21.15.125:0/2506670323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc4c1591d0 0x7fcc4c155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:29.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc4ad9d700 1 -- 172.21.15.125:0/2506670323 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc400094f0 con 0x7fcc4c1595a0 2023-10-06T03:04:29.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc4ad9d700 1 --2- 172.21.15.125:0/2506670323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc4c1595a0 0x7fcc4c0ae360 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcc44009fa0 tx=0x7fcc44009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:29.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc3a7fc700 1 -- 172.21.15.125:0/2506670323 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4400ebc0 con 0x7fcc4c1595a0 2023-10-06T03:04:29.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc3a7fc700 1 -- 172.21.15.125:0/2506670323 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4400ed20 con 0x7fcc4c1595a0 2023-10-06T03:04:29.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc50856700 1 -- 172.21.15.125:0/2506670323 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4c16d4c0 con 0x7fcc4c1595a0 2023-10-06T03:04:29.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc3a7fc700 1 -- 172.21.15.125:0/2506670323 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc44014670 con 0x7fcc4c1595a0 2023-10-06T03:04:29.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.985+0000 7fcc50856700 1 -- 172.21.15.125:0/2506670323 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4c16db10 con 0x7fcc4c1595a0 2023-10-06T03:04:29.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.986+0000 7fcc50856700 1 -- 172.21.15.125:0/2506670323 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc4c06e0e0 con 0x7fcc4c1595a0 2023-10-06T03:04:29.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.987+0000 7fcc3a7fc700 1 -- 172.21.15.125:0/2506670323 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc440149e0 con 0x7fcc4c1595a0 2023-10-06T03:04:29.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.987+0000 7fcc3a7fc700 1 --2- 172.21.15.125:0/2506670323 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcc2c066f30 0x7fcc2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:29.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.987+0000 7fcc4a59c700 1 --2- 172.21.15.125:0/2506670323 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcc2c066f30 0x7fcc2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:29.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.987+0000 7fcc3a7fc700 1 -- 172.21.15.125:0/2506670323 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcc44084cf0 con 0x7fcc4c1595a0 2023-10-06T03:04:29.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.988+0000 7fcc4a59c700 1 --2- 172.21.15.125:0/2506670323 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcc2c066f30 0x7fcc2c0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c06eb90 tx=0x7fcc40017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:29.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:29.991+0000 7fcc3a7fc700 1 -- 172.21.15.125:0/2506670323 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc44089070 con 0x7fcc4c1595a0 2023-10-06T03:04:30.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.183+0000 7fcc50856700 1 -- 172.21.15.125:0/2506670323 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fcc4c0c8800 con 0x7fcc4c1595a0 2023-10-06T03:04:30.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.235+0000 7fcc3a7fc700 1 -- 172.21.15.125:0/2506670323 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7fcc44051e00 con 0x7fcc4c1595a0 2023-10-06T03:04:30.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.237+0000 7fcc50856700 1 -- 172.21.15.125:0/2506670323 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcc2c066f30 msgr2=0x7fcc2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:30.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.237+0000 7fcc50856700 1 --2- 172.21.15.125:0/2506670323 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcc2c066f30 0x7fcc2c0693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c06eb90 tx=0x7fcc40017000 comp rx=0 tx=0).stop 2023-10-06T03:04:30.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.237+0000 7fcc50856700 1 -- 172.21.15.125:0/2506670323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc4c1595a0 msgr2=0x7fcc4c0ae360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:30.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.237+0000 7fcc50856700 1 --2- 172.21.15.125:0/2506670323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc4c1595a0 0x7fcc4c0ae360 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcc44009fa0 tx=0x7fcc44009900 comp rx=0 tx=0).stop 2023-10-06T03:04:30.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.237+0000 7fcc50856700 1 -- 172.21.15.125:0/2506670323 shutdown_connections 2023-10-06T03:04:30.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.238+0000 7fcc50856700 1 --2- 172.21.15.125:0/2506670323 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcc2c066f30 0x7fcc2c0693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:30.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.238+0000 7fcc50856700 1 --2- 172.21.15.125:0/2506670323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcc4c1595a0 0x7fcc4c0ae360 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:30.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.238+0000 7fcc50856700 1 --2- 172.21.15.125:0/2506670323 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcc4c06c910 0x7fcc4c0a9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:30.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.238+0000 7fcc50856700 1 --2- 172.21.15.125:0/2506670323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcc4c1591d0 0x7fcc4c155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:30.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.238+0000 7fcc50856700 1 -- 172.21.15.125:0/2506670323 >> 172.21.15.125:0/2506670323 conn(0x7fcc4c06b190 msgr2=0x7fcc4c15d030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:30.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.238+0000 7fcc50856700 1 -- 172.21.15.125:0/2506670323 shutdown_connections 2023-10-06T03:04:30.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.238+0000 7fcc50856700 1 -- 172.21.15.125:0/2506670323 wait complete. 2023-10-06T03:04:30.251 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:04:30.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.376+0000 7ff1530b3700 1 Processor -- start 2023-10-06T03:04:30.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.376+0000 7ff1530b3700 1 -- start start 2023-10-06T03:04:30.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.377+0000 7ff1530b3700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff14c0aa2f0 0x7ff14c0b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:30.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.377+0000 7ff1530b3700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff14c068bd0 0x7ff14c1576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:30.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.377+0000 7ff1530b3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14c0aa760 con 0x7ff14c157300 2023-10-06T03:04:30.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.377+0000 7ff1530b3700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c0aaa40 con 0x7ff14c068bd0 2023-10-06T03:04:30.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.377+0000 7ff1530b3700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0aad20 con 0x7ff14c0aa2f0 2023-10-06T03:04:30.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.377+0000 7ff150e4f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff14c157300 0x7ff14c0684c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35286/0 (socket says 172.21.15.125:35286) 2023-10-06T03:04:30.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.377+0000 7ff150e4f700 1 -- 172.21.15.125:0/104446628 learned_addr learned my addr 172.21.15.125:0/104446628 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:30.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.377+0000 7ff151650700 1 --2- 172.21.15.125:0/104446628 >> v2:172.21.15.130:3300/0 conn(0x7ff14c068bd0 0x7ff14c1576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:30.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.377+0000 7ff14bfff700 1 --2- 172.21.15.125:0/104446628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff14c0aa2f0 0x7ff14c0b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:30.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.377+0000 7ff14b7fe700 1 -- 172.21.15.125:0/104446628 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892441707 0 0) 0x7ff14c0aa760 con 0x7ff14c157300 2023-10-06T03:04:30.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.377+0000 7ff14b7fe700 1 -- 172.21.15.125:0/104446628 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff138003570 con 0x7ff14c157300 2023-10-06T03:04:30.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14b7fe700 1 -- 172.21.15.125:0/104446628 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1191299886 0 0) 0x7ff138003570 con 0x7ff14c157300 2023-10-06T03:04:30.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14b7fe700 1 -- 172.21.15.125:0/104446628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff14c0aa2f0 msgr2=0x7ff14c0b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:30.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14b7fe700 1 --2- 172.21.15.125:0/104446628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff14c0aa2f0 0x7ff14c0b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:30.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14b7fe700 1 -- 172.21.15.125:0/104446628 >> v2:172.21.15.130:3300/0 conn(0x7ff14c068bd0 msgr2=0x7ff14c1576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:30.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14b7fe700 1 --2- 172.21.15.125:0/104446628 >> v2:172.21.15.130:3300/0 conn(0x7ff14c068bd0 0x7ff14c1576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:30.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14b7fe700 1 -- 172.21.15.125:0/104446628 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c0ab000 con 0x7ff14c157300 2023-10-06T03:04:30.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14b7fe700 1 -- 172.21.15.125:0/104446628 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7ff144001970 con 0x7ff14c157300 2023-10-06T03:04:30.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff151650700 1 --2- 172.21.15.125:0/104446628 >> v2:172.21.15.130:3300/0 conn(0x7ff14c068bd0 0x7ff14c1576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:30.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14bfff700 1 --2- 172.21.15.125:0/104446628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff14c0aa2f0 0x7ff14c0b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:30.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14b7fe700 1 -- 172.21.15.125:0/104446628 >> v1:172.21.15.125:6789/0 conn(0x7ff14c157300 legacy=0x7ff14c0684c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:30.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14b7fe700 1 --2- 172.21.15.125:0/104446628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff138003a60 0x7ff138003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:30.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14b7fe700 1 --2- 172.21.15.125:0/104446628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff138004810 0x7ff138004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:30.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14b7fe700 1 --2- 172.21.15.125:0/104446628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff14c0aa2f0 0x7ff1380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:30.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14b7fe700 1 -- 172.21.15.125:0/104446628 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0aaa40 con 0x7ff138004810 2023-10-06T03:04:30.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14b7fe700 1 -- 172.21.15.125:0/104446628 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0aad20 con 0x7ff138003a60 2023-10-06T03:04:30.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14b7fe700 1 -- 172.21.15.125:0/104446628 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13800ba60 con 0x7ff14c0aa2f0 2023-10-06T03:04:30.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14bfff700 1 --2- 172.21.15.125:0/104446628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff138004810 0x7ff138004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:30.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff150e4f700 1 --2- 172.21.15.125:0/104446628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff138003a60 0x7ff138003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:30.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff151650700 1 --2- 172.21.15.125:0/104446628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff14c0aa2f0 0x7ff1380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:30.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14bfff700 1 -- 172.21.15.125:0/104446628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff14c0aa2f0 msgr2=0x7ff1380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:30.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14bfff700 1 --2- 172.21.15.125:0/104446628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff14c0aa2f0 0x7ff1380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:30.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14bfff700 1 -- 172.21.15.125:0/104446628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff138003a60 msgr2=0x7ff138003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:30.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14bfff700 1 --2- 172.21.15.125:0/104446628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff138003a60 0x7ff138003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:30.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14bfff700 1 -- 172.21.15.125:0/104446628 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff134009420 con 0x7ff138004810 2023-10-06T03:04:30.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff151650700 1 --2- 172.21.15.125:0/104446628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff14c0aa2f0 0x7ff1380051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:30.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14bfff700 1 --2- 172.21.15.125:0/104446628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff138004810 0x7ff138004c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff134009df0 tx=0x7ff1340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870546bababa3773 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:30.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14b7fe700 1 -- 172.21.15.125:0/104446628 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134009740 con 0x7ff138004810 2023-10-06T03:04:30.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14b7fe700 1 -- 172.21.15.125:0/104446628 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13400e920 con 0x7ff138004810 2023-10-06T03:04:30.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.378+0000 7ff14b7fe700 1 -- 172.21.15.125:0/104446628 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13400ece0 con 0x7ff138004810 2023-10-06T03:04:30.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.379+0000 7ff1530b3700 1 -- 172.21.15.125:0/104446628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff138004810 msgr2=0x7ff138004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:30.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.379+0000 7ff1530b3700 1 --2- 172.21.15.125:0/104446628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff138004810 0x7ff138004c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff134009df0 tx=0x7ff1340091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:30.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.379+0000 7ff151650700 1 -- 172.21.15.125:0/104446628 reap_dead start 2023-10-06T03:04:30.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.379+0000 7ff1530b3700 1 -- 172.21.15.125:0/104446628 shutdown_connections 2023-10-06T03:04:30.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.379+0000 7ff1530b3700 1 -- 172.21.15.125:0/104446628 >> 172.21.15.125:0/104446628 conn(0x7ff14c0af730 msgr2=0x7ff14c0afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:30.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.379+0000 7ff1530b3700 1 -- 172.21.15.125:0/104446628 shutdown_connections 2023-10-06T03:04:30.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.379+0000 7ff1530b3700 1 -- 172.21.15.125:0/104446628 wait complete. 2023-10-06T03:04:30.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.380+0000 7ff1530b3700 1 Processor -- start 2023-10-06T03:04:30.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.380+0000 7ff1530b3700 1 -- start start 2023-10-06T03:04:30.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.381+0000 7ff1530b3700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff138004810 0x7ff14c0c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:30.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.381+0000 7ff1530b3700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff14c0aea70 0x7ff14c154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:30.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.381+0000 7ff1530b3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff14c0aeee0 0x7ff14c154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:30.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.381+0000 7ff1530b3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0c7a30 con 0x7ff14c0aeee0 2023-10-06T03:04:30.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.381+0000 7ff1530b3700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c154ba0 con 0x7ff14c0aea70 2023-10-06T03:04:30.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.381+0000 7ff1530b3700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c0c6e20 con 0x7ff138004810 2023-10-06T03:04:30.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.381+0000 7ff151650700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff14c0aeee0 0x7ff14c154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:30.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.381+0000 7ff151650700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff14c0aeee0 0x7ff14c154660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44322/0 (socket says 172.21.15.125:44322) 2023-10-06T03:04:30.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.381+0000 7ff151650700 1 -- 172.21.15.125:0/1006080735 learned_addr learned my addr 172.21.15.125:0/1006080735 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:30.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.381+0000 7ff14bfff700 1 --2- 172.21.15.125:0/1006080735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff14c0aea70 0x7ff14c154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:30.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.381+0000 7ff150e4f700 1 --2- 172.21.15.125:0/1006080735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff138004810 0x7ff14c0c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:30.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.381+0000 7ff151650700 1 -- 172.21.15.125:0/1006080735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff138004810 msgr2=0x7ff14c0c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:30.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.381+0000 7ff151650700 1 --2- 172.21.15.125:0/1006080735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff138004810 0x7ff14c0c5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:30.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.381+0000 7ff151650700 1 -- 172.21.15.125:0/1006080735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff14c0aea70 msgr2=0x7ff14c154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:30.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.381+0000 7ff151650700 1 --2- 172.21.15.125:0/1006080735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff14c0aea70 0x7ff14c154120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:30.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.381+0000 7ff151650700 1 -- 172.21.15.125:0/1006080735 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c0c7100 con 0x7ff14c0aeee0 2023-10-06T03:04:30.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.381+0000 7ff151650700 1 --2- 172.21.15.125:0/1006080735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff14c0aeee0 0x7ff14c154660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0635f0 tx=0x7ff13c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:30.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.382+0000 7ff148ff9700 1 -- 172.21.15.125:0/1006080735 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c015670 con 0x7ff14c0aeee0 2023-10-06T03:04:30.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.382+0000 7ff148ff9700 1 -- 172.21.15.125:0/1006080735 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13c0157d0 con 0x7ff14c0aeee0 2023-10-06T03:04:30.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.382+0000 7ff1530b3700 1 -- 172.21.15.125:0/1006080735 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14c0c73e0 con 0x7ff14c0aeee0 2023-10-06T03:04:30.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.382+0000 7ff148ff9700 1 -- 172.21.15.125:0/1006080735 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13c015b90 con 0x7ff14c0aeee0 2023-10-06T03:04:30.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.382+0000 7ff1530b3700 1 -- 172.21.15.125:0/1006080735 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14c096680 con 0x7ff14c0aeee0 2023-10-06T03:04:30.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.383+0000 7ff1530b3700 1 -- 172.21.15.125:0/1006080735 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14c0c7be0 con 0x7ff14c0aeee0 2023-10-06T03:04:30.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.383+0000 7ff148ff9700 1 -- 172.21.15.125:0/1006080735 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff13c01f410 con 0x7ff14c0aeee0 2023-10-06T03:04:30.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.383+0000 7ff148ff9700 1 --2- 172.21.15.125:0/1006080735 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff12c066f30 0x7ff12c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:30.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.383+0000 7ff148ff9700 1 -- 172.21.15.125:0/1006080735 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6284+0+0 (secure 0 0 0) 0x7ff13c084780 con 0x7ff14c0aeee0 2023-10-06T03:04:30.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.383+0000 7ff150e4f700 1 --2- 172.21.15.125:0/1006080735 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff12c066f30 0x7ff12c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:30.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.384+0000 7ff150e4f700 1 --2- 172.21.15.125:0/1006080735 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff12c066f30 0x7ff12c0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff144001270 tx=0x7ff144009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:30.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.388+0000 7ff148ff9700 1 -- 172.21.15.125:0/1006080735 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff14c0c7be0 con 0x7ff14c0aeee0 2023-10-06T03:04:30.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:30.570+0000 7ff1530b3700 1 -- 172.21.15.125:0/1006080735 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff14c0c7be0 con 0x7ff14c0aeee0 2023-10-06T03:04:32.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.248+0000 7ff148ff9700 1 -- 172.21.15.125:0/1006080735 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7ff14c0c7be0 con 0x7ff14c0aeee0 2023-10-06T03:04:32.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.253+0000 7ff1530b3700 1 -- 172.21.15.125:0/1006080735 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff12c066f30 msgr2=0x7ff12c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:32.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.253+0000 7ff1530b3700 1 --2- 172.21.15.125:0/1006080735 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff12c066f30 0x7ff12c0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff144001270 tx=0x7ff144009040 comp rx=0 tx=0).stop 2023-10-06T03:04:32.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.253+0000 7ff1530b3700 1 -- 172.21.15.125:0/1006080735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff14c0aeee0 msgr2=0x7ff14c154660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:32.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.253+0000 7ff1530b3700 1 --2- 172.21.15.125:0/1006080735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff14c0aeee0 0x7ff14c154660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0635f0 tx=0x7ff13c008040 comp rx=0 tx=0).stop 2023-10-06T03:04:32.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.255+0000 7ff1530b3700 1 -- 172.21.15.125:0/1006080735 shutdown_connections 2023-10-06T03:04:32.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.255+0000 7ff1530b3700 1 --2- 172.21.15.125:0/1006080735 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff12c066f30 0x7ff12c0693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:32.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.255+0000 7ff1530b3700 1 --2- 172.21.15.125:0/1006080735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff14c0aeee0 0x7ff14c154660 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:32.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.255+0000 7ff1530b3700 1 --2- 172.21.15.125:0/1006080735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff138004810 0x7ff14c0c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:32.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.255+0000 7ff1530b3700 1 --2- 172.21.15.125:0/1006080735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff14c0aea70 0x7ff14c154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:32.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.255+0000 7ff1530b3700 1 -- 172.21.15.125:0/1006080735 >> 172.21.15.125:0/1006080735 conn(0x7ff14c0af730 msgr2=0x7ff14c0684a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:32.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.256+0000 7ff1530b3700 1 -- 172.21.15.125:0/1006080735 shutdown_connections 2023-10-06T03:04:32.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.257+0000 7ff1530b3700 1 -- 172.21.15.125:0/1006080735 wait complete. 2023-10-06T03:04:32.259 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data_ec' created 2023-10-06T03:04:32.273 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-06T03:04:32.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.399+0000 7fb3f4724700 1 Processor -- start 2023-10-06T03:04:32.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.399+0000 7fb3f4724700 1 -- start start 2023-10-06T03:04:32.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f4724700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb3ec0c6c20 0x7fb3ec157060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:32.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f4724700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3ec0cc010 con 0x7fb3ec153a60 2023-10-06T03:04:32.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f4724700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3ec0cc2f0 con 0x7fb3ec0ca8c0 2023-10-06T03:04:32.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f4724700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3ec068ff0 con 0x7fb3ec0c6c20 2023-10-06T03:04:32.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f24c0700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb3ec153a60 0x7fb3ec0ca1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35290/0 (socket says 172.21.15.125:35290) 2023-10-06T03:04:32.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f24c0700 1 -- 172.21.15.125:0/2232684265 learned_addr learned my addr 172.21.15.125:0/2232684265 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:32.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f14be700 1 -- 172.21.15.125:0/2232684265 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793620453 0 0) 0x7fb3ec0cc010 con 0x7fb3ec153a60 2023-10-06T03:04:32.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f14be700 1 -- 172.21.15.125:0/2232684265 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3d8003570 con 0x7fb3ec153a60 2023-10-06T03:04:32.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f2cc1700 1 --2- 172.21.15.125:0/2232684265 >> v2:172.21.15.130:3300/0 conn(0x7fb3ec0c6c20 0x7fb3ec157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:32.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f14be700 1 -- 172.21.15.125:0/2232684265 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1338511741 0 0) 0x7fb3d8003570 con 0x7fb3ec153a60 2023-10-06T03:04:32.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f14be700 1 -- 172.21.15.125:0/2232684265 >> v2:172.21.15.130:3300/0 conn(0x7fb3ec0c6c20 msgr2=0x7fb3ec157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:32.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f14be700 1 --2- 172.21.15.125:0/2232684265 >> v2:172.21.15.130:3300/0 conn(0x7fb3ec0c6c20 0x7fb3ec157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:32.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f14be700 1 -- 172.21.15.125:0/2232684265 >> v1:172.21.15.130:6789/0 conn(0x7fb3ec0ca8c0 legacy=0x7fb3ec067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:32.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f14be700 1 -- 172.21.15.125:0/2232684265 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec156860 con 0x7fb3ec153a60 2023-10-06T03:04:32.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f14be700 1 -- 172.21.15.125:0/2232684265 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7fb3e8001470 con 0x7fb3ec153a60 2023-10-06T03:04:32.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f14be700 1 -- 172.21.15.125:0/2232684265 >> v1:172.21.15.125:6789/0 conn(0x7fb3ec153a60 legacy=0x7fb3ec0ca1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:32.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f14be700 1 --2- 172.21.15.125:0/2232684265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3d8003a60 0x7fb3d8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:32.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f14be700 1 --2- 172.21.15.125:0/2232684265 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb3d8004810 0x7fb3d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:32.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f14be700 1 --2- 172.21.15.125:0/2232684265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3d80051c0 0x7fb3d800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:32.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f14be700 1 -- 172.21.15.125:0/2232684265 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec068ff0 con 0x7fb3d8003a60 2023-10-06T03:04:32.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f14be700 1 -- 172.21.15.125:0/2232684265 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d800c0d0 con 0x7fb3d80051c0 2023-10-06T03:04:32.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f14be700 1 -- 172.21.15.125:0/2232684265 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d800c290 con 0x7fb3d8004810 2023-10-06T03:04:32.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f24c0700 1 --2- 172.21.15.125:0/2232684265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3d8003a60 0x7fb3d8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:32.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.400+0000 7fb3f2cc1700 1 --2- 172.21.15.125:0/2232684265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3d80051c0 0x7fb3d800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:32.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.401+0000 7fb3f1cbf700 1 --2- 172.21.15.125:0/2232684265 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb3d8004810 0x7fb3d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:32.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.401+0000 7fb3f24c0700 1 -- 172.21.15.125:0/2232684265 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb3d8004810 msgr2=0x7fb3d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:32.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.401+0000 7fb3f24c0700 1 --2- 172.21.15.125:0/2232684265 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb3d8004810 0x7fb3d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:32.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.401+0000 7fb3f24c0700 1 -- 172.21.15.125:0/2232684265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3d80051c0 msgr2=0x7fb3d800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:32.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.401+0000 7fb3f24c0700 1 --2- 172.21.15.125:0/2232684265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3d80051c0 0x7fb3d800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:32.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.401+0000 7fb3f2cc1700 1 -- 172.21.15.125:0/2232684265 reap_dead start 2023-10-06T03:04:32.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.401+0000 7fb3f24c0700 1 -- 172.21.15.125:0/2232684265 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d8003570 con 0x7fb3d8003a60 2023-10-06T03:04:32.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.401+0000 7fb3f24c0700 1 --2- 172.21.15.125:0/2232684265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3d8003a60 0x7fb3d8003e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb3e800c3c0 tx=0x7fb3e8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47a6b7e30674253 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:32.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.401+0000 7fb3f14be700 1 -- 172.21.15.125:0/2232684265 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e800cc10 con 0x7fb3d8003a60 2023-10-06T03:04:32.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.401+0000 7fb3f14be700 1 -- 172.21.15.125:0/2232684265 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e800cd70 con 0x7fb3d8003a60 2023-10-06T03:04:32.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.401+0000 7fb3f14be700 1 -- 172.21.15.125:0/2232684265 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8005b50 con 0x7fb3d8003a60 2023-10-06T03:04:32.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.401+0000 7fb3f4724700 1 -- 172.21.15.125:0/2232684265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3d8003a60 msgr2=0x7fb3d8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:32.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.401+0000 7fb3f4724700 1 --2- 172.21.15.125:0/2232684265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3d8003a60 0x7fb3d8003e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb3e800c3c0 tx=0x7fb3e8001e50 comp rx=0 tx=0).stop 2023-10-06T03:04:32.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.402+0000 7fb3f4724700 1 -- 172.21.15.125:0/2232684265 shutdown_connections 2023-10-06T03:04:32.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.402+0000 7fb3f4724700 1 --2- 172.21.15.125:0/2232684265 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3d8003a60 0x7fb3d8003e70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:32.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.402+0000 7fb3f4724700 1 -- 172.21.15.125:0/2232684265 >> 172.21.15.125:0/2232684265 conn(0x7fb3ec06b3b0 msgr2=0x7fb3ec0cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:32.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.402+0000 7fb3f4724700 1 -- 172.21.15.125:0/2232684265 shutdown_connections 2023-10-06T03:04:32.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.402+0000 7fb3f4724700 1 -- 172.21.15.125:0/2232684265 wait complete. 2023-10-06T03:04:32.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.403+0000 7fb3f4724700 1 Processor -- start 2023-10-06T03:04:32.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.403+0000 7fb3f4724700 1 -- start start 2023-10-06T03:04:32.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.403+0000 7fb3f4724700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb3d8003a60 0x7fb3ec166cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:32.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.403+0000 7fb3f4724700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3ec0c4d10 0x7fb3ec165b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:32.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.403+0000 7fb3f4724700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3ec0b1ea0 0x7fb3ec0c5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:32.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.403+0000 7fb3f4724700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec0c4880 con 0x7fb3ec0b1ea0 2023-10-06T03:04:32.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.403+0000 7fb3f4724700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec167210 con 0x7fb3ec0c4d10 2023-10-06T03:04:32.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.403+0000 7fb3f4724700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec0c3c70 con 0x7fb3d8003a60 2023-10-06T03:04:32.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.403+0000 7fb3f2cc1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3ec0b1ea0 0x7fb3ec0c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:32.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.404+0000 7fb3f2cc1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3ec0b1ea0 0x7fb3ec0c5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44326/0 (socket says 172.21.15.125:44326) 2023-10-06T03:04:32.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.404+0000 7fb3f2cc1700 1 -- 172.21.15.125:0/1744046781 learned_addr learned my addr 172.21.15.125:0/1744046781 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:32.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.404+0000 7fb3f2cc1700 1 -- 172.21.15.125:0/1744046781 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb3d8003a60 msgr2=0x7fb3ec166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:32.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.404+0000 7fb3f1cbf700 1 --2- 172.21.15.125:0/1744046781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3ec0c4d10 0x7fb3ec165b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:32.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.404+0000 7fb3f2cc1700 1 --2- 172.21.15.125:0/1744046781 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb3d8003a60 0x7fb3ec166cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:32.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.404+0000 7fb3f2cc1700 1 -- 172.21.15.125:0/1744046781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3ec0c4d10 msgr2=0x7fb3ec165b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:32.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.404+0000 7fb3f2cc1700 1 --2- 172.21.15.125:0/1744046781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3ec0c4d10 0x7fb3ec165b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:32.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.404+0000 7fb3f2cc1700 1 -- 172.21.15.125:0/1744046781 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec0c3f50 con 0x7fb3ec0b1ea0 2023-10-06T03:04:32.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.404+0000 7fb3f2cc1700 1 --2- 172.21.15.125:0/1744046781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3ec0b1ea0 0x7fb3ec0c5720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec0cd360 tx=0x7fb3e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:32.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.404+0000 7fb3e27fc700 1 -- 172.21.15.125:0/1744046781 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e400e040 con 0x7fb3ec0b1ea0 2023-10-06T03:04:32.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.404+0000 7fb3e27fc700 1 -- 172.21.15.125:0/1744046781 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e400f040 con 0x7fb3ec0b1ea0 2023-10-06T03:04:32.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.404+0000 7fb3e27fc700 1 -- 172.21.15.125:0/1744046781 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e400fe20 con 0x7fb3ec0b1ea0 2023-10-06T03:04:32.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.404+0000 7fb3f4724700 1 -- 172.21.15.125:0/1744046781 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ec0c4230 con 0x7fb3ec0b1ea0 2023-10-06T03:04:32.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.404+0000 7fb3f4724700 1 -- 172.21.15.125:0/1744046781 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ec166050 con 0x7fb3ec0b1ea0 2023-10-06T03:04:32.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.405+0000 7fb3f4724700 1 -- 172.21.15.125:0/1744046781 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ec06d830 con 0x7fb3ec0b1ea0 2023-10-06T03:04:32.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.405+0000 7fb3e27fc700 1 -- 172.21.15.125:0/1744046781 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3e4015640 con 0x7fb3ec0b1ea0 2023-10-06T03:04:32.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.406+0000 7fb3e27fc700 1 --2- 172.21.15.125:0/1744046781 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb3d0066fb0 0x7fb3d0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:32.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.406+0000 7fb3e27fc700 1 -- 172.21.15.125:0/1744046781 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fb3e40851a0 con 0x7fb3ec0b1ea0 2023-10-06T03:04:32.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.406+0000 7fb3f24c0700 1 --2- 172.21.15.125:0/1744046781 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb3d0066fb0 0x7fb3d0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:32.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.406+0000 7fb3f24c0700 1 --2- 172.21.15.125:0/1744046781 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb3d0066fb0 0x7fb3d0069460 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8001ed0 tx=0x7fb3e8015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:32.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.410+0000 7fb3e27fc700 1 -- 172.21.15.125:0/1744046781 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3e4051f40 con 0x7fb3ec0b1ea0 2023-10-06T03:04:32.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:32.590+0000 7fb3f4724700 1 -- 172.21.15.125:0/1744046781 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fb3ec0c49c0 con 0x7fb3ec0b1ea0 2023-10-06T03:04:33.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.247+0000 7fb3e27fc700 1 -- 172.21.15.125:0/1744046781 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb3ec0c49c0 con 0x7fb3ec0b1ea0 2023-10-06T03:04:33.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.253+0000 7fb3f4724700 1 -- 172.21.15.125:0/1744046781 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb3d0066fb0 msgr2=0x7fb3d0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.253+0000 7fb3f4724700 1 --2- 172.21.15.125:0/1744046781 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb3d0066fb0 0x7fb3d0069460 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8001ed0 tx=0x7fb3e8015000 comp rx=0 tx=0).stop 2023-10-06T03:04:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.253+0000 7fb3f4724700 1 -- 172.21.15.125:0/1744046781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3ec0b1ea0 msgr2=0x7fb3ec0c5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:33.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.253+0000 7fb3f4724700 1 --2- 172.21.15.125:0/1744046781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3ec0b1ea0 0x7fb3ec0c5720 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec0cd360 tx=0x7fb3e400b040 comp rx=0 tx=0).stop 2023-10-06T03:04:33.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.261+0000 7fb3f4724700 1 -- 172.21.15.125:0/1744046781 shutdown_connections 2023-10-06T03:04:33.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.261+0000 7fb3f4724700 1 --2- 172.21.15.125:0/1744046781 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb3d0066fb0 0x7fb3d0069460 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:33.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.261+0000 7fb3f4724700 1 --2- 172.21.15.125:0/1744046781 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb3ec0b1ea0 0x7fb3ec0c5720 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:33.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.261+0000 7fb3f4724700 1 --2- 172.21.15.125:0/1744046781 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb3d8003a60 0x7fb3ec166cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:33.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.261+0000 7fb3f4724700 1 --2- 172.21.15.125:0/1744046781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3ec0c4d10 0x7fb3ec165b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:33.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.261+0000 7fb3f4724700 1 -- 172.21.15.125:0/1744046781 >> 172.21.15.125:0/1744046781 conn(0x7fb3ec06b3b0 msgr2=0x7fb3ec153e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:33.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.261+0000 7fb3f4724700 1 -- 172.21.15.125:0/1744046781 shutdown_connections 2023-10-06T03:04:33.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.263+0000 7fb3f4724700 1 -- 172.21.15.125:0/1744046781 wait complete. 2023-10-06T03:04:33.274 INFO:teuthology.orchestra.run.smithi125.stderr:set pool 5 allow_ec_overwrites to true 2023-10-06T03:04:33.286 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-06T03:04:33.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.408+0000 7f0643a1e700 1 Processor -- start 2023-10-06T03:04:33.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.408+0000 7f0643a1e700 1 -- start start 2023-10-06T03:04:33.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.409+0000 7f0643a1e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f063c06ef70 0x7f063c159380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:33.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.409+0000 7f0643a1e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f063c0c8640 0x7f063c15d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:33.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.409+0000 7f0643a1e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063c15dd50 con 0x7f063c158fb0 2023-10-06T03:04:33.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.409+0000 7f0643a1e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063c0c75e0 con 0x7f063c0c8640 2023-10-06T03:04:33.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.409+0000 7f0643a1e700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c0c7880 con 0x7f063c06ef70 2023-10-06T03:04:33.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.409+0000 7f0641fbb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f063c0c8640 0x7f063c15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.409+0000 7f06417ba700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f063c158fb0 0x7f063c06e860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35304/0 (socket says 172.21.15.125:35304) 2023-10-06T03:04:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.409+0000 7f06417ba700 1 -- 172.21.15.125:0/3201877691 learned_addr learned my addr 172.21.15.125:0/3201877691 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.410+0000 7f0641fbb700 1 -- 172.21.15.125:0/3201877691 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f063c06ef70 msgr2=0x7f063c159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.410+0000 7f0641fbb700 1 --2- 172.21.15.125:0/3201877691 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f063c06ef70 0x7f063c159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.410+0000 7f0641fbb700 1 -- 172.21.15.125:0/3201877691 >> v1:172.21.15.125:6789/0 conn(0x7f063c158fb0 legacy=0x7f063c06e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.410+0000 7f0641fbb700 1 -- 172.21.15.125:0/3201877691 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c0c7b60 con 0x7f063c0c8640 2023-10-06T03:04:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.410+0000 7f0633fff700 1 -- 172.21.15.125:0/3201877691 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 147938384 0 0) 0x7f063c15dd50 con 0x7f063c158fb0 2023-10-06T03:04:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.410+0000 7f0641fbb700 1 --2- 172.21.15.125:0/3201877691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f063c0c8640 0x7f063c15d810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0634009e60 tx=0x7f0634009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906a98604acbcd13 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.410+0000 7f0633fff700 1 -- 172.21.15.125:0/3201877691 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063400e070 con 0x7f063c0c8640 2023-10-06T03:04:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.410+0000 7f0633fff700 1 -- 172.21.15.125:0/3201877691 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063400bc30 con 0x7f063c0c8640 2023-10-06T03:04:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.410+0000 7f0633fff700 1 -- 172.21.15.125:0/3201877691 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634012430 con 0x7f063c0c8640 2023-10-06T03:04:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.411+0000 7f0643a1e700 1 -- 172.21.15.125:0/3201877691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f063c0c8640 msgr2=0x7f063c15d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.411+0000 7f0643a1e700 1 --2- 172.21.15.125:0/3201877691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f063c0c8640 0x7f063c15d810 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0634009e60 tx=0x7f0634009780 comp rx=0 tx=0).stop 2023-10-06T03:04:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.411+0000 7f0643a1e700 1 -- 172.21.15.125:0/3201877691 shutdown_connections 2023-10-06T03:04:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.411+0000 7f0643a1e700 1 --2- 172.21.15.125:0/3201877691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f063c0c8640 0x7f063c15d810 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.411+0000 7f0643a1e700 1 --2- 172.21.15.125:0/3201877691 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f063c06ef70 0x7f063c159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.411+0000 7f0643a1e700 1 -- 172.21.15.125:0/3201877691 >> 172.21.15.125:0/3201877691 conn(0x7f063c06b350 msgr2=0x7f063c0cc560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.411+0000 7f0643a1e700 1 -- 172.21.15.125:0/3201877691 shutdown_connections 2023-10-06T03:04:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.411+0000 7f0643a1e700 1 -- 172.21.15.125:0/3201877691 wait complete. 2023-10-06T03:04:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.412+0000 7f0643a1e700 1 Processor -- start 2023-10-06T03:04:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.412+0000 7f0643a1e700 1 -- start start 2023-10-06T03:04:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f0643a1e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f063c06ef70 0x7f063c15c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f0643a1e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f063c0c8640 0x7f063c142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f0643a1e700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f063c158fb0 0x7f063c168ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f0643a1e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c15bc70 con 0x7f063c0c8640 2023-10-06T03:04:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f0643a1e700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063c169760 con 0x7f063c158fb0 2023-10-06T03:04:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f0643a1e700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063c169a40 con 0x7f063c06ef70 2023-10-06T03:04:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f0640fb9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f063c0c8640 0x7f063c142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f0640fb9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f063c0c8640 0x7f063c142710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44350/0 (socket says 172.21.15.125:44350) 2023-10-06T03:04:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f0640fb9700 1 -- 172.21.15.125:0/102879044 learned_addr learned my addr 172.21.15.125:0/102879044 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f06417ba700 1 --2- 172.21.15.125:0/102879044 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f063c06ef70 0x7f063c15c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f0641fbb700 1 --2- 172.21.15.125:0/102879044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f063c158fb0 0x7f063c168ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f0640fb9700 1 -- 172.21.15.125:0/102879044 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f063c06ef70 msgr2=0x7f063c15c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f0640fb9700 1 --2- 172.21.15.125:0/102879044 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f063c06ef70 0x7f063c15c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f0640fb9700 1 -- 172.21.15.125:0/102879044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f063c158fb0 msgr2=0x7f063c168ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f0640fb9700 1 --2- 172.21.15.125:0/102879044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f063c158fb0 0x7f063c168ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f0640fb9700 1 -- 172.21.15.125:0/102879044 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0634009a20 con 0x7f063c0c8640 2023-10-06T03:04:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f0641fbb700 1 --2- 172.21.15.125:0/102879044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f063c158fb0 0x7f063c168ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f0640fb9700 1 --2- 172.21.15.125:0/102879044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f063c0c8640 0x7f063c142710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f063800b5d0 tx=0x7f06380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f06317fa700 1 -- 172.21.15.125:0/102879044 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063800f510 con 0x7f063c0c8640 2023-10-06T03:04:33.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f06317fa700 1 -- 172.21.15.125:0/102879044 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063800f670 con 0x7f063c0c8640 2023-10-06T03:04:33.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.413+0000 7f0643a1e700 1 -- 172.21.15.125:0/102879044 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063c15b900 con 0x7f063c0c8640 2023-10-06T03:04:33.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.414+0000 7f06317fa700 1 -- 172.21.15.125:0/102879044 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063800fa30 con 0x7f063c0c8640 2023-10-06T03:04:33.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.414+0000 7f0643a1e700 1 -- 172.21.15.125:0/102879044 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063c15b5d0 con 0x7f063c0c8640 2023-10-06T03:04:33.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.414+0000 7f0643a1e700 1 -- 172.21.15.125:0/102879044 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063c066510 con 0x7f063c0c8640 2023-10-06T03:04:33.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.415+0000 7f06317fa700 1 -- 172.21.15.125:0/102879044 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f063801a400 con 0x7f063c0c8640 2023-10-06T03:04:33.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.415+0000 7f06317fa700 1 --2- 172.21.15.125:0/102879044 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0620066f30 0x7f06200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:33.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.415+0000 7f06417ba700 1 --2- 172.21.15.125:0/102879044 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0620066f30 0x7f06200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:33.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.415+0000 7f06317fa700 1 -- 172.21.15.125:0/102879044 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f0638084430 con 0x7f063c0c8640 2023-10-06T03:04:33.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.416+0000 7f06417ba700 1 --2- 172.21.15.125:0/102879044 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0620066f30 0x7f06200693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f062c007fd0 tx=0x7f062c007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:33.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.420+0000 7f06317fa700 1 -- 172.21.15.125:0/102879044 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06380512f0 con 0x7f063c0c8640 2023-10-06T03:04:33.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:33.644+0000 7f0643a1e700 1 -- 172.21.15.125:0/102879044 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f063c0c7e40 con 0x7f063c0c8640 2023-10-06T03:04:34.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.260+0000 7f06317fa700 1 -- 172.21.15.125:0/102879044 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f0638054910 con 0x7f063c0c8640 2023-10-06T03:04:34.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.262+0000 7f0643a1e700 1 -- 172.21.15.125:0/102879044 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0620066f30 msgr2=0x7f06200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:34.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.262+0000 7f0643a1e700 1 --2- 172.21.15.125:0/102879044 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0620066f30 0x7f06200693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f062c007fd0 tx=0x7f062c007d30 comp rx=0 tx=0).stop 2023-10-06T03:04:34.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.262+0000 7f0643a1e700 1 -- 172.21.15.125:0/102879044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f063c0c8640 msgr2=0x7f063c142710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:34.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.262+0000 7f0643a1e700 1 --2- 172.21.15.125:0/102879044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f063c0c8640 0x7f063c142710 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f063800b5d0 tx=0x7f06380091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.262+0000 7f0643a1e700 1 -- 172.21.15.125:0/102879044 shutdown_connections 2023-10-06T03:04:34.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.262+0000 7f0643a1e700 1 --2- 172.21.15.125:0/102879044 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0620066f30 0x7f06200693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.262+0000 7f0643a1e700 1 --2- 172.21.15.125:0/102879044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f063c158fb0 0x7f063c168ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.262+0000 7f0643a1e700 1 --2- 172.21.15.125:0/102879044 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f063c06ef70 0x7f063c15c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.262+0000 7f0643a1e700 1 --2- 172.21.15.125:0/102879044 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f063c0c8640 0x7f063c142710 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.262+0000 7f0643a1e700 1 -- 172.21.15.125:0/102879044 >> 172.21.15.125:0/102879044 conn(0x7f063c06b350 msgr2=0x7f063c15d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:34.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.262+0000 7f0643a1e700 1 -- 172.21.15.125:0/102879044 shutdown_connections 2023-10-06T03:04:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.262+0000 7f0643a1e700 1 -- 172.21.15.125:0/102879044 wait complete. 2023-10-06T03:04:34.264 INFO:teuthology.orchestra.run.smithi125.stderr:added data pool 5 to fsmap 2023-10-06T03:04:34.274 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:04:34.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.394+0000 7f23b2b8b700 1 Processor -- start 2023-10-06T03:04:34.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.395+0000 7f23b2b8b700 1 -- start start 2023-10-06T03:04:34.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.395+0000 7f23b2b8b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f23ac15b360 0x7f23ac0b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:34.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.395+0000 7f23b2b8b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac159ec0 con 0x7f23ac159050 2023-10-06T03:04:34.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.395+0000 7f23b2b8b700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac0b0bf0 con 0x7f23ac06f010 2023-10-06T03:04:34.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.395+0000 7f23b2b8b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23ac0b0ed0 con 0x7f23ac15b360 2023-10-06T03:04:34.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.395+0000 7f23b0927700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f23ac159050 0x7f23ac06e900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35314/0 (socket says 172.21.15.125:35314) 2023-10-06T03:04:34.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.395+0000 7f23b0927700 1 -- 172.21.15.125:0/536342748 learned_addr learned my addr 172.21.15.125:0/536342748 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:34.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.396+0000 7f23b1128700 1 --2- 172.21.15.125:0/536342748 >> v2:172.21.15.125:3300/0 conn(0x7f23ac15b360 0x7f23ac0b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:34.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.396+0000 7f23ab7fe700 1 -- 172.21.15.125:0/536342748 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868081883 0 0) 0x7f23ac159ec0 con 0x7f23ac159050 2023-10-06T03:04:34.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.396+0000 7f23ab7fe700 1 -- 172.21.15.125:0/536342748 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f239c003570 con 0x7f23ac159050 2023-10-06T03:04:34.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.396+0000 7f23b1128700 1 -- 172.21.15.125:0/536342748 >> v1:172.21.15.130:6789/0 conn(0x7f23ac06f010 legacy=0x7f23ac0afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:34.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.396+0000 7f23b1128700 1 -- 172.21.15.125:0/536342748 >> v1:172.21.15.125:6789/0 conn(0x7f23ac159050 legacy=0x7f23ac06e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:34.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.396+0000 7f23b1128700 1 -- 172.21.15.125:0/536342748 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac159b50 con 0x7f23ac15b360 2023-10-06T03:04:34.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.396+0000 7f23b1128700 1 --2- 172.21.15.125:0/536342748 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23ac15b360 0x7f23ac0b05a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009e60 tx=0x7f23a4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c2594913ded31b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:34.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.396+0000 7f23ab7fe700 1 -- 172.21.15.125:0/536342748 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a400e070 con 0x7f23ac15b360 2023-10-06T03:04:34.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.396+0000 7f23ab7fe700 1 -- 172.21.15.125:0/536342748 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a400bb20 con 0x7f23ac15b360 2023-10-06T03:04:34.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.396+0000 7f23ab7fe700 1 -- 172.21.15.125:0/536342748 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a4012430 con 0x7f23ac15b360 2023-10-06T03:04:34.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.397+0000 7f23b2b8b700 1 -- 172.21.15.125:0/536342748 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23ac15b360 msgr2=0x7f23ac0b05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:34.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.397+0000 7f23b2b8b700 1 --2- 172.21.15.125:0/536342748 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23ac15b360 0x7f23ac0b05a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009e60 tx=0x7f23a4009780 comp rx=0 tx=0).stop 2023-10-06T03:04:34.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.397+0000 7f23b2b8b700 1 -- 172.21.15.125:0/536342748 shutdown_connections 2023-10-06T03:04:34.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.397+0000 7f23b2b8b700 1 --2- 172.21.15.125:0/536342748 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23ac15b360 0x7f23ac0b05a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.397+0000 7f23b2b8b700 1 -- 172.21.15.125:0/536342748 >> 172.21.15.125:0/536342748 conn(0x7f23ac0cc620 msgr2=0x7f23ac0cc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:34.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.397+0000 7f23b2b8b700 1 -- 172.21.15.125:0/536342748 shutdown_connections 2023-10-06T03:04:34.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.397+0000 7f23b2b8b700 1 -- 172.21.15.125:0/536342748 wait complete. 2023-10-06T03:04:34.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.398+0000 7f23b2b8b700 1 Processor -- start 2023-10-06T03:04:34.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.398+0000 7f23b2b8b700 1 -- start start 2023-10-06T03:04:34.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.399+0000 7f23b2b8b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23ac06f010 0x7f23ac143a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:34.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.399+0000 7f23b2b8b700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23ac159050 0x7f23ac0aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:34.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.399+0000 7f23b2b8b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23ac15b360 0x7f23ac0ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:34.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.399+0000 7f23b2b8b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac144360 con 0x7f23ac15b360 2023-10-06T03:04:34.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.399+0000 7f23b2b8b700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0a9610 con 0x7f23ac159050 2023-10-06T03:04:34.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.399+0000 7f23b2b8b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0a8a40 con 0x7f23ac06f010 2023-10-06T03:04:34.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.399+0000 7f23b1128700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23ac15b360 0x7f23ac0ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:34.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.399+0000 7f23b1128700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23ac15b360 0x7f23ac0ab310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44362/0 (socket says 172.21.15.125:44362) 2023-10-06T03:04:34.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.399+0000 7f23b1128700 1 -- 172.21.15.125:0/186058689 learned_addr learned my addr 172.21.15.125:0/186058689 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:34.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.399+0000 7f23abfff700 1 --2- 172.21.15.125:0/186058689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23ac159050 0x7f23ac0aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:34.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.400+0000 7f23b0927700 1 --2- 172.21.15.125:0/186058689 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23ac06f010 0x7f23ac143a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:34.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.400+0000 7f23b1128700 1 -- 172.21.15.125:0/186058689 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23ac06f010 msgr2=0x7f23ac143a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:34.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.400+0000 7f23b1128700 1 --2- 172.21.15.125:0/186058689 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23ac06f010 0x7f23ac143a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.400+0000 7f23b1128700 1 -- 172.21.15.125:0/186058689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23ac159050 msgr2=0x7f23ac0aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:34.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.400+0000 7f23b1128700 1 --2- 172.21.15.125:0/186058689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23ac159050 0x7f23ac0aadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.400+0000 7f23b1128700 1 -- 172.21.15.125:0/186058689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a4009a20 con 0x7f23ac15b360 2023-10-06T03:04:34.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.400+0000 7f23abfff700 1 --2- 172.21.15.125:0/186058689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23ac159050 0x7f23ac0aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:34.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.400+0000 7f23b1128700 1 --2- 172.21.15.125:0/186058689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23ac15b360 0x7f23ac0ab310 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f23a40097c0 tx=0x7f23a4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:34.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.400+0000 7f23a8ff9700 1 -- 172.21.15.125:0/186058689 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a4012e00 con 0x7f23ac15b360 2023-10-06T03:04:34.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.400+0000 7f23a8ff9700 1 -- 172.21.15.125:0/186058689 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a401e640 con 0x7f23ac15b360 2023-10-06T03:04:34.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.400+0000 7f23b2b8b700 1 -- 172.21.15.125:0/186058689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac0a8ce0 con 0x7f23ac15b360 2023-10-06T03:04:34.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.400+0000 7f23a8ff9700 1 -- 172.21.15.125:0/186058689 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a401ea00 con 0x7f23ac15b360 2023-10-06T03:04:34.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.400+0000 7f23b2b8b700 1 -- 172.21.15.125:0/186058689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ac0a92a0 con 0x7f23ac15b360 2023-10-06T03:04:34.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.401+0000 7f23b2b8b700 1 -- 172.21.15.125:0/186058689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ac066510 con 0x7f23ac15b360 2023-10-06T03:04:34.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.401+0000 7f23a8ff9700 1 -- 172.21.15.125:0/186058689 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f23a4029460 con 0x7f23ac15b360 2023-10-06T03:04:34.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.402+0000 7f23a8ff9700 1 --2- 172.21.15.125:0/186058689 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2390066f30 0x7f23900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:34.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.402+0000 7f23a8ff9700 1 -- 172.21.15.125:0/186058689 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f23a4086ed0 con 0x7f23ac15b360 2023-10-06T03:04:34.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.402+0000 7f23b0927700 1 --2- 172.21.15.125:0/186058689 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2390066f30 0x7f23900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:34.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.402+0000 7f23b0927700 1 --2- 172.21.15.125:0/186058689 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2390066f30 0x7f23900693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f23a00058d0 tx=0x7f23a0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:34.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.406+0000 7f23a8ff9700 1 -- 172.21.15.125:0/186058689 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23a4053cf0 con 0x7f23ac15b360 2023-10-06T03:04:34.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.633+0000 7f23b2b8b700 1 -- 172.21.15.125:0/186058689 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23ac159420 con 0x7f23ac15b360 2023-10-06T03:04:34.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.634+0000 7f23a8ff9700 1 -- 172.21.15.125:0/186058689 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f23a4057310 con 0x7f23ac15b360 2023-10-06T03:04:34.634 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:34.634 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/1260071130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1260071130},{"type":"v1","addr":"172.21.15.130:6834","nonce":1260071130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/63925154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":63925154},{"type":"v1","addr":"172.21.15.125:6836","nonce":63925154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/1057811891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1057811891},{"type":"v1","addr":"172.21.15.125:6837","nonce":1057811891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:04:29.211664+0000","modified":"2023-10-06T03:04:34.254253+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/4004582354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":4004582354},{"type":"v1","addr":"172.21.15.130:6835","nonce":4004582354}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T03:04:34.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.636+0000 7f23b2b8b700 1 -- 172.21.15.125:0/186058689 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2390066f30 msgr2=0x7f23900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:34.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.636+0000 7f23b2b8b700 1 --2- 172.21.15.125:0/186058689 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2390066f30 0x7f23900693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f23a00058d0 tx=0x7f23a0009040 comp rx=0 tx=0).stop 2023-10-06T03:04:34.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.636+0000 7f23b2b8b700 1 -- 172.21.15.125:0/186058689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23ac15b360 msgr2=0x7f23ac0ab310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:34.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.636+0000 7f23b2b8b700 1 --2- 172.21.15.125:0/186058689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23ac15b360 0x7f23ac0ab310 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f23a40097c0 tx=0x7f23a4018000 comp rx=0 tx=0).stop 2023-10-06T03:04:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.636+0000 7f23b2b8b700 1 -- 172.21.15.125:0/186058689 shutdown_connections 2023-10-06T03:04:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.636+0000 7f23b2b8b700 1 --2- 172.21.15.125:0/186058689 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2390066f30 0x7f23900693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.636+0000 7f23b2b8b700 1 --2- 172.21.15.125:0/186058689 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23ac15b360 0x7f23ac0ab310 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.636+0000 7f23b2b8b700 1 --2- 172.21.15.125:0/186058689 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f23ac06f010 0x7f23ac143a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.636+0000 7f23b2b8b700 1 --2- 172.21.15.125:0/186058689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23ac159050 0x7f23ac0aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.636+0000 7f23b2b8b700 1 -- 172.21.15.125:0/186058689 >> 172.21.15.125:0/186058689 conn(0x7f23ac0cc620 msgr2=0x7f23ac0ad580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.636+0000 7f23b2b8b700 1 -- 172.21.15.125:0/186058689 shutdown_connections 2023-10-06T03:04:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.636+0000 7f23b2b8b700 1 -- 172.21.15.125:0/186058689 wait complete. 2023-10-06T03:04:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 7 2023-10-06T03:04:34.648 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:04:34.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.765+0000 7f6985327700 1 Processor -- start 2023-10-06T03:04:34.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.766+0000 7f6985327700 1 -- start start 2023-10-06T03:04:34.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.767+0000 7f6985327700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69801591f0 0x7f69801595c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:34.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.767+0000 7f6985327700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f69800b33a0 0x7f69800caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:34.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.767+0000 7f6985327700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69800cbb90 con 0x7f69800b2f30 2023-10-06T03:04:34.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.767+0000 7f6985327700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69800afbf0 con 0x7f69800b33a0 2023-10-06T03:04:34.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.767+0000 7f6985327700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69800cbe70 con 0x7f69801591f0 2023-10-06T03:04:34.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.767+0000 7f697f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f69800b33a0 0x7f69800caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:34.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.767+0000 7f697e7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f69800b2f30 0x7f69800ccc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35320/0 (socket says 172.21.15.125:35320) 2023-10-06T03:04:34.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.767+0000 7f697e7fc700 1 -- 172.21.15.125:0/1592111815 learned_addr learned my addr 172.21.15.125:0/1592111815 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:34.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.767+0000 7f697effd700 1 --2- 172.21.15.125:0/1592111815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69801591f0 0x7f69801595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:34.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.767+0000 7f697f7fe700 1 -- 172.21.15.125:0/1592111815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69801591f0 msgr2=0x7f69801595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:34.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.767+0000 7f697f7fe700 1 --2- 172.21.15.125:0/1592111815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69801591f0 0x7f69801595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.767+0000 7f697f7fe700 1 -- 172.21.15.125:0/1592111815 >> v1:172.21.15.125:6789/0 conn(0x7f69800b2f30 legacy=0x7f69800ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:34.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.767+0000 7f697f7fe700 1 -- 172.21.15.125:0/1592111815 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69800cc150 con 0x7f69800b33a0 2023-10-06T03:04:34.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.767+0000 7f697dffb700 1 -- 172.21.15.125:0/1592111815 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711726264 0 0) 0x7f69800cbb90 con 0x7f69800b2f30 2023-10-06T03:04:34.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.767+0000 7f697effd700 1 --2- 172.21.15.125:0/1592111815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69801591f0 0x7f69801595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:34.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.767+0000 7f697f7fe700 1 --2- 172.21.15.125:0/1592111815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69800b33a0 0x7f69800caf10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6978009e60 tx=0x7f6978009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c55dea621c3fb89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:34.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.767+0000 7f697dffb700 1 -- 172.21.15.125:0/1592111815 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697800e070 con 0x7f69800b33a0 2023-10-06T03:04:34.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.767+0000 7f697dffb700 1 -- 172.21.15.125:0/1592111815 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697800bc30 con 0x7f69800b33a0 2023-10-06T03:04:34.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.768+0000 7f697dffb700 1 -- 172.21.15.125:0/1592111815 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6978012430 con 0x7f69800b33a0 2023-10-06T03:04:34.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.768+0000 7f6985327700 1 -- 172.21.15.125:0/1592111815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69800b33a0 msgr2=0x7f69800caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:34.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.768+0000 7f6985327700 1 --2- 172.21.15.125:0/1592111815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69800b33a0 0x7f69800caf10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6978009e60 tx=0x7f6978009780 comp rx=0 tx=0).stop 2023-10-06T03:04:34.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.768+0000 7f6985327700 1 -- 172.21.15.125:0/1592111815 shutdown_connections 2023-10-06T03:04:34.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.768+0000 7f6985327700 1 --2- 172.21.15.125:0/1592111815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69800b33a0 0x7f69800caf10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.768+0000 7f6985327700 1 --2- 172.21.15.125:0/1592111815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69801591f0 0x7f69801595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.768+0000 7f6985327700 1 -- 172.21.15.125:0/1592111815 >> 172.21.15.125:0/1592111815 conn(0x7f698006ed40 msgr2=0x7f698006f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:34.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.768+0000 7f6985327700 1 -- 172.21.15.125:0/1592111815 shutdown_connections 2023-10-06T03:04:34.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.768+0000 7f6985327700 1 -- 172.21.15.125:0/1592111815 wait complete. 2023-10-06T03:04:34.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.770+0000 7f6985327700 1 Processor -- start 2023-10-06T03:04:34.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.770+0000 7f6985327700 1 -- start start 2023-10-06T03:04:34.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f6985327700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69800b2f30 0x7f69801577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:34.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f6985327700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69800b33a0 0x7f69801548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:34.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f6985327700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69801591f0 0x7f698015bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:34.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f6985327700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6980157350 con 0x7f69801591f0 2023-10-06T03:04:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f6985327700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6980156740 con 0x7f69800b33a0 2023-10-06T03:04:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f6985327700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6980156a20 con 0x7f69800b2f30 2023-10-06T03:04:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f697f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69801591f0 0x7f698015bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f697f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69801591f0 0x7f698015bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44376/0 (socket says 172.21.15.125:44376) 2023-10-06T03:04:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f697f7fe700 1 -- 172.21.15.125:0/784088436 learned_addr learned my addr 172.21.15.125:0/784088436 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f697effd700 1 --2- 172.21.15.125:0/784088436 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69800b2f30 0x7f69801577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f697e7fc700 1 --2- 172.21.15.125:0/784088436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69800b33a0 0x7f69801548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f697f7fe700 1 -- 172.21.15.125:0/784088436 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69800b2f30 msgr2=0x7f69801577e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f697f7fe700 1 --2- 172.21.15.125:0/784088436 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69800b2f30 0x7f69801577e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f697f7fe700 1 -- 172.21.15.125:0/784088436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69800b33a0 msgr2=0x7f69801548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f697f7fe700 1 --2- 172.21.15.125:0/784088436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69800b33a0 0x7f69801548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f697f7fe700 1 -- 172.21.15.125:0/784088436 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6978009a20 con 0x7f69801591f0 2023-10-06T03:04:34.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f697f7fe700 1 --2- 172.21.15.125:0/784088436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69801591f0 0x7f698015bde0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6980088f80 tx=0x7f6978019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:34.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f6976ffd700 1 -- 172.21.15.125:0/784088436 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6978027470 con 0x7f69801591f0 2023-10-06T03:04:34.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f6976ffd700 1 -- 172.21.15.125:0/784088436 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69780275f0 con 0x7f69801591f0 2023-10-06T03:04:34.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f6976ffd700 1 -- 172.21.15.125:0/784088436 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69780279b0 con 0x7f69801591f0 2023-10-06T03:04:34.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f6985327700 1 -- 172.21.15.125:0/784088436 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6980156d00 con 0x7f69801591f0 2023-10-06T03:04:34.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.771+0000 7f6985327700 1 -- 172.21.15.125:0/784088436 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6980154e20 con 0x7f69801591f0 2023-10-06T03:04:34.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.772+0000 7f6985327700 1 -- 172.21.15.125:0/784088436 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6980155040 con 0x7f69801591f0 2023-10-06T03:04:34.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.773+0000 7f6976ffd700 1 -- 172.21.15.125:0/784088436 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6978024070 con 0x7f69801591f0 2023-10-06T03:04:34.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.773+0000 7f6976ffd700 1 --2- 172.21.15.125:0/784088436 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6960066f30 0x7f69600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:34.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.773+0000 7f697effd700 1 --2- 172.21.15.125:0/784088436 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6960066f30 0x7f69600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:34.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.773+0000 7f6976ffd700 1 -- 172.21.15.125:0/784088436 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6978087000 con 0x7f69801591f0 2023-10-06T03:04:34.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.774+0000 7f697effd700 1 --2- 172.21.15.125:0/784088436 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6960066f30 0x7f69600693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6970006f00 tx=0x7f6970008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:34.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.777+0000 7f6976ffd700 1 -- 172.21.15.125:0/784088436 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6980155040 con 0x7f69801591f0 2023-10-06T03:04:34.923 INFO:tasks.ceph.mds.b.smithi130.stderr:2023-10-06T03:04:34.923+0000 7f97f9f98700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:04:34.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.963+0000 7f6985327700 1 -- 172.21.15.125:0/784088436 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6980155040 con 0x7f69801591f0 2023-10-06T03:04:34.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.964+0000 7f6976ffd700 1 -- 172.21.15.125:0/784088436 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18851 (secure 0 0 0) 0x7f6980155040 con 0x7f69801591f0 2023-10-06T03:04:34.965 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:34.965 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:33.645139+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:04:26.828121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:04:28.179225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:04:31.256394+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:04:34.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.966+0000 7f6985327700 1 -- 172.21.15.125:0/784088436 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6960066f30 msgr2=0x7f69600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:34.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.966+0000 7f6985327700 1 --2- 172.21.15.125:0/784088436 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6960066f30 0x7f69600693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6970006f00 tx=0x7f6970008040 comp rx=0 tx=0).stop 2023-10-06T03:04:34.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.966+0000 7f6985327700 1 -- 172.21.15.125:0/784088436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69801591f0 msgr2=0x7f698015bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:34.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.966+0000 7f6985327700 1 --2- 172.21.15.125:0/784088436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69801591f0 0x7f698015bde0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6980088f80 tx=0x7f6978019000 comp rx=0 tx=0).stop 2023-10-06T03:04:34.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.966+0000 7f6985327700 1 -- 172.21.15.125:0/784088436 shutdown_connections 2023-10-06T03:04:34.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.966+0000 7f6985327700 1 --2- 172.21.15.125:0/784088436 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6960066f30 0x7f69600693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.966+0000 7f6985327700 1 --2- 172.21.15.125:0/784088436 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f69801591f0 0x7f698015bde0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.966+0000 7f6985327700 1 --2- 172.21.15.125:0/784088436 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f69800b2f30 0x7f69801577e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.966+0000 7f6985327700 1 --2- 172.21.15.125:0/784088436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69800b33a0 0x7f69801548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:34.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.966+0000 7f6985327700 1 -- 172.21.15.125:0/784088436 >> 172.21.15.125:0/784088436 conn(0x7f698006ed40 msgr2=0x7f69800b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:34.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.966+0000 7f6985327700 1 -- 172.21.15.125:0/784088436 shutdown_connections 2023-10-06T03:04:34.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:34.966+0000 7f6985327700 1 -- 172.21.15.125:0/784088436 wait complete. 2023-10-06T03:04:34.978 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:04:35.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.095+0000 7f89fcea7700 1 Processor -- start 2023-10-06T03:04:35.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.095+0000 7f89fcea7700 1 -- start start 2023-10-06T03:04:35.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.096+0000 7f89fcea7700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89f8157bc0 0x7f89f80ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:35.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.096+0000 7f89fcea7700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f89f80ceb30 0x7f89f80c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:35.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.096+0000 7f89fcea7700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f89f80ca440 0x7f89f8157f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:35.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.096+0000 7f89fcea7700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f80c9a70 con 0x7f89f80ceb30 2023-10-06T03:04:35.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.096+0000 7f89fcea7700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f80c9140 con 0x7f89f80ca440 2023-10-06T03:04:35.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.096+0000 7f89fcea7700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f80c9420 con 0x7f89f8157bc0 2023-10-06T03:04:35.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.096+0000 7f89f5d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f89f80ceb30 0x7f89f80c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:35.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.096+0000 7f89f5d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f89f80ceb30 0x7f89f80c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44390/0 (socket says 172.21.15.125:44390) 2023-10-06T03:04:35.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.096+0000 7f89f5d9b700 1 -- 172.21.15.125:0/2945882444 learned_addr learned my addr 172.21.15.125:0/2945882444 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:35.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.097+0000 7f89f659c700 1 --2- 172.21.15.125:0/2945882444 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89f8157bc0 0x7f89f80ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:35.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.097+0000 7f89f6d9d700 1 --2- 172.21.15.125:0/2945882444 >> v2:172.21.15.130:3300/0 conn(0x7f89f80ca440 0x7f89f8157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:35.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.097+0000 7f89f5d9b700 1 -- 172.21.15.125:0/2945882444 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89f8157bc0 msgr2=0x7f89f80ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:35.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.097+0000 7f89f5d9b700 1 --2- 172.21.15.125:0/2945882444 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89f8157bc0 0x7f89f80ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.097+0000 7f89f5d9b700 1 -- 172.21.15.125:0/2945882444 >> v2:172.21.15.130:3300/0 conn(0x7f89f80ca440 msgr2=0x7f89f8157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:35.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.097+0000 7f89f5d9b700 1 --2- 172.21.15.125:0/2945882444 >> v2:172.21.15.130:3300/0 conn(0x7f89f80ca440 0x7f89f8157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.097+0000 7f89f5d9b700 1 -- 172.21.15.125:0/2945882444 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f80c9700 con 0x7f89f80ceb30 2023-10-06T03:04:35.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.097+0000 7f89f6d9d700 1 --2- 172.21.15.125:0/2945882444 >> v2:172.21.15.130:3300/0 conn(0x7f89f80ca440 0x7f89f8157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:04:35.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.097+0000 7f89f5d9b700 1 --2- 172.21.15.125:0/2945882444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f89f80ceb30 0x7f89f80c9f00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f89f80cf030 tx=0x7f89e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a901b51eba2fb0dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.097+0000 7f89f559a700 1 -- 172.21.15.125:0/2945882444 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e800b860 con 0x7f89f80ceb30 2023-10-06T03:04:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.097+0000 7f89f559a700 1 -- 172.21.15.125:0/2945882444 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e800b9c0 con 0x7f89f80ceb30 2023-10-06T03:04:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.097+0000 7f89f559a700 1 -- 172.21.15.125:0/2945882444 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e800bd60 con 0x7f89f80ceb30 2023-10-06T03:04:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.097+0000 7f89fcea7700 1 -- 172.21.15.125:0/2945882444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f89f80ceb30 msgr2=0x7f89f80c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.097+0000 7f89fcea7700 1 --2- 172.21.15.125:0/2945882444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f89f80ceb30 0x7f89f80c9f00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f89f80cf030 tx=0x7f89e8009250 comp rx=0 tx=0).stop 2023-10-06T03:04:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.097+0000 7f89fcea7700 1 -- 172.21.15.125:0/2945882444 shutdown_connections 2023-10-06T03:04:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.097+0000 7f89fcea7700 1 --2- 172.21.15.125:0/2945882444 >> v2:172.21.15.130:3300/0 conn(0x7f89f80ca440 0x7f89f8157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.097+0000 7f89fcea7700 1 --2- 172.21.15.125:0/2945882444 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89f8157bc0 0x7f89f80ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.097+0000 7f89fcea7700 1 --2- 172.21.15.125:0/2945882444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f89f80ceb30 0x7f89f80c9f00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.097+0000 7f89fcea7700 1 -- 172.21.15.125:0/2945882444 >> 172.21.15.125:0/2945882444 conn(0x7f89f8067df0 msgr2=0x7f89f80cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.098+0000 7f89fcea7700 1 -- 172.21.15.125:0/2945882444 shutdown_connections 2023-10-06T03:04:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.098+0000 7f89fcea7700 1 -- 172.21.15.125:0/2945882444 wait complete. 2023-10-06T03:04:35.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.099+0000 7f89fcea7700 1 Processor -- start 2023-10-06T03:04:35.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.099+0000 7f89fcea7700 1 -- start start 2023-10-06T03:04:35.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.099+0000 7f89fcea7700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89f80ca440 0x7f89f8155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:35.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.099+0000 7f89fcea7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f89f80ceb30 0x7f89f813c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:35.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.099+0000 7f89fcea7700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89f8157bc0 0x7f89f80b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:35.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.099+0000 7f89fcea7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f814f2a0 con 0x7f89f80ceb30 2023-10-06T03:04:35.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.099+0000 7f89fcea7700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f813cac0 con 0x7f89f8157bc0 2023-10-06T03:04:35.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.099+0000 7f89fcea7700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f81565e0 con 0x7f89f80ca440 2023-10-06T03:04:35.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.099+0000 7f89f5d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f89f80ceb30 0x7f89f813c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:35.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.099+0000 7f89f5d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f89f80ceb30 0x7f89f813c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44406/0 (socket says 172.21.15.125:44406) 2023-10-06T03:04:35.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.099+0000 7f89f5d9b700 1 -- 172.21.15.125:0/3091046600 learned_addr learned my addr 172.21.15.125:0/3091046600 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:35.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.099+0000 7f89f659c700 1 --2- 172.21.15.125:0/3091046600 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89f80ca440 0x7f89f8155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:35.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.099+0000 7f89f6d9d700 1 --2- 172.21.15.125:0/3091046600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89f8157bc0 0x7f89f80b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.100+0000 7f89f5d9b700 1 -- 172.21.15.125:0/3091046600 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89f80ca440 msgr2=0x7f89f8155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.100+0000 7f89f5d9b700 1 --2- 172.21.15.125:0/3091046600 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89f80ca440 0x7f89f8155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.100+0000 7f89f5d9b700 1 -- 172.21.15.125:0/3091046600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89f8157bc0 msgr2=0x7f89f80b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.100+0000 7f89f5d9b700 1 --2- 172.21.15.125:0/3091046600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89f8157bc0 0x7f89f80b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.100+0000 7f89f5d9b700 1 -- 172.21.15.125:0/3091046600 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e80094f0 con 0x7f89f80ceb30 2023-10-06T03:04:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.100+0000 7f89f659c700 1 --2- 172.21.15.125:0/3091046600 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89f80ca440 0x7f89f8155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.100+0000 7f89f5d9b700 1 --2- 172.21.15.125:0/3091046600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f89f80ceb30 0x7f89f813c580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f89f806f140 tx=0x7f89e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.100+0000 7f89e67fc700 1 -- 172.21.15.125:0/3091046600 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8011e70 con 0x7f89f80ceb30 2023-10-06T03:04:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.100+0000 7f89e67fc700 1 -- 172.21.15.125:0/3091046600 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e8024440 con 0x7f89f80ceb30 2023-10-06T03:04:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.100+0000 7f89e67fc700 1 -- 172.21.15.125:0/3091046600 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8024800 con 0x7f89f80ceb30 2023-10-06T03:04:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.100+0000 7f89fcea7700 1 -- 172.21.15.125:0/3091046600 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f81568c0 con 0x7f89f80ceb30 2023-10-06T03:04:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.100+0000 7f89fcea7700 1 -- 172.21.15.125:0/3091046600 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f8156e80 con 0x7f89f80ceb30 2023-10-06T03:04:35.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.101+0000 7f89fcea7700 1 -- 172.21.15.125:0/3091046600 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f81571d0 con 0x7f89f80ceb30 2023-10-06T03:04:35.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.101+0000 7f89e67fc700 1 -- 172.21.15.125:0/3091046600 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f89e801a420 con 0x7f89f80ceb30 2023-10-06T03:04:35.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.102+0000 7f89e67fc700 1 --2- 172.21.15.125:0/3091046600 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f89d8066f30 0x7f89d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:35.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.102+0000 7f89e67fc700 1 -- 172.21.15.125:0/3091046600 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f89e8086790 con 0x7f89f80ceb30 2023-10-06T03:04:35.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.102+0000 7f89f659c700 1 --2- 172.21.15.125:0/3091046600 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f89d8066f30 0x7f89d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:35.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.102+0000 7f89f659c700 1 --2- 172.21.15.125:0/3091046600 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f89d8066f30 0x7f89d80693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f89ec006fd0 tx=0x7f89ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:35.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.106+0000 7f89e67fc700 1 -- 172.21.15.125:0/3091046600 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89e80535b0 con 0x7f89f80ceb30 2023-10-06T03:04:35.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.288+0000 7f89fcea7700 1 -- 172.21.15.125:0/3091046600 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89f8066510 con 0x7f89f80ceb30 2023-10-06T03:04:35.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.289+0000 7f89e67fc700 1 -- 172.21.15.125:0/3091046600 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18851 (secure 0 0 0) 0x7f89e8056bd0 con 0x7f89f80ceb30 2023-10-06T03:04:35.290 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:35.290 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:33.645139+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:04:26.828121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:04:28.179225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:04:31.256394+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:04:35.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.291+0000 7f89fcea7700 1 -- 172.21.15.125:0/3091046600 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f89d8066f30 msgr2=0x7f89d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:35.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.291+0000 7f89fcea7700 1 --2- 172.21.15.125:0/3091046600 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f89d8066f30 0x7f89d80693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f89ec006fd0 tx=0x7f89ec008040 comp rx=0 tx=0).stop 2023-10-06T03:04:35.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.291+0000 7f89fcea7700 1 -- 172.21.15.125:0/3091046600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f89f80ceb30 msgr2=0x7f89f813c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:35.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.291+0000 7f89fcea7700 1 --2- 172.21.15.125:0/3091046600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f89f80ceb30 0x7f89f813c580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f89f806f140 tx=0x7f89e8017000 comp rx=0 tx=0).stop 2023-10-06T03:04:35.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.291+0000 7f89fcea7700 1 -- 172.21.15.125:0/3091046600 shutdown_connections 2023-10-06T03:04:35.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.291+0000 7f89fcea7700 1 --2- 172.21.15.125:0/3091046600 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f89d8066f30 0x7f89d80693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.291+0000 7f89fcea7700 1 --2- 172.21.15.125:0/3091046600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f89f8157bc0 0x7f89f80b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.291+0000 7f89fcea7700 1 --2- 172.21.15.125:0/3091046600 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f89f80ca440 0x7f89f8155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.291+0000 7f89fcea7700 1 --2- 172.21.15.125:0/3091046600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f89f80ceb30 0x7f89f813c580 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.291+0000 7f89fcea7700 1 -- 172.21.15.125:0/3091046600 >> 172.21.15.125:0/3091046600 conn(0x7f89f8067df0 msgr2=0x7f89f80ca9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:35.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.292+0000 7f89fcea7700 1 -- 172.21.15.125:0/3091046600 shutdown_connections 2023-10-06T03:04:35.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.292+0000 7f89fcea7700 1 -- 172.21.15.125:0/3091046600 wait complete. 2023-10-06T03:04:35.315 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:04:35.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.432+0000 7f460c989700 1 Processor -- start 2023-10-06T03:04:35.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.432+0000 7f460c989700 1 -- start start 2023-10-06T03:04:35.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.433+0000 7f460c989700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46080ac670 0x7f46080c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:35.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.433+0000 7f460c989700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f460806afd0 0x7f46080c7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:35.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.433+0000 7f460c989700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4608067c70 con 0x7f46081590d0 2023-10-06T03:04:35.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.433+0000 7f460c989700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46080c75c0 con 0x7f460806afd0 2023-10-06T03:04:35.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.433+0000 7f460c989700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4608069110 con 0x7f46080ac670 2023-10-06T03:04:35.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.433+0000 7f4605d9b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46080ac670 0x7f46080c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:35.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.433+0000 7f460659c700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f46081590d0 0x7f460806a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:37508/0 (socket says 172.21.15.125:37508) 2023-10-06T03:04:35.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.433+0000 7f4606d9d700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f460806afd0 0x7f46080c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:35.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.433+0000 7f460659c700 1 -- 172.21.15.125:0/687675135 learned_addr learned my addr 172.21.15.125:0/687675135 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:35.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.433+0000 7f4606d9d700 1 -- 172.21.15.125:0/687675135 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46080ac670 msgr2=0x7f46080c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:35.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.433+0000 7f4606d9d700 1 --2- 172.21.15.125:0/687675135 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46080ac670 0x7f46080c6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.433+0000 7f4606d9d700 1 -- 172.21.15.125:0/687675135 >> v1:172.21.15.130:6789/0 conn(0x7f46081590d0 legacy=0x7f460806a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:35.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.433+0000 7f4606d9d700 1 -- 172.21.15.125:0/687675135 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46080c77e0 con 0x7f460806afd0 2023-10-06T03:04:35.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.433+0000 7f4605d9b700 1 --2- 172.21.15.125:0/687675135 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46080ac670 0x7f46080c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:35.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.433+0000 7f4606d9d700 1 --2- 172.21.15.125:0/687675135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f460806afd0 0x7f46080c7080 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4600009e60 tx=0x7f4600009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=548d1e9e277710ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:35.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.434+0000 7f460559a700 1 -- 172.21.15.125:0/687675135 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460000e070 con 0x7f460806afd0 2023-10-06T03:04:35.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.434+0000 7f460559a700 1 -- 172.21.15.125:0/687675135 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460000bb60 con 0x7f460806afd0 2023-10-06T03:04:35.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.434+0000 7f460559a700 1 -- 172.21.15.125:0/687675135 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4600012430 con 0x7f460806afd0 2023-10-06T03:04:35.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.434+0000 7f460c989700 1 -- 172.21.15.125:0/687675135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f460806afd0 msgr2=0x7f46080c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:35.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.434+0000 7f460c989700 1 --2- 172.21.15.125:0/687675135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f460806afd0 0x7f46080c7080 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4600009e60 tx=0x7f4600009780 comp rx=0 tx=0).stop 2023-10-06T03:04:35.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.434+0000 7f460c989700 1 -- 172.21.15.125:0/687675135 shutdown_connections 2023-10-06T03:04:35.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.434+0000 7f460c989700 1 --2- 172.21.15.125:0/687675135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f460806afd0 0x7f46080c7080 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.434+0000 7f460c989700 1 --2- 172.21.15.125:0/687675135 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46080ac670 0x7f46080c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.434+0000 7f460c989700 1 -- 172.21.15.125:0/687675135 >> 172.21.15.125:0/687675135 conn(0x7f46080cc5a0 msgr2=0x7f46080cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:35.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.434+0000 7f460c989700 1 -- 172.21.15.125:0/687675135 shutdown_connections 2023-10-06T03:04:35.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.434+0000 7f460c989700 1 -- 172.21.15.125:0/687675135 wait complete. 2023-10-06T03:04:35.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.435+0000 7f460c989700 1 Processor -- start 2023-10-06T03:04:35.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.435+0000 7f460c989700 1 -- start start 2023-10-06T03:04:35.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.436+0000 7f460c989700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f460806afd0 0x7f4608155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:35.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.436+0000 7f460c989700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46080ac670 0x7f46080aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:35.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.436+0000 7f460c989700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46081590d0 0x7f46080aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:35.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.436+0000 7f460c989700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46080c3640 con 0x7f46081590d0 2023-10-06T03:04:35.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.436+0000 7f460c989700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46080b1890 con 0x7f460806afd0 2023-10-06T03:04:35.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.436+0000 7f460c989700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46080b1b70 con 0x7f46080ac670 2023-10-06T03:04:35.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.436+0000 7f4606d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46081590d0 0x7f46080aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:35.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.436+0000 7f4606d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46081590d0 0x7f46080aac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53830/0 (socket says 172.21.15.125:53830) 2023-10-06T03:04:35.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.436+0000 7f4606d9d700 1 -- 172.21.15.125:0/3083737836 learned_addr learned my addr 172.21.15.125:0/3083737836 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:35.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.436+0000 7f460659c700 1 --2- 172.21.15.125:0/3083737836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f460806afd0 0x7f4608155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:35.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.436+0000 7f4605d9b700 1 --2- 172.21.15.125:0/3083737836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46080ac670 0x7f46080aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:35.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.436+0000 7f4606d9d700 1 -- 172.21.15.125:0/3083737836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46080ac670 msgr2=0x7f46080aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:35.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.436+0000 7f4606d9d700 1 --2- 172.21.15.125:0/3083737836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46080ac670 0x7f46080aa6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.436+0000 7f4606d9d700 1 -- 172.21.15.125:0/3083737836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f460806afd0 msgr2=0x7f4608155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:35.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.436+0000 7f4606d9d700 1 --2- 172.21.15.125:0/3083737836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f460806afd0 0x7f4608155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.436+0000 7f4606d9d700 1 -- 172.21.15.125:0/3083737836 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45fc009420 con 0x7f46081590d0 2023-10-06T03:04:35.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.437+0000 7f4606d9d700 1 --2- 172.21.15.125:0/3083737836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46081590d0 0x7f46080aac20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4600013000 tx=0x7f4600019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:35.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.437+0000 7f45f67fc700 1 -- 172.21.15.125:0/3083737836 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4600027470 con 0x7f46081590d0 2023-10-06T03:04:35.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.437+0000 7f45f67fc700 1 -- 172.21.15.125:0/3083737836 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4600027610 con 0x7f46081590d0 2023-10-06T03:04:35.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.437+0000 7f460c989700 1 -- 172.21.15.125:0/3083737836 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4600009a20 con 0x7f46081590d0 2023-10-06T03:04:35.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.437+0000 7f45f67fc700 1 -- 172.21.15.125:0/3083737836 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46000279d0 con 0x7f46081590d0 2023-10-06T03:04:35.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.437+0000 7f460c989700 1 -- 172.21.15.125:0/3083737836 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46080b2130 con 0x7f46081590d0 2023-10-06T03:04:35.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.438+0000 7f460c989700 1 -- 172.21.15.125:0/3083737836 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46080c37f0 con 0x7f46081590d0 2023-10-06T03:04:35.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.438+0000 7f45f67fc700 1 -- 172.21.15.125:0/3083737836 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4600024070 con 0x7f46081590d0 2023-10-06T03:04:35.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.438+0000 7f45f67fc700 1 --2- 172.21.15.125:0/3083737836 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f45e8066f30 0x7f45e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:35.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.438+0000 7f45f67fc700 1 -- 172.21.15.125:0/3083737836 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4600087440 con 0x7f46081590d0 2023-10-06T03:04:35.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.439+0000 7f460659c700 1 --2- 172.21.15.125:0/3083737836 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f45e8066f30 0x7f45e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:35.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.439+0000 7f460659c700 1 --2- 172.21.15.125:0/3083737836 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f45e8066f30 0x7f45e80693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f45f80017a0 tx=0x7f45f8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:35.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.443+0000 7f45f67fc700 1 -- 172.21.15.125:0/3083737836 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46080c37f0 con 0x7f46081590d0 2023-10-06T03:04:35.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.663+0000 7f460c989700 1 -- 172.21.15.125:0/3083737836 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4608066510 con 0x7f46081590d0 2023-10-06T03:04:35.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.663+0000 7f45f67fc700 1 -- 172.21.15.125:0/3083737836 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f4600054260 con 0x7f46081590d0 2023-10-06T03:04:35.664 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:35.664 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/1260071130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1260071130},{"type":"v1","addr":"172.21.15.130:6834","nonce":1260071130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/63925154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":63925154},{"type":"v1","addr":"172.21.15.125:6836","nonce":63925154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/1057811891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1057811891},{"type":"v1","addr":"172.21.15.125:6837","nonce":1057811891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:04:29.211664+0000","modified":"2023-10-06T03:04:34.254253+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/4004582354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":4004582354},{"type":"v1","addr":"172.21.15.130:6835","nonce":4004582354}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2023-10-06T03:04:35.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.666+0000 7f460c989700 1 -- 172.21.15.125:0/3083737836 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f45e8066f30 msgr2=0x7f45e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:35.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.666+0000 7f460c989700 1 --2- 172.21.15.125:0/3083737836 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f45e8066f30 0x7f45e80693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f45f80017a0 tx=0x7f45f8009040 comp rx=0 tx=0).stop 2023-10-06T03:04:35.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.666+0000 7f460c989700 1 -- 172.21.15.125:0/3083737836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46081590d0 msgr2=0x7f46080aac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:35.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.666+0000 7f460c989700 1 --2- 172.21.15.125:0/3083737836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46081590d0 0x7f46080aac20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f4600013000 tx=0x7f4600019000 comp rx=0 tx=0).stop 2023-10-06T03:04:35.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.666+0000 7f460c989700 1 -- 172.21.15.125:0/3083737836 shutdown_connections 2023-10-06T03:04:35.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.666+0000 7f460c989700 1 --2- 172.21.15.125:0/3083737836 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f45e8066f30 0x7f45e80693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.666+0000 7f460c989700 1 --2- 172.21.15.125:0/3083737836 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46081590d0 0x7f46080aac20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.666+0000 7f460c989700 1 --2- 172.21.15.125:0/3083737836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f460806afd0 0x7f4608155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.666+0000 7f460c989700 1 --2- 172.21.15.125:0/3083737836 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46080ac670 0x7f46080aa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.666+0000 7f460c989700 1 -- 172.21.15.125:0/3083737836 >> 172.21.15.125:0/3083737836 conn(0x7f46080cc5a0 msgr2=0x7f46081560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:35.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.666+0000 7f460c989700 1 -- 172.21.15.125:0/3083737836 shutdown_connections 2023-10-06T03:04:35.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.666+0000 7f460c989700 1 -- 172.21.15.125:0/3083737836 wait complete. 2023-10-06T03:04:35.668 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 7 2023-10-06T03:04:35.678 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:04:35.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.794+0000 7ff93f0a8700 1 Processor -- start 2023-10-06T03:04:35.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.795+0000 7ff93f0a8700 1 -- start start 2023-10-06T03:04:35.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.795+0000 7ff93f0a8700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9380ac670 0x7ff938158c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:35.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.795+0000 7ff93f0a8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff9380c7250 0x7ff938159190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:35.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.795+0000 7ff93f0a8700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff938067c70 con 0x7ff93806ab10 2023-10-06T03:04:35.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.795+0000 7ff93f0a8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff938069110 con 0x7ff9380c7250 2023-10-06T03:04:35.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.795+0000 7ff93f0a8700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9381596d0 con 0x7ff9380ac670 2023-10-06T03:04:35.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.795+0000 7ff93d645700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff9380c7250 0x7ff938159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:35.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.795+0000 7ff93d645700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff9380c7250 0x7ff938159190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53832/0 (socket says 172.21.15.125:53832) 2023-10-06T03:04:35.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.795+0000 7ff93d645700 1 -- 172.21.15.125:0/4024472705 learned_addr learned my addr 172.21.15.125:0/4024472705 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:35.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.796+0000 7ff937fff700 1 --2- 172.21.15.125:0/4024472705 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9380ac670 0x7ff938158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:35.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.796+0000 7ff93d645700 1 -- 172.21.15.125:0/4024472705 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9380ac670 msgr2=0x7ff938158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:35.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.796+0000 7ff93d645700 1 --2- 172.21.15.125:0/4024472705 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9380ac670 0x7ff938158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.796+0000 7ff93d645700 1 -- 172.21.15.125:0/4024472705 >> v1:172.21.15.130:6789/0 conn(0x7ff93806ab10 legacy=0x7ff9380c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:35.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.796+0000 7ff93d645700 1 -- 172.21.15.125:0/4024472705 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9380c7800 con 0x7ff9380c7250 2023-10-06T03:04:35.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.796+0000 7ff937fff700 1 --2- 172.21.15.125:0/4024472705 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9380ac670 0x7ff938158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:04:35.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.796+0000 7ff93d645700 1 --2- 172.21.15.125:0/4024472705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9380c7250 0x7ff938159190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff930009f20 tx=0x7ff930009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b5063af68450d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:35.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.796+0000 7ff9377fe700 1 -- 172.21.15.125:0/4024472705 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93000e070 con 0x7ff9380c7250 2023-10-06T03:04:35.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.796+0000 7ff9377fe700 1 -- 172.21.15.125:0/4024472705 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93000ba40 con 0x7ff9380c7250 2023-10-06T03:04:35.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.796+0000 7ff9377fe700 1 -- 172.21.15.125:0/4024472705 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9300092e0 con 0x7ff9380c7250 2023-10-06T03:04:35.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.796+0000 7ff93f0a8700 1 -- 172.21.15.125:0/4024472705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9380c7250 msgr2=0x7ff938159190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:35.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.796+0000 7ff93f0a8700 1 --2- 172.21.15.125:0/4024472705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9380c7250 0x7ff938159190 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff930009f20 tx=0x7ff930009840 comp rx=0 tx=0).stop 2023-10-06T03:04:35.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.797+0000 7ff93f0a8700 1 -- 172.21.15.125:0/4024472705 shutdown_connections 2023-10-06T03:04:35.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.797+0000 7ff93f0a8700 1 --2- 172.21.15.125:0/4024472705 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff9380c7250 0x7ff938159190 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.797+0000 7ff93f0a8700 1 --2- 172.21.15.125:0/4024472705 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9380ac670 0x7ff938158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.797+0000 7ff93f0a8700 1 -- 172.21.15.125:0/4024472705 >> 172.21.15.125:0/4024472705 conn(0x7ff9380cc5a0 msgr2=0x7ff9380cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:35.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.797+0000 7ff93f0a8700 1 -- 172.21.15.125:0/4024472705 shutdown_connections 2023-10-06T03:04:35.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.797+0000 7ff93f0a8700 1 -- 172.21.15.125:0/4024472705 wait complete. 2023-10-06T03:04:35.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.798+0000 7ff93f0a8700 1 Processor -- start 2023-10-06T03:04:35.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.798+0000 7ff93f0a8700 1 -- start start 2023-10-06T03:04:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff93f0a8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff93806ab10 0x7ff9380afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff93f0a8700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9380ac670 0x7ff938153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff93f0a8700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9380c7250 0x7ff9380c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff93f0a8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff938154110 con 0x7ff93806ab10 2023-10-06T03:04:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff93f0a8700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff938154fb0 con 0x7ff9380c7250 2023-10-06T03:04:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff93f0a8700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9380aa380 con 0x7ff9380ac670 2023-10-06T03:04:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff93ce44700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff93806ab10 0x7ff9380afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff93ce44700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff93806ab10 0x7ff9380afd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53846/0 (socket says 172.21.15.125:53846) 2023-10-06T03:04:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff93ce44700 1 -- 172.21.15.125:0/479082673 learned_addr learned my addr 172.21.15.125:0/479082673 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff937fff700 1 --2- 172.21.15.125:0/479082673 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9380ac670 0x7ff938153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:35.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff93d645700 1 --2- 172.21.15.125:0/479082673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9380c7250 0x7ff9380c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:35.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff93ce44700 1 -- 172.21.15.125:0/479082673 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9380ac670 msgr2=0x7ff938153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:35.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff93ce44700 1 --2- 172.21.15.125:0/479082673 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9380ac670 0x7ff938153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff93ce44700 1 -- 172.21.15.125:0/479082673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9380c7250 msgr2=0x7ff9380c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:35.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff93ce44700 1 --2- 172.21.15.125:0/479082673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9380c7250 0x7ff9380c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff93ce44700 1 -- 172.21.15.125:0/479082673 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff930009ae0 con 0x7ff93806ab10 2023-10-06T03:04:35.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff93ce44700 1 --2- 172.21.15.125:0/479082673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff93806ab10 0x7ff9380afd00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00c5d0 tx=0x7ff92c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:35.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff934ff9700 1 -- 172.21.15.125:0/479082673 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c011590 con 0x7ff93806ab10 2023-10-06T03:04:35.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff934ff9700 1 -- 172.21.15.125:0/479082673 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c011710 con 0x7ff93806ab10 2023-10-06T03:04:35.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff93f0a8700 1 -- 172.21.15.125:0/479082673 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9380aa660 con 0x7ff93806ab10 2023-10-06T03:04:35.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff934ff9700 1 -- 172.21.15.125:0/479082673 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c011ad0 con 0x7ff93806ab10 2023-10-06T03:04:35.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.799+0000 7ff93f0a8700 1 -- 172.21.15.125:0/479082673 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9380aac20 con 0x7ff93806ab10 2023-10-06T03:04:35.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.800+0000 7ff93f0a8700 1 -- 172.21.15.125:0/479082673 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff938066510 con 0x7ff93806ab10 2023-10-06T03:04:35.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.801+0000 7ff934ff9700 1 -- 172.21.15.125:0/479082673 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff92c01c460 con 0x7ff93806ab10 2023-10-06T03:04:35.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.801+0000 7ff934ff9700 1 --2- 172.21.15.125:0/479082673 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff91c066f30 0x7ff91c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:35.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.801+0000 7ff934ff9700 1 -- 172.21.15.125:0/479082673 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff92c084600 con 0x7ff93806ab10 2023-10-06T03:04:35.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.801+0000 7ff937fff700 1 --2- 172.21.15.125:0/479082673 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff91c066f30 0x7ff91c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:35.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.801+0000 7ff937fff700 1 --2- 172.21.15.125:0/479082673 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff91c066f30 0x7ff91c0693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff9380b18a0 tx=0x7ff924006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:35.805 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.805+0000 7ff934ff9700 1 -- 172.21.15.125:0/479082673 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff92c051420 con 0x7ff93806ab10 2023-10-06T03:04:35.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.988+0000 7ff93f0a8700 1 -- 172.21.15.125:0/479082673 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9380c7ae0 con 0x7ff93806ab10 2023-10-06T03:04:35.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.989+0000 7ff934ff9700 1 -- 172.21.15.125:0/479082673 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18851 (secure 0 0 0) 0x7ff92c054a40 con 0x7ff93806ab10 2023-10-06T03:04:35.990 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:35.990 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:33.645139+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:04:26.828121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:04:28.179225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:04:31.256394+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:04:35.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.991+0000 7ff93f0a8700 1 -- 172.21.15.125:0/479082673 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff91c066f30 msgr2=0x7ff91c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.991+0000 7ff93f0a8700 1 --2- 172.21.15.125:0/479082673 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff91c066f30 0x7ff91c0693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff9380b18a0 tx=0x7ff924006f90 comp rx=0 tx=0).stop 2023-10-06T03:04:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.991+0000 7ff93f0a8700 1 -- 172.21.15.125:0/479082673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff93806ab10 msgr2=0x7ff9380afd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.991+0000 7ff93f0a8700 1 --2- 172.21.15.125:0/479082673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff93806ab10 0x7ff9380afd00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff92c00c5d0 tx=0x7ff92c007f60 comp rx=0 tx=0).stop 2023-10-06T03:04:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.991+0000 7ff93f0a8700 1 -- 172.21.15.125:0/479082673 shutdown_connections 2023-10-06T03:04:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.991+0000 7ff93f0a8700 1 --2- 172.21.15.125:0/479082673 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff91c066f30 0x7ff91c0693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.991+0000 7ff93f0a8700 1 --2- 172.21.15.125:0/479082673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9380c7250 0x7ff9380c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.991+0000 7ff93f0a8700 1 --2- 172.21.15.125:0/479082673 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff93806ab10 0x7ff9380afd00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.991+0000 7ff93f0a8700 1 --2- 172.21.15.125:0/479082673 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff9380ac670 0x7ff938153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.991+0000 7ff93f0a8700 1 -- 172.21.15.125:0/479082673 >> 172.21.15.125:0/479082673 conn(0x7ff9380cc5a0 msgr2=0x7ff9380cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.991+0000 7ff93f0a8700 1 -- 172.21.15.125:0/479082673 shutdown_connections 2023-10-06T03:04:35.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:35.991+0000 7ff93f0a8700 1 -- 172.21.15.125:0/479082673 wait complete. 2023-10-06T03:04:36.405 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:04:29.211664+0000', 'modified': '2023-10-06T03:04:34.254253+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4269': {'gid': 4269, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.130:6835/4004582354', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6833', 'nonce': 4004582354}, {'type': 'v1', 'addr': '172.21.15.130:6835', 'nonce': 4004582354}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 1} 2023-10-06T03:04:36.405 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:04:36.405 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T03:04:36.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.525+0000 7fd4c3356700 1 Processor -- start 2023-10-06T03:04:36.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.526+0000 7fd4c3356700 1 -- start start 2023-10-06T03:04:36.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.526+0000 7fd4c3356700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd4bc159780 0x7fd4bc068c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.526+0000 7fd4c3356700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd4bc0b02d0 0x7fd4bc0c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.526+0000 7fd4c3356700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc0c9e70 con 0x7fd4bc159b50 2023-10-06T03:04:36.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.526+0000 7fd4c3356700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc0c6fe0 con 0x7fd4bc0b02d0 2023-10-06T03:04:36.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.526+0000 7fd4c3356700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc0ca0b0 con 0x7fd4bc159780 2023-10-06T03:04:36.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.526+0000 7fd4c18f3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd4bc0b02d0 0x7fd4bc0c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.526+0000 7fd4c08f1700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd4bc159b50 0x7fd4bc0c9220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58004/0 (socket says 172.21.15.125:58004) 2023-10-06T03:04:36.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.526+0000 7fd4c08f1700 1 -- 172.21.15.125:0/204482990 learned_addr learned my addr 172.21.15.125:0/204482990 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:36.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.527+0000 7fd4c10f2700 1 --2- 172.21.15.125:0/204482990 >> v2:172.21.15.130:3300/0 conn(0x7fd4bc159780 0x7fd4bc068c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.527+0000 7fd4c18f3700 1 -- 172.21.15.125:0/204482990 >> v2:172.21.15.130:3300/0 conn(0x7fd4bc159780 msgr2=0x7fd4bc068c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:36.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.527+0000 7fd4c18f3700 1 --2- 172.21.15.125:0/204482990 >> v2:172.21.15.130:3300/0 conn(0x7fd4bc159780 0x7fd4bc068c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.527+0000 7fd4c18f3700 1 -- 172.21.15.125:0/204482990 >> v1:172.21.15.125:6789/0 conn(0x7fd4bc159b50 legacy=0x7fd4bc0c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:36.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.527+0000 7fd4c18f3700 1 -- 172.21.15.125:0/204482990 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc068020 con 0x7fd4bc0b02d0 2023-10-06T03:04:36.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.527+0000 7fd4b3fff700 1 -- 172.21.15.125:0/204482990 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297992148 0 0) 0x7fd4b8001110 con 0x7fd4bc159b50 2023-10-06T03:04:36.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.527+0000 7fd4c18f3700 1 --2- 172.21.15.125:0/204482990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4bc0b02d0 0x7fd4bc0c9930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc06fd90 tx=0x7fd4b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922dc377ac430887 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:36.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.527+0000 7fd4b3fff700 1 -- 172.21.15.125:0/204482990 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b400e070 con 0x7fd4bc0b02d0 2023-10-06T03:04:36.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.527+0000 7fd4b3fff700 1 -- 172.21.15.125:0/204482990 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b400bcc0 con 0x7fd4bc0b02d0 2023-10-06T03:04:36.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.527+0000 7fd4b3fff700 1 -- 172.21.15.125:0/204482990 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4012680 con 0x7fd4bc0b02d0 2023-10-06T03:04:36.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.528+0000 7fd4c3356700 1 -- 172.21.15.125:0/204482990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4bc0b02d0 msgr2=0x7fd4bc0c9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:36.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.528+0000 7fd4c3356700 1 --2- 172.21.15.125:0/204482990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4bc0b02d0 0x7fd4bc0c9930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc06fd90 tx=0x7fd4b4009780 comp rx=0 tx=0).stop 2023-10-06T03:04:36.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.528+0000 7fd4c3356700 1 -- 172.21.15.125:0/204482990 shutdown_connections 2023-10-06T03:04:36.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.528+0000 7fd4c3356700 1 --2- 172.21.15.125:0/204482990 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4bc0b02d0 0x7fd4bc0c9930 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.528+0000 7fd4c3356700 1 --2- 172.21.15.125:0/204482990 >> v2:172.21.15.130:3300/0 conn(0x7fd4bc159780 0x7fd4bc068c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.528+0000 7fd4c3356700 1 -- 172.21.15.125:0/204482990 >> 172.21.15.125:0/204482990 conn(0x7fd4bc0af730 msgr2=0x7fd4bc0afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:36.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.528+0000 7fd4c3356700 1 -- 172.21.15.125:0/204482990 shutdown_connections 2023-10-06T03:04:36.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.528+0000 7fd4c3356700 1 -- 172.21.15.125:0/204482990 wait complete. 2023-10-06T03:04:36.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.529+0000 7fd4c3356700 1 Processor -- start 2023-10-06T03:04:36.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.529+0000 7fd4c3356700 1 -- start start 2023-10-06T03:04:36.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.530+0000 7fd4c3356700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd4bc0b02d0 0x7fd4bc166900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.530+0000 7fd4c3356700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4bc159780 0x7fd4bc168c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.530+0000 7fd4c3356700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4bc159b50 0x7fd4bc06bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.530+0000 7fd4c3356700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc0c4810 con 0x7fd4bc159780 2023-10-06T03:04:36.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.530+0000 7fd4c3356700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc166e40 con 0x7fd4bc159b50 2023-10-06T03:04:36.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.530+0000 7fd4c3356700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc0c3920 con 0x7fd4bc0b02d0 2023-10-06T03:04:36.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.530+0000 7fd4c08f1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4bc159780 0x7fd4bc168c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.530+0000 7fd4c08f1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4bc159780 0x7fd4bc168c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53852/0 (socket says 172.21.15.125:53852) 2023-10-06T03:04:36.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.530+0000 7fd4c08f1700 1 -- 172.21.15.125:0/2214362975 learned_addr learned my addr 172.21.15.125:0/2214362975 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:36.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.531+0000 7fd4c10f2700 1 --2- 172.21.15.125:0/2214362975 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd4bc0b02d0 0x7fd4bc166900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.531+0000 7fd4c18f3700 1 --2- 172.21.15.125:0/2214362975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4bc159b50 0x7fd4bc06bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.531+0000 7fd4c08f1700 1 -- 172.21.15.125:0/2214362975 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd4bc0b02d0 msgr2=0x7fd4bc166900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:36.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.531+0000 7fd4c08f1700 1 --2- 172.21.15.125:0/2214362975 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd4bc0b02d0 0x7fd4bc166900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.531+0000 7fd4c08f1700 1 -- 172.21.15.125:0/2214362975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4bc159b50 msgr2=0x7fd4bc06bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:36.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.531+0000 7fd4c08f1700 1 --2- 172.21.15.125:0/2214362975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4bc159b50 0x7fd4bc06bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.531+0000 7fd4c08f1700 1 -- 172.21.15.125:0/2214362975 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b4009a20 con 0x7fd4bc159780 2023-10-06T03:04:36.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.531+0000 7fd4c18f3700 1 --2- 172.21.15.125:0/2214362975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4bc159b50 0x7fd4bc06bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:36.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.531+0000 7fd4c08f1700 1 --2- 172.21.15.125:0/2214362975 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4bc159780 0x7fd4bc168c80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800c810 tx=0x7fd4b8007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:36.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.531+0000 7fd4b17fa700 1 -- 172.21.15.125:0/2214362975 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8005b30 con 0x7fd4bc159780 2023-10-06T03:04:36.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.531+0000 7fd4b17fa700 1 -- 172.21.15.125:0/2214362975 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b8005c90 con 0x7fd4bc159780 2023-10-06T03:04:36.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.531+0000 7fd4b17fa700 1 -- 172.21.15.125:0/2214362975 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8007300 con 0x7fd4bc159780 2023-10-06T03:04:36.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.531+0000 7fd4c3356700 1 -- 172.21.15.125:0/2214362975 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4bc0c3c00 con 0x7fd4bc159780 2023-10-06T03:04:36.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.531+0000 7fd4c3356700 1 -- 172.21.15.125:0/2214362975 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4bc0c41c0 con 0x7fd4bc159780 2023-10-06T03:04:36.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.533+0000 7fd4b17fa700 1 -- 172.21.15.125:0/2214362975 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4b80076f0 con 0x7fd4bc159780 2023-10-06T03:04:36.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.533+0000 7fd4b17fa700 1 --2- 172.21.15.125:0/2214362975 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd4a0066f30 0x7fd4a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.533+0000 7fd4b17fa700 1 -- 172.21.15.125:0/2214362975 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd4b8084390 con 0x7fd4bc159780 2023-10-06T03:04:36.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.533+0000 7fd4c10f2700 1 --2- 172.21.15.125:0/2214362975 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd4a0066f30 0x7fd4a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.533+0000 7fd4c10f2700 1 --2- 172.21.15.125:0/2214362975 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd4a0066f30 0x7fd4a00693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac006aa0 tx=0x7fd4ac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:36.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.535+0000 7fd4cc66ab80 1 Processor -- start 2023-10-06T03:04:36.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.535+0000 7fd4cc66ab80 1 -- start start 2023-10-06T03:04:36.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.535+0000 7fd4cc66ab80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf0be80 0x559c9bf0c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.535+0000 7fd4cc66ab80 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559c9bf08e80 0x559c9bf05110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.535+0000 7fd4cc66ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bedf5b0 0x559c9bf05650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.535+0000 7fd4cc66ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c9bdf6310 con 0x559c9bedf5b0 2023-10-06T03:04:36.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.535+0000 7fd4cc66ab80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c9be33130 con 0x559c9bf0be80 2023-10-06T03:04:36.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.535+0000 7fd4cc66ab80 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c9be30af0 con 0x559c9bf08e80 2023-10-06T03:04:36.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.535+0000 7fd4c18f3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bedf5b0 0x559c9bf05650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.536+0000 7fd4c18f3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bedf5b0 0x559c9bf05650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53862/0 (socket says 172.21.15.125:53862) 2023-10-06T03:04:36.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.536+0000 7fd4c18f3700 1 -- 172.21.15.125:0/4211303011 learned_addr learned my addr 172.21.15.125:0/4211303011 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:36.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.536+0000 7fd4c10f2700 1 --2- 172.21.15.125:0/4211303011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf0be80 0x559c9bf0c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.536+0000 7fd4c08f1700 1 --2- 172.21.15.125:0/4211303011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559c9bf08e80 0x559c9bf05110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.536+0000 7fd4c18f3700 1 -- 172.21.15.125:0/4211303011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559c9bf08e80 msgr2=0x559c9bf05110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.536+0000 7fd4c18f3700 1 --2- 172.21.15.125:0/4211303011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559c9bf08e80 0x559c9bf05110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.536+0000 7fd4c18f3700 1 -- 172.21.15.125:0/4211303011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf0be80 msgr2=0x559c9bf0c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.536+0000 7fd4c18f3700 1 --2- 172.21.15.125:0/4211303011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf0be80 0x559c9bf0c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.536+0000 7fd4c18f3700 1 -- 172.21.15.125:0/4211303011 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c9bc32790 con 0x559c9bedf5b0 2023-10-06T03:04:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.536+0000 7fd4c10f2700 1 --2- 172.21.15.125:0/4211303011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf0be80 0x559c9bf0c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.536+0000 7fd4c18f3700 1 --2- 172.21.15.125:0/4211303011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bedf5b0 0x559c9bf05650 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc06d820 tx=0x7fd4b4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551b4cd812381c55 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.536+0000 7fd4a67fc700 1 -- 172.21.15.125:0/4211303011 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4012430 con 0x559c9bedf5b0 2023-10-06T03:04:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.536+0000 7fd4a67fc700 1 -- 172.21.15.125:0/4211303011 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b4012590 con 0x559c9bedf5b0 2023-10-06T03:04:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.536+0000 7fd4a67fc700 1 -- 172.21.15.125:0/4211303011 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4012c50 con 0x559c9bedf5b0 2023-10-06T03:04:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.537+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/4211303011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bedf5b0 msgr2=0x559c9bf05650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:36.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.537+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/4211303011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bedf5b0 0x559c9bf05650 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc06d820 tx=0x7fd4b4019000 comp rx=0 tx=0).stop 2023-10-06T03:04:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.537+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/4211303011 shutdown_connections 2023-10-06T03:04:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.537+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/4211303011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bedf5b0 0x559c9bf05650 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.537+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/4211303011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf0be80 0x559c9bf0c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.537+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/4211303011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559c9bf08e80 0x559c9bf05110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.537+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/4211303011 >> 172.21.15.125:0/4211303011 conn(0x559c9bf26890 msgr2=0x559c9bf26c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.537+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/4211303011 shutdown_connections 2023-10-06T03:04:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.537+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/4211303011 wait complete. 2023-10-06T03:04:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.537+0000 7fd4cc66ab80 1 -- start start 2023-10-06T03:04:36.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.538+0000 7fd4cc66ab80 1 Processor -- start 2023-10-06T03:04:36.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.538+0000 7fd4cc66ab80 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559c9bedf5b0 0x559c9bef7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.538+0000 7fd4cc66ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bf08e80 0x559c9bf0a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.538+0000 7fd4cc66ab80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf0be80 0x559c9bf0d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.538+0000 7fd4cc66ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c9be2c8e0 con 0x559c9bf08e80 2023-10-06T03:04:36.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.538+0000 7fd4cc66ab80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c9bdd8980 con 0x559c9bf0be80 2023-10-06T03:04:36.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.538+0000 7fd4cc66ab80 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c9bdd8620 con 0x559c9bedf5b0 2023-10-06T03:04:36.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.538+0000 7fd4cc66ab80 10 client.0 _ll_register_callbacks cb 0x559c9bc3ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:04:36.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.538+0000 7fd4c08f1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bf08e80 0x559c9bf0a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.538+0000 7fd4c08f1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bf08e80 0x559c9bf0a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53878/0 (socket says 172.21.15.125:53878) 2023-10-06T03:04:36.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.538+0000 7fd4c08f1700 1 -- 172.21.15.125:0/3098230455 learned_addr learned my addr 172.21.15.125:0/3098230455 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:36.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd4c10f2700 1 --2- 172.21.15.125:0/3098230455 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559c9bedf5b0 0x559c9bef7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd4c18f3700 1 --2- 172.21.15.125:0/3098230455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf0be80 0x559c9bf0d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd4c08f1700 1 -- 172.21.15.125:0/3098230455 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559c9bedf5b0 msgr2=0x559c9bef7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:36.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd4c08f1700 1 --2- 172.21.15.125:0/3098230455 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559c9bedf5b0 0x559c9bef7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd4c08f1700 1 -- 172.21.15.125:0/3098230455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf0be80 msgr2=0x559c9bf0d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:36.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd4c08f1700 1 --2- 172.21.15.125:0/3098230455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf0be80 0x559c9bf0d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd4c08f1700 1 -- 172.21.15.125:0/3098230455 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4bc068020 con 0x559c9bf08e80 2023-10-06T03:04:36.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd4c08f1700 1 --2- 172.21.15.125:0/3098230455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bf08e80 0x559c9bf0a210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8054e00 tx=0x7fd4b8014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34963d3e14c52729 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:36.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd49b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-06T03:04:36.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd49b7fe700 1 -- 172.21.15.125:0/3098230455 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8005e00 con 0x559c9bf08e80 2023-10-06T03:04:36.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd49b7fe700 1 -- 172.21.15.125:0/3098230455 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd4b806b210 con 0x559c9bf08e80 2023-10-06T03:04:36.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/3098230455 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c9bed0e50 con 0x559c9bf08e80 2023-10-06T03:04:36.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd49b7fe700 1 -- 172.21.15.125:0/3098230455 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4b8082170 con 0x559c9bf08e80 2023-10-06T03:04:36.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd4cc66ab80 10 client.4419 fetch_fsmap learned FSMap version 7 2023-10-06T03:04:36.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/3098230455 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x559c9bd1f0a0 con 0x559c9bf08e80 2023-10-06T03:04:36.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd49b7fe700 1 -- 172.21.15.125:0/3098230455 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b8060080 con 0x559c9bf08e80 2023-10-06T03:04:36.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd49b7fe700 1 -- 172.21.15.125:0/3098230455 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fd4b80550d0 con 0x559c9bf08e80 2023-10-06T03:04:36.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd4cc66ab80 10 client.4419 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T03:04:36.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd4cc66ab80 10 client.4419 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:04:36.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd4cc66ab80 20 client.4419 populate_metadata read hostname 'smithi125' 2023-10-06T03:04:36.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/3098230455 >> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] conn(0x559c9bf38540 0x559c9bf38910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd4cc66ab80 4 client.4419 mds_command: new command op to 4269 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:04:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.539+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/3098230455 --> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559c9beadc20 con 0x559c9bf38540 2023-10-06T03:04:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.540+0000 7fd4c10f2700 1 --2- 172.21.15.125:0/3098230455 >> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] conn(0x559c9bf38540 0x559c9bf38910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.540+0000 7fd49b7fe700 10 client.4419 ms_handle_connect on v2:172.21.15.130:6833/4004582354 2023-10-06T03:04:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.540+0000 7fd4c10f2700 1 --2- 172.21.15.125:0/3098230455 >> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] conn(0x559c9bf38540 0x559c9bf38910 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e87f8b1d79120fa6 server_cookie=b100c8c110f78d8a in_seq=0 out_seq=0 2023-10-06T03:04:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.541+0000 7fd49b7fe700 1 -- 172.21.15.125:0/3098230455 <== mds.0 v2:172.21.15.130:6833/4004582354 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x559c9beadc20 con 0x559c9bf38540 2023-10-06T03:04:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.541+0000 7fd49b7fe700 10 client.4419 handle_command_reply: tid=0 2023-10-06T03:04:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.541+0000 7fd4cc66ab80 1 client.4419 shutdown 2023-10-06T03:04:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.541+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/3098230455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bf08e80 msgr2=0x559c9bf0a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.541+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/3098230455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bf08e80 0x559c9bf0a210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8054e00 tx=0x7fd4b8014040 comp rx=0 tx=0).stop 2023-10-06T03:04:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.541+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/3098230455 shutdown_connections 2023-10-06T03:04:36.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.541+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/3098230455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf0be80 0x559c9bf0d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.541+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/3098230455 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559c9bedf5b0 0x559c9bef7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.541+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/3098230455 >> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] conn(0x559c9bf38540 0x559c9bf38910 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.541+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/3098230455 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bf08e80 0x559c9bf0a210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.541+0000 7fd49b7fe700 0 client.4419 ms_handle_reset on v2:172.21.15.130:6833/4004582354 2023-10-06T03:04:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.541+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/3098230455 >> 172.21.15.125:0/3098230455 conn(0x559c9bf26890 msgr2=0x559c9bf08590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.541+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/3098230455 shutdown_connections 2023-10-06T03:04:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.541+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/3098230455 wait complete. 2023-10-06T03:04:36.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.541+0000 7fd4cc66ab80 20 client.4419 trim_cache size 0 max 16384 2023-10-06T03:04:36.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.558+0000 7fd4cc66ab80 1 Processor -- start 2023-10-06T03:04:36.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.558+0000 7fd4cc66ab80 1 -- start start 2023-10-06T03:04:36.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.558+0000 7fd4cc66ab80 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559c9bedf5b0 0x559c9bed29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.558+0000 7fd4cc66ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bf08e80 0x559c9bf36ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.558+0000 7fd4cc66ab80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf0be80 0x559c9bf37220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.558+0000 7fd4cc66ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c9bcc41e0 con 0x559c9bf08e80 2023-10-06T03:04:36.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.558+0000 7fd4cc66ab80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c9bedfb20 con 0x559c9bf0be80 2023-10-06T03:04:36.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.558+0000 7fd4cc66ab80 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c9bf092f0 con 0x559c9bedf5b0 2023-10-06T03:04:36.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.558+0000 7fd4c08f1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bf08e80 0x559c9bf36ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.558+0000 7fd4c08f1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bf08e80 0x559c9bf36ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53880/0 (socket says 172.21.15.125:53880) 2023-10-06T03:04:36.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.558+0000 7fd4c08f1700 1 -- 172.21.15.125:0/4118709200 learned_addr learned my addr 172.21.15.125:0/4118709200 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:36.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.559+0000 7fd4c08f1700 1 -- 172.21.15.125:0/4118709200 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559c9bedf5b0 msgr2=0x559c9bed29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:36.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.559+0000 7fd4c18f3700 1 --2- 172.21.15.125:0/4118709200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf0be80 0x559c9bf37220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.559+0000 7fd4c08f1700 1 --2- 172.21.15.125:0/4118709200 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559c9bedf5b0 0x559c9bed29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.559+0000 7fd4c08f1700 1 -- 172.21.15.125:0/4118709200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf0be80 msgr2=0x559c9bf37220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:36.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.559+0000 7fd4c08f1700 1 --2- 172.21.15.125:0/4118709200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf0be80 0x559c9bf37220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.559+0000 7fd4c08f1700 1 -- 172.21.15.125:0/4118709200 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c9bdfb3c0 con 0x559c9bf08e80 2023-10-06T03:04:36.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.559+0000 7fd4c08f1700 1 --2- 172.21.15.125:0/4118709200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bf08e80 0x559c9bf36ce0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8051370 tx=0x7fd4b8068000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4605886114ce63 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:36.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.559+0000 7fd4a6ffd700 1 -- 172.21.15.125:0/4118709200 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8005e00 con 0x559c9bf08e80 2023-10-06T03:04:36.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.559+0000 7fd4a6ffd700 1 -- 172.21.15.125:0/4118709200 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b8060070 con 0x559c9bf08e80 2023-10-06T03:04:36.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.559+0000 7fd4a6ffd700 1 -- 172.21.15.125:0/4118709200 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b805be90 con 0x559c9bf08e80 2023-10-06T03:04:36.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.559+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/4118709200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bf08e80 msgr2=0x559c9bf36ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:36.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.559+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/4118709200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bf08e80 0x559c9bf36ce0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8051370 tx=0x7fd4b8068000 comp rx=0 tx=0).stop 2023-10-06T03:04:36.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.560+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/4118709200 shutdown_connections 2023-10-06T03:04:36.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.560+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/4118709200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf0be80 0x559c9bf37220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.560+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/4118709200 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559c9bedf5b0 0x559c9bed29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.560+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/4118709200 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bf08e80 0x559c9bf36ce0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.560+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/4118709200 >> 172.21.15.125:0/4118709200 conn(0x559c9bf26890 msgr2=0x559c9bf0b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:36.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.560+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/4118709200 shutdown_connections 2023-10-06T03:04:36.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.560+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/4118709200 wait complete. 2023-10-06T03:04:36.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.560+0000 7fd4cc66ab80 1 -- start start 2023-10-06T03:04:36.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.560+0000 7fd4cc66ab80 1 Processor -- start 2023-10-06T03:04:36.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.561+0000 7fd4cc66ab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bedf5b0 0x559c9bf0ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.561+0000 7fd4cc66ab80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf08e80 0x559c9bf0d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.561+0000 7fd4cc66ab80 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559c9bf0be80 0x559c9bf09810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.561+0000 7fd4cc66ab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c9bf8b380 con 0x559c9bedf5b0 2023-10-06T03:04:36.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.561+0000 7fd4cc66ab80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c9bf8a1f0 con 0x559c9bf08e80 2023-10-06T03:04:36.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.561+0000 7fd4cc66ab80 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c9bf09380 con 0x559c9bf0be80 2023-10-06T03:04:36.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.561+0000 7fd4cc66ab80 10 client.0 _ll_register_callbacks cb 0x559c9bc3ba00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:04:36.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.561+0000 7fd4c10f2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bedf5b0 0x559c9bf0ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.561+0000 7fd4c10f2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bedf5b0 0x559c9bf0ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53886/0 (socket says 172.21.15.125:53886) 2023-10-06T03:04:36.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.561+0000 7fd4c10f2700 1 -- 172.21.15.125:0/1775607312 learned_addr learned my addr 172.21.15.125:0/1775607312 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:36.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.561+0000 7fd4c08f1700 1 --2- 172.21.15.125:0/1775607312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf08e80 0x559c9bf0d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.561+0000 7fd4c18f3700 1 --2- 172.21.15.125:0/1775607312 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559c9bf0be80 0x559c9bf09810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.561+0000 7fd4c10f2700 1 -- 172.21.15.125:0/1775607312 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559c9bf0be80 msgr2=0x559c9bf09810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:36.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.561+0000 7fd4c10f2700 1 --2- 172.21.15.125:0/1775607312 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559c9bf0be80 0x559c9bf09810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.561+0000 7fd4c10f2700 1 -- 172.21.15.125:0/1775607312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf08e80 msgr2=0x559c9bf0d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:36.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.561+0000 7fd4c10f2700 1 --2- 172.21.15.125:0/1775607312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf08e80 0x559c9bf0d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.561+0000 7fd4c10f2700 1 -- 172.21.15.125:0/1775607312 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c9bd1f0a0 con 0x559c9bedf5b0 2023-10-06T03:04:36.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.561+0000 7fd4c08f1700 1 --2- 172.21.15.125:0/1775607312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf08e80 0x559c9bf0d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:36.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.562+0000 7fd4c10f2700 1 --2- 172.21.15.125:0/1775607312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bedf5b0 0x559c9bf0ce10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac007980 tx=0x7fd4ac025040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9dadb20d768586f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:36.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.562+0000 7fd49b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-06T03:04:36.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.562+0000 7fd49b7fe700 1 -- 172.21.15.125:0/1775607312 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac028040 con 0x559c9bedf5b0 2023-10-06T03:04:36.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.562+0000 7fd49b7fe700 1 -- 172.21.15.125:0/1775607312 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd4ac023440 con 0x559c9bedf5b0 2023-10-06T03:04:36.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.562+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/1775607312 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd4b4012590 con 0x559c9bedf5b0 2023-10-06T03:04:36.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.562+0000 7fd49b7fe700 1 -- 172.21.15.125:0/1775607312 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4ac023810 con 0x559c9bedf5b0 2023-10-06T03:04:36.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.562+0000 7fd4cc66ab80 10 client.4425 fetch_fsmap learned FSMap version 7 2023-10-06T03:04:36.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.562+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/1775607312 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x559c9bc931d0 con 0x559c9bedf5b0 2023-10-06T03:04:36.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.562+0000 7fd49b7fe700 1 -- 172.21.15.125:0/1775607312 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b4012590 con 0x559c9bedf5b0 2023-10-06T03:04:36.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.562+0000 7fd49b7fe700 1 -- 172.21.15.125:0/1775607312 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 7) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fd4ac023970 con 0x559c9bedf5b0 2023-10-06T03:04:36.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.562+0000 7fd4cc66ab80 10 client.4425 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T03:04:36.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.562+0000 7fd4cc66ab80 10 client.4425 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:04:36.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.562+0000 7fd4cc66ab80 20 client.4425 populate_metadata read hostname 'smithi125' 2023-10-06T03:04:36.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.562+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/1775607312 >> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] conn(0x559c9bf09d50 0x559c9bf0a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.562+0000 7fd4cc66ab80 4 client.4425 mds_command: new command op to 4269 tid=0[{"prefix": "status"}] 2023-10-06T03:04:36.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.562+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/1775607312 --> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559c9bdcf8d0 con 0x559c9bf09d50 2023-10-06T03:04:36.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.562+0000 7fd4c08f1700 1 --2- 172.21.15.125:0/1775607312 >> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] conn(0x559c9bf09d50 0x559c9bf0a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.563+0000 7fd49b7fe700 10 client.4425 ms_handle_connect on v2:172.21.15.130:6833/4004582354 2023-10-06T03:04:36.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.563+0000 7fd4c08f1700 1 --2- 172.21.15.125:0/1775607312 >> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] conn(0x559c9bf09d50 0x559c9bf0a120 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=942691590f88f23c server_cookie=3b201fb48783479f in_seq=0 out_seq=0 2023-10-06T03:04:36.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.563+0000 7fd49b7fe700 1 -- 172.21.15.125:0/1775607312 <== mds.0 v2:172.21.15.130:6833/4004582354 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x559c9bdcf8d0 con 0x559c9bf09d50 2023-10-06T03:04:36.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.563+0000 7fd49b7fe700 10 client.4425 handle_command_reply: tid=0 2023-10-06T03:04:36.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.563+0000 7fd4cc66ab80 1 client.4425 shutdown 2023-10-06T03:04:36.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.563+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/1775607312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bedf5b0 msgr2=0x559c9bf0ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:36.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.563+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/1775607312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bedf5b0 0x559c9bf0ce10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac007980 tx=0x7fd4ac025040 comp rx=0 tx=0).stop 2023-10-06T03:04:36.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.563+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/1775607312 shutdown_connections 2023-10-06T03:04:36.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.563+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/1775607312 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x559c9bf0be80 0x559c9bf09810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.563+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/1775607312 >> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] conn(0x559c9bf09d50 0x559c9bf0a120 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.563+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/1775607312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x559c9bedf5b0 0x559c9bf0ce10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.563+0000 7fd4cc66ab80 1 --2- 172.21.15.125:0/1775607312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c9bf08e80 0x559c9bf0d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.563+0000 7fd49b7fe700 0 client.4425 ms_handle_reset on v2:172.21.15.130:6833/4004582354 2023-10-06T03:04:36.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.563+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/1775607312 >> 172.21.15.125:0/1775607312 conn(0x559c9bf26890 msgr2=0x559c9bf0ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:36.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.563+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/1775607312 shutdown_connections 2023-10-06T03:04:36.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.563+0000 7fd4cc66ab80 1 -- 172.21.15.125:0/1775607312 wait complete. 2023-10-06T03:04:36.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.563+0000 7fd4cc66ab80 20 client.4425 trim_cache size 0 max 16384 2023-10-06T03:04:36.571 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:04:36.571 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_fsid": "c8556660-0880-4430-a03a-c140780d46e7", 2023-10-06T03:04:36.572 INFO:teuthology.orchestra.run.smithi125.stdout: "whoami": 0, 2023-10-06T03:04:36.572 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 4269, 2023-10-06T03:04:36.572 INFO:teuthology.orchestra.run.smithi125.stdout: "want_state": "up:active", 2023-10-06T03:04:36.572 INFO:teuthology.orchestra.run.smithi125.stdout: "state": "up:active", 2023-10-06T03:04:36.572 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs", 2023-10-06T03:04:36.572 INFO:teuthology.orchestra.run.smithi125.stdout: "rank_uptime": 6.7270941960000004, 2023-10-06T03:04:36.572 INFO:teuthology.orchestra.run.smithi125.stdout: "mdsmap_epoch": 7, 2023-10-06T03:04:36.572 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch": 27, 2023-10-06T03:04:36.572 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch_barrier": 27, 2023-10-06T03:04:36.572 INFO:teuthology.orchestra.run.smithi125.stdout: "uptime": 12.650545299999999 2023-10-06T03:04:36.572 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:04:36.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.564+0000 7fd4c3356700 1 -- 172.21.15.125:0/2214362975 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd4a0066f30 msgr2=0x7fd4a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:36.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.564+0000 7fd4c3356700 1 --2- 172.21.15.125:0/2214362975 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd4a0066f30 0x7fd4a00693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac006aa0 tx=0x7fd4ac008040 comp rx=0 tx=0).stop 2023-10-06T03:04:36.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.564+0000 7fd4c3356700 1 -- 172.21.15.125:0/2214362975 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4bc159780 msgr2=0x7fd4bc168c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:36.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.564+0000 7fd4c3356700 1 --2- 172.21.15.125:0/2214362975 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4bc159780 0x7fd4bc168c80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd4b800c810 tx=0x7fd4b8007c50 comp rx=0 tx=0).stop 2023-10-06T03:04:36.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.564+0000 7fd4c3356700 1 -- 172.21.15.125:0/2214362975 shutdown_connections 2023-10-06T03:04:36.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.564+0000 7fd4c3356700 1 --2- 172.21.15.125:0/2214362975 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd4a0066f30 0x7fd4a00693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.564+0000 7fd4c3356700 1 --2- 172.21.15.125:0/2214362975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4bc159b50 0x7fd4bc06bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.564+0000 7fd4c3356700 1 --2- 172.21.15.125:0/2214362975 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd4bc0b02d0 0x7fd4bc166900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.564+0000 7fd4c3356700 1 --2- 172.21.15.125:0/2214362975 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4bc159780 0x7fd4bc168c80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.564+0000 7fd4c3356700 1 -- 172.21.15.125:0/2214362975 >> 172.21.15.125:0/2214362975 conn(0x7fd4bc0af730 msgr2=0x7fd4bc0c9200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:36.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.564+0000 7fd4c3356700 1 -- 172.21.15.125:0/2214362975 shutdown_connections 2023-10-06T03:04:36.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.564+0000 7fd4c3356700 1 -- 172.21.15.125:0/2214362975 wait complete. 2023-10-06T03:04:36.576 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:04:36.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.692+0000 7f257dbda700 1 Processor -- start 2023-10-06T03:04:36.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.693+0000 7f257dbda700 1 -- start start 2023-10-06T03:04:36.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f257dbda700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f257806a8c0 0x7f257806ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f257dbda700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2578068290 con 0x7f25781592e0 2023-10-06T03:04:36.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f257dbda700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2578159930 con 0x7f2578155670 2023-10-06T03:04:36.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f257dbda700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f257806f780 con 0x7f257806a8c0 2023-10-06T03:04:36.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f2576ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f25781592e0 0x7f25780ace80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58016/0 (socket says 172.21.15.125:58016) 2023-10-06T03:04:36.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f2576ffd700 1 -- 172.21.15.125:0/2845585063 learned_addr learned my addr 172.21.15.125:0/2845585063 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:36.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f2577fff700 1 --2- 172.21.15.125:0/2845585063 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f257806a8c0 0x7f257806ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f25767fc700 1 -- 172.21.15.125:0/2845585063 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596746611 0 0) 0x7f2578068290 con 0x7f25781592e0 2023-10-06T03:04:36.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f25767fc700 1 -- 172.21.15.125:0/2845585063 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2564004680 con 0x7f25781592e0 2023-10-06T03:04:36.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f25767fc700 1 -- 172.21.15.125:0/2845585063 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3982901357 0 0) 0x7f2564004680 con 0x7f25781592e0 2023-10-06T03:04:36.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f25767fc700 1 -- 172.21.15.125:0/2845585063 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f257806a8c0 msgr2=0x7f257806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:36.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f25767fc700 1 --2- 172.21.15.125:0/2845585063 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f257806a8c0 0x7f257806ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f25767fc700 1 -- 172.21.15.125:0/2845585063 >> v1:172.21.15.130:6789/0 conn(0x7f2578155670 legacy=0x7f257806f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:36.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f25767fc700 1 -- 172.21.15.125:0/2845585063 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2578159c10 con 0x7f25781592e0 2023-10-06T03:04:36.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f25767fc700 1 -- 172.21.15.125:0/2845585063 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f2560001470 con 0x7f25781592e0 2023-10-06T03:04:36.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f25767fc700 1 -- 172.21.15.125:0/2845585063 >> v1:172.21.15.125:6789/0 conn(0x7f25781592e0 legacy=0x7f25780ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f25767fc700 1 --2- 172.21.15.125:0/2845585063 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f257806a8c0 0x7f2564004ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f25767fc700 1 --2- 172.21.15.125:0/2845585063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2564005120 0x7f2564005920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f25767fc700 1 --2- 172.21.15.125:0/2845585063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2564005e60 0x7f25640062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f25767fc700 1 -- 172.21.15.125:0/2845585063 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256400cd00 con 0x7f2564005120 2023-10-06T03:04:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f25767fc700 1 -- 172.21.15.125:0/2845585063 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256400ce40 con 0x7f2564005e60 2023-10-06T03:04:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.694+0000 7f25767fc700 1 -- 172.21.15.125:0/2845585063 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256400d000 con 0x7f257806a8c0 2023-10-06T03:04:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.695+0000 7f2576ffd700 1 --2- 172.21.15.125:0/2845585063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2564005120 0x7f2564005920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.695+0000 7f2577fff700 1 --2- 172.21.15.125:0/2845585063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2564005e60 0x7f25640062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.695+0000 7f25777fe700 1 --2- 172.21.15.125:0/2845585063 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f257806a8c0 0x7f2564004ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.695+0000 7f2576ffd700 1 -- 172.21.15.125:0/2845585063 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f257806a8c0 msgr2=0x7f2564004ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.695+0000 7f2576ffd700 1 --2- 172.21.15.125:0/2845585063 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f257806a8c0 0x7f2564004ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.695+0000 7f2576ffd700 1 -- 172.21.15.125:0/2845585063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2564005e60 msgr2=0x7f25640062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.695+0000 7f2576ffd700 1 --2- 172.21.15.125:0/2845585063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2564005e60 0x7f25640062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.695+0000 7f2576ffd700 1 -- 172.21.15.125:0/2845585063 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2564004680 con 0x7f2564005120 2023-10-06T03:04:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.695+0000 7f2577fff700 1 --2- 172.21.15.125:0/2845585063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2564005e60 0x7f25640062d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.695+0000 7f25777fe700 1 --2- 172.21.15.125:0/2845585063 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f257806a8c0 0x7f2564004ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.695+0000 7f2576ffd700 1 --2- 172.21.15.125:0/2845585063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2564005120 0x7f2564005920 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f256000c390 tx=0x7f2560001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f466e39d4c3b30dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.695+0000 7f25767fc700 1 -- 172.21.15.125:0/2845585063 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000cc60 con 0x7f2564005120 2023-10-06T03:04:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.695+0000 7f25767fc700 1 -- 172.21.15.125:0/2845585063 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256000cdc0 con 0x7f2564005120 2023-10-06T03:04:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.695+0000 7f25767fc700 1 -- 172.21.15.125:0/2845585063 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560005b50 con 0x7f2564005120 2023-10-06T03:04:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.696+0000 7f257dbda700 1 -- 172.21.15.125:0/2845585063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2564005120 msgr2=0x7f2564005920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.696+0000 7f257dbda700 1 --2- 172.21.15.125:0/2845585063 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2564005120 0x7f2564005920 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f256000c390 tx=0x7f2560001e50 comp rx=0 tx=0).stop 2023-10-06T03:04:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.696+0000 7f2577fff700 1 -- 172.21.15.125:0/2845585063 reap_dead start 2023-10-06T03:04:36.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.696+0000 7f257dbda700 1 -- 172.21.15.125:0/2845585063 shutdown_connections 2023-10-06T03:04:36.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.696+0000 7f257dbda700 1 -- 172.21.15.125:0/2845585063 >> 172.21.15.125:0/2845585063 conn(0x7f25780cc5a0 msgr2=0x7f25780cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:36.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.696+0000 7f257dbda700 1 -- 172.21.15.125:0/2845585063 shutdown_connections 2023-10-06T03:04:36.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.696+0000 7f257dbda700 1 -- 172.21.15.125:0/2845585063 wait complete. 2023-10-06T03:04:36.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.697+0000 7f257dbda700 1 Processor -- start 2023-10-06T03:04:36.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.697+0000 7f257dbda700 1 -- start start 2023-10-06T03:04:36.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f257dbda700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2564005120 0x7f25781534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f257dbda700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25780b1fa0 0x7f2578157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f257dbda700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25781581c0 0x7f25780b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f257dbda700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2578158620 con 0x7f25781581c0 2023-10-06T03:04:36.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f257dbda700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25780b1b10 con 0x7f2564005120 2023-10-06T03:04:36.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f257dbda700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25780b0f00 con 0x7f25780b1fa0 2023-10-06T03:04:36.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f2577fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25781581c0 0x7f25780b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f2577fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25781581c0 0x7f25780b0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53898/0 (socket says 172.21.15.125:53898) 2023-10-06T03:04:36.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f2577fff700 1 -- 172.21.15.125:0/2816570212 learned_addr learned my addr 172.21.15.125:0/2816570212 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:36.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f25777fe700 1 --2- 172.21.15.125:0/2816570212 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2564005120 0x7f25781534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f2576ffd700 1 --2- 172.21.15.125:0/2816570212 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25780b1fa0 0x7f2578157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f2577fff700 1 -- 172.21.15.125:0/2816570212 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25780b1fa0 msgr2=0x7f2578157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f2577fff700 1 --2- 172.21.15.125:0/2816570212 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25780b1fa0 0x7f2578157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f2577fff700 1 -- 172.21.15.125:0/2816570212 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2564005120 msgr2=0x7f25781534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f2577fff700 1 --2- 172.21.15.125:0/2816570212 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2564005120 0x7f25781534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f2577fff700 1 -- 172.21.15.125:0/2816570212 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25780b11e0 con 0x7f25781581c0 2023-10-06T03:04:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f2577fff700 1 --2- 172.21.15.125:0/2816570212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25781581c0 0x7f25780b0210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f25781596b0 tx=0x7f257000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f256f7fe700 1 -- 172.21.15.125:0/2816570212 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257001b070 con 0x7f25781581c0 2023-10-06T03:04:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f256f7fe700 1 -- 172.21.15.125:0/2816570212 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257000f040 con 0x7f25781581c0 2023-10-06T03:04:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f256f7fe700 1 -- 172.21.15.125:0/2816570212 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257000e050 con 0x7f25781581c0 2023-10-06T03:04:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f257dbda700 1 -- 172.21.15.125:0/2816570212 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25780b14c0 con 0x7f25781581c0 2023-10-06T03:04:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.698+0000 7f257dbda700 1 -- 172.21.15.125:0/2816570212 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2578153a30 con 0x7f25781581c0 2023-10-06T03:04:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.699+0000 7f257dbda700 1 -- 172.21.15.125:0/2816570212 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257806ec60 con 0x7f25781581c0 2023-10-06T03:04:36.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.700+0000 7f256f7fe700 1 -- 172.21.15.125:0/2816570212 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2570003020 con 0x7f25781581c0 2023-10-06T03:04:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.700+0000 7f256f7fe700 1 --2- 172.21.15.125:0/2816570212 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2558066f30 0x7f25580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.700+0000 7f25777fe700 1 --2- 172.21.15.125:0/2816570212 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2558066f30 0x7f25580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.700+0000 7f256f7fe700 1 -- 172.21.15.125:0/2816570212 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2570084dc0 con 0x7f25781581c0 2023-10-06T03:04:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.700+0000 7f25777fe700 1 --2- 172.21.15.125:0/2816570212 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2558066f30 0x7f25580693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2568007fd0 tx=0x7f2568009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:36.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.704+0000 7f256f7fe700 1 -- 172.21.15.125:0/2816570212 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2570051be0 con 0x7f25781581c0 2023-10-06T03:04:36.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.930+0000 7f257dbda700 1 -- 172.21.15.125:0/2816570212 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f25780b1ca0 con 0x7f25781581c0 2023-10-06T03:04:36.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.930+0000 7f256f7fe700 1 -- 172.21.15.125:0/2816570212 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2570055200 con 0x7f25781581c0 2023-10-06T03:04:36.931 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T03:04:36.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.932+0000 7f257dbda700 1 -- 172.21.15.125:0/2816570212 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2558066f30 msgr2=0x7f25580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:36.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.932+0000 7f257dbda700 1 --2- 172.21.15.125:0/2816570212 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2558066f30 0x7f25580693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2568007fd0 tx=0x7f2568009040 comp rx=0 tx=0).stop 2023-10-06T03:04:36.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.932+0000 7f257dbda700 1 -- 172.21.15.125:0/2816570212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25781581c0 msgr2=0x7f25780b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:36.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.932+0000 7f257dbda700 1 --2- 172.21.15.125:0/2816570212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25781581c0 0x7f25780b0210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f25781596b0 tx=0x7f257000b040 comp rx=0 tx=0).stop 2023-10-06T03:04:36.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.932+0000 7f257dbda700 1 -- 172.21.15.125:0/2816570212 shutdown_connections 2023-10-06T03:04:36.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.932+0000 7f257dbda700 1 --2- 172.21.15.125:0/2816570212 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2558066f30 0x7f25580693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.932+0000 7f257dbda700 1 --2- 172.21.15.125:0/2816570212 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f25781581c0 0x7f25780b0210 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.932+0000 7f257dbda700 1 --2- 172.21.15.125:0/2816570212 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2564005120 0x7f25781534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.932+0000 7f257dbda700 1 --2- 172.21.15.125:0/2816570212 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f25780b1fa0 0x7f2578157c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:36.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.932+0000 7f257dbda700 1 -- 172.21.15.125:0/2816570212 >> 172.21.15.125:0/2816570212 conn(0x7f25780cc5a0 msgr2=0x7f25780ca0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:36.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.932+0000 7f257dbda700 1 -- 172.21.15.125:0/2816570212 shutdown_connections 2023-10-06T03:04:36.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:36.932+0000 7f257dbda700 1 -- 172.21.15.125:0/2816570212 wait complete. 2023-10-06T03:04:36.944 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T03:04:36.944 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:04:36.944 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-10-06T03:04:36.945 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-06T03:04:36.945 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:04:36.945 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T03:04:36.945 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:04:36.945 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:04:36.945 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T03:04:36.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:36.945 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-10-06T03:04:36.963 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:04:36.964 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:04:36.964 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:04:36.964 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:36.964 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-10-06T03:04:36.964 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:36.964 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:04:36.964 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:04:36.964 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2023-10-06T03:04:36.964 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:04:36.964 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:04:36.964 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2023-10-06T03:04:36.965 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:04:36.965 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:04:36.965 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:04:36.965 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:04:36.965 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:04:36.965 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42524sec preferred_lft 42524sec 2023-10-06T03:04:36.965 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2023-10-06T03:04:36.965 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:36.966 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T03:04:36.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:36.966 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:04:36.966 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:04:36.966 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add name ceph-brx type bridge 2023-10-06T03:04:36.966 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip addr flush dev ceph-brx 2023-10-06T03:04:36.967 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set ceph-brx up 2023-10-06T03:04:36.967 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T03:04:36.967 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:04:37.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:37.127 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:04:37.160 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-10-06T03:04:37.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:37.162 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-10-06T03:04:37.250 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-10-06T03:04:37.250 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:04:37.250 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:04:37.250 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:04:37.250 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:04:37.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:37.251 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:04:37.251 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:04:37.251 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:04:37.251 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:04:37.251 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:04:37.251 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:04:37.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:37.481 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-06T03:04:37.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:37.500 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list-id 2023-10-06T03:04:37.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:37.559 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:04:37.559 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:04:37.559 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T03:04:37.559 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-06T03:04:37.559 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:04:37.653 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-06T03:04:37.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:37.653 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:04:37.653 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:04:37.653 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-06T03:04:37.653 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T03:04:37.653 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-06T03:04:37.654 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-06T03:04:37.654 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-06T03:04:37.654 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:04:37.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:37.869 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:04:37.869 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:04:37.869 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2023-10-06T03:04:37.869 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T03:04:37.869 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:04:37.967 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-06T03:04:37.967 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:04:37.967 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:04:37.985 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-06T03:04:37.985 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:04:37.985 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:04:38.044 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-06T03:04:38.112 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:04:38.112 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:04:38.179 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:04:38.180 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:04:38.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:04:38.181 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-06T03:04:38.239 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T03:04:38.239 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-06T03:04:38.281 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-06T03:04:38.310 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:04:38.310 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:04:38.367 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi125.stderr:2023-10-06T03:04:38.366+0000 7f90261f1540 -1 init, newargv = 0x563aa2bc8790 newargc=15 2023-10-06T03:04:38.367 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi125.stderr:ceph-fuse[127312]: starting ceph client 2023-10-06T03:04:38.373 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi125.stderr:ceph-fuse[127312]: starting fuse 2023-10-06T03:04:38.378 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:04:38.380 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:04:38.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:04:38.380 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-06T03:04:38.438 INFO:teuthology.orchestra.run.smithi125.stdout:46 2023-10-06T03:04:38.438 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T03:04:38.438 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:04:38.438 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2023-10-06T03:04:38.439 DEBUG:teuthology.orchestra.run.smithi125:> import re 2023-10-06T03:04:38.439 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-10-06T03:04:38.439 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2023-10-06T03:04:38.439 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:04:38.439 DEBUG:teuthology.orchestra.run.smithi125:> def _find_admin_socket(client_name): 2023-10-06T03:04:38.439 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-06T03:04:38.439 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2023-10-06T03:04:38.439 DEBUG:teuthology.orchestra.run.smithi125:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-06T03:04:38.439 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:04:38.439 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2023-10-06T03:04:38.439 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2023-10-06T03:04:38.439 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2023-10-06T03:04:38.440 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2023-10-06T03:04:38.440 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:04:38.440 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2023-10-06T03:04:38.440 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T03:04:38.440 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T03:04:38.440 DEBUG:teuthology.orchestra.run.smithi125:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T03:04:38.440 DEBUG:teuthology.orchestra.run.smithi125:> contents = proc_f.read() 2023-10-06T03:04:38.440 DEBUG:teuthology.orchestra.run.smithi125:> if mountpoint in contents: 2023-10-06T03:04:38.440 DEBUG:teuthology.orchestra.run.smithi125:> return f 2023-10-06T03:04:38.440 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T03:04:38.440 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:04:38.441 DEBUG:teuthology.orchestra.run.smithi125:> print(_find_admin_socket("client.admin")) 2023-10-06T03:04:38.441 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-10-06T03:04:38.561 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.admin.127312.asok 2023-10-06T03:04:38.743 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.127312.asok 2023-10-06T03:04:38.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:04:38.744 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.127312.asok status 2023-10-06T03:04:38.895 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:04:38.896 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2023-10-06T03:04:38.896 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T03:04:38.896 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T03:04:38.896 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "admin", 2023-10-06T03:04:38.896 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2023-10-06T03:04:38.896 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-06T03:04:38.896 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "127312", 2023-10-06T03:04:38.896 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2023-10-06T03:04:38.896 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:04:38.896 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2023-10-06T03:04:38.897 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2023-10-06T03:04:38.897 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 4437, 2023-10-06T03:04:38.897 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2023-10-06T03:04:38.897 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2023-10-06T03:04:38.897 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2023-10-06T03:04:38.897 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 4437 2023-10-06T03:04:38.897 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:04:38.897 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-06T03:04:38.897 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-06T03:04:38.897 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:04:38.898 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 4002747128 2023-10-06T03:04:38.898 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:04:38.898 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:04:38.898 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-06T03:04:38.898 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-06T03:04:38.898 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:04:38.898 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 4002747128 2023-10-06T03:04:38.898 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:04:38.898 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.4437 192.168.0.1:0/4002747128", 2023-10-06T03:04:38.898 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "192.168.0.1:0/4002747128", 2023-10-06T03:04:38.899 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2023-10-06T03:04:38.899 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 7, 2023-10-06T03:04:38.899 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 27, 2023-10-06T03:04:38.899 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2023-10-06T03:04:38.899 INFO:teuthology.orchestra.run.smithi125.stdout: "blocklisted": false, 2023-10-06T03:04:38.899 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2023-10-06T03:04:38.899 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:04:38.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:04:38.906 DEBUG:teuthology.orchestra.run.smithi125:> stat --file-system '--printf=%T 2023-10-06T03:04:38.906 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:04:38.926 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2023-10-06T03:04:38.926 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:04:38.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:04:38.926 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:04:38.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:04:38.994 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-06T03:04:39.095 INFO:teuthology.orchestra.run.smithi125.stdout:# file: . 2023-10-06T03:04:39.096 INFO:teuthology.orchestra.run.smithi125.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-06T03:04:39.096 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:39.096 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2023-10-06T03:04:39.096 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:04:39.096 DEBUG:teuthology.orchestra.run.smithi125:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-06T03:04:39.137 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi125.stderr:ceph-fuse[127312]: fuse finished with error 0 and tester_r 0 2023-10-06T03:04:39.138 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T03:04:39.155 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:04:39.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:39.156 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-06T03:04:39.217 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:04:39.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.375+0000 7f9617aea700 1 Processor -- start 2023-10-06T03:04:39.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.375+0000 7f9617aea700 1 -- start start 2023-10-06T03:04:39.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.375+0000 7f9617aea700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9610155670 0x7f96101592e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:39.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.376+0000 7f9617aea700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f961006a8c0 0x7f961006ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:39.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.376+0000 7f9617aea700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9610068290 con 0x7f961006f070 2023-10-06T03:04:39.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.376+0000 7f9617aea700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f961006b240 con 0x7f961006a8c0 2023-10-06T03:04:39.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.376+0000 7f9617aea700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9610159930 con 0x7f9610155670 2023-10-06T03:04:39.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.376+0000 7f9616087700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f961006a8c0 0x7f961006ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:39.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.376+0000 7f9616087700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f961006a8c0 0x7f961006ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53910/0 (socket says 172.21.15.125:53910) 2023-10-06T03:04:39.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.376+0000 7f9616087700 1 -- 172.21.15.125:0/151649972 learned_addr learned my addr 172.21.15.125:0/151649972 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:39.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.376+0000 7f9615886700 1 --2- 172.21.15.125:0/151649972 >> v2:172.21.15.130:3300/0 conn(0x7f9610155670 0x7f96101592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:39.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.376+0000 7f9616087700 1 -- 172.21.15.125:0/151649972 >> v2:172.21.15.130:3300/0 conn(0x7f9610155670 msgr2=0x7f96101592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:39.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.376+0000 7f9616087700 1 --2- 172.21.15.125:0/151649972 >> v2:172.21.15.130:3300/0 conn(0x7f9610155670 0x7f96101592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:39.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.376+0000 7f9616087700 1 -- 172.21.15.125:0/151649972 >> v1:172.21.15.130:6789/0 conn(0x7f961006f070 legacy=0x7f96100ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:39.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.376+0000 7f9616087700 1 -- 172.21.15.125:0/151649972 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9610159c10 con 0x7f961006a8c0 2023-10-06T03:04:39.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.376+0000 7f9616087700 1 --2- 172.21.15.125:0/151649972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961006a8c0 0x7f961006ad00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f961006b9d0 tx=0x7f9608009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50610f27e6d1329c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:39.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.376+0000 7f9614884700 1 -- 172.21.15.125:0/151649972 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960800e070 con 0x7f961006a8c0 2023-10-06T03:04:39.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.376+0000 7f9614884700 1 -- 172.21.15.125:0/151649972 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960800ba10 con 0x7f961006a8c0 2023-10-06T03:04:39.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.376+0000 7f9614884700 1 -- 172.21.15.125:0/151649972 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96080092e0 con 0x7f961006a8c0 2023-10-06T03:04:39.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.377+0000 7f9617aea700 1 -- 172.21.15.125:0/151649972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961006a8c0 msgr2=0x7f961006ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:39.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.377+0000 7f9617aea700 1 --2- 172.21.15.125:0/151649972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961006a8c0 0x7f961006ad00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f961006b9d0 tx=0x7f9608009840 comp rx=0 tx=0).stop 2023-10-06T03:04:39.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.377+0000 7f9617aea700 1 -- 172.21.15.125:0/151649972 shutdown_connections 2023-10-06T03:04:39.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.377+0000 7f9617aea700 1 --2- 172.21.15.125:0/151649972 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961006a8c0 0x7f961006ad00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:39.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.377+0000 7f9617aea700 1 --2- 172.21.15.125:0/151649972 >> v2:172.21.15.130:3300/0 conn(0x7f9610155670 0x7f96101592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:39.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.377+0000 7f9617aea700 1 -- 172.21.15.125:0/151649972 >> 172.21.15.125:0/151649972 conn(0x7f96100cc5a0 msgr2=0x7f96100cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:39.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.377+0000 7f9617aea700 1 -- 172.21.15.125:0/151649972 shutdown_connections 2023-10-06T03:04:39.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.377+0000 7f9617aea700 1 -- 172.21.15.125:0/151649972 wait complete. 2023-10-06T03:04:39.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.378+0000 7f9617aea700 1 Processor -- start 2023-10-06T03:04:39.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.379+0000 7f9617aea700 1 -- start start 2023-10-06T03:04:39.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.379+0000 7f9617aea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961006a8c0 0x7f96100c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:39.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.379+0000 7f9617aea700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961006f070 0x7f961014bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:39.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.379+0000 7f9617aea700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9610155670 0x7f9610155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:39.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.379+0000 7f9617aea700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961014c640 con 0x7f961006a8c0 2023-10-06T03:04:39.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.379+0000 7f9617aea700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961014c890 con 0x7f961006f070 2023-10-06T03:04:39.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.379+0000 7f9617aea700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f961014cb70 con 0x7f9610155670 2023-10-06T03:04:39.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.380+0000 7f9615886700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961006a8c0 0x7f96100c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:39.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.380+0000 7f9615886700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961006a8c0 0x7f96100c21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53916/0 (socket says 172.21.15.125:53916) 2023-10-06T03:04:39.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.380+0000 7f9615886700 1 -- 172.21.15.125:0/281446169 learned_addr learned my addr 172.21.15.125:0/281446169 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:39.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.380+0000 7f9615085700 1 --2- 172.21.15.125:0/281446169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961006f070 0x7f961014bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:39.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.380+0000 7f9616087700 1 --2- 172.21.15.125:0/281446169 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9610155670 0x7f9610155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:39.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.380+0000 7f9615886700 1 -- 172.21.15.125:0/281446169 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9610155670 msgr2=0x7f9610155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:39.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.380+0000 7f9615886700 1 --2- 172.21.15.125:0/281446169 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9610155670 0x7f9610155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:39.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.380+0000 7f9615886700 1 -- 172.21.15.125:0/281446169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961006f070 msgr2=0x7f961014bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:39.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.380+0000 7f9615886700 1 --2- 172.21.15.125:0/281446169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961006f070 0x7f961014bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:39.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.380+0000 7f9615886700 1 -- 172.21.15.125:0/281446169 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9608009ae0 con 0x7f961006a8c0 2023-10-06T03:04:39.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.380+0000 7f9615886700 1 --2- 172.21.15.125:0/281446169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961006a8c0 0x7f96100c21b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f960c00af10 tx=0x7f960c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:39.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.380+0000 7f9605ffb700 1 -- 172.21.15.125:0/281446169 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c010720 con 0x7f961006a8c0 2023-10-06T03:04:39.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.380+0000 7f9605ffb700 1 -- 172.21.15.125:0/281446169 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960c010880 con 0x7f961006a8c0 2023-10-06T03:04:39.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.380+0000 7f9617aea700 1 -- 172.21.15.125:0/281446169 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961014ce50 con 0x7f961006a8c0 2023-10-06T03:04:39.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.380+0000 7f9605ffb700 1 -- 172.21.15.125:0/281446169 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960c010c40 con 0x7f961006a8c0 2023-10-06T03:04:39.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.380+0000 7f9617aea700 1 -- 172.21.15.125:0/281446169 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96100c26f0 con 0x7f961006a8c0 2023-10-06T03:04:39.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.381+0000 7f9617aea700 1 -- 172.21.15.125:0/281446169 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9610066510 con 0x7f961006a8c0 2023-10-06T03:04:39.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.382+0000 7f9605ffb700 1 -- 172.21.15.125:0/281446169 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f960c00f640 con 0x7f961006a8c0 2023-10-06T03:04:39.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.382+0000 7f9605ffb700 1 --2- 172.21.15.125:0/281446169 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f95f4066f30 0x7f95f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:39.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.382+0000 7f9605ffb700 1 -- 172.21.15.125:0/281446169 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f960c014070 con 0x7f961006a8c0 2023-10-06T03:04:39.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.382+0000 7f9615085700 1 --2- 172.21.15.125:0/281446169 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f95f4066f30 0x7f95f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:39.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.383+0000 7f9615085700 1 --2- 172.21.15.125:0/281446169 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f95f4066f30 0x7f95f40693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f96100abda0 tx=0x7f9600009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:39.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.387+0000 7f9605ffb700 1 -- 172.21.15.125:0/281446169 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f960c0505a0 con 0x7f961006a8c0 2023-10-06T03:04:39.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.568+0000 7f9617aea700 1 -- 172.21.15.125:0/281446169 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9610159ef0 con 0x7f961006a8c0 2023-10-06T03:04:39.569 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.569+0000 7f9605ffb700 1 -- 172.21.15.125:0/281446169 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18851 (secure 0 0 0) 0x7f960c057060 con 0x7f961006a8c0 2023-10-06T03:04:39.570 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:39.570 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:33.645139+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:04:26.828121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:04:28.179225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:04:31.256394+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:04:39.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.571+0000 7f9617aea700 1 -- 172.21.15.125:0/281446169 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f95f4066f30 msgr2=0x7f95f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:39.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.571+0000 7f9617aea700 1 --2- 172.21.15.125:0/281446169 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f95f4066f30 0x7f95f40693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f96100abda0 tx=0x7f9600009040 comp rx=0 tx=0).stop 2023-10-06T03:04:39.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.571+0000 7f9617aea700 1 -- 172.21.15.125:0/281446169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961006a8c0 msgr2=0x7f96100c21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:39.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.571+0000 7f9617aea700 1 --2- 172.21.15.125:0/281446169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961006a8c0 0x7f96100c21b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f960c00af10 tx=0x7f960c008040 comp rx=0 tx=0).stop 2023-10-06T03:04:39.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.571+0000 7f9617aea700 1 -- 172.21.15.125:0/281446169 shutdown_connections 2023-10-06T03:04:39.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.571+0000 7f9617aea700 1 --2- 172.21.15.125:0/281446169 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f95f4066f30 0x7f95f40693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:39.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.571+0000 7f9617aea700 1 --2- 172.21.15.125:0/281446169 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9610155670 0x7f9610155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:39.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.571+0000 7f9617aea700 1 --2- 172.21.15.125:0/281446169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f961006a8c0 0x7f96100c21b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:39.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.571+0000 7f9617aea700 1 --2- 172.21.15.125:0/281446169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f961006f070 0x7f961014bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:39.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.571+0000 7f9617aea700 1 -- 172.21.15.125:0/281446169 >> 172.21.15.125:0/281446169 conn(0x7f96100cc5a0 msgr2=0x7f9610070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:39.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.571+0000 7f9617aea700 1 -- 172.21.15.125:0/281446169 shutdown_connections 2023-10-06T03:04:39.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.571+0000 7f9617aea700 1 -- 172.21.15.125:0/281446169 wait complete. 2023-10-06T03:04:39.583 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:04:39.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.700+0000 7fecc14d8700 1 Processor -- start 2023-10-06T03:04:39.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.700+0000 7fecc14d8700 1 -- start start 2023-10-06T03:04:39.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.701+0000 7fecc14d8700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fecbc0caf10 0x7fecbc0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:39.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.701+0000 7fecc14d8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecbc0cb8d0 con 0x7fecbc1595c0 2023-10-06T03:04:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.701+0000 7fecc14d8700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecbc0cbb90 con 0x7fecbc1591f0 2023-10-06T03:04:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.701+0000 7fecc14d8700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc0afbf0 con 0x7fecbc0caf10 2023-10-06T03:04:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.701+0000 7fecba7fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fecbc1595c0 0x7fecbc0ccc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58020/0 (socket says 172.21.15.125:58020) 2023-10-06T03:04:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.702+0000 7fecba7fc700 1 -- 172.21.15.125:0/1815810306 learned_addr learned my addr 172.21.15.125:0/1815810306 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.702+0000 7fecbb7fe700 1 --2- 172.21.15.125:0/1815810306 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fecbc0caf10 0x7fecbc0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.702+0000 7fecb9ffb700 1 -- 172.21.15.125:0/1815810306 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246217657 0 0) 0x7fecbc0cb8d0 con 0x7fecbc1595c0 2023-10-06T03:04:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.702+0000 7fecb9ffb700 1 -- 172.21.15.125:0/1815810306 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feca4003570 con 0x7fecbc1595c0 2023-10-06T03:04:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.702+0000 7fecb9ffb700 1 -- 172.21.15.125:0/1815810306 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462704382 0 0) 0x7fecbc0cbb90 con 0x7fecbc1591f0 2023-10-06T03:04:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.702+0000 7fecb9ffb700 1 -- 172.21.15.125:0/1815810306 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecbc0cb8d0 con 0x7fecbc1591f0 2023-10-06T03:04:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.702+0000 7fecb9ffb700 1 -- 172.21.15.125:0/1815810306 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2927578697 0 0) 0x7feca4003570 con 0x7fecbc1595c0 2023-10-06T03:04:39.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.702+0000 7fecbb7fe700 1 -- 172.21.15.125:0/1815810306 >> v1:172.21.15.130:6789/0 conn(0x7fecbc1591f0 legacy=0x7fecbc0b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.702+0000 7fecbb7fe700 1 -- 172.21.15.125:0/1815810306 >> v1:172.21.15.125:6789/0 conn(0x7fecbc1595c0 legacy=0x7fecbc0ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.702+0000 7fecbb7fe700 1 -- 172.21.15.125:0/1815810306 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc0cbe70 con 0x7fecbc0caf10 2023-10-06T03:04:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.702+0000 7fecbb7fe700 1 --2- 172.21.15.125:0/1815810306 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fecbc0caf10 0x7fecbc0cb390 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fecb4009e90 tx=0x7fecb4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=730373b683379479 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.702+0000 7fecb9ffb700 1 -- 172.21.15.125:0/1815810306 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb400e070 con 0x7fecbc0caf10 2023-10-06T03:04:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.702+0000 7fecb9ffb700 1 -- 172.21.15.125:0/1815810306 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb400b870 con 0x7fecbc0caf10 2023-10-06T03:04:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.702+0000 7fecb9ffb700 1 -- 172.21.15.125:0/1815810306 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac001470 con 0x7fecbc0caf10 2023-10-06T03:04:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.703+0000 7fecc14d8700 1 -- 172.21.15.125:0/1815810306 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fecbc0caf10 msgr2=0x7fecbc0cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.703+0000 7fecc14d8700 1 --2- 172.21.15.125:0/1815810306 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fecbc0caf10 0x7fecbc0cb390 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fecb4009e90 tx=0x7fecb4009780 comp rx=0 tx=0).stop 2023-10-06T03:04:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.703+0000 7fecc14d8700 1 -- 172.21.15.125:0/1815810306 shutdown_connections 2023-10-06T03:04:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.703+0000 7fecc14d8700 1 --2- 172.21.15.125:0/1815810306 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fecbc0caf10 0x7fecbc0cb390 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:39.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.703+0000 7fecc14d8700 1 -- 172.21.15.125:0/1815810306 >> 172.21.15.125:0/1815810306 conn(0x7fecbc06ed40 msgr2=0x7fecbc06f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:39.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.703+0000 7fecc14d8700 1 -- 172.21.15.125:0/1815810306 shutdown_connections 2023-10-06T03:04:39.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.703+0000 7fecc14d8700 1 -- 172.21.15.125:0/1815810306 wait complete. 2023-10-06T03:04:39.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.705+0000 7fecc14d8700 1 Processor -- start 2023-10-06T03:04:39.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.705+0000 7fecc14d8700 1 -- start start 2023-10-06T03:04:39.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecc14d8700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecbc0caf10 0x7fecbc0b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:39.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecc14d8700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fecbc1591f0 0x7fecbc15b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:39.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecc14d8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecbc1595c0 0x7fecbc1693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:39.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecc14d8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc0c4010 con 0x7fecbc1595c0 2023-10-06T03:04:39.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecc14d8700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc0c42f0 con 0x7fecbc0caf10 2023-10-06T03:04:39.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecc14d8700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc0c45d0 con 0x7fecbc1591f0 2023-10-06T03:04:39.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecbb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecbc1595c0 0x7fecbc1693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:39.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecbb7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecbc1595c0 0x7fecbc1693f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53932/0 (socket says 172.21.15.125:53932) 2023-10-06T03:04:39.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecbb7fe700 1 -- 172.21.15.125:0/1046517504 learned_addr learned my addr 172.21.15.125:0/1046517504 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:39.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecbaffd700 1 --2- 172.21.15.125:0/1046517504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecbc0caf10 0x7fecbc0b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:39.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecba7fc700 1 --2- 172.21.15.125:0/1046517504 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fecbc1591f0 0x7fecbc15b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:39.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecbb7fe700 1 -- 172.21.15.125:0/1046517504 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fecbc1591f0 msgr2=0x7fecbc15b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:39.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecbb7fe700 1 --2- 172.21.15.125:0/1046517504 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fecbc1591f0 0x7fecbc15b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:39.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecbb7fe700 1 -- 172.21.15.125:0/1046517504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecbc0caf10 msgr2=0x7fecbc0b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:39.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecbb7fe700 1 --2- 172.21.15.125:0/1046517504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecbc0caf10 0x7fecbc0b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:39.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecbb7fe700 1 -- 172.21.15.125:0/1046517504 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb4009a20 con 0x7fecbc1595c0 2023-10-06T03:04:39.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecbaffd700 1 --2- 172.21.15.125:0/1046517504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecbc0caf10 0x7fecbc0b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:39.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecbb7fe700 1 --2- 172.21.15.125:0/1046517504 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecbc1595c0 0x7fecbc1693f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fecb40097c0 tx=0x7fecb4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:39.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7feca2ffd700 1 -- 172.21.15.125:0/1046517504 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb4012d10 con 0x7fecbc1595c0 2023-10-06T03:04:39.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7feca2ffd700 1 -- 172.21.15.125:0/1046517504 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb4012e90 con 0x7fecbc1595c0 2023-10-06T03:04:39.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecc14d8700 1 -- 172.21.15.125:0/1046517504 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecbc0c48b0 con 0x7fecbc1595c0 2023-10-06T03:04:39.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7feca2ffd700 1 -- 172.21.15.125:0/1046517504 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb40266b0 con 0x7fecbc1595c0 2023-10-06T03:04:39.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.706+0000 7fecc14d8700 1 -- 172.21.15.125:0/1046517504 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecbc0c3bc0 con 0x7fecbc1595c0 2023-10-06T03:04:39.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.707+0000 7fecc14d8700 1 -- 172.21.15.125:0/1046517504 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecbc0c3db0 con 0x7fecbc1595c0 2023-10-06T03:04:39.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.708+0000 7feca2ffd700 1 -- 172.21.15.125:0/1046517504 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fecb401d440 con 0x7fecbc1595c0 2023-10-06T03:04:39.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.708+0000 7feca2ffd700 1 --2- 172.21.15.125:0/1046517504 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7feca8066f30 0x7feca80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:39.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.708+0000 7feca2ffd700 1 -- 172.21.15.125:0/1046517504 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fecb4086e00 con 0x7fecbc1595c0 2023-10-06T03:04:39.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.708+0000 7fecbaffd700 1 --2- 172.21.15.125:0/1046517504 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7feca8066f30 0x7feca80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:39.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.708+0000 7fecbaffd700 1 --2- 172.21.15.125:0/1046517504 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7feca8066f30 0x7feca80693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fecb0003990 tx=0x7fecb0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:39.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.712+0000 7feca2ffd700 1 -- 172.21.15.125:0/1046517504 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fecb4053cd0 con 0x7fecbc1595c0 2023-10-06T03:04:39.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.896+0000 7fecc14d8700 1 -- 172.21.15.125:0/1046517504 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecbc066510 con 0x7fecbc1595c0 2023-10-06T03:04:39.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.897+0000 7feca2ffd700 1 -- 172.21.15.125:0/1046517504 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18851 (secure 0 0 0) 0x7fecb4016090 con 0x7fecbc1595c0 2023-10-06T03:04:39.898 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:39.898 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:33.645139+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:04:26.828121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:04:28.179225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:04:31.256394+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:04:39.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.899+0000 7fecc14d8700 1 -- 172.21.15.125:0/1046517504 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7feca8066f30 msgr2=0x7feca80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:39.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.899+0000 7fecc14d8700 1 --2- 172.21.15.125:0/1046517504 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7feca8066f30 0x7feca80693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fecb0003990 tx=0x7fecb0009040 comp rx=0 tx=0).stop 2023-10-06T03:04:39.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.899+0000 7fecc14d8700 1 -- 172.21.15.125:0/1046517504 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecbc1595c0 msgr2=0x7fecbc1693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:39.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.899+0000 7fecc14d8700 1 --2- 172.21.15.125:0/1046517504 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecbc1595c0 0x7fecbc1693f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fecb40097c0 tx=0x7fecb4017000 comp rx=0 tx=0).stop 2023-10-06T03:04:39.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.899+0000 7fecc14d8700 1 -- 172.21.15.125:0/1046517504 shutdown_connections 2023-10-06T03:04:39.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.899+0000 7fecc14d8700 1 --2- 172.21.15.125:0/1046517504 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7feca8066f30 0x7feca80693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:39.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.899+0000 7fecc14d8700 1 --2- 172.21.15.125:0/1046517504 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fecbc1595c0 0x7fecbc1693f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:39.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.899+0000 7fecc14d8700 1 --2- 172.21.15.125:0/1046517504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fecbc0caf10 0x7fecbc0b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:39.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.899+0000 7fecc14d8700 1 --2- 172.21.15.125:0/1046517504 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fecbc1591f0 0x7fecbc15b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:39.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.899+0000 7fecc14d8700 1 -- 172.21.15.125:0/1046517504 >> 172.21.15.125:0/1046517504 conn(0x7fecbc06ed40 msgr2=0x7fecbc0cd020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:39.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.899+0000 7fecc14d8700 1 -- 172.21.15.125:0/1046517504 shutdown_connections 2023-10-06T03:04:39.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:39.899+0000 7fecc14d8700 1 -- 172.21.15.125:0/1046517504 wait complete. 2023-10-06T03:04:39.912 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:04:40.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.034+0000 7f72cf488700 1 Processor -- start 2023-10-06T03:04:40.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.034+0000 7f72cf488700 1 -- start start 2023-10-06T03:04:40.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.035+0000 7f72cf488700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f72c80af320 0x7f72c80caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:40.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.035+0000 7f72cf488700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72c80ca190 0x7f72c8067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:40.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.035+0000 7f72cf488700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c80cafe0 con 0x7f72c8067b50 2023-10-06T03:04:40.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.035+0000 7f72cf488700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c8067fd0 con 0x7f72c80af320 2023-10-06T03:04:40.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.035+0000 7f72cf488700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80c3b40 con 0x7f72c80ca190 2023-10-06T03:04:40.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.035+0000 7f72cd224700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f72c80af320 0x7f72c80caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:40.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.035+0000 7f72cd224700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f72c80af320 0x7f72c80caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53934/0 (socket says 172.21.15.125:53934) 2023-10-06T03:04:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.035+0000 7f72cda25700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f72c8067b50 0x7f72c80c1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58030/0 (socket says 172.21.15.125:58030) 2023-10-06T03:04:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.035+0000 7f72cd224700 1 -- 172.21.15.125:0/175366840 learned_addr learned my addr 172.21.15.125:0/175366840 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.035+0000 7f72cca23700 1 --2- 172.21.15.125:0/175366840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72c80ca190 0x7f72c8067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.035+0000 7f72cd224700 1 -- 172.21.15.125:0/175366840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72c80ca190 msgr2=0x7f72c8067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.035+0000 7f72cd224700 1 --2- 172.21.15.125:0/175366840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72c80ca190 0x7f72c8067610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.035+0000 7f72cd224700 1 -- 172.21.15.125:0/175366840 >> v1:172.21.15.125:6789/0 conn(0x7f72c8067b50 legacy=0x7f72c80c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.035+0000 7f72cd224700 1 -- 172.21.15.125:0/175366840 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c80ca710 con 0x7f72c80af320 2023-10-06T03:04:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.036+0000 7f72cd224700 1 --2- 172.21.15.125:0/175366840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c80af320 0x7f72c80caaa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009990 tx=0x7f72c4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3203a3e351eb80dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.036+0000 7f72bffff700 1 -- 172.21.15.125:0/175366840 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4005c10 con 0x7f72c80af320 2023-10-06T03:04:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.036+0000 7f72bffff700 1 -- 172.21.15.125:0/175366840 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c4005d70 con 0x7f72c80af320 2023-10-06T03:04:40.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.036+0000 7f72bffff700 1 -- 172.21.15.125:0/175366840 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c400b8a0 con 0x7f72c80af320 2023-10-06T03:04:40.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.036+0000 7f72cf488700 1 -- 172.21.15.125:0/175366840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c80af320 msgr2=0x7f72c80caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:40.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.036+0000 7f72cf488700 1 --2- 172.21.15.125:0/175366840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c80af320 0x7f72c80caaa0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009990 tx=0x7f72c4009220 comp rx=0 tx=0).stop 2023-10-06T03:04:40.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.036+0000 7f72cf488700 1 -- 172.21.15.125:0/175366840 shutdown_connections 2023-10-06T03:04:40.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.036+0000 7f72cf488700 1 --2- 172.21.15.125:0/175366840 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c80af320 0x7f72c80caaa0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:40.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.036+0000 7f72cf488700 1 --2- 172.21.15.125:0/175366840 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72c80ca190 0x7f72c8067610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:40.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.036+0000 7f72cf488700 1 -- 172.21.15.125:0/175366840 >> 172.21.15.125:0/175366840 conn(0x7f72c8096120 msgr2=0x7f72c8068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:40.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.036+0000 7f72cf488700 1 -- 172.21.15.125:0/175366840 shutdown_connections 2023-10-06T03:04:40.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.036+0000 7f72cf488700 1 -- 172.21.15.125:0/175366840 wait complete. 2023-10-06T03:04:40.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.038+0000 7f72cf488700 1 Processor -- start 2023-10-06T03:04:40.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.038+0000 7f72cf488700 1 -- start start 2023-10-06T03:04:40.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72cf488700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c8067b50 0x7f72c815c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:40.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72cf488700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72c80af320 0x7f72c80c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:40.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72cf488700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c80ca190 0x7f72c8157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:40.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72cf488700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80c44c0 con 0x7f72c8067b50 2023-10-06T03:04:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72cf488700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80c4760 con 0x7f72c80ca190 2023-10-06T03:04:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72cf488700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80c4a40 con 0x7f72c80af320 2023-10-06T03:04:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72cd224700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c8067b50 0x7f72c815c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72cd224700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c8067b50 0x7f72c815c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53936/0 (socket says 172.21.15.125:53936) 2023-10-06T03:04:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72cd224700 1 -- 172.21.15.125:0/3999684505 learned_addr learned my addr 172.21.15.125:0/3999684505 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72cca23700 1 --2- 172.21.15.125:0/3999684505 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72c80af320 0x7f72c80c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72cda25700 1 --2- 172.21.15.125:0/3999684505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c80ca190 0x7f72c8157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72cd224700 1 -- 172.21.15.125:0/3999684505 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72c80af320 msgr2=0x7f72c80c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:40.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72cd224700 1 --2- 172.21.15.125:0/3999684505 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72c80af320 0x7f72c80c3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:40.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72cd224700 1 -- 172.21.15.125:0/3999684505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c80ca190 msgr2=0x7f72c8157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:40.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72cd224700 1 --2- 172.21.15.125:0/3999684505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c80ca190 0x7f72c8157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:40.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72cd224700 1 -- 172.21.15.125:0/3999684505 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c4009480 con 0x7f72c8067b50 2023-10-06T03:04:40.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72cd224700 1 --2- 172.21.15.125:0/3999684505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c8067b50 0x7f72c815c100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f72c806df40 tx=0x7f72c4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:40.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72bd7fa700 1 -- 172.21.15.125:0/3999684505 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c401a420 con 0x7f72c8067b50 2023-10-06T03:04:40.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72bd7fa700 1 -- 172.21.15.125:0/3999684505 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c401a580 con 0x7f72c8067b50 2023-10-06T03:04:40.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72bd7fa700 1 -- 172.21.15.125:0/3999684505 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c401a940 con 0x7f72c8067b50 2023-10-06T03:04:40.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.039+0000 7f72cf488700 1 -- 172.21.15.125:0/3999684505 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c80c4d20 con 0x7f72c8067b50 2023-10-06T03:04:40.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.040+0000 7f72cf488700 1 -- 172.21.15.125:0/3999684505 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c80c52e0 con 0x7f72c8067b50 2023-10-06T03:04:40.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.040+0000 7f72cf488700 1 -- 172.21.15.125:0/3999684505 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c8066510 con 0x7f72c8067b50 2023-10-06T03:04:40.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.041+0000 7f72bd7fa700 1 -- 172.21.15.125:0/3999684505 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72c401ad30 con 0x7f72c8067b50 2023-10-06T03:04:40.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.041+0000 7f72bd7fa700 1 --2- 172.21.15.125:0/3999684505 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f72ac066f30 0x7f72ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:40.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.041+0000 7f72bd7fa700 1 -- 172.21.15.125:0/3999684505 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f72c4085e40 con 0x7f72c8067b50 2023-10-06T03:04:40.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.041+0000 7f72cca23700 1 --2- 172.21.15.125:0/3999684505 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f72ac066f30 0x7f72ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:40.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.042+0000 7f72cca23700 1 --2- 172.21.15.125:0/3999684505 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f72ac066f30 0x7f72ac0693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f72c80b2950 tx=0x7f72b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:40.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.045+0000 7f72bd7fa700 1 -- 172.21.15.125:0/3999684505 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72c4052c60 con 0x7f72c8067b50 2023-10-06T03:04:40.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:40.270+0000 7f72cf488700 1 -- 172.21.15.125:0/3999684505 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f72c80cc750 con 0x7f72c8067b50 2023-10-06T03:04:41.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.275+0000 7f72bd7fa700 1 -- 172.21.15.125:0/3999684505 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f72c4029020 con 0x7f72c8067b50 2023-10-06T03:04:41.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.278+0000 7f72cf488700 1 -- 172.21.15.125:0/3999684505 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f72ac066f30 msgr2=0x7f72ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:41.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.278+0000 7f72cf488700 1 --2- 172.21.15.125:0/3999684505 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f72ac066f30 0x7f72ac0693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f72c80b2950 tx=0x7f72b8008040 comp rx=0 tx=0).stop 2023-10-06T03:04:41.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.278+0000 7f72cf488700 1 -- 172.21.15.125:0/3999684505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c8067b50 msgr2=0x7f72c815c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:41.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.278+0000 7f72cf488700 1 --2- 172.21.15.125:0/3999684505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c8067b50 0x7f72c815c100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f72c806df40 tx=0x7f72c4016000 comp rx=0 tx=0).stop 2023-10-06T03:04:41.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.278+0000 7f72cf488700 1 -- 172.21.15.125:0/3999684505 shutdown_connections 2023-10-06T03:04:41.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.278+0000 7f72cf488700 1 --2- 172.21.15.125:0/3999684505 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f72ac066f30 0x7f72ac0693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:41.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.278+0000 7f72cf488700 1 --2- 172.21.15.125:0/3999684505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c80ca190 0x7f72c8157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:41.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.278+0000 7f72cf488700 1 --2- 172.21.15.125:0/3999684505 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72c8067b50 0x7f72c815c100 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:41.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.278+0000 7f72cf488700 1 --2- 172.21.15.125:0/3999684505 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72c80af320 0x7f72c80c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:41.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.278+0000 7f72cf488700 1 -- 172.21.15.125:0/3999684505 >> 172.21.15.125:0/3999684505 conn(0x7f72c8096120 msgr2=0x7f72c80c8cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:41.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.278+0000 7f72cf488700 1 -- 172.21.15.125:0/3999684505 shutdown_connections 2023-10-06T03:04:41.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.278+0000 7f72cf488700 1 -- 172.21.15.125:0/3999684505 wait complete. 2023-10-06T03:04:41.295 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:04:41.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.420+0000 7f40863ca700 1 Processor -- start 2023-10-06T03:04:41.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.420+0000 7f40863ca700 1 -- start start 2023-10-06T03:04:41.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.421+0000 7f40863ca700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40800af320 0x7f40800cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:41.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.421+0000 7f40863ca700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f40800cb880 0x7f40800c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:41.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.421+0000 7f40863ca700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f40800c8150 0x7f40801565e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:41.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.421+0000 7f40863ca700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40800c9470 con 0x7f40800c8150 2023-10-06T03:04:41.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.421+0000 7f40863ca700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40800cbcf0 con 0x7f40800cb880 2023-10-06T03:04:41.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.421+0000 7f40863ca700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40800c9b40 con 0x7f40800af320 2023-10-06T03:04:41.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.421+0000 7f4084967700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f40800c8150 0x7f40801565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:41.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.421+0000 7f4084967700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f40800c8150 0x7f40801565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53952/0 (socket says 172.21.15.125:53952) 2023-10-06T03:04:41.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.421+0000 7f4084967700 1 -- 172.21.15.125:0/2229978926 learned_addr learned my addr 172.21.15.125:0/2229978926 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:41.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.422+0000 7f407ffff700 1 --2- 172.21.15.125:0/2229978926 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40800af320 0x7f40800cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:41.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.422+0000 7f407f7fe700 1 --2- 172.21.15.125:0/2229978926 >> v2:172.21.15.130:3300/0 conn(0x7f40800cb880 0x7f40800c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:41.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.422+0000 7f4084967700 1 -- 172.21.15.125:0/2229978926 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40800af320 msgr2=0x7f40800cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:41.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.422+0000 7f4084967700 1 --2- 172.21.15.125:0/2229978926 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40800af320 0x7f40800cb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:41.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.422+0000 7f4084967700 1 -- 172.21.15.125:0/2229978926 >> v2:172.21.15.130:3300/0 conn(0x7f40800cb880 msgr2=0x7f40800c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:41.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.422+0000 7f4084967700 1 --2- 172.21.15.125:0/2229978926 >> v2:172.21.15.130:3300/0 conn(0x7f40800cb880 0x7f40800c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:41.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.422+0000 7f4084967700 1 -- 172.21.15.125:0/2229978926 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40800c85a0 con 0x7f40800c8150 2023-10-06T03:04:41.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.422+0000 7f4084967700 1 --2- 172.21.15.125:0/2229978926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40800c8150 0x7f40801565e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f408006dec0 tx=0x7f4078009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8c143e04dae803 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:41.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.422+0000 7f407effd700 1 -- 172.21.15.125:0/2229978926 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407800e070 con 0x7f40800c8150 2023-10-06T03:04:41.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.422+0000 7f407effd700 1 -- 172.21.15.125:0/2229978926 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407800ba50 con 0x7f40800c8150 2023-10-06T03:04:41.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.422+0000 7f407effd700 1 -- 172.21.15.125:0/2229978926 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40780092e0 con 0x7f40800c8150 2023-10-06T03:04:41.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.423+0000 7f40863ca700 1 -- 172.21.15.125:0/2229978926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40800c8150 msgr2=0x7f40801565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:41.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.423+0000 7f40863ca700 1 --2- 172.21.15.125:0/2229978926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40800c8150 0x7f40801565e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f408006dec0 tx=0x7f4078009840 comp rx=0 tx=0).stop 2023-10-06T03:04:41.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.423+0000 7f40863ca700 1 -- 172.21.15.125:0/2229978926 shutdown_connections 2023-10-06T03:04:41.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.423+0000 7f40863ca700 1 --2- 172.21.15.125:0/2229978926 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40800c8150 0x7f40801565e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:41.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.423+0000 7f40863ca700 1 --2- 172.21.15.125:0/2229978926 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40800af320 0x7f40800cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:41.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.423+0000 7f40863ca700 1 --2- 172.21.15.125:0/2229978926 >> v2:172.21.15.130:3300/0 conn(0x7f40800cb880 0x7f40800c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:41.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.423+0000 7f40863ca700 1 -- 172.21.15.125:0/2229978926 >> 172.21.15.125:0/2229978926 conn(0x7f4080096120 msgr2=0x7f4080068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:41.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.423+0000 7f40863ca700 1 -- 172.21.15.125:0/2229978926 shutdown_connections 2023-10-06T03:04:41.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.423+0000 7f40863ca700 1 -- 172.21.15.125:0/2229978926 wait complete. 2023-10-06T03:04:41.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.424+0000 7f40863ca700 1 Processor -- start 2023-10-06T03:04:41.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.424+0000 7f40863ca700 1 -- start start 2023-10-06T03:04:41.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f40863ca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40800af320 0x7f4080153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:41.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f40863ca700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40800c8150 0x7f40801563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:41.429 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f40863ca700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40800cb880 0x7f4080157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:41.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f40863ca700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4080156d40 con 0x7f40800af320 2023-10-06T03:04:41.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f40863ca700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4080157020 con 0x7f40800c8150 2023-10-06T03:04:41.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f40863ca700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4080157300 con 0x7f40800cb880 2023-10-06T03:04:41.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f407ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40800af320 0x7f4080153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:41.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f407ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40800af320 0x7f4080153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53958/0 (socket says 172.21.15.125:53958) 2023-10-06T03:04:41.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f407ffff700 1 -- 172.21.15.125:0/3439298560 learned_addr learned my addr 172.21.15.125:0/3439298560 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:41.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f407f7fe700 1 --2- 172.21.15.125:0/3439298560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40800c8150 0x7f40801563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:41.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f4084967700 1 --2- 172.21.15.125:0/3439298560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40800cb880 0x7f4080157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:41.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f407ffff700 1 -- 172.21.15.125:0/3439298560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40800cb880 msgr2=0x7f4080157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:41.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f407ffff700 1 --2- 172.21.15.125:0/3439298560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40800cb880 0x7f4080157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:41.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f407ffff700 1 -- 172.21.15.125:0/3439298560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40800c8150 msgr2=0x7f40801563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:41.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f407ffff700 1 --2- 172.21.15.125:0/3439298560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40800c8150 0x7f40801563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:41.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f407ffff700 1 -- 172.21.15.125:0/3439298560 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4078009ae0 con 0x7f40800af320 2023-10-06T03:04:41.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f407ffff700 1 --2- 172.21.15.125:0/3439298560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40800af320 0x7f4080153560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f407000c850 tx=0x7f4070008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:41.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f4077fff700 1 -- 172.21.15.125:0/3439298560 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4070011600 con 0x7f40800af320 2023-10-06T03:04:41.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f4077fff700 1 -- 172.21.15.125:0/3439298560 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4070011760 con 0x7f40800af320 2023-10-06T03:04:41.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f40863ca700 1 -- 172.21.15.125:0/3439298560 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40801575e0 con 0x7f40800af320 2023-10-06T03:04:41.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f4077fff700 1 -- 172.21.15.125:0/3439298560 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4070011b20 con 0x7f40800af320 2023-10-06T03:04:41.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.425+0000 7f40863ca700 1 -- 172.21.15.125:0/3439298560 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4080153aa0 con 0x7f40800af320 2023-10-06T03:04:41.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.426+0000 7f40863ca700 1 -- 172.21.15.125:0/3439298560 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4080157b00 con 0x7f40800af320 2023-10-06T03:04:41.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.427+0000 7f4077fff700 1 -- 172.21.15.125:0/3439298560 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4070018350 con 0x7f40800af320 2023-10-06T03:04:41.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.427+0000 7f4077fff700 1 --2- 172.21.15.125:0/3439298560 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4060066f30 0x7f40600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:41.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.427+0000 7f4077fff700 1 -- 172.21.15.125:0/3439298560 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f40700845b0 con 0x7f40800af320 2023-10-06T03:04:41.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.427+0000 7f407f7fe700 1 --2- 172.21.15.125:0/3439298560 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4060066f30 0x7f40600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:41.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.428+0000 7f407f7fe700 1 --2- 172.21.15.125:0/3439298560 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4060066f30 0x7f40600693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f40800c5000 tx=0x7f4068008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:41.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.431+0000 7f4077fff700 1 -- 172.21.15.125:0/3439298560 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4080157b00 con 0x7f40800af320 2023-10-06T03:04:41.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:41.655+0000 7f40863ca700 1 -- 172.21.15.125:0/3439298560 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4080157b00 con 0x7f40800af320 2023-10-06T03:04:42.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.280+0000 7f4077fff700 1 -- 172.21.15.125:0/3439298560 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4070054e60 con 0x7f40800af320 2023-10-06T03:04:42.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.282+0000 7f40863ca700 1 -- 172.21.15.125:0/3439298560 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4060066f30 msgr2=0x7f40600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:42.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.283+0000 7f40863ca700 1 --2- 172.21.15.125:0/3439298560 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4060066f30 0x7f40600693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f40800c5000 tx=0x7f4068008040 comp rx=0 tx=0).stop 2023-10-06T03:04:42.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.283+0000 7f40863ca700 1 -- 172.21.15.125:0/3439298560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40800af320 msgr2=0x7f4080153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:42.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.283+0000 7f40863ca700 1 --2- 172.21.15.125:0/3439298560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40800af320 0x7f4080153560 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f407000c850 tx=0x7f4070008040 comp rx=0 tx=0).stop 2023-10-06T03:04:42.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.283+0000 7f40863ca700 1 -- 172.21.15.125:0/3439298560 shutdown_connections 2023-10-06T03:04:42.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.283+0000 7f40863ca700 1 --2- 172.21.15.125:0/3439298560 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4060066f30 0x7f40600693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.283+0000 7f40863ca700 1 --2- 172.21.15.125:0/3439298560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f40800cb880 0x7f4080157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.283+0000 7f40863ca700 1 --2- 172.21.15.125:0/3439298560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f40800af320 0x7f4080153560 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.283+0000 7f40863ca700 1 --2- 172.21.15.125:0/3439298560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40800c8150 0x7f40801563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.283+0000 7f40863ca700 1 -- 172.21.15.125:0/3439298560 >> 172.21.15.125:0/3439298560 conn(0x7f4080096120 msgr2=0x7f40800caf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:42.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.283+0000 7f40863ca700 1 -- 172.21.15.125:0/3439298560 shutdown_connections 2023-10-06T03:04:42.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.283+0000 7f40863ca700 1 -- 172.21.15.125:0/3439298560 wait complete. 2023-10-06T03:04:42.298 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:04:42.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.419+0000 7fc033419700 1 Processor -- start 2023-10-06T03:04:42.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.419+0000 7fc033419700 1 -- start start 2023-10-06T03:04:42.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.420+0000 7fc033419700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fc02c157bc0 0x7fc02c0ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:42.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.420+0000 7fc033419700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc02c0ceb30 0x7fc02c0c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:42.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.421+0000 7fc033419700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc02c0c9a70 con 0x7fc02c0ca440 2023-10-06T03:04:42.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.421+0000 7fc033419700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02c0c9140 con 0x7fc02c0ceb30 2023-10-06T03:04:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.421+0000 7fc033419700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc02c0c9420 con 0x7fc02c157bc0 2023-10-06T03:04:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.421+0000 7fc0309b4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc02c0ceb30 0x7fc02c0c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.421+0000 7fc0309b4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc02c0ceb30 0x7fc02c0c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53964/0 (socket says 172.21.15.125:53964) 2023-10-06T03:04:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.421+0000 7fc0309b4700 1 -- 172.21.15.125:0/3850841209 learned_addr learned my addr 172.21.15.125:0/3850841209 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.421+0000 7fc0309b4700 1 -- 172.21.15.125:0/3850841209 >> v2:172.21.15.130:3300/0 conn(0x7fc02c157bc0 msgr2=0x7fc02c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.421+0000 7fc0311b5700 1 --2- 172.21.15.125:0/3850841209 >> v2:172.21.15.130:3300/0 conn(0x7fc02c157bc0 0x7fc02c0ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.421+0000 7fc0309b4700 1 --2- 172.21.15.125:0/3850841209 >> v2:172.21.15.130:3300/0 conn(0x7fc02c157bc0 0x7fc02c0ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.421+0000 7fc0309b4700 1 -- 172.21.15.125:0/3850841209 >> v1:172.21.15.125:6789/0 conn(0x7fc02c0ca440 legacy=0x7fc02c157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.421+0000 7fc0309b4700 1 -- 172.21.15.125:0/3850841209 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02c0c9700 con 0x7fc02c0ceb30 2023-10-06T03:04:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.421+0000 7fc023fff700 1 -- 172.21.15.125:0/3850841209 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 821183763 0 0) 0x7fc02c0c9a70 con 0x7fc02c0ca440 2023-10-06T03:04:42.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.421+0000 7fc0309b4700 1 --2- 172.21.15.125:0/3850841209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc02c0ceb30 0x7fc02c0c9f00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc02c06fab0 tx=0x7fc028009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352847c8fa6154ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:42.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.421+0000 7fc023fff700 1 -- 172.21.15.125:0/3850841209 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02800b860 con 0x7fc02c0ceb30 2023-10-06T03:04:42.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.421+0000 7fc023fff700 1 -- 172.21.15.125:0/3850841209 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02800b9c0 con 0x7fc02c0ceb30 2023-10-06T03:04:42.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.421+0000 7fc023fff700 1 -- 172.21.15.125:0/3850841209 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02800bd60 con 0x7fc02c0ceb30 2023-10-06T03:04:42.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.422+0000 7fc033419700 1 -- 172.21.15.125:0/3850841209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc02c0ceb30 msgr2=0x7fc02c0c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:42.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.422+0000 7fc033419700 1 --2- 172.21.15.125:0/3850841209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc02c0ceb30 0x7fc02c0c9f00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc02c06fab0 tx=0x7fc028009250 comp rx=0 tx=0).stop 2023-10-06T03:04:42.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.422+0000 7fc033419700 1 -- 172.21.15.125:0/3850841209 shutdown_connections 2023-10-06T03:04:42.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.422+0000 7fc033419700 1 --2- 172.21.15.125:0/3850841209 >> v2:172.21.15.130:3300/0 conn(0x7fc02c157bc0 0x7fc02c0ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.422+0000 7fc033419700 1 --2- 172.21.15.125:0/3850841209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc02c0ceb30 0x7fc02c0c9f00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.422+0000 7fc033419700 1 -- 172.21.15.125:0/3850841209 >> 172.21.15.125:0/3850841209 conn(0x7fc02c067df0 msgr2=0x7fc02c0cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:42.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.422+0000 7fc033419700 1 -- 172.21.15.125:0/3850841209 shutdown_connections 2023-10-06T03:04:42.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.422+0000 7fc033419700 1 -- 172.21.15.125:0/3850841209 wait complete. 2023-10-06T03:04:42.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.423+0000 7fc033419700 1 Processor -- start 2023-10-06T03:04:42.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.423+0000 7fc033419700 1 -- start start 2023-10-06T03:04:42.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.424+0000 7fc033419700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc02c0ca440 0x7fc02c151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:42.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.424+0000 7fc033419700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc02c0ceb30 0x7fc02c0b1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:42.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.424+0000 7fc033419700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc02c157bc0 0x7fc02c15be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:42.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.424+0000 7fc033419700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c153b90 con 0x7fc02c0ceb30 2023-10-06T03:04:42.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.424+0000 7fc033419700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c0c5570 con 0x7fc02c157bc0 2023-10-06T03:04:42.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.424+0000 7fc033419700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02c0c5850 con 0x7fc02c0ca440 2023-10-06T03:04:42.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.424+0000 7fc0309b4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc02c0ceb30 0x7fc02c0b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:42.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.424+0000 7fc0309b4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc02c0ceb30 0x7fc02c0b1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53966/0 (socket says 172.21.15.125:53966) 2023-10-06T03:04:42.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.424+0000 7fc0309b4700 1 -- 172.21.15.125:0/3014022745 learned_addr learned my addr 172.21.15.125:0/3014022745 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:42.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.424+0000 7fc0311b5700 1 --2- 172.21.15.125:0/3014022745 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc02c0ca440 0x7fc02c151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:42.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.424+0000 7fc0319b6700 1 --2- 172.21.15.125:0/3014022745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc02c157bc0 0x7fc02c15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:42.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.424+0000 7fc0309b4700 1 -- 172.21.15.125:0/3014022745 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc02c0ca440 msgr2=0x7fc02c151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:42.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.424+0000 7fc0309b4700 1 --2- 172.21.15.125:0/3014022745 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc02c0ca440 0x7fc02c151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.424+0000 7fc0309b4700 1 -- 172.21.15.125:0/3014022745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc02c157bc0 msgr2=0x7fc02c15be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:42.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.424+0000 7fc0309b4700 1 --2- 172.21.15.125:0/3014022745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc02c157bc0 0x7fc02c15be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.424+0000 7fc0309b4700 1 -- 172.21.15.125:0/3014022745 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0280094f0 con 0x7fc02c0ceb30 2023-10-06T03:04:42.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.424+0000 7fc0309b4700 1 --2- 172.21.15.125:0/3014022745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc02c0ceb30 0x7fc02c0b1460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc02c06f140 tx=0x7fc028017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:42.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.425+0000 7fc0217fa700 1 -- 172.21.15.125:0/3014022745 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc028006bc0 con 0x7fc02c0ceb30 2023-10-06T03:04:42.432 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.425+0000 7fc0217fa700 1 -- 172.21.15.125:0/3014022745 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc028011e60 con 0x7fc02c0ceb30 2023-10-06T03:04:42.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.425+0000 7fc0217fa700 1 -- 172.21.15.125:0/3014022745 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02801a860 con 0x7fc02c0ceb30 2023-10-06T03:04:42.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.425+0000 7fc033419700 1 -- 172.21.15.125:0/3014022745 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02c0c5b30 con 0x7fc02c0ceb30 2023-10-06T03:04:42.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.425+0000 7fc033419700 1 -- 172.21.15.125:0/3014022745 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02c0b19a0 con 0x7fc02c0ceb30 2023-10-06T03:04:42.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.426+0000 7fc033419700 1 -- 172.21.15.125:0/3014022745 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc02c153d20 con 0x7fc02c0ceb30 2023-10-06T03:04:42.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.426+0000 7fc0217fa700 1 -- 172.21.15.125:0/3014022745 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc02801abd0 con 0x7fc02c0ceb30 2023-10-06T03:04:42.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.426+0000 7fc0217fa700 1 --2- 172.21.15.125:0/3014022745 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc010066f30 0x7fc0100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:42.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.426+0000 7fc0217fa700 1 -- 172.21.15.125:0/3014022745 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc028086400 con 0x7fc02c0ceb30 2023-10-06T03:04:42.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.427+0000 7fc0311b5700 1 --2- 172.21.15.125:0/3014022745 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc010066f30 0x7fc0100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:42.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.427+0000 7fc0311b5700 1 --2- 172.21.15.125:0/3014022745 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc010066f30 0x7fc0100693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc01c006fd0 tx=0x7fc01c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:42.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.431+0000 7fc0217fa700 1 -- 172.21.15.125:0/3014022745 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc02c153d20 con 0x7fc02c0ceb30 2023-10-06T03:04:42.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.652+0000 7fc033419700 1 -- 172.21.15.125:0/3014022745 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc02c153cd0 con 0x7fc02c0ceb30 2023-10-06T03:04:42.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.652+0000 7fc0217fa700 1 -- 172.21.15.125:0/3014022745 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7fc028053220 con 0x7fc02c0ceb30 2023-10-06T03:04:42.654 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:42.654 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/1260071130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1260071130},{"type":"v1","addr":"172.21.15.130:6834","nonce":1260071130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/63925154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":63925154},{"type":"v1","addr":"172.21.15.125:6836","nonce":63925154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/1057811891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1057811891},{"type":"v1","addr":"172.21.15.125:6837","nonce":1057811891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:04:29.211664+0000","modified":"2023-10-06T03:04:42.275374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/4004582354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":4004582354},{"type":"v1","addr":"172.21.15.130:6835","nonce":4004582354}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:04:42.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.654+0000 7fc033419700 1 -- 172.21.15.125:0/3014022745 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc010066f30 msgr2=0x7fc0100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:42.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.654+0000 7fc033419700 1 --2- 172.21.15.125:0/3014022745 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc010066f30 0x7fc0100693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc01c006fd0 tx=0x7fc01c008040 comp rx=0 tx=0).stop 2023-10-06T03:04:42.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.654+0000 7fc033419700 1 -- 172.21.15.125:0/3014022745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc02c0ceb30 msgr2=0x7fc02c0b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:42.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.654+0000 7fc033419700 1 --2- 172.21.15.125:0/3014022745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc02c0ceb30 0x7fc02c0b1460 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc02c06f140 tx=0x7fc028017000 comp rx=0 tx=0).stop 2023-10-06T03:04:42.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.655+0000 7fc033419700 1 -- 172.21.15.125:0/3014022745 shutdown_connections 2023-10-06T03:04:42.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.655+0000 7fc033419700 1 --2- 172.21.15.125:0/3014022745 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc010066f30 0x7fc0100693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.655+0000 7fc033419700 1 --2- 172.21.15.125:0/3014022745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc02c157bc0 0x7fc02c15be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.655+0000 7fc033419700 1 --2- 172.21.15.125:0/3014022745 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc02c0ca440 0x7fc02c151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.655+0000 7fc033419700 1 --2- 172.21.15.125:0/3014022745 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc02c0ceb30 0x7fc02c0b1460 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.655+0000 7fc033419700 1 -- 172.21.15.125:0/3014022745 >> 172.21.15.125:0/3014022745 conn(0x7fc02c067df0 msgr2=0x7fc02c06dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:42.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.655+0000 7fc033419700 1 -- 172.21.15.125:0/3014022745 shutdown_connections 2023-10-06T03:04:42.657 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.655+0000 7fc033419700 1 -- 172.21.15.125:0/3014022745 wait complete. 2023-10-06T03:04:42.658 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 9 2023-10-06T03:04:42.668 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:04:42.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.783+0000 7faf7cbeb700 1 Processor -- start 2023-10-06T03:04:42.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.784+0000 7faf7cbeb700 1 -- start start 2023-10-06T03:04:42.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.784+0000 7faf7cbeb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf781590d0 0x7faf7806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:42.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.784+0000 7faf7cbeb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf78067c70 con 0x7faf781594a0 2023-10-06T03:04:42.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.784+0000 7faf7cbeb700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf780c77e0 con 0x7faf780ac670 2023-10-06T03:04:42.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.784+0000 7faf7cbeb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf780c7ac0 con 0x7faf781590d0 2023-10-06T03:04:42.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.785+0000 7faf7659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faf781590d0 0x7faf7806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:42.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.785+0000 7faf76d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7faf781594a0 0x7faf78068100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58046/0 (socket says 172.21.15.125:58046) 2023-10-06T03:04:42.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.785+0000 7faf76d9d700 1 -- 172.21.15.125:0/3324333625 learned_addr learned my addr 172.21.15.125:0/3324333625 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:42.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.785+0000 7faf7559a700 1 -- 172.21.15.125:0/3324333625 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453305301 0 0) 0x7faf78067c70 con 0x7faf781594a0 2023-10-06T03:04:42.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.785+0000 7faf7559a700 1 -- 172.21.15.125:0/3324333625 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf60003570 con 0x7faf781594a0 2023-10-06T03:04:42.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.785+0000 7faf7659c700 1 -- 172.21.15.125:0/3324333625 >> v1:172.21.15.130:6789/0 conn(0x7faf780ac670 legacy=0x7faf780c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:42.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.785+0000 7faf7659c700 1 -- 172.21.15.125:0/3324333625 >> v1:172.21.15.125:6789/0 conn(0x7faf781594a0 legacy=0x7faf78068100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:42.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.785+0000 7faf7659c700 1 -- 172.21.15.125:0/3324333625 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf780c7da0 con 0x7faf781590d0 2023-10-06T03:04:42.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.785+0000 7faf7659c700 1 --2- 172.21.15.125:0/3324333625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf781590d0 0x7faf7806a8c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0098e0 tx=0x7faf6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6519ef1c7edc63b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:42.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.785+0000 7faf7559a700 1 -- 172.21.15.125:0/3324333625 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c00b640 con 0x7faf781590d0 2023-10-06T03:04:42.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.785+0000 7faf7559a700 1 -- 172.21.15.125:0/3324333625 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6c00b7a0 con 0x7faf781590d0 2023-10-06T03:04:42.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.785+0000 7faf7559a700 1 -- 172.21.15.125:0/3324333625 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c00bb40 con 0x7faf781590d0 2023-10-06T03:04:42.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.786+0000 7faf7cbeb700 1 -- 172.21.15.125:0/3324333625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf781590d0 msgr2=0x7faf7806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:42.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.786+0000 7faf7cbeb700 1 --2- 172.21.15.125:0/3324333625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf781590d0 0x7faf7806a8c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0098e0 tx=0x7faf6c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.786+0000 7faf7cbeb700 1 -- 172.21.15.125:0/3324333625 shutdown_connections 2023-10-06T03:04:42.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.786+0000 7faf7cbeb700 1 --2- 172.21.15.125:0/3324333625 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf781590d0 0x7faf7806a8c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.786+0000 7faf7cbeb700 1 -- 172.21.15.125:0/3324333625 >> 172.21.15.125:0/3324333625 conn(0x7faf780cc5a0 msgr2=0x7faf780cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:42.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.786+0000 7faf7cbeb700 1 -- 172.21.15.125:0/3324333625 shutdown_connections 2023-10-06T03:04:42.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.786+0000 7faf7cbeb700 1 -- 172.21.15.125:0/3324333625 wait complete. 2023-10-06T03:04:42.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.787+0000 7faf7cbeb700 1 Processor -- start 2023-10-06T03:04:42.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.787+0000 7faf7cbeb700 1 -- start start 2023-10-06T03:04:42.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf7cbeb700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf780ac670 0x7faf78154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:42.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf7cbeb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf781590d0 0x7faf780c4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:42.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf7cbeb700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faf781594a0 0x7faf780acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:42.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf7cbeb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf780c4ee0 con 0x7faf781590d0 2023-10-06T03:04:42.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf7cbeb700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf781698a0 con 0x7faf780ac670 2023-10-06T03:04:42.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf7cbeb700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf7816a100 con 0x7faf781594a0 2023-10-06T03:04:42.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf75d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf781590d0 0x7faf780c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:42.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf75d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf781590d0 0x7faf780c4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53978/0 (socket says 172.21.15.125:53978) 2023-10-06T03:04:42.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf75d9b700 1 -- 172.21.15.125:0/3725119412 learned_addr learned my addr 172.21.15.125:0/3725119412 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:42.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf7659c700 1 --2- 172.21.15.125:0/3725119412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf780ac670 0x7faf78154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:42.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf76d9d700 1 --2- 172.21.15.125:0/3725119412 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faf781594a0 0x7faf780acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:42.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf75d9b700 1 -- 172.21.15.125:0/3725119412 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faf781594a0 msgr2=0x7faf780acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:42.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf75d9b700 1 --2- 172.21.15.125:0/3725119412 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faf781594a0 0x7faf780acaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf75d9b700 1 -- 172.21.15.125:0/3725119412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf780ac670 msgr2=0x7faf78154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:42.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf75d9b700 1 --2- 172.21.15.125:0/3725119412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf780ac670 0x7faf78154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf75d9b700 1 -- 172.21.15.125:0/3725119412 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6c009420 con 0x7faf781590d0 2023-10-06T03:04:42.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf75d9b700 1 --2- 172.21.15.125:0/3725119412 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf781590d0 0x7faf780c4290 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faf6800c7c0 tx=0x7faf68007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:42.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf667fc700 1 -- 172.21.15.125:0/3725119412 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68011590 con 0x7faf781590d0 2023-10-06T03:04:42.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf667fc700 1 -- 172.21.15.125:0/3725119412 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf680116f0 con 0x7faf781590d0 2023-10-06T03:04:42.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf7cbeb700 1 -- 172.21.15.125:0/3725119412 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf780c4c00 con 0x7faf781590d0 2023-10-06T03:04:42.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf667fc700 1 -- 172.21.15.125:0/3725119412 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68011ab0 con 0x7faf781590d0 2023-10-06T03:04:42.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.788+0000 7faf7cbeb700 1 -- 172.21.15.125:0/3725119412 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf78169e10 con 0x7faf781590d0 2023-10-06T03:04:42.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.789+0000 7faf7cbeb700 1 -- 172.21.15.125:0/3725119412 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7816a2b0 con 0x7faf781590d0 2023-10-06T03:04:42.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.790+0000 7faf667fc700 1 -- 172.21.15.125:0/3725119412 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf6801b3b0 con 0x7faf781590d0 2023-10-06T03:04:42.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.790+0000 7faf667fc700 1 --2- 172.21.15.125:0/3725119412 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7faf58066f30 0x7faf580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:42.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.790+0000 7faf667fc700 1 -- 172.21.15.125:0/3725119412 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7faf68083f10 con 0x7faf781590d0 2023-10-06T03:04:42.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.790+0000 7faf7659c700 1 --2- 172.21.15.125:0/3725119412 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7faf58066f30 0x7faf580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:42.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.791+0000 7faf7659c700 1 --2- 172.21.15.125:0/3725119412 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7faf58066f30 0x7faf580693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0093f0 tx=0x7faf6c017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:42.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.794+0000 7faf667fc700 1 -- 172.21.15.125:0/3725119412 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf7816a2b0 con 0x7faf781590d0 2023-10-06T03:04:42.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.979+0000 7faf7cbeb700 1 -- 172.21.15.125:0/3725119412 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf7816a2b0 con 0x7faf781590d0 2023-10-06T03:04:42.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.980+0000 7faf667fc700 1 -- 172.21.15.125:0/3725119412 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18851 (secure 0 0 0) 0x7faf7816a2b0 con 0x7faf781590d0 2023-10-06T03:04:42.982 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:42.982 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:33.645139+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:04:26.828121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:04:28.179225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:04:31.256394+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:04:42.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.982+0000 7faf7cbeb700 1 -- 172.21.15.125:0/3725119412 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7faf58066f30 msgr2=0x7faf580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:42.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.982+0000 7faf7cbeb700 1 --2- 172.21.15.125:0/3725119412 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7faf58066f30 0x7faf580693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faf6c0093f0 tx=0x7faf6c017000 comp rx=0 tx=0).stop 2023-10-06T03:04:42.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.982+0000 7faf7cbeb700 1 -- 172.21.15.125:0/3725119412 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf781590d0 msgr2=0x7faf780c4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:42.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.982+0000 7faf7cbeb700 1 --2- 172.21.15.125:0/3725119412 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf781590d0 0x7faf780c4290 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faf6800c7c0 tx=0x7faf68007f50 comp rx=0 tx=0).stop 2023-10-06T03:04:42.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.982+0000 7faf7cbeb700 1 -- 172.21.15.125:0/3725119412 shutdown_connections 2023-10-06T03:04:42.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.982+0000 7faf7cbeb700 1 --2- 172.21.15.125:0/3725119412 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7faf58066f30 0x7faf580693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.984 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.982+0000 7faf7cbeb700 1 --2- 172.21.15.125:0/3725119412 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faf781594a0 0x7faf780acaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.982+0000 7faf7cbeb700 1 --2- 172.21.15.125:0/3725119412 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf780ac670 0x7faf78154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.982+0000 7faf7cbeb700 1 --2- 172.21.15.125:0/3725119412 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faf781590d0 0x7faf780c4290 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:42.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.982+0000 7faf7cbeb700 1 -- 172.21.15.125:0/3725119412 >> 172.21.15.125:0/3725119412 conn(0x7faf780cc5a0 msgr2=0x7faf78156d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:42.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.982+0000 7faf7cbeb700 1 -- 172.21.15.125:0/3725119412 shutdown_connections 2023-10-06T03:04:42.985 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:42.982+0000 7faf7cbeb700 1 -- 172.21.15.125:0/3725119412 wait complete. 2023-10-06T03:04:42.995 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:04:42.996 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:04:43.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.110+0000 7fdc40af8700 1 Processor -- start 2023-10-06T03:04:43.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.111+0000 7fdc40af8700 1 -- start start 2023-10-06T03:04:43.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.111+0000 7fdc40af8700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fdc3c1590d0 0x7fdc3c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.111+0000 7fdc40af8700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc3c0ac670 0x7fdc3c06ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.111+0000 7fdc40af8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc3c067c70 con 0x7fdc3c1594a0 2023-10-06T03:04:43.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.111+0000 7fdc40af8700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc3c069110 con 0x7fdc3c1590d0 2023-10-06T03:04:43.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.111+0000 7fdc40af8700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c0c77e0 con 0x7fdc3c0ac670 2023-10-06T03:04:43.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3ad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdc3c1594a0 0x7fdc3c0c6b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58052/0 (socket says 172.21.15.125:58052) 2023-10-06T03:04:43.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3ad9d700 1 -- 172.21.15.125:0/2509555852 learned_addr learned my addr 172.21.15.125:0/2509555852 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:43.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3a59c700 1 --2- 172.21.15.125:0/2509555852 >> v2:172.21.15.130:3300/0 conn(0x7fdc3c1590d0 0x7fdc3c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc39d9b700 1 --2- 172.21.15.125:0/2509555852 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc3c0ac670 0x7fdc3c06ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3959a700 1 -- 172.21.15.125:0/2509555852 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285495504 0 0) 0x7fdc3c067c70 con 0x7fdc3c1594a0 2023-10-06T03:04:43.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3959a700 1 -- 172.21.15.125:0/2509555852 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc24003570 con 0x7fdc3c1594a0 2023-10-06T03:04:43.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3959a700 1 -- 172.21.15.125:0/2509555852 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3981236055 0 0) 0x7fdc24003570 con 0x7fdc3c1594a0 2023-10-06T03:04:43.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3959a700 1 -- 172.21.15.125:0/2509555852 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc3c0ac670 msgr2=0x7fdc3c06ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:43.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3959a700 1 --2- 172.21.15.125:0/2509555852 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc3c0ac670 0x7fdc3c06ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3959a700 1 -- 172.21.15.125:0/2509555852 >> v2:172.21.15.130:3300/0 conn(0x7fdc3c1590d0 msgr2=0x7fdc3c06a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:43.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3959a700 1 --2- 172.21.15.125:0/2509555852 >> v2:172.21.15.130:3300/0 conn(0x7fdc3c1590d0 0x7fdc3c06a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3959a700 1 -- 172.21.15.125:0/2509555852 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c0c7ac0 con 0x7fdc3c1594a0 2023-10-06T03:04:43.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3959a700 1 -- 172.21.15.125:0/2509555852 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7fdc340017f0 con 0x7fdc3c1594a0 2023-10-06T03:04:43.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3959a700 1 -- 172.21.15.125:0/2509555852 >> v1:172.21.15.125:6789/0 conn(0x7fdc3c1594a0 legacy=0x7fdc3c0c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:43.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3959a700 1 --2- 172.21.15.125:0/2509555852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc24003a60 0x7fdc24003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3959a700 1 --2- 172.21.15.125:0/2509555852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc24004810 0x7fdc24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3959a700 1 --2- 172.21.15.125:0/2509555852 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc3c0ac670 0x7fdc240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3959a700 1 -- 172.21.15.125:0/2509555852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c069110 con 0x7fdc24003a60 2023-10-06T03:04:43.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3959a700 1 -- 172.21.15.125:0/2509555852 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c0c77e0 con 0x7fdc24004810 2023-10-06T03:04:43.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3959a700 1 -- 172.21.15.125:0/2509555852 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2400ba60 con 0x7fdc3c0ac670 2023-10-06T03:04:43.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3a59c700 1 --2- 172.21.15.125:0/2509555852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc24003a60 0x7fdc24003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc39d9b700 1 --2- 172.21.15.125:0/2509555852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc24004810 0x7fdc24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.112+0000 7fdc3ad9d700 1 --2- 172.21.15.125:0/2509555852 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc3c0ac670 0x7fdc240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.113+0000 7fdc3a59c700 1 -- 172.21.15.125:0/2509555852 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc3c0ac670 msgr2=0x7fdc240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:43.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.113+0000 7fdc3a59c700 1 --2- 172.21.15.125:0/2509555852 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc3c0ac670 0x7fdc240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.113+0000 7fdc3a59c700 1 -- 172.21.15.125:0/2509555852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc24004810 msgr2=0x7fdc24004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:43.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.113+0000 7fdc3a59c700 1 --2- 172.21.15.125:0/2509555852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc24004810 0x7fdc24004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.113+0000 7fdc3a59c700 1 -- 172.21.15.125:0/2509555852 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc24003570 con 0x7fdc24003a60 2023-10-06T03:04:43.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.113+0000 7fdc39d9b700 1 --2- 172.21.15.125:0/2509555852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc24004810 0x7fdc24004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:43.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.113+0000 7fdc3a59c700 1 --2- 172.21.15.125:0/2509555852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc24003a60 0x7fdc24003e70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdc30009c30 tx=0x7fdc300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae2684860d311f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:43.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.113+0000 7fdc3959a700 1 -- 172.21.15.125:0/2509555852 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3000e710 con 0x7fdc24003a60 2023-10-06T03:04:43.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.113+0000 7fdc3959a700 1 -- 172.21.15.125:0/2509555852 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3000e870 con 0x7fdc24003a60 2023-10-06T03:04:43.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.113+0000 7fdc3959a700 1 -- 172.21.15.125:0/2509555852 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3000ec30 con 0x7fdc24003a60 2023-10-06T03:04:43.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.113+0000 7fdc40af8700 1 -- 172.21.15.125:0/2509555852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc24003a60 msgr2=0x7fdc24003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:43.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.113+0000 7fdc40af8700 1 --2- 172.21.15.125:0/2509555852 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc24003a60 0x7fdc24003e70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdc30009c30 tx=0x7fdc300091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.113+0000 7fdc3ad9d700 1 -- 172.21.15.125:0/2509555852 reap_dead start 2023-10-06T03:04:43.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.113+0000 7fdc40af8700 1 -- 172.21.15.125:0/2509555852 shutdown_connections 2023-10-06T03:04:43.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.113+0000 7fdc40af8700 1 -- 172.21.15.125:0/2509555852 >> 172.21.15.125:0/2509555852 conn(0x7fdc3c0cc5a0 msgr2=0x7fdc3c0cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:43.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.113+0000 7fdc40af8700 1 -- 172.21.15.125:0/2509555852 shutdown_connections 2023-10-06T03:04:43.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.113+0000 7fdc40af8700 1 -- 172.21.15.125:0/2509555852 wait complete. 2023-10-06T03:04:43.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.114+0000 7fdc40af8700 1 Processor -- start 2023-10-06T03:04:43.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.115+0000 7fdc40af8700 1 -- start start 2023-10-06T03:04:43.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.115+0000 7fdc40af8700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc24003a60 0x7fdc3c14c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.115+0000 7fdc40af8700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc3c15b120 0x7fdc3c14c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.115+0000 7fdc40af8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc3c0c2fe0 0x7fdc3c0ad310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.115+0000 7fdc40af8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c14c560 con 0x7fdc3c0c2fe0 2023-10-06T03:04:43.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.115+0000 7fdc40af8700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c1699a0 con 0x7fdc24003a60 2023-10-06T03:04:43.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.115+0000 7fdc40af8700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc3c169c80 con 0x7fdc3c15b120 2023-10-06T03:04:43.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.115+0000 7fdc3ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc3c0c2fe0 0x7fdc3c0ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.115+0000 7fdc3ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc3c0c2fe0 0x7fdc3c0ad310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:53998/0 (socket says 172.21.15.125:53998) 2023-10-06T03:04:43.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.115+0000 7fdc3ad9d700 1 -- 172.21.15.125:0/3828558093 learned_addr learned my addr 172.21.15.125:0/3828558093 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:43.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.115+0000 7fdc39d9b700 1 --2- 172.21.15.125:0/3828558093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc3c15b120 0x7fdc3c14c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.115+0000 7fdc3a59c700 1 --2- 172.21.15.125:0/3828558093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc24003a60 0x7fdc3c14c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.116+0000 7fdc3ad9d700 1 -- 172.21.15.125:0/3828558093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc3c15b120 msgr2=0x7fdc3c14c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:43.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.116+0000 7fdc3ad9d700 1 --2- 172.21.15.125:0/3828558093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc3c15b120 0x7fdc3c14c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.116+0000 7fdc3ad9d700 1 -- 172.21.15.125:0/3828558093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc24003a60 msgr2=0x7fdc3c14c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:43.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.116+0000 7fdc3ad9d700 1 --2- 172.21.15.125:0/3828558093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc24003a60 0x7fdc3c14c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.116+0000 7fdc3ad9d700 1 -- 172.21.15.125:0/3828558093 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c169f60 con 0x7fdc3c0c2fe0 2023-10-06T03:04:43.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.116+0000 7fdc3ad9d700 1 --2- 172.21.15.125:0/3828558093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc3c0c2fe0 0x7fdc3c0ad310 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdc34001350 tx=0x7fdc34001890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:43.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.116+0000 7fdc2a7fc700 1 -- 172.21.15.125:0/3828558093 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3400eb10 con 0x7fdc3c0c2fe0 2023-10-06T03:04:43.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.116+0000 7fdc2a7fc700 1 -- 172.21.15.125:0/3828558093 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3400ec70 con 0x7fdc3c0c2fe0 2023-10-06T03:04:43.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.116+0000 7fdc2a7fc700 1 -- 172.21.15.125:0/3828558093 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc34013420 con 0x7fdc3c0c2fe0 2023-10-06T03:04:43.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.116+0000 7fdc40af8700 1 -- 172.21.15.125:0/3828558093 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc3c16a240 con 0x7fdc3c0c2fe0 2023-10-06T03:04:43.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.116+0000 7fdc40af8700 1 -- 172.21.15.125:0/3828558093 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc3c159a20 con 0x7fdc3c0c2fe0 2023-10-06T03:04:43.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.117+0000 7fdc40af8700 1 -- 172.21.15.125:0/3828558093 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc3c159c10 con 0x7fdc3c0c2fe0 2023-10-06T03:04:43.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.117+0000 7fdc2a7fc700 1 -- 172.21.15.125:0/3828558093 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc34013870 con 0x7fdc3c0c2fe0 2023-10-06T03:04:43.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.118+0000 7fdc2a7fc700 1 --2- 172.21.15.125:0/3828558093 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdc1c066f30 0x7fdc1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.118+0000 7fdc2a7fc700 1 -- 172.21.15.125:0/3828558093 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fdc34084e60 con 0x7fdc3c0c2fe0 2023-10-06T03:04:43.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.118+0000 7fdc3a59c700 1 --2- 172.21.15.125:0/3828558093 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdc1c066f30 0x7fdc1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.118+0000 7fdc3a59c700 1 --2- 172.21.15.125:0/3828558093 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdc1c066f30 0x7fdc1c0693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdc300091e0 tx=0x7fdc3001a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:43.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.122+0000 7fdc2a7fc700 1 -- 172.21.15.125:0/3828558093 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc3c159c10 con 0x7fdc3c0c2fe0 2023-10-06T03:04:43.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.300+0000 7fdc40af8700 1 -- 172.21.15.125:0/3828558093 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc3c159c10 con 0x7fdc1c066f30 2023-10-06T03:04:43.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.310+0000 7fdc2a7fc700 1 -- 172.21.15.125:0/3828558093 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367369 (secure 0 0 0) 0x7fdc3c159c10 con 0x7fdc1c066f30 2023-10-06T03:04:43.316 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:43.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.314+0000 7fdc40af8700 1 -- 172.21.15.125:0/3828558093 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdc1c066f30 msgr2=0x7fdc1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:43.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.314+0000 7fdc40af8700 1 --2- 172.21.15.125:0/3828558093 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdc1c066f30 0x7fdc1c0693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdc300091e0 tx=0x7fdc3001a000 comp rx=0 tx=0).stop 2023-10-06T03:04:43.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.314+0000 7fdc40af8700 1 -- 172.21.15.125:0/3828558093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc3c0c2fe0 msgr2=0x7fdc3c0ad310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:43.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.314+0000 7fdc40af8700 1 --2- 172.21.15.125:0/3828558093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc3c0c2fe0 0x7fdc3c0ad310 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdc34001350 tx=0x7fdc34001890 comp rx=0 tx=0).stop 2023-10-06T03:04:43.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.314+0000 7fdc40af8700 1 -- 172.21.15.125:0/3828558093 shutdown_connections 2023-10-06T03:04:43.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.314+0000 7fdc40af8700 1 --2- 172.21.15.125:0/3828558093 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdc1c066f30 0x7fdc1c0693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.314+0000 7fdc40af8700 1 --2- 172.21.15.125:0/3828558093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdc3c0c2fe0 0x7fdc3c0ad310 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.314+0000 7fdc40af8700 1 --2- 172.21.15.125:0/3828558093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc24003a60 0x7fdc3c14c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.314+0000 7fdc40af8700 1 --2- 172.21.15.125:0/3828558093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdc3c15b120 0x7fdc3c14c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.314+0000 7fdc40af8700 1 -- 172.21.15.125:0/3828558093 >> 172.21.15.125:0/3828558093 conn(0x7fdc3c0cc5a0 msgr2=0x7fdc3c06e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:43.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.314+0000 7fdc40af8700 1 -- 172.21.15.125:0/3828558093 shutdown_connections 2023-10-06T03:04:43.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.314+0000 7fdc40af8700 1 -- 172.21.15.125:0/3828558093 wait complete. 2023-10-06T03:04:43.319 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-06T03:04:43.327 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-10-06T03:04:41.809393+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594853,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381796,"kb_used_data":3492,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592924,"statfs":{"total":773094113280,"available":770655154176,"internally_reserved":0,"allocated":3575808,"data_stored":2145279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2179,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.563869"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257885+0000","last_change":"2023-10-06T03:04:29.236716+0000","last_active":"2023-10-06T03:04:33.257885+0000","last_peered":"2023-10-06T03:04:33.257885+0000","last_clean":"2023-10-06T03:04:33.257885+0000","last_became_active":"2023-10-06T03:04:29.236437+0000","last_became_peered":"2023-10-06T03:04:29.236437+0000","last_unstale":"2023-10-06T03:04:33.257885+0000","last_undegraded":"2023-10-06T03:04:33.257885+0000","last_fullsized":"2023-10-06T03:04:33.257885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:20.456488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.248189+0000","last_change":"2023-10-06T03:04:29.250536+0000","last_active":"2023-10-06T03:04:33.248189+0000","last_peered":"2023-10-06T03:04:33.248189+0000","last_clean":"2023-10-06T03:04:33.248189+0000","last_became_active":"2023-10-06T03:04:29.249872+0000","last_became_peered":"2023-10-06T03:04:29.249872+0000","last_unstale":"2023-10-06T03:04:33.248189+0000","last_undegraded":"2023-10-06T03:04:33.248189+0000","last_fullsized":"2023-10-06T03:04:33.248189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:06.710555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251359+0000","last_change":"2023-10-06T03:04:29.244837+0000","last_active":"2023-10-06T03:04:33.251359+0000","last_peered":"2023-10-06T03:04:33.251359+0000","last_clean":"2023-10-06T03:04:33.251359+0000","last_became_active":"2023-10-06T03:04:29.244485+0000","last_became_peered":"2023-10-06T03:04:29.244485+0000","last_unstale":"2023-10-06T03:04:33.251359+0000","last_undegraded":"2023-10-06T03:04:33.251359+0000","last_fullsized":"2023-10-06T03:04:33.251359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:22.025761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251807+0000","last_change":"2023-10-06T03:04:29.244101+0000","last_active":"2023-10-06T03:04:33.251807+0000","last_peered":"2023-10-06T03:04:33.251807+0000","last_clean":"2023-10-06T03:04:33.251807+0000","last_became_active":"2023-10-06T03:04:29.243769+0000","last_became_peered":"2023-10-06T03:04:29.243769+0000","last_unstale":"2023-10-06T03:04:33.251807+0000","last_undegraded":"2023-10-06T03:04:33.251807+0000","last_fullsized":"2023-10-06T03:04:33.251807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:03.973528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260210+0000","last_change":"2023-10-06T03:04:29.245074+0000","last_active":"2023-10-06T03:04:33.260210+0000","last_peered":"2023-10-06T03:04:33.260210+0000","last_clean":"2023-10-06T03:04:33.260210+0000","last_became_active":"2023-10-06T03:04:29.244794+0000","last_became_peered":"2023-10-06T03:04:29.244794+0000","last_unstale":"2023-10-06T03:04:33.260210+0000","last_undegraded":"2023-10-06T03:04:33.260210+0000","last_fullsized":"2023-10-06T03:04:33.260210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:14.635872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251200+0000","last_change":"2023-10-06T03:04:29.248647+0000","last_active":"2023-10-06T03:04:33.251200+0000","last_peered":"2023-10-06T03:04:33.251200+0000","last_clean":"2023-10-06T03:04:33.251200+0000","last_became_active":"2023-10-06T03:04:29.248380+0000","last_became_peered":"2023-10-06T03:04:29.248380+0000","last_unstale":"2023-10-06T03:04:33.251200+0000","last_undegraded":"2023-10-06T03:04:33.251200+0000","last_fullsized":"2023-10-06T03:04:33.251200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:03.691892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255155+0000","last_change":"2023-10-06T03:04:29.249718+0000","last_active":"2023-10-06T03:04:33.255155+0000","last_peered":"2023-10-06T03:04:33.255155+0000","last_clean":"2023-10-06T03:04:33.255155+0000","last_became_active":"2023-10-06T03:04:29.249402+0000","last_became_peered":"2023-10-06T03:04:29.249402+0000","last_unstale":"2023-10-06T03:04:33.255155+0000","last_undegraded":"2023-10-06T03:04:33.255155+0000","last_fullsized":"2023-10-06T03:04:33.255155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247799+0000","last_change":"2023-10-06T03:04:29.252781+0000","last_active":"2023-10-06T03:04:33.247799+0000","last_peered":"2023-10-06T03:04:33.247799+0000","last_clean":"2023-10-06T03:04:33.247799+0000","last_became_active":"2023-10-06T03:04:29.252492+0000","last_became_peered":"2023-10-06T03:04:29.252492+0000","last_unstale":"2023-10-06T03:04:33.247799+0000","last_undegraded":"2023-10-06T03:04:33.247799+0000","last_fullsized":"2023-10-06T03:04:33.247799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:27.111880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260274+0000","last_change":"2023-10-06T03:04:29.248896+0000","last_active":"2023-10-06T03:04:33.260274+0000","last_peered":"2023-10-06T03:04:33.260274+0000","last_clean":"2023-10-06T03:04:33.260274+0000","last_became_active":"2023-10-06T03:04:29.248629+0000","last_became_peered":"2023-10-06T03:04:29.248629+0000","last_unstale":"2023-10-06T03:04:33.260274+0000","last_undegraded":"2023-10-06T03:04:33.260274+0000","last_fullsized":"2023-10-06T03:04:33.260274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:07.410542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.248372+0000","last_change":"2023-10-06T03:04:29.249187+0000","last_active":"2023-10-06T03:04:33.248372+0000","last_peered":"2023-10-06T03:04:33.248372+0000","last_clean":"2023-10-06T03:04:33.248372+0000","last_became_active":"2023-10-06T03:04:29.248914+0000","last_became_peered":"2023-10-06T03:04:29.248914+0000","last_unstale":"2023-10-06T03:04:33.248372+0000","last_undegraded":"2023-10-06T03:04:33.248372+0000","last_fullsized":"2023-10-06T03:04:33.248372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:07.410542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251508+0000","last_change":"2023-10-06T03:04:29.254043+0000","last_active":"2023-10-06T03:04:33.251508+0000","last_peered":"2023-10-06T03:04:33.251508+0000","last_clean":"2023-10-06T03:04:33.251508+0000","last_became_active":"2023-10-06T03:04:29.253749+0000","last_became_peered":"2023-10-06T03:04:29.253749+0000","last_unstale":"2023-10-06T03:04:33.251508+0000","last_undegraded":"2023-10-06T03:04:33.251508+0000","last_fullsized":"2023-10-06T03:04:33.251508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:56.032368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256021+0000","last_change":"2023-10-06T03:04:29.248689+0000","last_active":"2023-10-06T03:04:33.256021+0000","last_peered":"2023-10-06T03:04:33.256021+0000","last_clean":"2023-10-06T03:04:33.256021+0000","last_became_active":"2023-10-06T03:04:29.248400+0000","last_became_peered":"2023-10-06T03:04:29.248400+0000","last_unstale":"2023-10-06T03:04:33.256021+0000","last_undegraded":"2023-10-06T03:04:33.256021+0000","last_fullsized":"2023-10-06T03:04:33.256021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:23.078369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252308+0000","last_change":"2023-10-06T03:04:29.238874+0000","last_active":"2023-10-06T03:04:33.252308+0000","last_peered":"2023-10-06T03:04:33.252308+0000","last_clean":"2023-10-06T03:04:33.252308+0000","last_became_active":"2023-10-06T03:04:29.238616+0000","last_became_peered":"2023-10-06T03:04:29.238616+0000","last_unstale":"2023-10-06T03:04:33.252308+0000","last_undegraded":"2023-10-06T03:04:33.252308+0000","last_fullsized":"2023-10-06T03:04:33.252308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:05.482076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247717+0000","last_change":"2023-10-06T03:04:29.248968+0000","last_active":"2023-10-06T03:04:33.247717+0000","last_peered":"2023-10-06T03:04:33.247717+0000","last_clean":"2023-10-06T03:04:33.247717+0000","last_became_active":"2023-10-06T03:04:29.248709+0000","last_became_peered":"2023-10-06T03:04:29.248709+0000","last_unstale":"2023-10-06T03:04:33.247717+0000","last_undegraded":"2023-10-06T03:04:33.247717+0000","last_fullsized":"2023-10-06T03:04:33.247717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:41.163677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254258+0000","last_change":"2023-10-06T03:04:29.253102+0000","last_active":"2023-10-06T03:04:33.254258+0000","last_peered":"2023-10-06T03:04:33.254258+0000","last_clean":"2023-10-06T03:04:33.254258+0000","last_became_active":"2023-10-06T03:04:29.252836+0000","last_became_peered":"2023-10-06T03:04:29.252836+0000","last_unstale":"2023-10-06T03:04:33.254258+0000","last_undegraded":"2023-10-06T03:04:33.254258+0000","last_fullsized":"2023-10-06T03:04:33.254258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251098+0000","last_change":"2023-10-06T03:04:29.244988+0000","last_active":"2023-10-06T03:04:33.251098+0000","last_peered":"2023-10-06T03:04:33.251098+0000","last_clean":"2023-10-06T03:04:33.251098+0000","last_became_active":"2023-10-06T03:04:29.244457+0000","last_became_peered":"2023-10-06T03:04:29.244457+0000","last_unstale":"2023-10-06T03:04:33.251098+0000","last_undegraded":"2023-10-06T03:04:33.251098+0000","last_fullsized":"2023-10-06T03:04:33.251098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:20.580002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260392+0000","last_change":"2023-10-06T03:04:29.242343+0000","last_active":"2023-10-06T03:04:33.260392+0000","last_peered":"2023-10-06T03:04:33.260392+0000","last_clean":"2023-10-06T03:04:33.260392+0000","last_became_active":"2023-10-06T03:04:29.242032+0000","last_became_peered":"2023-10-06T03:04:29.242032+0000","last_unstale":"2023-10-06T03:04:33.260392+0000","last_undegraded":"2023-10-06T03:04:33.260392+0000","last_fullsized":"2023-10-06T03:04:33.260392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.258197+0000","last_change":"2023-10-06T03:04:29.246372+0000","last_active":"2023-10-06T03:04:33.258197+0000","last_peered":"2023-10-06T03:04:33.258197+0000","last_clean":"2023-10-06T03:04:33.258197+0000","last_became_active":"2023-10-06T03:04:29.246058+0000","last_became_peered":"2023-10-06T03:04:29.246058+0000","last_unstale":"2023-10-06T03:04:33.258197+0000","last_undegraded":"2023-10-06T03:04:33.258197+0000","last_fullsized":"2023-10-06T03:04:33.258197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253617+0000","last_change":"2023-10-06T03:04:29.242029+0000","last_active":"2023-10-06T03:04:33.253617+0000","last_peered":"2023-10-06T03:04:33.253617+0000","last_clean":"2023-10-06T03:04:33.253617+0000","last_became_active":"2023-10-06T03:04:29.241785+0000","last_became_peered":"2023-10-06T03:04:29.241785+0000","last_unstale":"2023-10-06T03:04:33.253617+0000","last_undegraded":"2023-10-06T03:04:33.253617+0000","last_fullsized":"2023-10-06T03:04:33.253617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:48.653156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253130+0000","last_change":"2023-10-06T03:04:29.246603+0000","last_active":"2023-10-06T03:04:33.253130+0000","last_peered":"2023-10-06T03:04:33.253130+0000","last_clean":"2023-10-06T03:04:33.253130+0000","last_became_active":"2023-10-06T03:04:29.246405+0000","last_became_peered":"2023-10-06T03:04:29.246405+0000","last_unstale":"2023-10-06T03:04:33.253130+0000","last_undegraded":"2023-10-06T03:04:33.253130+0000","last_fullsized":"2023-10-06T03:04:33.253130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:41.436589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254147+0000","last_change":"2023-10-06T03:04:29.250839+0000","last_active":"2023-10-06T03:04:33.254147+0000","last_peered":"2023-10-06T03:04:33.254147+0000","last_clean":"2023-10-06T03:04:33.254147+0000","last_became_active":"2023-10-06T03:04:29.250600+0000","last_became_peered":"2023-10-06T03:04:29.250600+0000","last_unstale":"2023-10-06T03:04:33.254147+0000","last_undegraded":"2023-10-06T03:04:33.254147+0000","last_fullsized":"2023-10-06T03:04:33.254147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:27.111880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252975+0000","last_change":"2023-10-06T03:04:29.247916+0000","last_active":"2023-10-06T03:04:33.252975+0000","last_peered":"2023-10-06T03:04:33.252975+0000","last_clean":"2023-10-06T03:04:33.252975+0000","last_became_active":"2023-10-06T03:04:29.247638+0000","last_became_peered":"2023-10-06T03:04:29.247638+0000","last_unstale":"2023-10-06T03:04:33.252975+0000","last_undegraded":"2023-10-06T03:04:33.252975+0000","last_fullsized":"2023-10-06T03:04:33.252975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:06.710555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255737+0000","last_change":"2023-10-06T03:04:29.244948+0000","last_active":"2023-10-06T03:04:33.255737+0000","last_peered":"2023-10-06T03:04:33.255737+0000","last_clean":"2023-10-06T03:04:33.255737+0000","last_became_active":"2023-10-06T03:04:29.244458+0000","last_became_peered":"2023-10-06T03:04:29.244458+0000","last_unstale":"2023-10-06T03:04:33.255737+0000","last_undegraded":"2023-10-06T03:04:33.255737+0000","last_fullsized":"2023-10-06T03:04:33.255737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:07.410542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253458+0000","last_change":"2023-10-06T03:04:29.246013+0000","last_active":"2023-10-06T03:04:33.253458+0000","last_peered":"2023-10-06T03:04:33.253458+0000","last_clean":"2023-10-06T03:04:33.253458+0000","last_became_active":"2023-10-06T03:04:29.245107+0000","last_became_peered":"2023-10-06T03:04:29.245107+0000","last_unstale":"2023-10-06T03:04:33.253458+0000","last_undegraded":"2023-10-06T03:04:33.253458+0000","last_fullsized":"2023-10-06T03:04:33.253458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257429+0000","last_change":"2023-10-06T03:04:29.249697+0000","last_active":"2023-10-06T03:04:33.257429+0000","last_peered":"2023-10-06T03:04:33.257429+0000","last_clean":"2023-10-06T03:04:33.257429+0000","last_became_active":"2023-10-06T03:04:29.249523+0000","last_became_peered":"2023-10-06T03:04:29.249523+0000","last_unstale":"2023-10-06T03:04:33.257429+0000","last_undegraded":"2023-10-06T03:04:33.257429+0000","last_fullsized":"2023-10-06T03:04:33.257429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:22.258796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256711+0000","last_change":"2023-10-06T03:04:29.249776+0000","last_active":"2023-10-06T03:04:33.256711+0000","last_peered":"2023-10-06T03:04:33.256711+0000","last_clean":"2023-10-06T03:04:33.256711+0000","last_became_active":"2023-10-06T03:04:29.249512+0000","last_became_peered":"2023-10-06T03:04:29.249512+0000","last_unstale":"2023-10-06T03:04:33.256711+0000","last_undegraded":"2023-10-06T03:04:33.256711+0000","last_fullsized":"2023-10-06T03:04:33.256711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:03.973528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.248523+0000","last_change":"2023-10-06T03:04:29.253464+0000","last_active":"2023-10-06T03:04:33.248523+0000","last_peered":"2023-10-06T03:04:33.248523+0000","last_clean":"2023-10-06T03:04:33.248523+0000","last_became_active":"2023-10-06T03:04:29.253186+0000","last_became_peered":"2023-10-06T03:04:29.253186+0000","last_unstale":"2023-10-06T03:04:33.248523+0000","last_undegraded":"2023-10-06T03:04:33.248523+0000","last_fullsized":"2023-10-06T03:04:33.248523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.277035+0000","last_change":"2023-10-06T03:04:33.272809+0000","last_active":"2023-10-06T03:04:33.277035+0000","last_peered":"2023-10-06T03:04:33.277035+0000","last_clean":"2023-10-06T03:04:33.277035+0000","last_became_active":"2023-10-06T03:04:33.272457+0000","last_became_peered":"2023-10-06T03:04:33.272457+0000","last_unstale":"2023-10-06T03:04:33.277035+0000","last_undegraded":"2023-10-06T03:04:33.277035+0000","last_fullsized":"2023-10-06T03:04:33.277035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:00.208098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251101+0000","last_change":"2023-10-06T03:04:28.838285+0000","last_active":"2023-10-06T03:04:33.251101+0000","last_peered":"2023-10-06T03:04:33.251101+0000","last_clean":"2023-10-06T03:04:33.251101+0000","last_became_active":"2023-10-06T03:04:28.837675+0000","last_became_peered":"2023-10-06T03:04:28.837675+0000","last_unstale":"2023-10-06T03:04:33.251101+0000","last_undegraded":"2023-10-06T03:04:33.251101+0000","last_fullsized":"2023-10-06T03:04:33.251101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:01.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256585+0000","last_change":"2023-10-06T03:04:29.251007+0000","last_active":"2023-10-06T03:04:33.256585+0000","last_peered":"2023-10-06T03:04:33.256585+0000","last_clean":"2023-10-06T03:04:33.256585+0000","last_became_active":"2023-10-06T03:04:29.250760+0000","last_became_peered":"2023-10-06T03:04:29.250760+0000","last_unstale":"2023-10-06T03:04:33.256585+0000","last_undegraded":"2023-10-06T03:04:33.256585+0000","last_fullsized":"2023-10-06T03:04:33.256585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:14.635872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274464+0000","last_change":"2023-10-06T03:04:33.270233+0000","last_active":"2023-10-06T03:04:33.274464+0000","last_peered":"2023-10-06T03:04:33.274464+0000","last_clean":"2023-10-06T03:04:33.274464+0000","last_became_active":"2023-10-06T03:04:33.269917+0000","last_became_peered":"2023-10-06T03:04:33.269917+0000","last_unstale":"2023-10-06T03:04:33.274464+0000","last_undegraded":"2023-10-06T03:04:33.274464+0000","last_fullsized":"2023-10-06T03:04:33.274464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:25.913975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254184+0000","last_change":"2023-10-06T03:04:28.831735+0000","last_active":"2023-10-06T03:04:33.254184+0000","last_peered":"2023-10-06T03:04:33.254184+0000","last_clean":"2023-10-06T03:04:33.254184+0000","last_became_active":"2023-10-06T03:04:28.831448+0000","last_became_peered":"2023-10-06T03:04:28.831448+0000","last_unstale":"2023-10-06T03:04:33.254184+0000","last_undegraded":"2023-10-06T03:04:33.254184+0000","last_fullsized":"2023-10-06T03:04:33.254184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:16.444923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260988+0000","last_change":"2023-10-06T03:04:29.244005+0000","last_active":"2023-10-06T03:04:33.260988+0000","last_peered":"2023-10-06T03:04:33.260988+0000","last_clean":"2023-10-06T03:04:33.260988+0000","last_became_active":"2023-10-06T03:04:29.243597+0000","last_became_peered":"2023-10-06T03:04:29.243597+0000","last_unstale":"2023-10-06T03:04:33.260988+0000","last_undegraded":"2023-10-06T03:04:33.260988+0000","last_fullsized":"2023-10-06T03:04:33.260988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279041+0000","last_change":"2023-10-06T03:04:33.275920+0000","last_active":"2023-10-06T03:04:33.279041+0000","last_peered":"2023-10-06T03:04:33.279041+0000","last_clean":"2023-10-06T03:04:33.279041+0000","last_became_active":"2023-10-06T03:04:33.275198+0000","last_became_peered":"2023-10-06T03:04:33.275198+0000","last_unstale":"2023-10-06T03:04:33.279041+0000","last_undegraded":"2023-10-06T03:04:33.279041+0000","last_fullsized":"2023-10-06T03:04:33.279041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:53.801187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255924+0000","last_change":"2023-10-06T03:04:28.839035+0000","last_active":"2023-10-06T03:04:33.255924+0000","last_peered":"2023-10-06T03:04:33.255924+0000","last_clean":"2023-10-06T03:04:33.255924+0000","last_became_active":"2023-10-06T03:04:28.838799+0000","last_became_peered":"2023-10-06T03:04:28.838799+0000","last_unstale":"2023-10-06T03:04:33.255924+0000","last_undegraded":"2023-10-06T03:04:33.255924+0000","last_fullsized":"2023-10-06T03:04:33.255924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:16.444923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252657+0000","last_change":"2023-10-06T03:04:29.250582+0000","last_active":"2023-10-06T03:04:33.252657+0000","last_peered":"2023-10-06T03:04:33.252657+0000","last_clean":"2023-10-06T03:04:33.252657+0000","last_became_active":"2023-10-06T03:04:29.250300+0000","last_became_peered":"2023-10-06T03:04:29.250300+0000","last_unstale":"2023-10-06T03:04:33.252657+0000","last_undegraded":"2023-10-06T03:04:33.252657+0000","last_fullsized":"2023-10-06T03:04:33.252657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:20.456488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.273611+0000","last_change":"2023-10-06T03:04:33.268665+0000","last_active":"2023-10-06T03:04:33.273611+0000","last_peered":"2023-10-06T03:04:33.273611+0000","last_clean":"2023-10-06T03:04:33.273611+0000","last_became_active":"2023-10-06T03:04:33.268265+0000","last_became_peered":"2023-10-06T03:04:33.268265+0000","last_unstale":"2023-10-06T03:04:33.273611+0000","last_undegraded":"2023-10-06T03:04:33.273611+0000","last_fullsized":"2023-10-06T03:04:33.273611+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:44.857274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260397+0000","last_change":"2023-10-06T03:04:28.840063+0000","last_active":"2023-10-06T03:04:33.260397+0000","last_peered":"2023-10-06T03:04:33.260397+0000","last_clean":"2023-10-06T03:04:33.260397+0000","last_became_active":"2023-10-06T03:04:28.839810+0000","last_became_peered":"2023-10-06T03:04:28.839810+0000","last_unstale":"2023-10-06T03:04:33.260397+0000","last_undegraded":"2023-10-06T03:04:33.260397+0000","last_fullsized":"2023-10-06T03:04:33.260397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:47.647784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255847+0000","last_change":"2023-10-06T03:04:29.246067+0000","last_active":"2023-10-06T03:04:33.255847+0000","last_peered":"2023-10-06T03:04:33.255847+0000","last_clean":"2023-10-06T03:04:33.255847+0000","last_became_active":"2023-10-06T03:04:29.245691+0000","last_became_peered":"2023-10-06T03:04:29.245691+0000","last_unstale":"2023-10-06T03:04:33.255847+0000","last_undegraded":"2023-10-06T03:04:33.255847+0000","last_fullsized":"2023-10-06T03:04:33.255847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274621+0000","last_change":"2023-10-06T03:04:33.271930+0000","last_active":"2023-10-06T03:04:33.274621+0000","last_peered":"2023-10-06T03:04:33.274621+0000","last_clean":"2023-10-06T03:04:33.274621+0000","last_became_active":"2023-10-06T03:04:33.271546+0000","last_became_peered":"2023-10-06T03:04:33.271546+0000","last_unstale":"2023-10-06T03:04:33.274621+0000","last_undegraded":"2023-10-06T03:04:33.274621+0000","last_fullsized":"2023-10-06T03:04:33.274621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:53.801187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.248282+0000","last_change":"2023-10-06T03:04:28.844581+0000","last_active":"2023-10-06T03:04:33.248282+0000","last_peered":"2023-10-06T03:04:33.248282+0000","last_clean":"2023-10-06T03:04:33.248282+0000","last_became_active":"2023-10-06T03:04:28.844305+0000","last_became_peered":"2023-10-06T03:04:28.844305+0000","last_unstale":"2023-10-06T03:04:33.248282+0000","last_undegraded":"2023-10-06T03:04:33.248282+0000","last_fullsized":"2023-10-06T03:04:33.248282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:02.968156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255764+0000","last_change":"2023-10-06T03:04:29.250970+0000","last_active":"2023-10-06T03:04:33.255764+0000","last_peered":"2023-10-06T03:04:33.255764+0000","last_clean":"2023-10-06T03:04:33.255764+0000","last_became_active":"2023-10-06T03:04:29.250699+0000","last_became_peered":"2023-10-06T03:04:29.250699+0000","last_unstale":"2023-10-06T03:04:33.255764+0000","last_undegraded":"2023-10-06T03:04:33.255764+0000","last_fullsized":"2023-10-06T03:04:33.255764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:00.194415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274257+0000","last_change":"2023-10-06T03:04:33.266174+0000","last_active":"2023-10-06T03:04:33.274257+0000","last_peered":"2023-10-06T03:04:33.274257+0000","last_clean":"2023-10-06T03:04:33.274257+0000","last_became_active":"2023-10-06T03:04:33.265684+0000","last_became_peered":"2023-10-06T03:04:33.265684+0000","last_unstale":"2023-10-06T03:04:33.274257+0000","last_undegraded":"2023-10-06T03:04:33.274257+0000","last_fullsized":"2023-10-06T03:04:33.274257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:25.279420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254696+0000","last_change":"2023-10-06T03:04:28.841750+0000","last_active":"2023-10-06T03:04:33.254696+0000","last_peered":"2023-10-06T03:04:33.254696+0000","last_clean":"2023-10-06T03:04:33.254696+0000","last_became_active":"2023-10-06T03:04:28.841494+0000","last_became_peered":"2023-10-06T03:04:28.841494+0000","last_unstale":"2023-10-06T03:04:33.254696+0000","last_undegraded":"2023-10-06T03:04:33.254696+0000","last_fullsized":"2023-10-06T03:04:33.254696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:37.754382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252743+0000","last_change":"2023-10-06T03:04:29.252516+0000","last_active":"2023-10-06T03:04:33.252743+0000","last_peered":"2023-10-06T03:04:33.252743+0000","last_clean":"2023-10-06T03:04:33.252743+0000","last_became_active":"2023-10-06T03:04:29.252229+0000","last_became_peered":"2023-10-06T03:04:29.252229+0000","last_unstale":"2023-10-06T03:04:33.252743+0000","last_undegraded":"2023-10-06T03:04:33.252743+0000","last_fullsized":"2023-10-06T03:04:33.252743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:41.163677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.273192+0000","last_change":"2023-10-06T03:04:33.270221+0000","last_active":"2023-10-06T03:04:33.273192+0000","last_peered":"2023-10-06T03:04:33.273192+0000","last_clean":"2023-10-06T03:04:33.273192+0000","last_became_active":"2023-10-06T03:04:33.269852+0000","last_became_peered":"2023-10-06T03:04:33.269852+0000","last_unstale":"2023-10-06T03:04:33.273192+0000","last_undegraded":"2023-10-06T03:04:33.273192+0000","last_fullsized":"2023-10-06T03:04:33.273192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:29.020898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'9","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:04:39.092973+0000","last_change":"2023-10-06T03:04:28.838015+0000","last_active":"2023-10-06T03:04:39.092973+0000","last_peered":"2023-10-06T03:04:39.092973+0000","last_clean":"2023-10-06T03:04:39.092973+0000","last_became_active":"2023-10-06T03:04:28.837321+0000","last_became_peered":"2023-10-06T03:04:28.837321+0000","last_unstale":"2023-10-06T03:04:39.092973+0000","last_undegraded":"2023-10-06T03:04:39.092973+0000","last_fullsized":"2023-10-06T03:04:39.092973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:16.444923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3715,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251923+0000","last_change":"2023-10-06T03:04:29.245423+0000","last_active":"2023-10-06T03:04:33.251923+0000","last_peered":"2023-10-06T03:04:33.251923+0000","last_clean":"2023-10-06T03:04:33.251923+0000","last_became_active":"2023-10-06T03:04:29.245125+0000","last_became_peered":"2023-10-06T03:04:29.245125+0000","last_unstale":"2023-10-06T03:04:33.251923+0000","last_undegraded":"2023-10-06T03:04:33.251923+0000","last_fullsized":"2023-10-06T03:04:33.251923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:16.298020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.272326+0000","last_change":"2023-10-06T03:04:33.269331+0000","last_active":"2023-10-06T03:04:33.272326+0000","last_peered":"2023-10-06T03:04:33.272326+0000","last_clean":"2023-10-06T03:04:33.272326+0000","last_became_active":"2023-10-06T03:04:33.268947+0000","last_became_peered":"2023-10-06T03:04:33.268947+0000","last_unstale":"2023-10-06T03:04:33.272326+0000","last_undegraded":"2023-10-06T03:04:33.272326+0000","last_fullsized":"2023-10-06T03:04:33.272326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:18.722157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254189+0000","last_change":"2023-10-06T03:04:28.844574+0000","last_active":"2023-10-06T03:04:33.254189+0000","last_peered":"2023-10-06T03:04:33.254189+0000","last_clean":"2023-10-06T03:04:33.254189+0000","last_became_active":"2023-10-06T03:04:28.844264+0000","last_became_peered":"2023-10-06T03:04:28.844264+0000","last_unstale":"2023-10-06T03:04:33.254189+0000","last_undegraded":"2023-10-06T03:04:33.254189+0000","last_fullsized":"2023-10-06T03:04:33.254189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:05.970777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256525+0000","last_change":"2023-10-06T03:04:29.247698+0000","last_active":"2023-10-06T03:04:33.256525+0000","last_peered":"2023-10-06T03:04:33.256525+0000","last_clean":"2023-10-06T03:04:33.256525+0000","last_became_active":"2023-10-06T03:04:29.247464+0000","last_became_peered":"2023-10-06T03:04:29.247464+0000","last_unstale":"2023-10-06T03:04:33.256525+0000","last_undegraded":"2023-10-06T03:04:33.256525+0000","last_fullsized":"2023-10-06T03:04:33.256525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:13.355371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.273888+0000","last_change":"2023-10-06T03:04:33.266947+0000","last_active":"2023-10-06T03:04:33.273888+0000","last_peered":"2023-10-06T03:04:33.273888+0000","last_clean":"2023-10-06T03:04:33.273888+0000","last_became_active":"2023-10-06T03:04:33.266543+0000","last_became_peered":"2023-10-06T03:04:33.266543+0000","last_unstale":"2023-10-06T03:04:33.273888+0000","last_undegraded":"2023-10-06T03:04:33.273888+0000","last_fullsized":"2023-10-06T03:04:33.273888+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:29.020898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252534+0000","last_change":"2023-10-06T03:04:28.838464+0000","last_active":"2023-10-06T03:04:33.252534+0000","last_peered":"2023-10-06T03:04:33.252534+0000","last_clean":"2023-10-06T03:04:33.252534+0000","last_became_active":"2023-10-06T03:04:28.838008+0000","last_became_peered":"2023-10-06T03:04:28.838008+0000","last_unstale":"2023-10-06T03:04:33.252534+0000","last_undegraded":"2023-10-06T03:04:33.252534+0000","last_fullsized":"2023-10-06T03:04:33.252534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:53.804099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247750+0000","last_change":"2023-10-06T03:04:29.252750+0000","last_active":"2023-10-06T03:04:33.247750+0000","last_peered":"2023-10-06T03:04:33.247750+0000","last_clean":"2023-10-06T03:04:33.247750+0000","last_became_active":"2023-10-06T03:04:29.252421+0000","last_became_peered":"2023-10-06T03:04:29.252421+0000","last_unstale":"2023-10-06T03:04:33.247750+0000","last_undegraded":"2023-10-06T03:04:33.247750+0000","last_fullsized":"2023-10-06T03:04:33.247750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274637+0000","last_change":"2023-10-06T03:04:33.267286+0000","last_active":"2023-10-06T03:04:33.274637+0000","last_peered":"2023-10-06T03:04:33.274637+0000","last_clean":"2023-10-06T03:04:33.274637+0000","last_became_active":"2023-10-06T03:04:33.266886+0000","last_became_peered":"2023-10-06T03:04:33.266886+0000","last_unstale":"2023-10-06T03:04:33.274637+0000","last_undegraded":"2023-10-06T03:04:33.274637+0000","last_fullsized":"2023-10-06T03:04:33.274637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:49.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254264+0000","last_change":"2023-10-06T03:04:28.841825+0000","last_active":"2023-10-06T03:04:33.254264+0000","last_peered":"2023-10-06T03:04:33.254264+0000","last_clean":"2023-10-06T03:04:33.254264+0000","last_became_active":"2023-10-06T03:04:28.841550+0000","last_became_peered":"2023-10-06T03:04:28.841550+0000","last_unstale":"2023-10-06T03:04:33.254264+0000","last_undegraded":"2023-10-06T03:04:33.254264+0000","last_fullsized":"2023-10-06T03:04:33.254264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:22.072997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260999+0000","last_change":"2023-10-06T03:04:29.243824+0000","last_active":"2023-10-06T03:04:33.260999+0000","last_peered":"2023-10-06T03:04:33.260999+0000","last_clean":"2023-10-06T03:04:33.260999+0000","last_became_active":"2023-10-06T03:04:29.243249+0000","last_became_peered":"2023-10-06T03:04:29.243249+0000","last_unstale":"2023-10-06T03:04:33.260999+0000","last_undegraded":"2023-10-06T03:04:33.260999+0000","last_fullsized":"2023-10-06T03:04:33.260999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:16.298020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.272146+0000","last_change":"2023-10-06T03:04:33.268277+0000","last_active":"2023-10-06T03:04:33.272146+0000","last_peered":"2023-10-06T03:04:33.272146+0000","last_clean":"2023-10-06T03:04:33.272146+0000","last_became_active":"2023-10-06T03:04:33.267827+0000","last_became_peered":"2023-10-06T03:04:33.267827+0000","last_unstale":"2023-10-06T03:04:33.272146+0000","last_undegraded":"2023-10-06T03:04:33.272146+0000","last_fullsized":"2023-10-06T03:04:33.272146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:03.744883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251717+0000","last_change":"2023-10-06T03:04:28.843010+0000","last_active":"2023-10-06T03:04:33.251717+0000","last_peered":"2023-10-06T03:04:33.251717+0000","last_clean":"2023-10-06T03:04:33.251717+0000","last_became_active":"2023-10-06T03:04:28.842743+0000","last_became_peered":"2023-10-06T03:04:28.842743+0000","last_unstale":"2023-10-06T03:04:33.251717+0000","last_undegraded":"2023-10-06T03:04:33.251717+0000","last_fullsized":"2023-10-06T03:04:33.251717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:01.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257848+0000","last_change":"2023-10-06T03:04:29.246248+0000","last_active":"2023-10-06T03:04:33.257848+0000","last_peered":"2023-10-06T03:04:33.257848+0000","last_clean":"2023-10-06T03:04:33.257848+0000","last_became_active":"2023-10-06T03:04:29.245660+0000","last_became_peered":"2023-10-06T03:04:29.245660+0000","last_unstale":"2023-10-06T03:04:33.257848+0000","last_undegraded":"2023-10-06T03:04:33.257848+0000","last_fullsized":"2023-10-06T03:04:33.257848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274535+0000","last_change":"2023-10-06T03:04:33.270753+0000","last_active":"2023-10-06T03:04:33.274535+0000","last_peered":"2023-10-06T03:04:33.274535+0000","last_clean":"2023-10-06T03:04:33.274535+0000","last_became_active":"2023-10-06T03:04:33.270285+0000","last_became_peered":"2023-10-06T03:04:33.270285+0000","last_unstale":"2023-10-06T03:04:33.274535+0000","last_undegraded":"2023-10-06T03:04:33.274535+0000","last_fullsized":"2023-10-06T03:04:33.274535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:38.040904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256306+0000","last_change":"2023-10-06T03:04:28.841768+0000","last_active":"2023-10-06T03:04:33.256306+0000","last_peered":"2023-10-06T03:04:33.256306+0000","last_clean":"2023-10-06T03:04:33.256306+0000","last_became_active":"2023-10-06T03:04:28.841466+0000","last_became_peered":"2023-10-06T03:04:28.841466+0000","last_unstale":"2023-10-06T03:04:33.256306+0000","last_undegraded":"2023-10-06T03:04:33.256306+0000","last_fullsized":"2023-10-06T03:04:33.256306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:18.790700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247445+0000","last_change":"2023-10-06T03:04:29.254847+0000","last_active":"2023-10-06T03:04:33.247445+0000","last_peered":"2023-10-06T03:04:33.247445+0000","last_clean":"2023-10-06T03:04:33.247445+0000","last_became_active":"2023-10-06T03:04:29.254566+0000","last_became_peered":"2023-10-06T03:04:29.254566+0000","last_unstale":"2023-10-06T03:04:33.247445+0000","last_undegraded":"2023-10-06T03:04:33.247445+0000","last_fullsized":"2023-10-06T03:04:33.247445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279105+0000","last_change":"2023-10-06T03:04:33.273474+0000","last_active":"2023-10-06T03:04:33.279105+0000","last_peered":"2023-10-06T03:04:33.279105+0000","last_clean":"2023-10-06T03:04:33.279105+0000","last_became_active":"2023-10-06T03:04:33.272844+0000","last_became_peered":"2023-10-06T03:04:33.272844+0000","last_unstale":"2023-10-06T03:04:33.279105+0000","last_undegraded":"2023-10-06T03:04:33.279105+0000","last_fullsized":"2023-10-06T03:04:33.279105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:22:18.478319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253676+0000","last_change":"2023-10-06T03:04:28.844454+0000","last_active":"2023-10-06T03:04:33.253676+0000","last_peered":"2023-10-06T03:04:33.253676+0000","last_clean":"2023-10-06T03:04:33.253676+0000","last_became_active":"2023-10-06T03:04:28.844159+0000","last_became_peered":"2023-10-06T03:04:28.844159+0000","last_unstale":"2023-10-06T03:04:33.253676+0000","last_undegraded":"2023-10-06T03:04:33.253676+0000","last_fullsized":"2023-10-06T03:04:33.253676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:02.968156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260414+0000","last_change":"2023-10-06T03:04:29.247815+0000","last_active":"2023-10-06T03:04:33.260414+0000","last_peered":"2023-10-06T03:04:33.260414+0000","last_clean":"2023-10-06T03:04:33.260414+0000","last_became_active":"2023-10-06T03:04:29.247468+0000","last_became_peered":"2023-10-06T03:04:29.247468+0000","last_unstale":"2023-10-06T03:04:33.260414+0000","last_undegraded":"2023-10-06T03:04:33.260414+0000","last_fullsized":"2023-10-06T03:04:33.260414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:00.742905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.281495+0000","last_change":"2023-10-06T03:04:33.274004+0000","last_active":"2023-10-06T03:04:33.281495+0000","last_peered":"2023-10-06T03:04:33.281495+0000","last_clean":"2023-10-06T03:04:33.281495+0000","last_became_active":"2023-10-06T03:04:33.273505+0000","last_became_peered":"2023-10-06T03:04:33.273505+0000","last_unstale":"2023-10-06T03:04:33.281495+0000","last_undegraded":"2023-10-06T03:04:33.281495+0000","last_fullsized":"2023-10-06T03:04:33.281495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:59.453052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254602+0000","last_change":"2023-10-06T03:04:28.844541+0000","last_active":"2023-10-06T03:04:33.254602+0000","last_peered":"2023-10-06T03:04:33.254602+0000","last_clean":"2023-10-06T03:04:33.254602+0000","last_became_active":"2023-10-06T03:04:28.844287+0000","last_became_peered":"2023-10-06T03:04:28.844287+0000","last_unstale":"2023-10-06T03:04:33.254602+0000","last_undegraded":"2023-10-06T03:04:33.254602+0000","last_fullsized":"2023-10-06T03:04:33.254602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:56.517421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251704+0000","last_change":"2023-10-06T03:04:29.247387+0000","last_active":"2023-10-06T03:04:33.251704+0000","last_peered":"2023-10-06T03:04:33.251704+0000","last_clean":"2023-10-06T03:04:33.251704+0000","last_became_active":"2023-10-06T03:04:29.247094+0000","last_became_peered":"2023-10-06T03:04:29.247094+0000","last_unstale":"2023-10-06T03:04:33.251704+0000","last_undegraded":"2023-10-06T03:04:33.251704+0000","last_fullsized":"2023-10-06T03:04:33.251704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:23.078369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275074+0000","last_change":"2023-10-06T03:04:33.268719+0000","last_active":"2023-10-06T03:04:33.275074+0000","last_peered":"2023-10-06T03:04:33.275074+0000","last_clean":"2023-10-06T03:04:33.275074+0000","last_became_active":"2023-10-06T03:04:33.268369+0000","last_became_peered":"2023-10-06T03:04:33.268369+0000","last_unstale":"2023-10-06T03:04:33.275074+0000","last_undegraded":"2023-10-06T03:04:33.275074+0000","last_fullsized":"2023-10-06T03:04:33.275074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:39.388410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247659+0000","last_change":"2023-10-06T03:04:28.836622+0000","last_active":"2023-10-06T03:04:33.247659+0000","last_peered":"2023-10-06T03:04:33.247659+0000","last_clean":"2023-10-06T03:04:33.247659+0000","last_became_active":"2023-10-06T03:04:28.836361+0000","last_became_peered":"2023-10-06T03:04:28.836361+0000","last_unstale":"2023-10-06T03:04:33.247659+0000","last_undegraded":"2023-10-06T03:04:33.247659+0000","last_fullsized":"2023-10-06T03:04:33.247659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:53.804099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260554+0000","last_change":"2023-10-06T03:04:29.246365+0000","last_active":"2023-10-06T03:04:33.260554+0000","last_peered":"2023-10-06T03:04:33.260554+0000","last_clean":"2023-10-06T03:04:33.260554+0000","last_became_active":"2023-10-06T03:04:29.246129+0000","last_became_peered":"2023-10-06T03:04:29.246129+0000","last_unstale":"2023-10-06T03:04:33.260554+0000","last_undegraded":"2023-10-06T03:04:33.260554+0000","last_fullsized":"2023-10-06T03:04:33.260554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.273557+0000","last_change":"2023-10-06T03:04:33.263768+0000","last_active":"2023-10-06T03:04:33.273557+0000","last_peered":"2023-10-06T03:04:33.273557+0000","last_clean":"2023-10-06T03:04:33.273557+0000","last_became_active":"2023-10-06T03:04:33.263379+0000","last_became_peered":"2023-10-06T03:04:33.263379+0000","last_unstale":"2023-10-06T03:04:33.273557+0000","last_undegraded":"2023-10-06T03:04:33.273557+0000","last_fullsized":"2023-10-06T03:04:33.273557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:03.615099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256254+0000","last_change":"2023-10-06T03:04:28.842173+0000","last_active":"2023-10-06T03:04:33.256254+0000","last_peered":"2023-10-06T03:04:33.256254+0000","last_clean":"2023-10-06T03:04:33.256254+0000","last_became_active":"2023-10-06T03:04:28.841904+0000","last_became_peered":"2023-10-06T03:04:28.841904+0000","last_unstale":"2023-10-06T03:04:33.256254+0000","last_undegraded":"2023-10-06T03:04:33.256254+0000","last_fullsized":"2023-10-06T03:04:33.256254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:47.647784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252916+0000","last_change":"2023-10-06T03:04:29.248275+0000","last_active":"2023-10-06T03:04:33.252916+0000","last_peered":"2023-10-06T03:04:33.252916+0000","last_clean":"2023-10-06T03:04:33.252916+0000","last_became_active":"2023-10-06T03:04:29.247441+0000","last_became_peered":"2023-10-06T03:04:29.247441+0000","last_unstale":"2023-10-06T03:04:33.252916+0000","last_undegraded":"2023-10-06T03:04:33.252916+0000","last_fullsized":"2023-10-06T03:04:33.252916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:41.084853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279289+0000","last_change":"2023-10-06T03:04:33.277569+0000","last_active":"2023-10-06T03:04:33.279289+0000","last_peered":"2023-10-06T03:04:33.279289+0000","last_clean":"2023-10-06T03:04:33.279289+0000","last_became_active":"2023-10-06T03:04:33.277036+0000","last_became_peered":"2023-10-06T03:04:33.277036+0000","last_unstale":"2023-10-06T03:04:33.279289+0000","last_undegraded":"2023-10-06T03:04:33.279289+0000","last_fullsized":"2023-10-06T03:04:33.279289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:16.342856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252435+0000","last_change":"2023-10-06T03:04:28.839083+0000","last_active":"2023-10-06T03:04:33.252435+0000","last_peered":"2023-10-06T03:04:33.252435+0000","last_clean":"2023-10-06T03:04:33.252435+0000","last_became_active":"2023-10-06T03:04:28.838794+0000","last_became_peered":"2023-10-06T03:04:28.838794+0000","last_unstale":"2023-10-06T03:04:33.252435+0000","last_undegraded":"2023-10-06T03:04:33.252435+0000","last_fullsized":"2023-10-06T03:04:33.252435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:08.701124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251200+0000","last_change":"2023-10-06T03:04:29.245977+0000","last_active":"2023-10-06T03:04:33.251200+0000","last_peered":"2023-10-06T03:04:33.251200+0000","last_clean":"2023-10-06T03:04:33.251200+0000","last_became_active":"2023-10-06T03:04:29.245626+0000","last_became_peered":"2023-10-06T03:04:29.245626+0000","last_unstale":"2023-10-06T03:04:33.251200+0000","last_undegraded":"2023-10-06T03:04:33.251200+0000","last_fullsized":"2023-10-06T03:04:33.251200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275700+0000","last_change":"2023-10-06T03:04:33.273132+0000","last_active":"2023-10-06T03:04:33.275700+0000","last_peered":"2023-10-06T03:04:33.275700+0000","last_clean":"2023-10-06T03:04:33.275700+0000","last_became_active":"2023-10-06T03:04:33.270004+0000","last_became_peered":"2023-10-06T03:04:33.270004+0000","last_unstale":"2023-10-06T03:04:33.275700+0000","last_undegraded":"2023-10-06T03:04:33.275700+0000","last_fullsized":"2023-10-06T03:04:33.275700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:29.588904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.262618+0000","last_change":"2023-10-06T03:04:28.834924+0000","last_active":"2023-10-06T03:04:33.262618+0000","last_peered":"2023-10-06T03:04:33.262618+0000","last_clean":"2023-10-06T03:04:33.262618+0000","last_became_active":"2023-10-06T03:04:28.833593+0000","last_became_peered":"2023-10-06T03:04:28.833593+0000","last_unstale":"2023-10-06T03:04:33.262618+0000","last_undegraded":"2023-10-06T03:04:33.262618+0000","last_fullsized":"2023-10-06T03:04:33.262618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:01.349764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.258286+0000","last_change":"2023-10-06T03:04:29.242813+0000","last_active":"2023-10-06T03:04:33.258286+0000","last_peered":"2023-10-06T03:04:33.258286+0000","last_clean":"2023-10-06T03:04:33.258286+0000","last_became_active":"2023-10-06T03:04:29.242505+0000","last_became_peered":"2023-10-06T03:04:29.242505+0000","last_unstale":"2023-10-06T03:04:33.258286+0000","last_undegraded":"2023-10-06T03:04:33.258286+0000","last_fullsized":"2023-10-06T03:04:33.258286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:00.194415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279673+0000","last_change":"2023-10-06T03:04:33.276215+0000","last_active":"2023-10-06T03:04:33.279673+0000","last_peered":"2023-10-06T03:04:33.279673+0000","last_clean":"2023-10-06T03:04:33.279673+0000","last_became_active":"2023-10-06T03:04:33.275880+0000","last_became_peered":"2023-10-06T03:04:33.275880+0000","last_unstale":"2023-10-06T03:04:33.279673+0000","last_undegraded":"2023-10-06T03:04:33.279673+0000","last_fullsized":"2023-10-06T03:04:33.279673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:47.940801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255769+0000","last_change":"2023-10-06T03:04:28.833476+0000","last_active":"2023-10-06T03:04:33.255769+0000","last_peered":"2023-10-06T03:04:33.255769+0000","last_clean":"2023-10-06T03:04:33.255769+0000","last_became_active":"2023-10-06T03:04:28.833134+0000","last_became_peered":"2023-10-06T03:04:28.833134+0000","last_unstale":"2023-10-06T03:04:33.255769+0000","last_undegraded":"2023-10-06T03:04:33.255769+0000","last_fullsized":"2023-10-06T03:04:33.255769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:01.349764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257596+0000","last_change":"2023-10-06T03:04:29.254675+0000","last_active":"2023-10-06T03:04:33.257596+0000","last_peered":"2023-10-06T03:04:33.257596+0000","last_clean":"2023-10-06T03:04:33.257596+0000","last_became_active":"2023-10-06T03:04:29.254440+0000","last_became_peered":"2023-10-06T03:04:29.254440+0000","last_unstale":"2023-10-06T03:04:33.257596+0000","last_undegraded":"2023-10-06T03:04:33.257596+0000","last_fullsized":"2023-10-06T03:04:33.257596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:06.710555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275628+0000","last_change":"2023-10-06T03:04:33.271611+0000","last_active":"2023-10-06T03:04:33.275628+0000","last_peered":"2023-10-06T03:04:33.275628+0000","last_clean":"2023-10-06T03:04:33.275628+0000","last_became_active":"2023-10-06T03:04:33.270809+0000","last_became_peered":"2023-10-06T03:04:33.270809+0000","last_unstale":"2023-10-06T03:04:33.275628+0000","last_undegraded":"2023-10-06T03:04:33.275628+0000","last_fullsized":"2023-10-06T03:04:33.275628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:38.040904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256889+0000","last_change":"2023-10-06T03:04:23.986472+0000","last_active":"2023-10-06T03:04:33.256889+0000","last_peered":"2023-10-06T03:04:33.256889+0000","last_clean":"2023-10-06T03:04:33.256889+0000","last_became_active":"2023-10-06T03:04:23.986228+0000","last_became_peered":"2023-10-06T03:04:23.986228+0000","last_unstale":"2023-10-06T03:04:33.256889+0000","last_undegraded":"2023-10-06T03:04:33.256889+0000","last_fullsized":"2023-10-06T03:04:33.256889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:08.739849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247658+0000","last_change":"2023-10-06T03:04:28.837603+0000","last_active":"2023-10-06T03:04:33.247658+0000","last_peered":"2023-10-06T03:04:33.247658+0000","last_clean":"2023-10-06T03:04:33.247658+0000","last_became_active":"2023-10-06T03:04:28.837333+0000","last_became_peered":"2023-10-06T03:04:28.837333+0000","last_unstale":"2023-10-06T03:04:33.247658+0000","last_undegraded":"2023-10-06T03:04:33.247658+0000","last_fullsized":"2023-10-06T03:04:33.247658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:38:43.549607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252660+0000","last_change":"2023-10-06T03:04:29.251886+0000","last_active":"2023-10-06T03:04:33.252660+0000","last_peered":"2023-10-06T03:04:33.252660+0000","last_clean":"2023-10-06T03:04:33.252660+0000","last_became_active":"2023-10-06T03:04:29.250608+0000","last_became_peered":"2023-10-06T03:04:29.250608+0000","last_unstale":"2023-10-06T03:04:33.252660+0000","last_undegraded":"2023-10-06T03:04:33.252660+0000","last_fullsized":"2023-10-06T03:04:33.252660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275480+0000","last_change":"2023-10-06T03:04:33.270876+0000","last_active":"2023-10-06T03:04:33.275480+0000","last_peered":"2023-10-06T03:04:33.275480+0000","last_clean":"2023-10-06T03:04:33.275480+0000","last_became_active":"2023-10-06T03:04:33.270440+0000","last_became_peered":"2023-10-06T03:04:33.270440+0000","last_unstale":"2023-10-06T03:04:33.275480+0000","last_undegraded":"2023-10-06T03:04:33.275480+0000","last_fullsized":"2023-10-06T03:04:33.275480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:09:43.778573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247810+0000","last_change":"2023-10-06T03:04:23.814917+0000","last_active":"2023-10-06T03:04:33.247810+0000","last_peered":"2023-10-06T03:04:33.247810+0000","last_clean":"2023-10-06T03:04:33.247810+0000","last_became_active":"2023-10-06T03:04:23.814601+0000","last_became_peered":"2023-10-06T03:04:23.814601+0000","last_unstale":"2023-10-06T03:04:33.247810+0000","last_undegraded":"2023-10-06T03:04:33.247810+0000","last_fullsized":"2023-10-06T03:04:33.247810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251996+0000","last_change":"2023-10-06T03:04:28.844008+0000","last_active":"2023-10-06T03:04:33.251996+0000","last_peered":"2023-10-06T03:04:33.251996+0000","last_clean":"2023-10-06T03:04:33.251996+0000","last_became_active":"2023-10-06T03:04:28.843570+0000","last_became_peered":"2023-10-06T03:04:28.843570+0000","last_unstale":"2023-10-06T03:04:33.251996+0000","last_undegraded":"2023-10-06T03:04:33.251996+0000","last_fullsized":"2023-10-06T03:04:33.251996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:47.468717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256810+0000","last_change":"2023-10-06T03:04:29.251986+0000","last_active":"2023-10-06T03:04:33.256810+0000","last_peered":"2023-10-06T03:04:33.256810+0000","last_clean":"2023-10-06T03:04:33.256810+0000","last_became_active":"2023-10-06T03:04:29.250140+0000","last_became_peered":"2023-10-06T03:04:29.250140+0000","last_unstale":"2023-10-06T03:04:33.256810+0000","last_undegraded":"2023-10-06T03:04:33.256810+0000","last_fullsized":"2023-10-06T03:04:33.256810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:14.635872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275237+0000","last_change":"2023-10-06T03:04:33.271548+0000","last_active":"2023-10-06T03:04:33.275237+0000","last_peered":"2023-10-06T03:04:33.275237+0000","last_clean":"2023-10-06T03:04:33.275237+0000","last_became_active":"2023-10-06T03:04:33.270795+0000","last_became_peered":"2023-10-06T03:04:33.270795+0000","last_unstale":"2023-10-06T03:04:33.275237+0000","last_undegraded":"2023-10-06T03:04:33.275237+0000","last_fullsized":"2023-10-06T03:04:33.275237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:04.163589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254358+0000","last_change":"2023-10-06T03:04:24.314547+0000","last_active":"2023-10-06T03:04:33.254358+0000","last_peered":"2023-10-06T03:04:33.254358+0000","last_clean":"2023-10-06T03:04:33.254358+0000","last_became_active":"2023-10-06T03:04:24.314278+0000","last_became_peered":"2023-10-06T03:04:24.314278+0000","last_unstale":"2023-10-06T03:04:33.254358+0000","last_undegraded":"2023-10-06T03:04:33.254358+0000","last_fullsized":"2023-10-06T03:04:33.254358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:25.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.258223+0000","last_change":"2023-10-06T03:04:28.830604+0000","last_active":"2023-10-06T03:04:33.258223+0000","last_peered":"2023-10-06T03:04:33.258223+0000","last_clean":"2023-10-06T03:04:33.258223+0000","last_became_active":"2023-10-06T03:04:28.828889+0000","last_became_peered":"2023-10-06T03:04:28.828889+0000","last_unstale":"2023-10-06T03:04:33.258223+0000","last_undegraded":"2023-10-06T03:04:33.258223+0000","last_fullsized":"2023-10-06T03:04:33.258223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:53.804099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257514+0000","last_change":"2023-10-06T03:04:29.250731+0000","last_active":"2023-10-06T03:04:33.257514+0000","last_peered":"2023-10-06T03:04:33.257514+0000","last_clean":"2023-10-06T03:04:33.257514+0000","last_became_active":"2023-10-06T03:04:29.250491+0000","last_became_peered":"2023-10-06T03:04:29.250491+0000","last_unstale":"2023-10-06T03:04:33.257514+0000","last_undegraded":"2023-10-06T03:04:33.257514+0000","last_fullsized":"2023-10-06T03:04:33.257514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:13.355371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.271453+0000","last_change":"2023-10-06T03:04:33.266989+0000","last_active":"2023-10-06T03:04:33.271453+0000","last_peered":"2023-10-06T03:04:33.271453+0000","last_clean":"2023-10-06T03:04:33.271453+0000","last_became_active":"2023-10-06T03:04:33.266416+0000","last_became_peered":"2023-10-06T03:04:33.266416+0000","last_unstale":"2023-10-06T03:04:33.271453+0000","last_undegraded":"2023-10-06T03:04:33.271453+0000","last_fullsized":"2023-10-06T03:04:33.271453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:45.049591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247892+0000","last_change":"2023-10-06T03:04:23.807972+0000","last_active":"2023-10-06T03:04:33.247892+0000","last_peered":"2023-10-06T03:04:33.247892+0000","last_clean":"2023-10-06T03:04:33.247892+0000","last_became_active":"2023-10-06T03:04:23.807723+0000","last_became_peered":"2023-10-06T03:04:23.807723+0000","last_unstale":"2023-10-06T03:04:33.247892+0000","last_undegraded":"2023-10-06T03:04:33.247892+0000","last_fullsized":"2023-10-06T03:04:33.247892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253358+0000","last_change":"2023-10-06T03:04:17.779925+0000","last_active":"2023-10-06T03:04:33.253358+0000","last_peered":"2023-10-06T03:04:33.253358+0000","last_clean":"2023-10-06T03:04:33.253358+0000","last_became_active":"2023-10-06T03:04:17.778997+0000","last_became_peered":"2023-10-06T03:04:17.778997+0000","last_unstale":"2023-10-06T03:04:33.253358+0000","last_undegraded":"2023-10-06T03:04:33.253358+0000","last_fullsized":"2023-10-06T03:04:33.253358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_clean_scrub_stamp":"2023-10-06T03:04:16.761610+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255740+0000","last_change":"2023-10-06T03:04:28.836276+0000","last_active":"2023-10-06T03:04:33.255740+0000","last_peered":"2023-10-06T03:04:33.255740+0000","last_clean":"2023-10-06T03:04:33.255740+0000","last_became_active":"2023-10-06T03:04:28.836005+0000","last_became_peered":"2023-10-06T03:04:28.836005+0000","last_unstale":"2023-10-06T03:04:33.255740+0000","last_undegraded":"2023-10-06T03:04:33.255740+0000","last_fullsized":"2023-10-06T03:04:33.255740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:47.468717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251891+0000","last_change":"2023-10-06T03:04:29.246019+0000","last_active":"2023-10-06T03:04:33.251891+0000","last_peered":"2023-10-06T03:04:33.251891+0000","last_clean":"2023-10-06T03:04:33.251891+0000","last_became_active":"2023-10-06T03:04:29.245727+0000","last_became_peered":"2023-10-06T03:04:29.245727+0000","last_unstale":"2023-10-06T03:04:33.251891+0000","last_undegraded":"2023-10-06T03:04:33.251891+0000","last_fullsized":"2023-10-06T03:04:33.251891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:06.976149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275851+0000","last_change":"2023-10-06T03:04:33.273528+0000","last_active":"2023-10-06T03:04:33.275851+0000","last_peered":"2023-10-06T03:04:33.275851+0000","last_clean":"2023-10-06T03:04:33.275851+0000","last_became_active":"2023-10-06T03:04:33.272634+0000","last_became_peered":"2023-10-06T03:04:33.272634+0000","last_unstale":"2023-10-06T03:04:33.275851+0000","last_undegraded":"2023-10-06T03:04:33.275851+0000","last_fullsized":"2023-10-06T03:04:33.275851+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:49.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253551+0000","last_change":"2023-10-06T03:04:23.814887+0000","last_active":"2023-10-06T03:04:33.253551+0000","last_peered":"2023-10-06T03:04:33.253551+0000","last_clean":"2023-10-06T03:04:33.253551+0000","last_became_active":"2023-10-06T03:04:23.814581+0000","last_became_peered":"2023-10-06T03:04:23.814581+0000","last_unstale":"2023-10-06T03:04:33.253551+0000","last_undegraded":"2023-10-06T03:04:33.253551+0000","last_fullsized":"2023-10-06T03:04:33.253551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252277+0000","last_change":"2023-10-06T03:04:28.840850+0000","last_active":"2023-10-06T03:04:33.252277+0000","last_peered":"2023-10-06T03:04:33.252277+0000","last_clean":"2023-10-06T03:04:33.252277+0000","last_became_active":"2023-10-06T03:04:28.840598+0000","last_became_peered":"2023-10-06T03:04:28.840598+0000","last_unstale":"2023-10-06T03:04:33.252277+0000","last_undegraded":"2023-10-06T03:04:33.252277+0000","last_fullsized":"2023-10-06T03:04:33.252277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:01.349764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260789+0000","last_change":"2023-10-06T03:04:29.245535+0000","last_active":"2023-10-06T03:04:33.260789+0000","last_peered":"2023-10-06T03:04:33.260789+0000","last_clean":"2023-10-06T03:04:33.260789+0000","last_became_active":"2023-10-06T03:04:29.245290+0000","last_became_peered":"2023-10-06T03:04:29.245290+0000","last_unstale":"2023-10-06T03:04:33.260789+0000","last_undegraded":"2023-10-06T03:04:33.260789+0000","last_fullsized":"2023-10-06T03:04:33.260789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:41.163677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274377+0000","last_change":"2023-10-06T03:04:33.270521+0000","last_active":"2023-10-06T03:04:33.274377+0000","last_peered":"2023-10-06T03:04:33.274377+0000","last_clean":"2023-10-06T03:04:33.274377+0000","last_became_active":"2023-10-06T03:04:33.270088+0000","last_became_peered":"2023-10-06T03:04:33.270088+0000","last_unstale":"2023-10-06T03:04:33.274377+0000","last_undegraded":"2023-10-06T03:04:33.274377+0000","last_fullsized":"2023-10-06T03:04:33.274377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:19.718704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254193+0000","last_change":"2023-10-06T03:04:23.986771+0000","last_active":"2023-10-06T03:04:33.254193+0000","last_peered":"2023-10-06T03:04:33.254193+0000","last_clean":"2023-10-06T03:04:33.254193+0000","last_became_active":"2023-10-06T03:04:23.986552+0000","last_became_peered":"2023-10-06T03:04:23.986552+0000","last_unstale":"2023-10-06T03:04:33.254193+0000","last_undegraded":"2023-10-06T03:04:33.254193+0000","last_fullsized":"2023-10-06T03:04:33.254193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257056+0000","last_change":"2023-10-06T03:04:28.829211+0000","last_active":"2023-10-06T03:04:33.257056+0000","last_peered":"2023-10-06T03:04:33.257056+0000","last_clean":"2023-10-06T03:04:33.257056+0000","last_became_active":"2023-10-06T03:04:28.828898+0000","last_became_peered":"2023-10-06T03:04:28.828898+0000","last_unstale":"2023-10-06T03:04:33.257056+0000","last_undegraded":"2023-10-06T03:04:33.257056+0000","last_fullsized":"2023-10-06T03:04:33.257056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:47.647784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260435+0000","last_change":"2023-10-06T03:04:29.251481+0000","last_active":"2023-10-06T03:04:33.260435+0000","last_peered":"2023-10-06T03:04:33.260435+0000","last_clean":"2023-10-06T03:04:33.260435+0000","last_became_active":"2023-10-06T03:04:29.251248+0000","last_became_peered":"2023-10-06T03:04:29.251248+0000","last_unstale":"2023-10-06T03:04:33.260435+0000","last_undegraded":"2023-10-06T03:04:33.260435+0000","last_fullsized":"2023-10-06T03:04:33.260435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:27.111880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279649+0000","last_change":"2023-10-06T03:04:33.275681+0000","last_active":"2023-10-06T03:04:33.279649+0000","last_peered":"2023-10-06T03:04:33.279649+0000","last_clean":"2023-10-06T03:04:33.279649+0000","last_became_active":"2023-10-06T03:04:33.275300+0000","last_became_peered":"2023-10-06T03:04:33.275300+0000","last_unstale":"2023-10-06T03:04:33.279649+0000","last_undegraded":"2023-10-06T03:04:33.279649+0000","last_fullsized":"2023-10-06T03:04:33.279649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:47.690080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257944+0000","last_change":"2023-10-06T03:04:28.837159+0000","last_active":"2023-10-06T03:04:33.257944+0000","last_peered":"2023-10-06T03:04:33.257944+0000","last_clean":"2023-10-06T03:04:33.257944+0000","last_became_active":"2023-10-06T03:04:28.836765+0000","last_became_peered":"2023-10-06T03:04:28.836765+0000","last_unstale":"2023-10-06T03:04:33.257944+0000","last_undegraded":"2023-10-06T03:04:33.257944+0000","last_fullsized":"2023-10-06T03:04:33.257944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:53.804099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256426+0000","last_change":"2023-10-06T03:04:23.813862+0000","last_active":"2023-10-06T03:04:33.256426+0000","last_peered":"2023-10-06T03:04:33.256426+0000","last_clean":"2023-10-06T03:04:33.256426+0000","last_became_active":"2023-10-06T03:04:23.813584+0000","last_became_peered":"2023-10-06T03:04:23.813584+0000","last_unstale":"2023-10-06T03:04:33.256426+0000","last_undegraded":"2023-10-06T03:04:33.256426+0000","last_fullsized":"2023-10-06T03:04:33.256426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255681+0000","last_change":"2023-10-06T03:04:29.245915+0000","last_active":"2023-10-06T03:04:33.255681+0000","last_peered":"2023-10-06T03:04:33.255681+0000","last_clean":"2023-10-06T03:04:33.255681+0000","last_became_active":"2023-10-06T03:04:29.245657+0000","last_became_peered":"2023-10-06T03:04:29.245657+0000","last_unstale":"2023-10-06T03:04:33.255681+0000","last_undegraded":"2023-10-06T03:04:33.255681+0000","last_fullsized":"2023-10-06T03:04:33.255681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274653+0000","last_change":"2023-10-06T03:04:33.269388+0000","last_active":"2023-10-06T03:04:33.274653+0000","last_peered":"2023-10-06T03:04:33.274653+0000","last_clean":"2023-10-06T03:04:33.274653+0000","last_became_active":"2023-10-06T03:04:33.268742+0000","last_became_peered":"2023-10-06T03:04:33.268742+0000","last_unstale":"2023-10-06T03:04:33.274653+0000","last_undegraded":"2023-10-06T03:04:33.274653+0000","last_fullsized":"2023-10-06T03:04:33.274653+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:18.722157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252616+0000","last_change":"2023-10-06T03:04:23.805874+0000","last_active":"2023-10-06T03:04:33.252616+0000","last_peered":"2023-10-06T03:04:33.252616+0000","last_clean":"2023-10-06T03:04:33.252616+0000","last_became_active":"2023-10-06T03:04:23.805551+0000","last_became_peered":"2023-10-06T03:04:23.805551+0000","last_unstale":"2023-10-06T03:04:33.252616+0000","last_undegraded":"2023-10-06T03:04:33.252616+0000","last_fullsized":"2023-10-06T03:04:33.252616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:21.250275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.916228+0000","last_change":"2023-10-06T03:04:28.838956+0000","last_active":"2023-10-06T03:04:33.916228+0000","last_peered":"2023-10-06T03:04:33.916228+0000","last_clean":"2023-10-06T03:04:33.916228+0000","last_became_active":"2023-10-06T03:04:28.838653+0000","last_became_peered":"2023-10-06T03:04:28.838653+0000","last_unstale":"2023-10-06T03:04:33.916228+0000","last_undegraded":"2023-10-06T03:04:33.916228+0000","last_fullsized":"2023-10-06T03:04:33.916228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:01.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260316+0000","last_change":"2023-10-06T03:04:29.250642+0000","last_active":"2023-10-06T03:04:33.260316+0000","last_peered":"2023-10-06T03:04:33.260316+0000","last_clean":"2023-10-06T03:04:33.260316+0000","last_became_active":"2023-10-06T03:04:29.250128+0000","last_became_peered":"2023-10-06T03:04:29.250128+0000","last_unstale":"2023-10-06T03:04:33.260316+0000","last_undegraded":"2023-10-06T03:04:33.260316+0000","last_fullsized":"2023-10-06T03:04:33.260316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:07.410542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279289+0000","last_change":"2023-10-06T03:04:33.277567+0000","last_active":"2023-10-06T03:04:33.279289+0000","last_peered":"2023-10-06T03:04:33.279289+0000","last_clean":"2023-10-06T03:04:33.279289+0000","last_became_active":"2023-10-06T03:04:33.277169+0000","last_became_peered":"2023-10-06T03:04:33.277169+0000","last_unstale":"2023-10-06T03:04:33.279289+0000","last_undegraded":"2023-10-06T03:04:33.279289+0000","last_fullsized":"2023-10-06T03:04:33.279289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:38.040904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260456+0000","last_change":"2023-10-06T03:04:28.840794+0000","last_active":"2023-10-06T03:04:33.260456+0000","last_peered":"2023-10-06T03:04:33.260456+0000","last_clean":"2023-10-06T03:04:33.260456+0000","last_became_active":"2023-10-06T03:04:28.840573+0000","last_became_peered":"2023-10-06T03:04:28.840573+0000","last_unstale":"2023-10-06T03:04:33.260456+0000","last_undegraded":"2023-10-06T03:04:33.260456+0000","last_fullsized":"2023-10-06T03:04:33.260456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:16.444923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256202+0000","last_change":"2023-10-06T03:04:29.248438+0000","last_active":"2023-10-06T03:04:33.256202+0000","last_peered":"2023-10-06T03:04:33.256202+0000","last_clean":"2023-10-06T03:04:33.256202+0000","last_became_active":"2023-10-06T03:04:29.248173+0000","last_became_peered":"2023-10-06T03:04:29.248173+0000","last_unstale":"2023-10-06T03:04:33.256202+0000","last_undegraded":"2023-10-06T03:04:33.256202+0000","last_fullsized":"2023-10-06T03:04:33.256202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:38:44.554979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274467+0000","last_change":"2023-10-06T03:04:33.270323+0000","last_active":"2023-10-06T03:04:33.274467+0000","last_peered":"2023-10-06T03:04:33.274467+0000","last_clean":"2023-10-06T03:04:33.274467+0000","last_became_active":"2023-10-06T03:04:33.269918+0000","last_became_peered":"2023-10-06T03:04:33.269918+0000","last_unstale":"2023-10-06T03:04:33.274467+0000","last_undegraded":"2023-10-06T03:04:33.274467+0000","last_fullsized":"2023-10-06T03:04:33.274467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:29.020898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247754+0000","last_change":"2023-10-06T03:04:28.838880+0000","last_active":"2023-10-06T03:04:33.247754+0000","last_peered":"2023-10-06T03:04:33.247754+0000","last_clean":"2023-10-06T03:04:33.247754+0000","last_became_active":"2023-10-06T03:04:28.838586+0000","last_became_peered":"2023-10-06T03:04:28.838586+0000","last_unstale":"2023-10-06T03:04:33.247754+0000","last_undegraded":"2023-10-06T03:04:33.247754+0000","last_fullsized":"2023-10-06T03:04:33.247754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:22.072997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252124+0000","last_change":"2023-10-06T03:04:29.243720+0000","last_active":"2023-10-06T03:04:33.252124+0000","last_peered":"2023-10-06T03:04:33.252124+0000","last_clean":"2023-10-06T03:04:33.252124+0000","last_became_active":"2023-10-06T03:04:29.243445+0000","last_became_peered":"2023-10-06T03:04:29.243445+0000","last_unstale":"2023-10-06T03:04:33.252124+0000","last_undegraded":"2023-10-06T03:04:33.252124+0000","last_fullsized":"2023-10-06T03:04:33.252124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:22.258796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.272233+0000","last_change":"2023-10-06T03:04:33.267993+0000","last_active":"2023-10-06T03:04:33.272233+0000","last_peered":"2023-10-06T03:04:33.272233+0000","last_clean":"2023-10-06T03:04:33.272233+0000","last_became_active":"2023-10-06T03:04:33.267548+0000","last_became_peered":"2023-10-06T03:04:33.267548+0000","last_unstale":"2023-10-06T03:04:33.272233+0000","last_undegraded":"2023-10-06T03:04:33.272233+0000","last_fullsized":"2023-10-06T03:04:33.272233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:07.483381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247563+0000","last_change":"2023-10-06T03:04:28.839397+0000","last_active":"2023-10-06T03:04:33.247563+0000","last_peered":"2023-10-06T03:04:33.247563+0000","last_clean":"2023-10-06T03:04:33.247563+0000","last_became_active":"2023-10-06T03:04:28.839121+0000","last_became_peered":"2023-10-06T03:04:28.839121+0000","last_unstale":"2023-10-06T03:04:33.247563+0000","last_undegraded":"2023-10-06T03:04:33.247563+0000","last_fullsized":"2023-10-06T03:04:33.247563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:19.451116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251017+0000","last_change":"2023-10-06T03:04:29.241780+0000","last_active":"2023-10-06T03:04:33.251017+0000","last_peered":"2023-10-06T03:04:33.251017+0000","last_clean":"2023-10-06T03:04:33.251017+0000","last_became_active":"2023-10-06T03:04:29.241462+0000","last_became_peered":"2023-10-06T03:04:29.241462+0000","last_unstale":"2023-10-06T03:04:33.251017+0000","last_undegraded":"2023-10-06T03:04:33.251017+0000","last_fullsized":"2023-10-06T03:04:33.251017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.270793+0000","last_change":"2023-10-06T03:04:33.266666+0000","last_active":"2023-10-06T03:04:33.270793+0000","last_peered":"2023-10-06T03:04:33.270793+0000","last_clean":"2023-10-06T03:04:33.270793+0000","last_became_active":"2023-10-06T03:04:33.266284+0000","last_became_peered":"2023-10-06T03:04:33.266284+0000","last_unstale":"2023-10-06T03:04:33.270793+0000","last_undegraded":"2023-10-06T03:04:33.270793+0000","last_fullsized":"2023-10-06T03:04:33.270793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:17.775172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256370+0000","last_change":"2023-10-06T03:04:28.833313+0000","last_active":"2023-10-06T03:04:33.256370+0000","last_peered":"2023-10-06T03:04:33.256370+0000","last_clean":"2023-10-06T03:04:33.256370+0000","last_became_active":"2023-10-06T03:04:28.832982+0000","last_became_peered":"2023-10-06T03:04:28.832982+0000","last_unstale":"2023-10-06T03:04:33.256370+0000","last_undegraded":"2023-10-06T03:04:33.256370+0000","last_fullsized":"2023-10-06T03:04:33.256370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:04.476704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255857+0000","last_change":"2023-10-06T03:04:29.237739+0000","last_active":"2023-10-06T03:04:33.255857+0000","last_peered":"2023-10-06T03:04:33.255857+0000","last_clean":"2023-10-06T03:04:33.255857+0000","last_became_active":"2023-10-06T03:04:29.237497+0000","last_became_peered":"2023-10-06T03:04:29.237497+0000","last_unstale":"2023-10-06T03:04:33.255857+0000","last_undegraded":"2023-10-06T03:04:33.255857+0000","last_fullsized":"2023-10-06T03:04:33.255857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:27.111880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279027+0000","last_change":"2023-10-06T03:04:33.269307+0000","last_active":"2023-10-06T03:04:33.279027+0000","last_peered":"2023-10-06T03:04:33.279027+0000","last_clean":"2023-10-06T03:04:33.279027+0000","last_became_active":"2023-10-06T03:04:33.268876+0000","last_became_peered":"2023-10-06T03:04:33.268876+0000","last_unstale":"2023-10-06T03:04:33.279027+0000","last_undegraded":"2023-10-06T03:04:33.279027+0000","last_fullsized":"2023-10-06T03:04:33.279027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:53.801187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260493+0000","last_change":"2023-10-06T03:04:28.839985+0000","last_active":"2023-10-06T03:04:33.260493+0000","last_peered":"2023-10-06T03:04:33.260493+0000","last_clean":"2023-10-06T03:04:33.260493+0000","last_became_active":"2023-10-06T03:04:28.839831+0000","last_became_peered":"2023-10-06T03:04:28.839831+0000","last_unstale":"2023-10-06T03:04:33.260493+0000","last_undegraded":"2023-10-06T03:04:33.260493+0000","last_fullsized":"2023-10-06T03:04:33.260493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:04.476704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251017+0000","last_change":"2023-10-06T03:04:29.242972+0000","last_active":"2023-10-06T03:04:33.251017+0000","last_peered":"2023-10-06T03:04:33.251017+0000","last_clean":"2023-10-06T03:04:33.251017+0000","last_became_active":"2023-10-06T03:04:29.242692+0000","last_became_peered":"2023-10-06T03:04:29.242692+0000","last_unstale":"2023-10-06T03:04:33.251017+0000","last_undegraded":"2023-10-06T03:04:33.251017+0000","last_fullsized":"2023-10-06T03:04:33.251017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:22.493291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251832+0000","last_change":"2023-10-06T03:04:29.239473+0000","last_active":"2023-10-06T03:04:33.251832+0000","last_peered":"2023-10-06T03:04:33.251832+0000","last_clean":"2023-10-06T03:04:33.251832+0000","last_became_active":"2023-10-06T03:04:29.239195+0000","last_became_peered":"2023-10-06T03:04:29.239195+0000","last_unstale":"2023-10-06T03:04:33.251832+0000","last_undegraded":"2023-10-06T03:04:33.251832+0000","last_fullsized":"2023-10-06T03:04:33.251832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:38:44.554979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255913+0000","last_change":"2023-10-06T03:04:29.248060+0000","last_active":"2023-10-06T03:04:33.255913+0000","last_peered":"2023-10-06T03:04:33.255913+0000","last_clean":"2023-10-06T03:04:33.255913+0000","last_became_active":"2023-10-06T03:04:29.247710+0000","last_became_peered":"2023-10-06T03:04:29.247710+0000","last_unstale":"2023-10-06T03:04:33.255913+0000","last_undegraded":"2023-10-06T03:04:33.255913+0000","last_fullsized":"2023-10-06T03:04:33.255913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:41.163677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251328+0000","last_change":"2023-10-06T03:04:29.242391+0000","last_active":"2023-10-06T03:04:33.251328+0000","last_peered":"2023-10-06T03:04:33.251328+0000","last_clean":"2023-10-06T03:04:33.251328+0000","last_became_active":"2023-10-06T03:04:29.241939+0000","last_became_peered":"2023-10-06T03:04:29.241939+0000","last_unstale":"2023-10-06T03:04:33.251328+0000","last_undegraded":"2023-10-06T03:04:33.251328+0000","last_fullsized":"2023-10-06T03:04:33.251328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:22:15.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256253+0000","last_change":"2023-10-06T03:04:29.244909+0000","last_active":"2023-10-06T03:04:33.256253+0000","last_peered":"2023-10-06T03:04:33.256253+0000","last_clean":"2023-10-06T03:04:33.256253+0000","last_became_active":"2023-10-06T03:04:29.244666+0000","last_became_peered":"2023-10-06T03:04:29.244666+0000","last_unstale":"2023-10-06T03:04:33.256253+0000","last_undegraded":"2023-10-06T03:04:33.256253+0000","last_fullsized":"2023-10-06T03:04:33.256253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:16.298020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256973+0000","last_change":"2023-10-06T03:04:29.252885+0000","last_active":"2023-10-06T03:04:33.256973+0000","last_peered":"2023-10-06T03:04:33.256973+0000","last_clean":"2023-10-06T03:04:33.256973+0000","last_became_active":"2023-10-06T03:04:29.252697+0000","last_became_peered":"2023-10-06T03:04:29.252697+0000","last_unstale":"2023-10-06T03:04:33.256973+0000","last_undegraded":"2023-10-06T03:04:33.256973+0000","last_fullsized":"2023-10-06T03:04:33.256973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":713872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":709484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":119663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":123344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":299008,"data_stored":120197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:04:43.335 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:04:43.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.484+0000 7f80f5a44700 1 Processor -- start 2023-10-06T03:04:43.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.484+0000 7f80f5a44700 1 -- start start 2023-10-06T03:04:43.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.484+0000 7f80f5a44700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f80f01591f0 0x7f80f01595c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.484+0000 7f80f5a44700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80f00b2f30 0x7f80f00b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.484+0000 7f80f5a44700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f80f00ccc30 0x7f80f00cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.484+0000 7f80f5a44700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f00afbf0 con 0x7f80f00ccc30 2023-10-06T03:04:43.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.484+0000 7f80f5a44700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f00cbb90 con 0x7f80f01591f0 2023-10-06T03:04:43.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.484+0000 7f80f5a44700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00cbe70 con 0x7f80f00b2f30 2023-10-06T03:04:43.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.484+0000 7f80ef7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f80f00ccc30 0x7f80f00cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.485+0000 7f80ef7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f80f00ccc30 0x7f80f00cd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54002/0 (socket says 172.21.15.125:54002) 2023-10-06T03:04:43.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.485+0000 7f80ef7fe700 1 -- 172.21.15.125:0/1743982444 learned_addr learned my addr 172.21.15.125:0/1743982444 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:43.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.485+0000 7f80eeffd700 1 --2- 172.21.15.125:0/1743982444 >> v2:172.21.15.130:3300/0 conn(0x7f80f01591f0 0x7f80f01595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.485+0000 7f80ee7fc700 1 --2- 172.21.15.125:0/1743982444 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80f00b2f30 0x7f80f00b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.485+0000 7f80ef7fe700 1 -- 172.21.15.125:0/1743982444 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80f00b2f30 msgr2=0x7f80f00b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:43.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.485+0000 7f80ef7fe700 1 --2- 172.21.15.125:0/1743982444 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80f00b2f30 0x7f80f00b33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.485+0000 7f80ef7fe700 1 -- 172.21.15.125:0/1743982444 >> v2:172.21.15.130:3300/0 conn(0x7f80f01591f0 msgr2=0x7f80f01595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:43.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.485+0000 7f80ef7fe700 1 --2- 172.21.15.125:0/1743982444 >> v2:172.21.15.130:3300/0 conn(0x7f80f01591f0 0x7f80f01595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.485+0000 7f80ef7fe700 1 -- 172.21.15.125:0/1743982444 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f00cc150 con 0x7f80f00ccc30 2023-10-06T03:04:43.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.485+0000 7f80ef7fe700 1 --2- 172.21.15.125:0/1743982444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80f00ccc30 0x7f80f00cd0b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f80f0088030 tx=0x7f80e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337706ccc8e39659 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:43.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.485+0000 7f80edffb700 1 -- 172.21.15.125:0/1743982444 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e800e070 con 0x7f80f00ccc30 2023-10-06T03:04:43.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.485+0000 7f80edffb700 1 -- 172.21.15.125:0/1743982444 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e800ba50 con 0x7f80f00ccc30 2023-10-06T03:04:43.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.485+0000 7f80edffb700 1 -- 172.21.15.125:0/1743982444 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e80092e0 con 0x7f80f00ccc30 2023-10-06T03:04:43.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.486+0000 7f80f5a44700 1 -- 172.21.15.125:0/1743982444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80f00ccc30 msgr2=0x7f80f00cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:43.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.486+0000 7f80f5a44700 1 --2- 172.21.15.125:0/1743982444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80f00ccc30 0x7f80f00cd0b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f80f0088030 tx=0x7f80e8009840 comp rx=0 tx=0).stop 2023-10-06T03:04:43.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.486+0000 7f80f5a44700 1 -- 172.21.15.125:0/1743982444 shutdown_connections 2023-10-06T03:04:43.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.486+0000 7f80f5a44700 1 --2- 172.21.15.125:0/1743982444 >> v2:172.21.15.130:3300/0 conn(0x7f80f01591f0 0x7f80f01595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.486+0000 7f80f5a44700 1 --2- 172.21.15.125:0/1743982444 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80f00ccc30 0x7f80f00cd0b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.486+0000 7f80f5a44700 1 --2- 172.21.15.125:0/1743982444 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80f00b2f30 0x7f80f00b33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.486+0000 7f80f5a44700 1 -- 172.21.15.125:0/1743982444 >> 172.21.15.125:0/1743982444 conn(0x7f80f006ed40 msgr2=0x7f80f006f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:43.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.486+0000 7f80f5a44700 1 -- 172.21.15.125:0/1743982444 shutdown_connections 2023-10-06T03:04:43.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.486+0000 7f80f5a44700 1 -- 172.21.15.125:0/1743982444 wait complete. 2023-10-06T03:04:43.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.487+0000 7f80f5a44700 1 Processor -- start 2023-10-06T03:04:43.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.487+0000 7f80f5a44700 1 -- start start 2023-10-06T03:04:43.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80f5a44700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80f00b2f30 0x7f80f00d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80f5a44700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80f00ccc30 0x7f80f00c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80f5a44700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80f01591f0 0x7f80f00c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80f5a44700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00d0a30 con 0x7f80f00b2f30 2023-10-06T03:04:43.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80f5a44700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00c4870 con 0x7f80f01591f0 2023-10-06T03:04:43.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80f5a44700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f00c3c60 con 0x7f80f00ccc30 2023-10-06T03:04:43.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80eeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80f00b2f30 0x7f80f00d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80eeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80f00b2f30 0x7f80f00d04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54004/0 (socket says 172.21.15.125:54004) 2023-10-06T03:04:43.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80eeffd700 1 -- 172.21.15.125:0/3684516995 learned_addr learned my addr 172.21.15.125:0/3684516995 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:43.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80ee7fc700 1 --2- 172.21.15.125:0/3684516995 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80f00ccc30 0x7f80f00c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80ef7fe700 1 --2- 172.21.15.125:0/3684516995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80f01591f0 0x7f80f00c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80eeffd700 1 -- 172.21.15.125:0/3684516995 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80f00ccc30 msgr2=0x7f80f00c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:43.493 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80eeffd700 1 --2- 172.21.15.125:0/3684516995 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80f00ccc30 0x7f80f00c62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80eeffd700 1 -- 172.21.15.125:0/3684516995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80f01591f0 msgr2=0x7f80f00c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:43.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80eeffd700 1 --2- 172.21.15.125:0/3684516995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80f01591f0 0x7f80f00c8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80eeffd700 1 -- 172.21.15.125:0/3684516995 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e8009ae0 con 0x7f80f00b2f30 2023-10-06T03:04:43.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80eeffd700 1 --2- 172.21.15.125:0/3684516995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80f00b2f30 0x7f80f00d04f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f80e000d890 tx=0x7f80e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:43.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80e6ffd700 1 -- 172.21.15.125:0/3684516995 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e000b600 con 0x7f80f00b2f30 2023-10-06T03:04:43.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80e6ffd700 1 -- 172.21.15.125:0/3684516995 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e000b760 con 0x7f80f00b2f30 2023-10-06T03:04:43.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80e6ffd700 1 -- 172.21.15.125:0/3684516995 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e000bae0 con 0x7f80f00b2f30 2023-10-06T03:04:43.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.488+0000 7f80f5a44700 1 -- 172.21.15.125:0/3684516995 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f00c3f40 con 0x7f80f00b2f30 2023-10-06T03:04:43.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.489+0000 7f80f5a44700 1 -- 172.21.15.125:0/3684516995 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f00c4500 con 0x7f80f00b2f30 2023-10-06T03:04:43.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.489+0000 7f80f5a44700 1 -- 172.21.15.125:0/3684516995 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f00c4b50 con 0x7f80f00b2f30 2023-10-06T03:04:43.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.490+0000 7f80e6ffd700 1 -- 172.21.15.125:0/3684516995 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80e001e460 con 0x7f80f00b2f30 2023-10-06T03:04:43.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.490+0000 7f80e6ffd700 1 --2- 172.21.15.125:0/3684516995 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f80d0066f30 0x7f80d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.490+0000 7f80e6ffd700 1 -- 172.21.15.125:0/3684516995 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f80e00850d0 con 0x7f80f00b2f30 2023-10-06T03:04:43.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.490+0000 7f80ee7fc700 1 --2- 172.21.15.125:0/3684516995 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f80d0066f30 0x7f80d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.491+0000 7f80ee7fc700 1 --2- 172.21.15.125:0/3684516995 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f80d0066f30 0x7f80d00693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f80f00aeed0 tx=0x7f80d8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:43.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.494+0000 7f80e6ffd700 1 -- 172.21.15.125:0/3684516995 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80e0051e50 con 0x7f80f00b2f30 2023-10-06T03:04:43.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.673+0000 7f80f5a44700 1 -- 172.21.15.125:0/3684516995 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80f0066510 con 0x7f80d0066f30 2023-10-06T03:04:43.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.683+0000 7f80e6ffd700 1 -- 172.21.15.125:0/3684516995 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367369 (secure 0 0 0) 0x7f80f0066510 con 0x7f80d0066f30 2023-10-06T03:04:43.688 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:43.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.686+0000 7f80f5a44700 1 -- 172.21.15.125:0/3684516995 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f80d0066f30 msgr2=0x7f80d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:43.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.686+0000 7f80f5a44700 1 --2- 172.21.15.125:0/3684516995 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f80d0066f30 0x7f80d00693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f80f00aeed0 tx=0x7f80d8008040 comp rx=0 tx=0).stop 2023-10-06T03:04:43.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.686+0000 7f80f5a44700 1 -- 172.21.15.125:0/3684516995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80f00b2f30 msgr2=0x7f80f00d04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:43.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.686+0000 7f80f5a44700 1 --2- 172.21.15.125:0/3684516995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80f00b2f30 0x7f80f00d04f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f80e000d890 tx=0x7f80e0008040 comp rx=0 tx=0).stop 2023-10-06T03:04:43.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.686+0000 7f80f5a44700 1 -- 172.21.15.125:0/3684516995 shutdown_connections 2023-10-06T03:04:43.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.686+0000 7f80f5a44700 1 --2- 172.21.15.125:0/3684516995 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f80d0066f30 0x7f80d00693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.686+0000 7f80f5a44700 1 --2- 172.21.15.125:0/3684516995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80f01591f0 0x7f80f00c8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.686+0000 7f80f5a44700 1 --2- 172.21.15.125:0/3684516995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80f00b2f30 0x7f80f00d04f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.686+0000 7f80f5a44700 1 --2- 172.21.15.125:0/3684516995 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80f00ccc30 0x7f80f00c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.686+0000 7f80f5a44700 1 -- 172.21.15.125:0/3684516995 >> 172.21.15.125:0/3684516995 conn(0x7f80f006ed40 msgr2=0x7f80f00b5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:43.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.686+0000 7f80f5a44700 1 -- 172.21.15.125:0/3684516995 shutdown_connections 2023-10-06T03:04:43.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.686+0000 7f80f5a44700 1 -- 172.21.15.125:0/3684516995 wait complete. 2023-10-06T03:04:43.692 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-06T03:04:43.700 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-10-06T03:04:41.809393+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594853,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381796,"kb_used_data":3492,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592924,"statfs":{"total":773094113280,"available":770655154176,"internally_reserved":0,"allocated":3575808,"data_stored":2145279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2179,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.563869"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257885+0000","last_change":"2023-10-06T03:04:29.236716+0000","last_active":"2023-10-06T03:04:33.257885+0000","last_peered":"2023-10-06T03:04:33.257885+0000","last_clean":"2023-10-06T03:04:33.257885+0000","last_became_active":"2023-10-06T03:04:29.236437+0000","last_became_peered":"2023-10-06T03:04:29.236437+0000","last_unstale":"2023-10-06T03:04:33.257885+0000","last_undegraded":"2023-10-06T03:04:33.257885+0000","last_fullsized":"2023-10-06T03:04:33.257885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:20.456488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.248189+0000","last_change":"2023-10-06T03:04:29.250536+0000","last_active":"2023-10-06T03:04:33.248189+0000","last_peered":"2023-10-06T03:04:33.248189+0000","last_clean":"2023-10-06T03:04:33.248189+0000","last_became_active":"2023-10-06T03:04:29.249872+0000","last_became_peered":"2023-10-06T03:04:29.249872+0000","last_unstale":"2023-10-06T03:04:33.248189+0000","last_undegraded":"2023-10-06T03:04:33.248189+0000","last_fullsized":"2023-10-06T03:04:33.248189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:06.710555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251359+0000","last_change":"2023-10-06T03:04:29.244837+0000","last_active":"2023-10-06T03:04:33.251359+0000","last_peered":"2023-10-06T03:04:33.251359+0000","last_clean":"2023-10-06T03:04:33.251359+0000","last_became_active":"2023-10-06T03:04:29.244485+0000","last_became_peered":"2023-10-06T03:04:29.244485+0000","last_unstale":"2023-10-06T03:04:33.251359+0000","last_undegraded":"2023-10-06T03:04:33.251359+0000","last_fullsized":"2023-10-06T03:04:33.251359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:22.025761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251807+0000","last_change":"2023-10-06T03:04:29.244101+0000","last_active":"2023-10-06T03:04:33.251807+0000","last_peered":"2023-10-06T03:04:33.251807+0000","last_clean":"2023-10-06T03:04:33.251807+0000","last_became_active":"2023-10-06T03:04:29.243769+0000","last_became_peered":"2023-10-06T03:04:29.243769+0000","last_unstale":"2023-10-06T03:04:33.251807+0000","last_undegraded":"2023-10-06T03:04:33.251807+0000","last_fullsized":"2023-10-06T03:04:33.251807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:03.973528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260210+0000","last_change":"2023-10-06T03:04:29.245074+0000","last_active":"2023-10-06T03:04:33.260210+0000","last_peered":"2023-10-06T03:04:33.260210+0000","last_clean":"2023-10-06T03:04:33.260210+0000","last_became_active":"2023-10-06T03:04:29.244794+0000","last_became_peered":"2023-10-06T03:04:29.244794+0000","last_unstale":"2023-10-06T03:04:33.260210+0000","last_undegraded":"2023-10-06T03:04:33.260210+0000","last_fullsized":"2023-10-06T03:04:33.260210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:14.635872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251200+0000","last_change":"2023-10-06T03:04:29.248647+0000","last_active":"2023-10-06T03:04:33.251200+0000","last_peered":"2023-10-06T03:04:33.251200+0000","last_clean":"2023-10-06T03:04:33.251200+0000","last_became_active":"2023-10-06T03:04:29.248380+0000","last_became_peered":"2023-10-06T03:04:29.248380+0000","last_unstale":"2023-10-06T03:04:33.251200+0000","last_undegraded":"2023-10-06T03:04:33.251200+0000","last_fullsized":"2023-10-06T03:04:33.251200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:03.691892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255155+0000","last_change":"2023-10-06T03:04:29.249718+0000","last_active":"2023-10-06T03:04:33.255155+0000","last_peered":"2023-10-06T03:04:33.255155+0000","last_clean":"2023-10-06T03:04:33.255155+0000","last_became_active":"2023-10-06T03:04:29.249402+0000","last_became_peered":"2023-10-06T03:04:29.249402+0000","last_unstale":"2023-10-06T03:04:33.255155+0000","last_undegraded":"2023-10-06T03:04:33.255155+0000","last_fullsized":"2023-10-06T03:04:33.255155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247799+0000","last_change":"2023-10-06T03:04:29.252781+0000","last_active":"2023-10-06T03:04:33.247799+0000","last_peered":"2023-10-06T03:04:33.247799+0000","last_clean":"2023-10-06T03:04:33.247799+0000","last_became_active":"2023-10-06T03:04:29.252492+0000","last_became_peered":"2023-10-06T03:04:29.252492+0000","last_unstale":"2023-10-06T03:04:33.247799+0000","last_undegraded":"2023-10-06T03:04:33.247799+0000","last_fullsized":"2023-10-06T03:04:33.247799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:27.111880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260274+0000","last_change":"2023-10-06T03:04:29.248896+0000","last_active":"2023-10-06T03:04:33.260274+0000","last_peered":"2023-10-06T03:04:33.260274+0000","last_clean":"2023-10-06T03:04:33.260274+0000","last_became_active":"2023-10-06T03:04:29.248629+0000","last_became_peered":"2023-10-06T03:04:29.248629+0000","last_unstale":"2023-10-06T03:04:33.260274+0000","last_undegraded":"2023-10-06T03:04:33.260274+0000","last_fullsized":"2023-10-06T03:04:33.260274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:07.410542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.248372+0000","last_change":"2023-10-06T03:04:29.249187+0000","last_active":"2023-10-06T03:04:33.248372+0000","last_peered":"2023-10-06T03:04:33.248372+0000","last_clean":"2023-10-06T03:04:33.248372+0000","last_became_active":"2023-10-06T03:04:29.248914+0000","last_became_peered":"2023-10-06T03:04:29.248914+0000","last_unstale":"2023-10-06T03:04:33.248372+0000","last_undegraded":"2023-10-06T03:04:33.248372+0000","last_fullsized":"2023-10-06T03:04:33.248372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:07.410542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251508+0000","last_change":"2023-10-06T03:04:29.254043+0000","last_active":"2023-10-06T03:04:33.251508+0000","last_peered":"2023-10-06T03:04:33.251508+0000","last_clean":"2023-10-06T03:04:33.251508+0000","last_became_active":"2023-10-06T03:04:29.253749+0000","last_became_peered":"2023-10-06T03:04:29.253749+0000","last_unstale":"2023-10-06T03:04:33.251508+0000","last_undegraded":"2023-10-06T03:04:33.251508+0000","last_fullsized":"2023-10-06T03:04:33.251508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:56.032368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256021+0000","last_change":"2023-10-06T03:04:29.248689+0000","last_active":"2023-10-06T03:04:33.256021+0000","last_peered":"2023-10-06T03:04:33.256021+0000","last_clean":"2023-10-06T03:04:33.256021+0000","last_became_active":"2023-10-06T03:04:29.248400+0000","last_became_peered":"2023-10-06T03:04:29.248400+0000","last_unstale":"2023-10-06T03:04:33.256021+0000","last_undegraded":"2023-10-06T03:04:33.256021+0000","last_fullsized":"2023-10-06T03:04:33.256021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:23.078369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252308+0000","last_change":"2023-10-06T03:04:29.238874+0000","last_active":"2023-10-06T03:04:33.252308+0000","last_peered":"2023-10-06T03:04:33.252308+0000","last_clean":"2023-10-06T03:04:33.252308+0000","last_became_active":"2023-10-06T03:04:29.238616+0000","last_became_peered":"2023-10-06T03:04:29.238616+0000","last_unstale":"2023-10-06T03:04:33.252308+0000","last_undegraded":"2023-10-06T03:04:33.252308+0000","last_fullsized":"2023-10-06T03:04:33.252308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:05.482076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247717+0000","last_change":"2023-10-06T03:04:29.248968+0000","last_active":"2023-10-06T03:04:33.247717+0000","last_peered":"2023-10-06T03:04:33.247717+0000","last_clean":"2023-10-06T03:04:33.247717+0000","last_became_active":"2023-10-06T03:04:29.248709+0000","last_became_peered":"2023-10-06T03:04:29.248709+0000","last_unstale":"2023-10-06T03:04:33.247717+0000","last_undegraded":"2023-10-06T03:04:33.247717+0000","last_fullsized":"2023-10-06T03:04:33.247717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:41.163677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254258+0000","last_change":"2023-10-06T03:04:29.253102+0000","last_active":"2023-10-06T03:04:33.254258+0000","last_peered":"2023-10-06T03:04:33.254258+0000","last_clean":"2023-10-06T03:04:33.254258+0000","last_became_active":"2023-10-06T03:04:29.252836+0000","last_became_peered":"2023-10-06T03:04:29.252836+0000","last_unstale":"2023-10-06T03:04:33.254258+0000","last_undegraded":"2023-10-06T03:04:33.254258+0000","last_fullsized":"2023-10-06T03:04:33.254258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251098+0000","last_change":"2023-10-06T03:04:29.244988+0000","last_active":"2023-10-06T03:04:33.251098+0000","last_peered":"2023-10-06T03:04:33.251098+0000","last_clean":"2023-10-06T03:04:33.251098+0000","last_became_active":"2023-10-06T03:04:29.244457+0000","last_became_peered":"2023-10-06T03:04:29.244457+0000","last_unstale":"2023-10-06T03:04:33.251098+0000","last_undegraded":"2023-10-06T03:04:33.251098+0000","last_fullsized":"2023-10-06T03:04:33.251098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:20.580002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260392+0000","last_change":"2023-10-06T03:04:29.242343+0000","last_active":"2023-10-06T03:04:33.260392+0000","last_peered":"2023-10-06T03:04:33.260392+0000","last_clean":"2023-10-06T03:04:33.260392+0000","last_became_active":"2023-10-06T03:04:29.242032+0000","last_became_peered":"2023-10-06T03:04:29.242032+0000","last_unstale":"2023-10-06T03:04:33.260392+0000","last_undegraded":"2023-10-06T03:04:33.260392+0000","last_fullsized":"2023-10-06T03:04:33.260392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.258197+0000","last_change":"2023-10-06T03:04:29.246372+0000","last_active":"2023-10-06T03:04:33.258197+0000","last_peered":"2023-10-06T03:04:33.258197+0000","last_clean":"2023-10-06T03:04:33.258197+0000","last_became_active":"2023-10-06T03:04:29.246058+0000","last_became_peered":"2023-10-06T03:04:29.246058+0000","last_unstale":"2023-10-06T03:04:33.258197+0000","last_undegraded":"2023-10-06T03:04:33.258197+0000","last_fullsized":"2023-10-06T03:04:33.258197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253617+0000","last_change":"2023-10-06T03:04:29.242029+0000","last_active":"2023-10-06T03:04:33.253617+0000","last_peered":"2023-10-06T03:04:33.253617+0000","last_clean":"2023-10-06T03:04:33.253617+0000","last_became_active":"2023-10-06T03:04:29.241785+0000","last_became_peered":"2023-10-06T03:04:29.241785+0000","last_unstale":"2023-10-06T03:04:33.253617+0000","last_undegraded":"2023-10-06T03:04:33.253617+0000","last_fullsized":"2023-10-06T03:04:33.253617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:48.653156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253130+0000","last_change":"2023-10-06T03:04:29.246603+0000","last_active":"2023-10-06T03:04:33.253130+0000","last_peered":"2023-10-06T03:04:33.253130+0000","last_clean":"2023-10-06T03:04:33.253130+0000","last_became_active":"2023-10-06T03:04:29.246405+0000","last_became_peered":"2023-10-06T03:04:29.246405+0000","last_unstale":"2023-10-06T03:04:33.253130+0000","last_undegraded":"2023-10-06T03:04:33.253130+0000","last_fullsized":"2023-10-06T03:04:33.253130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:41.436589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254147+0000","last_change":"2023-10-06T03:04:29.250839+0000","last_active":"2023-10-06T03:04:33.254147+0000","last_peered":"2023-10-06T03:04:33.254147+0000","last_clean":"2023-10-06T03:04:33.254147+0000","last_became_active":"2023-10-06T03:04:29.250600+0000","last_became_peered":"2023-10-06T03:04:29.250600+0000","last_unstale":"2023-10-06T03:04:33.254147+0000","last_undegraded":"2023-10-06T03:04:33.254147+0000","last_fullsized":"2023-10-06T03:04:33.254147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:27.111880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252975+0000","last_change":"2023-10-06T03:04:29.247916+0000","last_active":"2023-10-06T03:04:33.252975+0000","last_peered":"2023-10-06T03:04:33.252975+0000","last_clean":"2023-10-06T03:04:33.252975+0000","last_became_active":"2023-10-06T03:04:29.247638+0000","last_became_peered":"2023-10-06T03:04:29.247638+0000","last_unstale":"2023-10-06T03:04:33.252975+0000","last_undegraded":"2023-10-06T03:04:33.252975+0000","last_fullsized":"2023-10-06T03:04:33.252975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:06.710555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255737+0000","last_change":"2023-10-06T03:04:29.244948+0000","last_active":"2023-10-06T03:04:33.255737+0000","last_peered":"2023-10-06T03:04:33.255737+0000","last_clean":"2023-10-06T03:04:33.255737+0000","last_became_active":"2023-10-06T03:04:29.244458+0000","last_became_peered":"2023-10-06T03:04:29.244458+0000","last_unstale":"2023-10-06T03:04:33.255737+0000","last_undegraded":"2023-10-06T03:04:33.255737+0000","last_fullsized":"2023-10-06T03:04:33.255737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:07.410542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253458+0000","last_change":"2023-10-06T03:04:29.246013+0000","last_active":"2023-10-06T03:04:33.253458+0000","last_peered":"2023-10-06T03:04:33.253458+0000","last_clean":"2023-10-06T03:04:33.253458+0000","last_became_active":"2023-10-06T03:04:29.245107+0000","last_became_peered":"2023-10-06T03:04:29.245107+0000","last_unstale":"2023-10-06T03:04:33.253458+0000","last_undegraded":"2023-10-06T03:04:33.253458+0000","last_fullsized":"2023-10-06T03:04:33.253458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257429+0000","last_change":"2023-10-06T03:04:29.249697+0000","last_active":"2023-10-06T03:04:33.257429+0000","last_peered":"2023-10-06T03:04:33.257429+0000","last_clean":"2023-10-06T03:04:33.257429+0000","last_became_active":"2023-10-06T03:04:29.249523+0000","last_became_peered":"2023-10-06T03:04:29.249523+0000","last_unstale":"2023-10-06T03:04:33.257429+0000","last_undegraded":"2023-10-06T03:04:33.257429+0000","last_fullsized":"2023-10-06T03:04:33.257429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:22.258796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256711+0000","last_change":"2023-10-06T03:04:29.249776+0000","last_active":"2023-10-06T03:04:33.256711+0000","last_peered":"2023-10-06T03:04:33.256711+0000","last_clean":"2023-10-06T03:04:33.256711+0000","last_became_active":"2023-10-06T03:04:29.249512+0000","last_became_peered":"2023-10-06T03:04:29.249512+0000","last_unstale":"2023-10-06T03:04:33.256711+0000","last_undegraded":"2023-10-06T03:04:33.256711+0000","last_fullsized":"2023-10-06T03:04:33.256711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:03.973528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.248523+0000","last_change":"2023-10-06T03:04:29.253464+0000","last_active":"2023-10-06T03:04:33.248523+0000","last_peered":"2023-10-06T03:04:33.248523+0000","last_clean":"2023-10-06T03:04:33.248523+0000","last_became_active":"2023-10-06T03:04:29.253186+0000","last_became_peered":"2023-10-06T03:04:29.253186+0000","last_unstale":"2023-10-06T03:04:33.248523+0000","last_undegraded":"2023-10-06T03:04:33.248523+0000","last_fullsized":"2023-10-06T03:04:33.248523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.277035+0000","last_change":"2023-10-06T03:04:33.272809+0000","last_active":"2023-10-06T03:04:33.277035+0000","last_peered":"2023-10-06T03:04:33.277035+0000","last_clean":"2023-10-06T03:04:33.277035+0000","last_became_active":"2023-10-06T03:04:33.272457+0000","last_became_peered":"2023-10-06T03:04:33.272457+0000","last_unstale":"2023-10-06T03:04:33.277035+0000","last_undegraded":"2023-10-06T03:04:33.277035+0000","last_fullsized":"2023-10-06T03:04:33.277035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:00.208098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251101+0000","last_change":"2023-10-06T03:04:28.838285+0000","last_active":"2023-10-06T03:04:33.251101+0000","last_peered":"2023-10-06T03:04:33.251101+0000","last_clean":"2023-10-06T03:04:33.251101+0000","last_became_active":"2023-10-06T03:04:28.837675+0000","last_became_peered":"2023-10-06T03:04:28.837675+0000","last_unstale":"2023-10-06T03:04:33.251101+0000","last_undegraded":"2023-10-06T03:04:33.251101+0000","last_fullsized":"2023-10-06T03:04:33.251101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:01.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256585+0000","last_change":"2023-10-06T03:04:29.251007+0000","last_active":"2023-10-06T03:04:33.256585+0000","last_peered":"2023-10-06T03:04:33.256585+0000","last_clean":"2023-10-06T03:04:33.256585+0000","last_became_active":"2023-10-06T03:04:29.250760+0000","last_became_peered":"2023-10-06T03:04:29.250760+0000","last_unstale":"2023-10-06T03:04:33.256585+0000","last_undegraded":"2023-10-06T03:04:33.256585+0000","last_fullsized":"2023-10-06T03:04:33.256585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:14.635872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274464+0000","last_change":"2023-10-06T03:04:33.270233+0000","last_active":"2023-10-06T03:04:33.274464+0000","last_peered":"2023-10-06T03:04:33.274464+0000","last_clean":"2023-10-06T03:04:33.274464+0000","last_became_active":"2023-10-06T03:04:33.269917+0000","last_became_peered":"2023-10-06T03:04:33.269917+0000","last_unstale":"2023-10-06T03:04:33.274464+0000","last_undegraded":"2023-10-06T03:04:33.274464+0000","last_fullsized":"2023-10-06T03:04:33.274464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:25.913975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254184+0000","last_change":"2023-10-06T03:04:28.831735+0000","last_active":"2023-10-06T03:04:33.254184+0000","last_peered":"2023-10-06T03:04:33.254184+0000","last_clean":"2023-10-06T03:04:33.254184+0000","last_became_active":"2023-10-06T03:04:28.831448+0000","last_became_peered":"2023-10-06T03:04:28.831448+0000","last_unstale":"2023-10-06T03:04:33.254184+0000","last_undegraded":"2023-10-06T03:04:33.254184+0000","last_fullsized":"2023-10-06T03:04:33.254184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:16.444923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260988+0000","last_change":"2023-10-06T03:04:29.244005+0000","last_active":"2023-10-06T03:04:33.260988+0000","last_peered":"2023-10-06T03:04:33.260988+0000","last_clean":"2023-10-06T03:04:33.260988+0000","last_became_active":"2023-10-06T03:04:29.243597+0000","last_became_peered":"2023-10-06T03:04:29.243597+0000","last_unstale":"2023-10-06T03:04:33.260988+0000","last_undegraded":"2023-10-06T03:04:33.260988+0000","last_fullsized":"2023-10-06T03:04:33.260988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279041+0000","last_change":"2023-10-06T03:04:33.275920+0000","last_active":"2023-10-06T03:04:33.279041+0000","last_peered":"2023-10-06T03:04:33.279041+0000","last_clean":"2023-10-06T03:04:33.279041+0000","last_became_active":"2023-10-06T03:04:33.275198+0000","last_became_peered":"2023-10-06T03:04:33.275198+0000","last_unstale":"2023-10-06T03:04:33.279041+0000","last_undegraded":"2023-10-06T03:04:33.279041+0000","last_fullsized":"2023-10-06T03:04:33.279041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:53.801187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255924+0000","last_change":"2023-10-06T03:04:28.839035+0000","last_active":"2023-10-06T03:04:33.255924+0000","last_peered":"2023-10-06T03:04:33.255924+0000","last_clean":"2023-10-06T03:04:33.255924+0000","last_became_active":"2023-10-06T03:04:28.838799+0000","last_became_peered":"2023-10-06T03:04:28.838799+0000","last_unstale":"2023-10-06T03:04:33.255924+0000","last_undegraded":"2023-10-06T03:04:33.255924+0000","last_fullsized":"2023-10-06T03:04:33.255924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:16.444923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252657+0000","last_change":"2023-10-06T03:04:29.250582+0000","last_active":"2023-10-06T03:04:33.252657+0000","last_peered":"2023-10-06T03:04:33.252657+0000","last_clean":"2023-10-06T03:04:33.252657+0000","last_became_active":"2023-10-06T03:04:29.250300+0000","last_became_peered":"2023-10-06T03:04:29.250300+0000","last_unstale":"2023-10-06T03:04:33.252657+0000","last_undegraded":"2023-10-06T03:04:33.252657+0000","last_fullsized":"2023-10-06T03:04:33.252657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:20.456488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.273611+0000","last_change":"2023-10-06T03:04:33.268665+0000","last_active":"2023-10-06T03:04:33.273611+0000","last_peered":"2023-10-06T03:04:33.273611+0000","last_clean":"2023-10-06T03:04:33.273611+0000","last_became_active":"2023-10-06T03:04:33.268265+0000","last_became_peered":"2023-10-06T03:04:33.268265+0000","last_unstale":"2023-10-06T03:04:33.273611+0000","last_undegraded":"2023-10-06T03:04:33.273611+0000","last_fullsized":"2023-10-06T03:04:33.273611+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:44.857274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260397+0000","last_change":"2023-10-06T03:04:28.840063+0000","last_active":"2023-10-06T03:04:33.260397+0000","last_peered":"2023-10-06T03:04:33.260397+0000","last_clean":"2023-10-06T03:04:33.260397+0000","last_became_active":"2023-10-06T03:04:28.839810+0000","last_became_peered":"2023-10-06T03:04:28.839810+0000","last_unstale":"2023-10-06T03:04:33.260397+0000","last_undegraded":"2023-10-06T03:04:33.260397+0000","last_fullsized":"2023-10-06T03:04:33.260397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:47.647784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255847+0000","last_change":"2023-10-06T03:04:29.246067+0000","last_active":"2023-10-06T03:04:33.255847+0000","last_peered":"2023-10-06T03:04:33.255847+0000","last_clean":"2023-10-06T03:04:33.255847+0000","last_became_active":"2023-10-06T03:04:29.245691+0000","last_became_peered":"2023-10-06T03:04:29.245691+0000","last_unstale":"2023-10-06T03:04:33.255847+0000","last_undegraded":"2023-10-06T03:04:33.255847+0000","last_fullsized":"2023-10-06T03:04:33.255847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274621+0000","last_change":"2023-10-06T03:04:33.271930+0000","last_active":"2023-10-06T03:04:33.274621+0000","last_peered":"2023-10-06T03:04:33.274621+0000","last_clean":"2023-10-06T03:04:33.274621+0000","last_became_active":"2023-10-06T03:04:33.271546+0000","last_became_peered":"2023-10-06T03:04:33.271546+0000","last_unstale":"2023-10-06T03:04:33.274621+0000","last_undegraded":"2023-10-06T03:04:33.274621+0000","last_fullsized":"2023-10-06T03:04:33.274621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:53.801187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.248282+0000","last_change":"2023-10-06T03:04:28.844581+0000","last_active":"2023-10-06T03:04:33.248282+0000","last_peered":"2023-10-06T03:04:33.248282+0000","last_clean":"2023-10-06T03:04:33.248282+0000","last_became_active":"2023-10-06T03:04:28.844305+0000","last_became_peered":"2023-10-06T03:04:28.844305+0000","last_unstale":"2023-10-06T03:04:33.248282+0000","last_undegraded":"2023-10-06T03:04:33.248282+0000","last_fullsized":"2023-10-06T03:04:33.248282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:02.968156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255764+0000","last_change":"2023-10-06T03:04:29.250970+0000","last_active":"2023-10-06T03:04:33.255764+0000","last_peered":"2023-10-06T03:04:33.255764+0000","last_clean":"2023-10-06T03:04:33.255764+0000","last_became_active":"2023-10-06T03:04:29.250699+0000","last_became_peered":"2023-10-06T03:04:29.250699+0000","last_unstale":"2023-10-06T03:04:33.255764+0000","last_undegraded":"2023-10-06T03:04:33.255764+0000","last_fullsized":"2023-10-06T03:04:33.255764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:00.194415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274257+0000","last_change":"2023-10-06T03:04:33.266174+0000","last_active":"2023-10-06T03:04:33.274257+0000","last_peered":"2023-10-06T03:04:33.274257+0000","last_clean":"2023-10-06T03:04:33.274257+0000","last_became_active":"2023-10-06T03:04:33.265684+0000","last_became_peered":"2023-10-06T03:04:33.265684+0000","last_unstale":"2023-10-06T03:04:33.274257+0000","last_undegraded":"2023-10-06T03:04:33.274257+0000","last_fullsized":"2023-10-06T03:04:33.274257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:25.279420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254696+0000","last_change":"2023-10-06T03:04:28.841750+0000","last_active":"2023-10-06T03:04:33.254696+0000","last_peered":"2023-10-06T03:04:33.254696+0000","last_clean":"2023-10-06T03:04:33.254696+0000","last_became_active":"2023-10-06T03:04:28.841494+0000","last_became_peered":"2023-10-06T03:04:28.841494+0000","last_unstale":"2023-10-06T03:04:33.254696+0000","last_undegraded":"2023-10-06T03:04:33.254696+0000","last_fullsized":"2023-10-06T03:04:33.254696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:37.754382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252743+0000","last_change":"2023-10-06T03:04:29.252516+0000","last_active":"2023-10-06T03:04:33.252743+0000","last_peered":"2023-10-06T03:04:33.252743+0000","last_clean":"2023-10-06T03:04:33.252743+0000","last_became_active":"2023-10-06T03:04:29.252229+0000","last_became_peered":"2023-10-06T03:04:29.252229+0000","last_unstale":"2023-10-06T03:04:33.252743+0000","last_undegraded":"2023-10-06T03:04:33.252743+0000","last_fullsized":"2023-10-06T03:04:33.252743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:41.163677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.273192+0000","last_change":"2023-10-06T03:04:33.270221+0000","last_active":"2023-10-06T03:04:33.273192+0000","last_peered":"2023-10-06T03:04:33.273192+0000","last_clean":"2023-10-06T03:04:33.273192+0000","last_became_active":"2023-10-06T03:04:33.269852+0000","last_became_peered":"2023-10-06T03:04:33.269852+0000","last_unstale":"2023-10-06T03:04:33.273192+0000","last_undegraded":"2023-10-06T03:04:33.273192+0000","last_fullsized":"2023-10-06T03:04:33.273192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:29.020898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'9","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:04:39.092973+0000","last_change":"2023-10-06T03:04:28.838015+0000","last_active":"2023-10-06T03:04:39.092973+0000","last_peered":"2023-10-06T03:04:39.092973+0000","last_clean":"2023-10-06T03:04:39.092973+0000","last_became_active":"2023-10-06T03:04:28.837321+0000","last_became_peered":"2023-10-06T03:04:28.837321+0000","last_unstale":"2023-10-06T03:04:39.092973+0000","last_undegraded":"2023-10-06T03:04:39.092973+0000","last_fullsized":"2023-10-06T03:04:39.092973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:16.444923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3715,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251923+0000","last_change":"2023-10-06T03:04:29.245423+0000","last_active":"2023-10-06T03:04:33.251923+0000","last_peered":"2023-10-06T03:04:33.251923+0000","last_clean":"2023-10-06T03:04:33.251923+0000","last_became_active":"2023-10-06T03:04:29.245125+0000","last_became_peered":"2023-10-06T03:04:29.245125+0000","last_unstale":"2023-10-06T03:04:33.251923+0000","last_undegraded":"2023-10-06T03:04:33.251923+0000","last_fullsized":"2023-10-06T03:04:33.251923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:16.298020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.272326+0000","last_change":"2023-10-06T03:04:33.269331+0000","last_active":"2023-10-06T03:04:33.272326+0000","last_peered":"2023-10-06T03:04:33.272326+0000","last_clean":"2023-10-06T03:04:33.272326+0000","last_became_active":"2023-10-06T03:04:33.268947+0000","last_became_peered":"2023-10-06T03:04:33.268947+0000","last_unstale":"2023-10-06T03:04:33.272326+0000","last_undegraded":"2023-10-06T03:04:33.272326+0000","last_fullsized":"2023-10-06T03:04:33.272326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:18.722157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254189+0000","last_change":"2023-10-06T03:04:28.844574+0000","last_active":"2023-10-06T03:04:33.254189+0000","last_peered":"2023-10-06T03:04:33.254189+0000","last_clean":"2023-10-06T03:04:33.254189+0000","last_became_active":"2023-10-06T03:04:28.844264+0000","last_became_peered":"2023-10-06T03:04:28.844264+0000","last_unstale":"2023-10-06T03:04:33.254189+0000","last_undegraded":"2023-10-06T03:04:33.254189+0000","last_fullsized":"2023-10-06T03:04:33.254189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:05.970777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256525+0000","last_change":"2023-10-06T03:04:29.247698+0000","last_active":"2023-10-06T03:04:33.256525+0000","last_peered":"2023-10-06T03:04:33.256525+0000","last_clean":"2023-10-06T03:04:33.256525+0000","last_became_active":"2023-10-06T03:04:29.247464+0000","last_became_peered":"2023-10-06T03:04:29.247464+0000","last_unstale":"2023-10-06T03:04:33.256525+0000","last_undegraded":"2023-10-06T03:04:33.256525+0000","last_fullsized":"2023-10-06T03:04:33.256525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:13.355371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.273888+0000","last_change":"2023-10-06T03:04:33.266947+0000","last_active":"2023-10-06T03:04:33.273888+0000","last_peered":"2023-10-06T03:04:33.273888+0000","last_clean":"2023-10-06T03:04:33.273888+0000","last_became_active":"2023-10-06T03:04:33.266543+0000","last_became_peered":"2023-10-06T03:04:33.266543+0000","last_unstale":"2023-10-06T03:04:33.273888+0000","last_undegraded":"2023-10-06T03:04:33.273888+0000","last_fullsized":"2023-10-06T03:04:33.273888+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:29.020898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252534+0000","last_change":"2023-10-06T03:04:28.838464+0000","last_active":"2023-10-06T03:04:33.252534+0000","last_peered":"2023-10-06T03:04:33.252534+0000","last_clean":"2023-10-06T03:04:33.252534+0000","last_became_active":"2023-10-06T03:04:28.838008+0000","last_became_peered":"2023-10-06T03:04:28.838008+0000","last_unstale":"2023-10-06T03:04:33.252534+0000","last_undegraded":"2023-10-06T03:04:33.252534+0000","last_fullsized":"2023-10-06T03:04:33.252534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:53.804099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247750+0000","last_change":"2023-10-06T03:04:29.252750+0000","last_active":"2023-10-06T03:04:33.247750+0000","last_peered":"2023-10-06T03:04:33.247750+0000","last_clean":"2023-10-06T03:04:33.247750+0000","last_became_active":"2023-10-06T03:04:29.252421+0000","last_became_peered":"2023-10-06T03:04:29.252421+0000","last_unstale":"2023-10-06T03:04:33.247750+0000","last_undegraded":"2023-10-06T03:04:33.247750+0000","last_fullsized":"2023-10-06T03:04:33.247750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274637+0000","last_change":"2023-10-06T03:04:33.267286+0000","last_active":"2023-10-06T03:04:33.274637+0000","last_peered":"2023-10-06T03:04:33.274637+0000","last_clean":"2023-10-06T03:04:33.274637+0000","last_became_active":"2023-10-06T03:04:33.266886+0000","last_became_peered":"2023-10-06T03:04:33.266886+0000","last_unstale":"2023-10-06T03:04:33.274637+0000","last_undegraded":"2023-10-06T03:04:33.274637+0000","last_fullsized":"2023-10-06T03:04:33.274637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:49.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254264+0000","last_change":"2023-10-06T03:04:28.841825+0000","last_active":"2023-10-06T03:04:33.254264+0000","last_peered":"2023-10-06T03:04:33.254264+0000","last_clean":"2023-10-06T03:04:33.254264+0000","last_became_active":"2023-10-06T03:04:28.841550+0000","last_became_peered":"2023-10-06T03:04:28.841550+0000","last_unstale":"2023-10-06T03:04:33.254264+0000","last_undegraded":"2023-10-06T03:04:33.254264+0000","last_fullsized":"2023-10-06T03:04:33.254264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:22.072997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260999+0000","last_change":"2023-10-06T03:04:29.243824+0000","last_active":"2023-10-06T03:04:33.260999+0000","last_peered":"2023-10-06T03:04:33.260999+0000","last_clean":"2023-10-06T03:04:33.260999+0000","last_became_active":"2023-10-06T03:04:29.243249+0000","last_became_peered":"2023-10-06T03:04:29.243249+0000","last_unstale":"2023-10-06T03:04:33.260999+0000","last_undegraded":"2023-10-06T03:04:33.260999+0000","last_fullsized":"2023-10-06T03:04:33.260999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:16.298020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.272146+0000","last_change":"2023-10-06T03:04:33.268277+0000","last_active":"2023-10-06T03:04:33.272146+0000","last_peered":"2023-10-06T03:04:33.272146+0000","last_clean":"2023-10-06T03:04:33.272146+0000","last_became_active":"2023-10-06T03:04:33.267827+0000","last_became_peered":"2023-10-06T03:04:33.267827+0000","last_unstale":"2023-10-06T03:04:33.272146+0000","last_undegraded":"2023-10-06T03:04:33.272146+0000","last_fullsized":"2023-10-06T03:04:33.272146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:03.744883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251717+0000","last_change":"2023-10-06T03:04:28.843010+0000","last_active":"2023-10-06T03:04:33.251717+0000","last_peered":"2023-10-06T03:04:33.251717+0000","last_clean":"2023-10-06T03:04:33.251717+0000","last_became_active":"2023-10-06T03:04:28.842743+0000","last_became_peered":"2023-10-06T03:04:28.842743+0000","last_unstale":"2023-10-06T03:04:33.251717+0000","last_undegraded":"2023-10-06T03:04:33.251717+0000","last_fullsized":"2023-10-06T03:04:33.251717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:01.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257848+0000","last_change":"2023-10-06T03:04:29.246248+0000","last_active":"2023-10-06T03:04:33.257848+0000","last_peered":"2023-10-06T03:04:33.257848+0000","last_clean":"2023-10-06T03:04:33.257848+0000","last_became_active":"2023-10-06T03:04:29.245660+0000","last_became_peered":"2023-10-06T03:04:29.245660+0000","last_unstale":"2023-10-06T03:04:33.257848+0000","last_undegraded":"2023-10-06T03:04:33.257848+0000","last_fullsized":"2023-10-06T03:04:33.257848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274535+0000","last_change":"2023-10-06T03:04:33.270753+0000","last_active":"2023-10-06T03:04:33.274535+0000","last_peered":"2023-10-06T03:04:33.274535+0000","last_clean":"2023-10-06T03:04:33.274535+0000","last_became_active":"2023-10-06T03:04:33.270285+0000","last_became_peered":"2023-10-06T03:04:33.270285+0000","last_unstale":"2023-10-06T03:04:33.274535+0000","last_undegraded":"2023-10-06T03:04:33.274535+0000","last_fullsized":"2023-10-06T03:04:33.274535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:38.040904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256306+0000","last_change":"2023-10-06T03:04:28.841768+0000","last_active":"2023-10-06T03:04:33.256306+0000","last_peered":"2023-10-06T03:04:33.256306+0000","last_clean":"2023-10-06T03:04:33.256306+0000","last_became_active":"2023-10-06T03:04:28.841466+0000","last_became_peered":"2023-10-06T03:04:28.841466+0000","last_unstale":"2023-10-06T03:04:33.256306+0000","last_undegraded":"2023-10-06T03:04:33.256306+0000","last_fullsized":"2023-10-06T03:04:33.256306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:18.790700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247445+0000","last_change":"2023-10-06T03:04:29.254847+0000","last_active":"2023-10-06T03:04:33.247445+0000","last_peered":"2023-10-06T03:04:33.247445+0000","last_clean":"2023-10-06T03:04:33.247445+0000","last_became_active":"2023-10-06T03:04:29.254566+0000","last_became_peered":"2023-10-06T03:04:29.254566+0000","last_unstale":"2023-10-06T03:04:33.247445+0000","last_undegraded":"2023-10-06T03:04:33.247445+0000","last_fullsized":"2023-10-06T03:04:33.247445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279105+0000","last_change":"2023-10-06T03:04:33.273474+0000","last_active":"2023-10-06T03:04:33.279105+0000","last_peered":"2023-10-06T03:04:33.279105+0000","last_clean":"2023-10-06T03:04:33.279105+0000","last_became_active":"2023-10-06T03:04:33.272844+0000","last_became_peered":"2023-10-06T03:04:33.272844+0000","last_unstale":"2023-10-06T03:04:33.279105+0000","last_undegraded":"2023-10-06T03:04:33.279105+0000","last_fullsized":"2023-10-06T03:04:33.279105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:22:18.478319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253676+0000","last_change":"2023-10-06T03:04:28.844454+0000","last_active":"2023-10-06T03:04:33.253676+0000","last_peered":"2023-10-06T03:04:33.253676+0000","last_clean":"2023-10-06T03:04:33.253676+0000","last_became_active":"2023-10-06T03:04:28.844159+0000","last_became_peered":"2023-10-06T03:04:28.844159+0000","last_unstale":"2023-10-06T03:04:33.253676+0000","last_undegraded":"2023-10-06T03:04:33.253676+0000","last_fullsized":"2023-10-06T03:04:33.253676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:02.968156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260414+0000","last_change":"2023-10-06T03:04:29.247815+0000","last_active":"2023-10-06T03:04:33.260414+0000","last_peered":"2023-10-06T03:04:33.260414+0000","last_clean":"2023-10-06T03:04:33.260414+0000","last_became_active":"2023-10-06T03:04:29.247468+0000","last_became_peered":"2023-10-06T03:04:29.247468+0000","last_unstale":"2023-10-06T03:04:33.260414+0000","last_undegraded":"2023-10-06T03:04:33.260414+0000","last_fullsized":"2023-10-06T03:04:33.260414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:00.742905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.281495+0000","last_change":"2023-10-06T03:04:33.274004+0000","last_active":"2023-10-06T03:04:33.281495+0000","last_peered":"2023-10-06T03:04:33.281495+0000","last_clean":"2023-10-06T03:04:33.281495+0000","last_became_active":"2023-10-06T03:04:33.273505+0000","last_became_peered":"2023-10-06T03:04:33.273505+0000","last_unstale":"2023-10-06T03:04:33.281495+0000","last_undegraded":"2023-10-06T03:04:33.281495+0000","last_fullsized":"2023-10-06T03:04:33.281495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:59.453052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254602+0000","last_change":"2023-10-06T03:04:28.844541+0000","last_active":"2023-10-06T03:04:33.254602+0000","last_peered":"2023-10-06T03:04:33.254602+0000","last_clean":"2023-10-06T03:04:33.254602+0000","last_became_active":"2023-10-06T03:04:28.844287+0000","last_became_peered":"2023-10-06T03:04:28.844287+0000","last_unstale":"2023-10-06T03:04:33.254602+0000","last_undegraded":"2023-10-06T03:04:33.254602+0000","last_fullsized":"2023-10-06T03:04:33.254602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:56.517421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251704+0000","last_change":"2023-10-06T03:04:29.247387+0000","last_active":"2023-10-06T03:04:33.251704+0000","last_peered":"2023-10-06T03:04:33.251704+0000","last_clean":"2023-10-06T03:04:33.251704+0000","last_became_active":"2023-10-06T03:04:29.247094+0000","last_became_peered":"2023-10-06T03:04:29.247094+0000","last_unstale":"2023-10-06T03:04:33.251704+0000","last_undegraded":"2023-10-06T03:04:33.251704+0000","last_fullsized":"2023-10-06T03:04:33.251704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:23.078369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275074+0000","last_change":"2023-10-06T03:04:33.268719+0000","last_active":"2023-10-06T03:04:33.275074+0000","last_peered":"2023-10-06T03:04:33.275074+0000","last_clean":"2023-10-06T03:04:33.275074+0000","last_became_active":"2023-10-06T03:04:33.268369+0000","last_became_peered":"2023-10-06T03:04:33.268369+0000","last_unstale":"2023-10-06T03:04:33.275074+0000","last_undegraded":"2023-10-06T03:04:33.275074+0000","last_fullsized":"2023-10-06T03:04:33.275074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:39.388410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247659+0000","last_change":"2023-10-06T03:04:28.836622+0000","last_active":"2023-10-06T03:04:33.247659+0000","last_peered":"2023-10-06T03:04:33.247659+0000","last_clean":"2023-10-06T03:04:33.247659+0000","last_became_active":"2023-10-06T03:04:28.836361+0000","last_became_peered":"2023-10-06T03:04:28.836361+0000","last_unstale":"2023-10-06T03:04:33.247659+0000","last_undegraded":"2023-10-06T03:04:33.247659+0000","last_fullsized":"2023-10-06T03:04:33.247659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:53.804099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260554+0000","last_change":"2023-10-06T03:04:29.246365+0000","last_active":"2023-10-06T03:04:33.260554+0000","last_peered":"2023-10-06T03:04:33.260554+0000","last_clean":"2023-10-06T03:04:33.260554+0000","last_became_active":"2023-10-06T03:04:29.246129+0000","last_became_peered":"2023-10-06T03:04:29.246129+0000","last_unstale":"2023-10-06T03:04:33.260554+0000","last_undegraded":"2023-10-06T03:04:33.260554+0000","last_fullsized":"2023-10-06T03:04:33.260554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.273557+0000","last_change":"2023-10-06T03:04:33.263768+0000","last_active":"2023-10-06T03:04:33.273557+0000","last_peered":"2023-10-06T03:04:33.273557+0000","last_clean":"2023-10-06T03:04:33.273557+0000","last_became_active":"2023-10-06T03:04:33.263379+0000","last_became_peered":"2023-10-06T03:04:33.263379+0000","last_unstale":"2023-10-06T03:04:33.273557+0000","last_undegraded":"2023-10-06T03:04:33.273557+0000","last_fullsized":"2023-10-06T03:04:33.273557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:03.615099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256254+0000","last_change":"2023-10-06T03:04:28.842173+0000","last_active":"2023-10-06T03:04:33.256254+0000","last_peered":"2023-10-06T03:04:33.256254+0000","last_clean":"2023-10-06T03:04:33.256254+0000","last_became_active":"2023-10-06T03:04:28.841904+0000","last_became_peered":"2023-10-06T03:04:28.841904+0000","last_unstale":"2023-10-06T03:04:33.256254+0000","last_undegraded":"2023-10-06T03:04:33.256254+0000","last_fullsized":"2023-10-06T03:04:33.256254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:47.647784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252916+0000","last_change":"2023-10-06T03:04:29.248275+0000","last_active":"2023-10-06T03:04:33.252916+0000","last_peered":"2023-10-06T03:04:33.252916+0000","last_clean":"2023-10-06T03:04:33.252916+0000","last_became_active":"2023-10-06T03:04:29.247441+0000","last_became_peered":"2023-10-06T03:04:29.247441+0000","last_unstale":"2023-10-06T03:04:33.252916+0000","last_undegraded":"2023-10-06T03:04:33.252916+0000","last_fullsized":"2023-10-06T03:04:33.252916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:41.084853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279289+0000","last_change":"2023-10-06T03:04:33.277569+0000","last_active":"2023-10-06T03:04:33.279289+0000","last_peered":"2023-10-06T03:04:33.279289+0000","last_clean":"2023-10-06T03:04:33.279289+0000","last_became_active":"2023-10-06T03:04:33.277036+0000","last_became_peered":"2023-10-06T03:04:33.277036+0000","last_unstale":"2023-10-06T03:04:33.279289+0000","last_undegraded":"2023-10-06T03:04:33.279289+0000","last_fullsized":"2023-10-06T03:04:33.279289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:16.342856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252435+0000","last_change":"2023-10-06T03:04:28.839083+0000","last_active":"2023-10-06T03:04:33.252435+0000","last_peered":"2023-10-06T03:04:33.252435+0000","last_clean":"2023-10-06T03:04:33.252435+0000","last_became_active":"2023-10-06T03:04:28.838794+0000","last_became_peered":"2023-10-06T03:04:28.838794+0000","last_unstale":"2023-10-06T03:04:33.252435+0000","last_undegraded":"2023-10-06T03:04:33.252435+0000","last_fullsized":"2023-10-06T03:04:33.252435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:08.701124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251200+0000","last_change":"2023-10-06T03:04:29.245977+0000","last_active":"2023-10-06T03:04:33.251200+0000","last_peered":"2023-10-06T03:04:33.251200+0000","last_clean":"2023-10-06T03:04:33.251200+0000","last_became_active":"2023-10-06T03:04:29.245626+0000","last_became_peered":"2023-10-06T03:04:29.245626+0000","last_unstale":"2023-10-06T03:04:33.251200+0000","last_undegraded":"2023-10-06T03:04:33.251200+0000","last_fullsized":"2023-10-06T03:04:33.251200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275700+0000","last_change":"2023-10-06T03:04:33.273132+0000","last_active":"2023-10-06T03:04:33.275700+0000","last_peered":"2023-10-06T03:04:33.275700+0000","last_clean":"2023-10-06T03:04:33.275700+0000","last_became_active":"2023-10-06T03:04:33.270004+0000","last_became_peered":"2023-10-06T03:04:33.270004+0000","last_unstale":"2023-10-06T03:04:33.275700+0000","last_undegraded":"2023-10-06T03:04:33.275700+0000","last_fullsized":"2023-10-06T03:04:33.275700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:29.588904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.262618+0000","last_change":"2023-10-06T03:04:28.834924+0000","last_active":"2023-10-06T03:04:33.262618+0000","last_peered":"2023-10-06T03:04:33.262618+0000","last_clean":"2023-10-06T03:04:33.262618+0000","last_became_active":"2023-10-06T03:04:28.833593+0000","last_became_peered":"2023-10-06T03:04:28.833593+0000","last_unstale":"2023-10-06T03:04:33.262618+0000","last_undegraded":"2023-10-06T03:04:33.262618+0000","last_fullsized":"2023-10-06T03:04:33.262618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:01.349764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.258286+0000","last_change":"2023-10-06T03:04:29.242813+0000","last_active":"2023-10-06T03:04:33.258286+0000","last_peered":"2023-10-06T03:04:33.258286+0000","last_clean":"2023-10-06T03:04:33.258286+0000","last_became_active":"2023-10-06T03:04:29.242505+0000","last_became_peered":"2023-10-06T03:04:29.242505+0000","last_unstale":"2023-10-06T03:04:33.258286+0000","last_undegraded":"2023-10-06T03:04:33.258286+0000","last_fullsized":"2023-10-06T03:04:33.258286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:00.194415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279673+0000","last_change":"2023-10-06T03:04:33.276215+0000","last_active":"2023-10-06T03:04:33.279673+0000","last_peered":"2023-10-06T03:04:33.279673+0000","last_clean":"2023-10-06T03:04:33.279673+0000","last_became_active":"2023-10-06T03:04:33.275880+0000","last_became_peered":"2023-10-06T03:04:33.275880+0000","last_unstale":"2023-10-06T03:04:33.279673+0000","last_undegraded":"2023-10-06T03:04:33.279673+0000","last_fullsized":"2023-10-06T03:04:33.279673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:47.940801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255769+0000","last_change":"2023-10-06T03:04:28.833476+0000","last_active":"2023-10-06T03:04:33.255769+0000","last_peered":"2023-10-06T03:04:33.255769+0000","last_clean":"2023-10-06T03:04:33.255769+0000","last_became_active":"2023-10-06T03:04:28.833134+0000","last_became_peered":"2023-10-06T03:04:28.833134+0000","last_unstale":"2023-10-06T03:04:33.255769+0000","last_undegraded":"2023-10-06T03:04:33.255769+0000","last_fullsized":"2023-10-06T03:04:33.255769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:01.349764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257596+0000","last_change":"2023-10-06T03:04:29.254675+0000","last_active":"2023-10-06T03:04:33.257596+0000","last_peered":"2023-10-06T03:04:33.257596+0000","last_clean":"2023-10-06T03:04:33.257596+0000","last_became_active":"2023-10-06T03:04:29.254440+0000","last_became_peered":"2023-10-06T03:04:29.254440+0000","last_unstale":"2023-10-06T03:04:33.257596+0000","last_undegraded":"2023-10-06T03:04:33.257596+0000","last_fullsized":"2023-10-06T03:04:33.257596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:06.710555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275628+0000","last_change":"2023-10-06T03:04:33.271611+0000","last_active":"2023-10-06T03:04:33.275628+0000","last_peered":"2023-10-06T03:04:33.275628+0000","last_clean":"2023-10-06T03:04:33.275628+0000","last_became_active":"2023-10-06T03:04:33.270809+0000","last_became_peered":"2023-10-06T03:04:33.270809+0000","last_unstale":"2023-10-06T03:04:33.275628+0000","last_undegraded":"2023-10-06T03:04:33.275628+0000","last_fullsized":"2023-10-06T03:04:33.275628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:38.040904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256889+0000","last_change":"2023-10-06T03:04:23.986472+0000","last_active":"2023-10-06T03:04:33.256889+0000","last_peered":"2023-10-06T03:04:33.256889+0000","last_clean":"2023-10-06T03:04:33.256889+0000","last_became_active":"2023-10-06T03:04:23.986228+0000","last_became_peered":"2023-10-06T03:04:23.986228+0000","last_unstale":"2023-10-06T03:04:33.256889+0000","last_undegraded":"2023-10-06T03:04:33.256889+0000","last_fullsized":"2023-10-06T03:04:33.256889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:08.739849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247658+0000","last_change":"2023-10-06T03:04:28.837603+0000","last_active":"2023-10-06T03:04:33.247658+0000","last_peered":"2023-10-06T03:04:33.247658+0000","last_clean":"2023-10-06T03:04:33.247658+0000","last_became_active":"2023-10-06T03:04:28.837333+0000","last_became_peered":"2023-10-06T03:04:28.837333+0000","last_unstale":"2023-10-06T03:04:33.247658+0000","last_undegraded":"2023-10-06T03:04:33.247658+0000","last_fullsized":"2023-10-06T03:04:33.247658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:38:43.549607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252660+0000","last_change":"2023-10-06T03:04:29.251886+0000","last_active":"2023-10-06T03:04:33.252660+0000","last_peered":"2023-10-06T03:04:33.252660+0000","last_clean":"2023-10-06T03:04:33.252660+0000","last_became_active":"2023-10-06T03:04:29.250608+0000","last_became_peered":"2023-10-06T03:04:29.250608+0000","last_unstale":"2023-10-06T03:04:33.252660+0000","last_undegraded":"2023-10-06T03:04:33.252660+0000","last_fullsized":"2023-10-06T03:04:33.252660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275480+0000","last_change":"2023-10-06T03:04:33.270876+0000","last_active":"2023-10-06T03:04:33.275480+0000","last_peered":"2023-10-06T03:04:33.275480+0000","last_clean":"2023-10-06T03:04:33.275480+0000","last_became_active":"2023-10-06T03:04:33.270440+0000","last_became_peered":"2023-10-06T03:04:33.270440+0000","last_unstale":"2023-10-06T03:04:33.275480+0000","last_undegraded":"2023-10-06T03:04:33.275480+0000","last_fullsized":"2023-10-06T03:04:33.275480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:09:43.778573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247810+0000","last_change":"2023-10-06T03:04:23.814917+0000","last_active":"2023-10-06T03:04:33.247810+0000","last_peered":"2023-10-06T03:04:33.247810+0000","last_clean":"2023-10-06T03:04:33.247810+0000","last_became_active":"2023-10-06T03:04:23.814601+0000","last_became_peered":"2023-10-06T03:04:23.814601+0000","last_unstale":"2023-10-06T03:04:33.247810+0000","last_undegraded":"2023-10-06T03:04:33.247810+0000","last_fullsized":"2023-10-06T03:04:33.247810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251996+0000","last_change":"2023-10-06T03:04:28.844008+0000","last_active":"2023-10-06T03:04:33.251996+0000","last_peered":"2023-10-06T03:04:33.251996+0000","last_clean":"2023-10-06T03:04:33.251996+0000","last_became_active":"2023-10-06T03:04:28.843570+0000","last_became_peered":"2023-10-06T03:04:28.843570+0000","last_unstale":"2023-10-06T03:04:33.251996+0000","last_undegraded":"2023-10-06T03:04:33.251996+0000","last_fullsized":"2023-10-06T03:04:33.251996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:47.468717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256810+0000","last_change":"2023-10-06T03:04:29.251986+0000","last_active":"2023-10-06T03:04:33.256810+0000","last_peered":"2023-10-06T03:04:33.256810+0000","last_clean":"2023-10-06T03:04:33.256810+0000","last_became_active":"2023-10-06T03:04:29.250140+0000","last_became_peered":"2023-10-06T03:04:29.250140+0000","last_unstale":"2023-10-06T03:04:33.256810+0000","last_undegraded":"2023-10-06T03:04:33.256810+0000","last_fullsized":"2023-10-06T03:04:33.256810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:14.635872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275237+0000","last_change":"2023-10-06T03:04:33.271548+0000","last_active":"2023-10-06T03:04:33.275237+0000","last_peered":"2023-10-06T03:04:33.275237+0000","last_clean":"2023-10-06T03:04:33.275237+0000","last_became_active":"2023-10-06T03:04:33.270795+0000","last_became_peered":"2023-10-06T03:04:33.270795+0000","last_unstale":"2023-10-06T03:04:33.275237+0000","last_undegraded":"2023-10-06T03:04:33.275237+0000","last_fullsized":"2023-10-06T03:04:33.275237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:04.163589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254358+0000","last_change":"2023-10-06T03:04:24.314547+0000","last_active":"2023-10-06T03:04:33.254358+0000","last_peered":"2023-10-06T03:04:33.254358+0000","last_clean":"2023-10-06T03:04:33.254358+0000","last_became_active":"2023-10-06T03:04:24.314278+0000","last_became_peered":"2023-10-06T03:04:24.314278+0000","last_unstale":"2023-10-06T03:04:33.254358+0000","last_undegraded":"2023-10-06T03:04:33.254358+0000","last_fullsized":"2023-10-06T03:04:33.254358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:25.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.258223+0000","last_change":"2023-10-06T03:04:28.830604+0000","last_active":"2023-10-06T03:04:33.258223+0000","last_peered":"2023-10-06T03:04:33.258223+0000","last_clean":"2023-10-06T03:04:33.258223+0000","last_became_active":"2023-10-06T03:04:28.828889+0000","last_became_peered":"2023-10-06T03:04:28.828889+0000","last_unstale":"2023-10-06T03:04:33.258223+0000","last_undegraded":"2023-10-06T03:04:33.258223+0000","last_fullsized":"2023-10-06T03:04:33.258223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:53.804099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257514+0000","last_change":"2023-10-06T03:04:29.250731+0000","last_active":"2023-10-06T03:04:33.257514+0000","last_peered":"2023-10-06T03:04:33.257514+0000","last_clean":"2023-10-06T03:04:33.257514+0000","last_became_active":"2023-10-06T03:04:29.250491+0000","last_became_peered":"2023-10-06T03:04:29.250491+0000","last_unstale":"2023-10-06T03:04:33.257514+0000","last_undegraded":"2023-10-06T03:04:33.257514+0000","last_fullsized":"2023-10-06T03:04:33.257514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:13.355371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.271453+0000","last_change":"2023-10-06T03:04:33.266989+0000","last_active":"2023-10-06T03:04:33.271453+0000","last_peered":"2023-10-06T03:04:33.271453+0000","last_clean":"2023-10-06T03:04:33.271453+0000","last_became_active":"2023-10-06T03:04:33.266416+0000","last_became_peered":"2023-10-06T03:04:33.266416+0000","last_unstale":"2023-10-06T03:04:33.271453+0000","last_undegraded":"2023-10-06T03:04:33.271453+0000","last_fullsized":"2023-10-06T03:04:33.271453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:45.049591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247892+0000","last_change":"2023-10-06T03:04:23.807972+0000","last_active":"2023-10-06T03:04:33.247892+0000","last_peered":"2023-10-06T03:04:33.247892+0000","last_clean":"2023-10-06T03:04:33.247892+0000","last_became_active":"2023-10-06T03:04:23.807723+0000","last_became_peered":"2023-10-06T03:04:23.807723+0000","last_unstale":"2023-10-06T03:04:33.247892+0000","last_undegraded":"2023-10-06T03:04:33.247892+0000","last_fullsized":"2023-10-06T03:04:33.247892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253358+0000","last_change":"2023-10-06T03:04:17.779925+0000","last_active":"2023-10-06T03:04:33.253358+0000","last_peered":"2023-10-06T03:04:33.253358+0000","last_clean":"2023-10-06T03:04:33.253358+0000","last_became_active":"2023-10-06T03:04:17.778997+0000","last_became_peered":"2023-10-06T03:04:17.778997+0000","last_unstale":"2023-10-06T03:04:33.253358+0000","last_undegraded":"2023-10-06T03:04:33.253358+0000","last_fullsized":"2023-10-06T03:04:33.253358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_clean_scrub_stamp":"2023-10-06T03:04:16.761610+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255740+0000","last_change":"2023-10-06T03:04:28.836276+0000","last_active":"2023-10-06T03:04:33.255740+0000","last_peered":"2023-10-06T03:04:33.255740+0000","last_clean":"2023-10-06T03:04:33.255740+0000","last_became_active":"2023-10-06T03:04:28.836005+0000","last_became_peered":"2023-10-06T03:04:28.836005+0000","last_unstale":"2023-10-06T03:04:33.255740+0000","last_undegraded":"2023-10-06T03:04:33.255740+0000","last_fullsized":"2023-10-06T03:04:33.255740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:47.468717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251891+0000","last_change":"2023-10-06T03:04:29.246019+0000","last_active":"2023-10-06T03:04:33.251891+0000","last_peered":"2023-10-06T03:04:33.251891+0000","last_clean":"2023-10-06T03:04:33.251891+0000","last_became_active":"2023-10-06T03:04:29.245727+0000","last_became_peered":"2023-10-06T03:04:29.245727+0000","last_unstale":"2023-10-06T03:04:33.251891+0000","last_undegraded":"2023-10-06T03:04:33.251891+0000","last_fullsized":"2023-10-06T03:04:33.251891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:06.976149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275851+0000","last_change":"2023-10-06T03:04:33.273528+0000","last_active":"2023-10-06T03:04:33.275851+0000","last_peered":"2023-10-06T03:04:33.275851+0000","last_clean":"2023-10-06T03:04:33.275851+0000","last_became_active":"2023-10-06T03:04:33.272634+0000","last_became_peered":"2023-10-06T03:04:33.272634+0000","last_unstale":"2023-10-06T03:04:33.275851+0000","last_undegraded":"2023-10-06T03:04:33.275851+0000","last_fullsized":"2023-10-06T03:04:33.275851+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:49.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253551+0000","last_change":"2023-10-06T03:04:23.814887+0000","last_active":"2023-10-06T03:04:33.253551+0000","last_peered":"2023-10-06T03:04:33.253551+0000","last_clean":"2023-10-06T03:04:33.253551+0000","last_became_active":"2023-10-06T03:04:23.814581+0000","last_became_peered":"2023-10-06T03:04:23.814581+0000","last_unstale":"2023-10-06T03:04:33.253551+0000","last_undegraded":"2023-10-06T03:04:33.253551+0000","last_fullsized":"2023-10-06T03:04:33.253551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252277+0000","last_change":"2023-10-06T03:04:28.840850+0000","last_active":"2023-10-06T03:04:33.252277+0000","last_peered":"2023-10-06T03:04:33.252277+0000","last_clean":"2023-10-06T03:04:33.252277+0000","last_became_active":"2023-10-06T03:04:28.840598+0000","last_became_peered":"2023-10-06T03:04:28.840598+0000","last_unstale":"2023-10-06T03:04:33.252277+0000","last_undegraded":"2023-10-06T03:04:33.252277+0000","last_fullsized":"2023-10-06T03:04:33.252277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:01.349764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260789+0000","last_change":"2023-10-06T03:04:29.245535+0000","last_active":"2023-10-06T03:04:33.260789+0000","last_peered":"2023-10-06T03:04:33.260789+0000","last_clean":"2023-10-06T03:04:33.260789+0000","last_became_active":"2023-10-06T03:04:29.245290+0000","last_became_peered":"2023-10-06T03:04:29.245290+0000","last_unstale":"2023-10-06T03:04:33.260789+0000","last_undegraded":"2023-10-06T03:04:33.260789+0000","last_fullsized":"2023-10-06T03:04:33.260789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:41.163677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274377+0000","last_change":"2023-10-06T03:04:33.270521+0000","last_active":"2023-10-06T03:04:33.274377+0000","last_peered":"2023-10-06T03:04:33.274377+0000","last_clean":"2023-10-06T03:04:33.274377+0000","last_became_active":"2023-10-06T03:04:33.270088+0000","last_became_peered":"2023-10-06T03:04:33.270088+0000","last_unstale":"2023-10-06T03:04:33.274377+0000","last_undegraded":"2023-10-06T03:04:33.274377+0000","last_fullsized":"2023-10-06T03:04:33.274377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:19.718704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254193+0000","last_change":"2023-10-06T03:04:23.986771+0000","last_active":"2023-10-06T03:04:33.254193+0000","last_peered":"2023-10-06T03:04:33.254193+0000","last_clean":"2023-10-06T03:04:33.254193+0000","last_became_active":"2023-10-06T03:04:23.986552+0000","last_became_peered":"2023-10-06T03:04:23.986552+0000","last_unstale":"2023-10-06T03:04:33.254193+0000","last_undegraded":"2023-10-06T03:04:33.254193+0000","last_fullsized":"2023-10-06T03:04:33.254193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257056+0000","last_change":"2023-10-06T03:04:28.829211+0000","last_active":"2023-10-06T03:04:33.257056+0000","last_peered":"2023-10-06T03:04:33.257056+0000","last_clean":"2023-10-06T03:04:33.257056+0000","last_became_active":"2023-10-06T03:04:28.828898+0000","last_became_peered":"2023-10-06T03:04:28.828898+0000","last_unstale":"2023-10-06T03:04:33.257056+0000","last_undegraded":"2023-10-06T03:04:33.257056+0000","last_fullsized":"2023-10-06T03:04:33.257056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:47.647784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260435+0000","last_change":"2023-10-06T03:04:29.251481+0000","last_active":"2023-10-06T03:04:33.260435+0000","last_peered":"2023-10-06T03:04:33.260435+0000","last_clean":"2023-10-06T03:04:33.260435+0000","last_became_active":"2023-10-06T03:04:29.251248+0000","last_became_peered":"2023-10-06T03:04:29.251248+0000","last_unstale":"2023-10-06T03:04:33.260435+0000","last_undegraded":"2023-10-06T03:04:33.260435+0000","last_fullsized":"2023-10-06T03:04:33.260435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:27.111880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279649+0000","last_change":"2023-10-06T03:04:33.275681+0000","last_active":"2023-10-06T03:04:33.279649+0000","last_peered":"2023-10-06T03:04:33.279649+0000","last_clean":"2023-10-06T03:04:33.279649+0000","last_became_active":"2023-10-06T03:04:33.275300+0000","last_became_peered":"2023-10-06T03:04:33.275300+0000","last_unstale":"2023-10-06T03:04:33.279649+0000","last_undegraded":"2023-10-06T03:04:33.279649+0000","last_fullsized":"2023-10-06T03:04:33.279649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:47.690080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257944+0000","last_change":"2023-10-06T03:04:28.837159+0000","last_active":"2023-10-06T03:04:33.257944+0000","last_peered":"2023-10-06T03:04:33.257944+0000","last_clean":"2023-10-06T03:04:33.257944+0000","last_became_active":"2023-10-06T03:04:28.836765+0000","last_became_peered":"2023-10-06T03:04:28.836765+0000","last_unstale":"2023-10-06T03:04:33.257944+0000","last_undegraded":"2023-10-06T03:04:33.257944+0000","last_fullsized":"2023-10-06T03:04:33.257944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:53.804099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256426+0000","last_change":"2023-10-06T03:04:23.813862+0000","last_active":"2023-10-06T03:04:33.256426+0000","last_peered":"2023-10-06T03:04:33.256426+0000","last_clean":"2023-10-06T03:04:33.256426+0000","last_became_active":"2023-10-06T03:04:23.813584+0000","last_became_peered":"2023-10-06T03:04:23.813584+0000","last_unstale":"2023-10-06T03:04:33.256426+0000","last_undegraded":"2023-10-06T03:04:33.256426+0000","last_fullsized":"2023-10-06T03:04:33.256426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255681+0000","last_change":"2023-10-06T03:04:29.245915+0000","last_active":"2023-10-06T03:04:33.255681+0000","last_peered":"2023-10-06T03:04:33.255681+0000","last_clean":"2023-10-06T03:04:33.255681+0000","last_became_active":"2023-10-06T03:04:29.245657+0000","last_became_peered":"2023-10-06T03:04:29.245657+0000","last_unstale":"2023-10-06T03:04:33.255681+0000","last_undegraded":"2023-10-06T03:04:33.255681+0000","last_fullsized":"2023-10-06T03:04:33.255681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274653+0000","last_change":"2023-10-06T03:04:33.269388+0000","last_active":"2023-10-06T03:04:33.274653+0000","last_peered":"2023-10-06T03:04:33.274653+0000","last_clean":"2023-10-06T03:04:33.274653+0000","last_became_active":"2023-10-06T03:04:33.268742+0000","last_became_peered":"2023-10-06T03:04:33.268742+0000","last_unstale":"2023-10-06T03:04:33.274653+0000","last_undegraded":"2023-10-06T03:04:33.274653+0000","last_fullsized":"2023-10-06T03:04:33.274653+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:18.722157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252616+0000","last_change":"2023-10-06T03:04:23.805874+0000","last_active":"2023-10-06T03:04:33.252616+0000","last_peered":"2023-10-06T03:04:33.252616+0000","last_clean":"2023-10-06T03:04:33.252616+0000","last_became_active":"2023-10-06T03:04:23.805551+0000","last_became_peered":"2023-10-06T03:04:23.805551+0000","last_unstale":"2023-10-06T03:04:33.252616+0000","last_undegraded":"2023-10-06T03:04:33.252616+0000","last_fullsized":"2023-10-06T03:04:33.252616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:21.250275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.916228+0000","last_change":"2023-10-06T03:04:28.838956+0000","last_active":"2023-10-06T03:04:33.916228+0000","last_peered":"2023-10-06T03:04:33.916228+0000","last_clean":"2023-10-06T03:04:33.916228+0000","last_became_active":"2023-10-06T03:04:28.838653+0000","last_became_peered":"2023-10-06T03:04:28.838653+0000","last_unstale":"2023-10-06T03:04:33.916228+0000","last_undegraded":"2023-10-06T03:04:33.916228+0000","last_fullsized":"2023-10-06T03:04:33.916228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:01.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260316+0000","last_change":"2023-10-06T03:04:29.250642+0000","last_active":"2023-10-06T03:04:33.260316+0000","last_peered":"2023-10-06T03:04:33.260316+0000","last_clean":"2023-10-06T03:04:33.260316+0000","last_became_active":"2023-10-06T03:04:29.250128+0000","last_became_peered":"2023-10-06T03:04:29.250128+0000","last_unstale":"2023-10-06T03:04:33.260316+0000","last_undegraded":"2023-10-06T03:04:33.260316+0000","last_fullsized":"2023-10-06T03:04:33.260316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:07.410542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279289+0000","last_change":"2023-10-06T03:04:33.277567+0000","last_active":"2023-10-06T03:04:33.279289+0000","last_peered":"2023-10-06T03:04:33.279289+0000","last_clean":"2023-10-06T03:04:33.279289+0000","last_became_active":"2023-10-06T03:04:33.277169+0000","last_became_peered":"2023-10-06T03:04:33.277169+0000","last_unstale":"2023-10-06T03:04:33.279289+0000","last_undegraded":"2023-10-06T03:04:33.279289+0000","last_fullsized":"2023-10-06T03:04:33.279289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:38.040904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260456+0000","last_change":"2023-10-06T03:04:28.840794+0000","last_active":"2023-10-06T03:04:33.260456+0000","last_peered":"2023-10-06T03:04:33.260456+0000","last_clean":"2023-10-06T03:04:33.260456+0000","last_became_active":"2023-10-06T03:04:28.840573+0000","last_became_peered":"2023-10-06T03:04:28.840573+0000","last_unstale":"2023-10-06T03:04:33.260456+0000","last_undegraded":"2023-10-06T03:04:33.260456+0000","last_fullsized":"2023-10-06T03:04:33.260456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:16.444923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256202+0000","last_change":"2023-10-06T03:04:29.248438+0000","last_active":"2023-10-06T03:04:33.256202+0000","last_peered":"2023-10-06T03:04:33.256202+0000","last_clean":"2023-10-06T03:04:33.256202+0000","last_became_active":"2023-10-06T03:04:29.248173+0000","last_became_peered":"2023-10-06T03:04:29.248173+0000","last_unstale":"2023-10-06T03:04:33.256202+0000","last_undegraded":"2023-10-06T03:04:33.256202+0000","last_fullsized":"2023-10-06T03:04:33.256202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:38:44.554979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274467+0000","last_change":"2023-10-06T03:04:33.270323+0000","last_active":"2023-10-06T03:04:33.274467+0000","last_peered":"2023-10-06T03:04:33.274467+0000","last_clean":"2023-10-06T03:04:33.274467+0000","last_became_active":"2023-10-06T03:04:33.269918+0000","last_became_peered":"2023-10-06T03:04:33.269918+0000","last_unstale":"2023-10-06T03:04:33.274467+0000","last_undegraded":"2023-10-06T03:04:33.274467+0000","last_fullsized":"2023-10-06T03:04:33.274467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:29.020898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247754+0000","last_change":"2023-10-06T03:04:28.838880+0000","last_active":"2023-10-06T03:04:33.247754+0000","last_peered":"2023-10-06T03:04:33.247754+0000","last_clean":"2023-10-06T03:04:33.247754+0000","last_became_active":"2023-10-06T03:04:28.838586+0000","last_became_peered":"2023-10-06T03:04:28.838586+0000","last_unstale":"2023-10-06T03:04:33.247754+0000","last_undegraded":"2023-10-06T03:04:33.247754+0000","last_fullsized":"2023-10-06T03:04:33.247754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:22.072997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252124+0000","last_change":"2023-10-06T03:04:29.243720+0000","last_active":"2023-10-06T03:04:33.252124+0000","last_peered":"2023-10-06T03:04:33.252124+0000","last_clean":"2023-10-06T03:04:33.252124+0000","last_became_active":"2023-10-06T03:04:29.243445+0000","last_became_peered":"2023-10-06T03:04:29.243445+0000","last_unstale":"2023-10-06T03:04:33.252124+0000","last_undegraded":"2023-10-06T03:04:33.252124+0000","last_fullsized":"2023-10-06T03:04:33.252124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:22.258796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.272233+0000","last_change":"2023-10-06T03:04:33.267993+0000","last_active":"2023-10-06T03:04:33.272233+0000","last_peered":"2023-10-06T03:04:33.272233+0000","last_clean":"2023-10-06T03:04:33.272233+0000","last_became_active":"2023-10-06T03:04:33.267548+0000","last_became_peered":"2023-10-06T03:04:33.267548+0000","last_unstale":"2023-10-06T03:04:33.272233+0000","last_undegraded":"2023-10-06T03:04:33.272233+0000","last_fullsized":"2023-10-06T03:04:33.272233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:07.483381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247563+0000","last_change":"2023-10-06T03:04:28.839397+0000","last_active":"2023-10-06T03:04:33.247563+0000","last_peered":"2023-10-06T03:04:33.247563+0000","last_clean":"2023-10-06T03:04:33.247563+0000","last_became_active":"2023-10-06T03:04:28.839121+0000","last_became_peered":"2023-10-06T03:04:28.839121+0000","last_unstale":"2023-10-06T03:04:33.247563+0000","last_undegraded":"2023-10-06T03:04:33.247563+0000","last_fullsized":"2023-10-06T03:04:33.247563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:19.451116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251017+0000","last_change":"2023-10-06T03:04:29.241780+0000","last_active":"2023-10-06T03:04:33.251017+0000","last_peered":"2023-10-06T03:04:33.251017+0000","last_clean":"2023-10-06T03:04:33.251017+0000","last_became_active":"2023-10-06T03:04:29.241462+0000","last_became_peered":"2023-10-06T03:04:29.241462+0000","last_unstale":"2023-10-06T03:04:33.251017+0000","last_undegraded":"2023-10-06T03:04:33.251017+0000","last_fullsized":"2023-10-06T03:04:33.251017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.270793+0000","last_change":"2023-10-06T03:04:33.266666+0000","last_active":"2023-10-06T03:04:33.270793+0000","last_peered":"2023-10-06T03:04:33.270793+0000","last_clean":"2023-10-06T03:04:33.270793+0000","last_became_active":"2023-10-06T03:04:33.266284+0000","last_became_peered":"2023-10-06T03:04:33.266284+0000","last_unstale":"2023-10-06T03:04:33.270793+0000","last_undegraded":"2023-10-06T03:04:33.270793+0000","last_fullsized":"2023-10-06T03:04:33.270793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:17.775172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256370+0000","last_change":"2023-10-06T03:04:28.833313+0000","last_active":"2023-10-06T03:04:33.256370+0000","last_peered":"2023-10-06T03:04:33.256370+0000","last_clean":"2023-10-06T03:04:33.256370+0000","last_became_active":"2023-10-06T03:04:28.832982+0000","last_became_peered":"2023-10-06T03:04:28.832982+0000","last_unstale":"2023-10-06T03:04:33.256370+0000","last_undegraded":"2023-10-06T03:04:33.256370+0000","last_fullsized":"2023-10-06T03:04:33.256370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:04.476704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255857+0000","last_change":"2023-10-06T03:04:29.237739+0000","last_active":"2023-10-06T03:04:33.255857+0000","last_peered":"2023-10-06T03:04:33.255857+0000","last_clean":"2023-10-06T03:04:33.255857+0000","last_became_active":"2023-10-06T03:04:29.237497+0000","last_became_peered":"2023-10-06T03:04:29.237497+0000","last_unstale":"2023-10-06T03:04:33.255857+0000","last_undegraded":"2023-10-06T03:04:33.255857+0000","last_fullsized":"2023-10-06T03:04:33.255857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:27.111880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279027+0000","last_change":"2023-10-06T03:04:33.269307+0000","last_active":"2023-10-06T03:04:33.279027+0000","last_peered":"2023-10-06T03:04:33.279027+0000","last_clean":"2023-10-06T03:04:33.279027+0000","last_became_active":"2023-10-06T03:04:33.268876+0000","last_became_peered":"2023-10-06T03:04:33.268876+0000","last_unstale":"2023-10-06T03:04:33.279027+0000","last_undegraded":"2023-10-06T03:04:33.279027+0000","last_fullsized":"2023-10-06T03:04:33.279027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:53.801187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260493+0000","last_change":"2023-10-06T03:04:28.839985+0000","last_active":"2023-10-06T03:04:33.260493+0000","last_peered":"2023-10-06T03:04:33.260493+0000","last_clean":"2023-10-06T03:04:33.260493+0000","last_became_active":"2023-10-06T03:04:28.839831+0000","last_became_peered":"2023-10-06T03:04:28.839831+0000","last_unstale":"2023-10-06T03:04:33.260493+0000","last_undegraded":"2023-10-06T03:04:33.260493+0000","last_fullsized":"2023-10-06T03:04:33.260493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:04.476704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251017+0000","last_change":"2023-10-06T03:04:29.242972+0000","last_active":"2023-10-06T03:04:33.251017+0000","last_peered":"2023-10-06T03:04:33.251017+0000","last_clean":"2023-10-06T03:04:33.251017+0000","last_became_active":"2023-10-06T03:04:29.242692+0000","last_became_peered":"2023-10-06T03:04:29.242692+0000","last_unstale":"2023-10-06T03:04:33.251017+0000","last_undegraded":"2023-10-06T03:04:33.251017+0000","last_fullsized":"2023-10-06T03:04:33.251017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:22.493291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251832+0000","last_change":"2023-10-06T03:04:29.239473+0000","last_active":"2023-10-06T03:04:33.251832+0000","last_peered":"2023-10-06T03:04:33.251832+0000","last_clean":"2023-10-06T03:04:33.251832+0000","last_became_active":"2023-10-06T03:04:29.239195+0000","last_became_peered":"2023-10-06T03:04:29.239195+0000","last_unstale":"2023-10-06T03:04:33.251832+0000","last_undegraded":"2023-10-06T03:04:33.251832+0000","last_fullsized":"2023-10-06T03:04:33.251832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:38:44.554979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255913+0000","last_change":"2023-10-06T03:04:29.248060+0000","last_active":"2023-10-06T03:04:33.255913+0000","last_peered":"2023-10-06T03:04:33.255913+0000","last_clean":"2023-10-06T03:04:33.255913+0000","last_became_active":"2023-10-06T03:04:29.247710+0000","last_became_peered":"2023-10-06T03:04:29.247710+0000","last_unstale":"2023-10-06T03:04:33.255913+0000","last_undegraded":"2023-10-06T03:04:33.255913+0000","last_fullsized":"2023-10-06T03:04:33.255913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:41.163677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251328+0000","last_change":"2023-10-06T03:04:29.242391+0000","last_active":"2023-10-06T03:04:33.251328+0000","last_peered":"2023-10-06T03:04:33.251328+0000","last_clean":"2023-10-06T03:04:33.251328+0000","last_became_active":"2023-10-06T03:04:29.241939+0000","last_became_peered":"2023-10-06T03:04:29.241939+0000","last_unstale":"2023-10-06T03:04:33.251328+0000","last_undegraded":"2023-10-06T03:04:33.251328+0000","last_fullsized":"2023-10-06T03:04:33.251328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:22:15.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256253+0000","last_change":"2023-10-06T03:04:29.244909+0000","last_active":"2023-10-06T03:04:33.256253+0000","last_peered":"2023-10-06T03:04:33.256253+0000","last_clean":"2023-10-06T03:04:33.256253+0000","last_became_active":"2023-10-06T03:04:29.244666+0000","last_became_peered":"2023-10-06T03:04:29.244666+0000","last_unstale":"2023-10-06T03:04:33.256253+0000","last_undegraded":"2023-10-06T03:04:33.256253+0000","last_fullsized":"2023-10-06T03:04:33.256253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:16.298020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256973+0000","last_change":"2023-10-06T03:04:29.252885+0000","last_active":"2023-10-06T03:04:33.256973+0000","last_peered":"2023-10-06T03:04:33.256973+0000","last_clean":"2023-10-06T03:04:33.256973+0000","last_became_active":"2023-10-06T03:04:29.252697+0000","last_became_peered":"2023-10-06T03:04:29.252697+0000","last_unstale":"2023-10-06T03:04:33.256973+0000","last_undegraded":"2023-10-06T03:04:33.256973+0000","last_fullsized":"2023-10-06T03:04:33.256973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":713872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":709484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.254}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":119663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":123344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":299008,"data_stored":120197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:04:43.707 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:04:43.707 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T03:04:43.707 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T03:04:43.707 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T03:04:43.708 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T03:04:43.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.857+0000 7f4029172700 1 Processor -- start 2023-10-06T03:04:43.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.857+0000 7f4029172700 1 -- start start 2023-10-06T03:04:43.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.857+0000 7f4029172700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4024067d20 0x7f4024069300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4029172700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40240cccc0 con 0x7f40240cc8f0 2023-10-06T03:04:43.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4029172700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40240cae70 con 0x7f40240caa40 2023-10-06T03:04:43.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4029172700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40241585c0 con 0x7f4024067d20 2023-10-06T03:04:43.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4022d9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f40240cc8f0 0x7f4024067610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58054/0 (socket says 172.21.15.125:58054) 2023-10-06T03:04:43.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4022d9d700 1 -- 172.21.15.125:0/4065977354 learned_addr learned my addr 172.21.15.125:0/4065977354 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:43.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f402259c700 1 --2- 172.21.15.125:0/4065977354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4024067d20 0x7f4024069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4021d9b700 1 -- 172.21.15.125:0/4065977354 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842149938 0 0) 0x7f40240cccc0 con 0x7f40240cc8f0 2023-10-06T03:04:43.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4021d9b700 1 -- 172.21.15.125:0/4065977354 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f400c003570 con 0x7f40240cc8f0 2023-10-06T03:04:43.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4021d9b700 1 -- 172.21.15.125:0/4065977354 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2505212646 0 0) 0x7f400c003570 con 0x7f40240cc8f0 2023-10-06T03:04:43.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4021d9b700 1 -- 172.21.15.125:0/4065977354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4024067d20 msgr2=0x7f4024069300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:43.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4021d9b700 1 --2- 172.21.15.125:0/4065977354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4024067d20 0x7f4024069300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4021d9b700 1 -- 172.21.15.125:0/4065977354 >> v1:172.21.15.130:6789/0 conn(0x7f40240caa40 legacy=0x7f4024159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:43.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4021d9b700 1 -- 172.21.15.125:0/4065977354 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4024158cd0 con 0x7f40240cc8f0 2023-10-06T03:04:43.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4021d9b700 1 -- 172.21.15.125:0/4065977354 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f40140015f0 con 0x7f40240cc8f0 2023-10-06T03:04:43.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4021d9b700 1 -- 172.21.15.125:0/4065977354 >> v1:172.21.15.125:6789/0 conn(0x7f40240cc8f0 legacy=0x7f4024067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:43.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4021d9b700 1 --2- 172.21.15.125:0/4065977354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f400c003a90 0x7f400c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4021d9b700 1 --2- 172.21.15.125:0/4065977354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f400c004810 0x7f400c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4021d9b700 1 --2- 172.21.15.125:0/4065977354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4024067d20 0x7f400c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4021d9b700 1 -- 172.21.15.125:0/4065977354 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40241585c0 con 0x7f400c003a90 2023-10-06T03:04:43.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4021d9b700 1 -- 172.21.15.125:0/4065977354 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400c00bb40 con 0x7f400c004810 2023-10-06T03:04:43.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4021d9b700 1 -- 172.21.15.125:0/4065977354 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400c00bd00 con 0x7f4024067d20 2023-10-06T03:04:43.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f4022d9d700 1 --2- 172.21.15.125:0/4065977354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f400c003a90 0x7f400c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f402259c700 1 --2- 172.21.15.125:0/4065977354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f400c004810 0x7f400c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.858+0000 7f402359e700 1 --2- 172.21.15.125:0/4065977354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4024067d20 0x7f400c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.859+0000 7f4022d9d700 1 -- 172.21.15.125:0/4065977354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4024067d20 msgr2=0x7f400c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:43.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.859+0000 7f4022d9d700 1 --2- 172.21.15.125:0/4065977354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4024067d20 0x7f400c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.859+0000 7f4022d9d700 1 -- 172.21.15.125:0/4065977354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f400c004810 msgr2=0x7f400c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:43.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.859+0000 7f4022d9d700 1 --2- 172.21.15.125:0/4065977354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f400c004810 0x7f400c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.859+0000 7f4022d9d700 1 -- 172.21.15.125:0/4065977354 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c003570 con 0x7f400c003a90 2023-10-06T03:04:43.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.859+0000 7f4022d9d700 1 --2- 172.21.15.125:0/4065977354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f400c003a90 0x7f400c003e60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f401400c300 tx=0x7f4014007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55327b99760c304 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:43.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.859+0000 7f4021d9b700 1 -- 172.21.15.125:0/4065977354 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401400cc30 con 0x7f400c003a90 2023-10-06T03:04:43.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.859+0000 7f4021d9b700 1 -- 172.21.15.125:0/4065977354 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401400cdb0 con 0x7f400c003a90 2023-10-06T03:04:43.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.859+0000 7f4021d9b700 1 -- 172.21.15.125:0/4065977354 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4014001de0 con 0x7f400c003a90 2023-10-06T03:04:43.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.859+0000 7f4029172700 1 -- 172.21.15.125:0/4065977354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f400c003a90 msgr2=0x7f400c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:43.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.859+0000 7f4029172700 1 --2- 172.21.15.125:0/4065977354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f400c003a90 0x7f400c003e60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f401400c300 tx=0x7f4014007920 comp rx=0 tx=0).stop 2023-10-06T03:04:43.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.859+0000 7f402359e700 1 -- 172.21.15.125:0/4065977354 reap_dead start 2023-10-06T03:04:43.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.859+0000 7f4029172700 1 -- 172.21.15.125:0/4065977354 shutdown_connections 2023-10-06T03:04:43.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.859+0000 7f4029172700 1 -- 172.21.15.125:0/4065977354 >> 172.21.15.125:0/4065977354 conn(0x7f4024068f00 msgr2=0x7f40240cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:43.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.859+0000 7f4029172700 1 -- 172.21.15.125:0/4065977354 shutdown_connections 2023-10-06T03:04:43.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.860+0000 7f4029172700 1 -- 172.21.15.125:0/4065977354 wait complete. 2023-10-06T03:04:43.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.861+0000 7f4029172700 1 Processor -- start 2023-10-06T03:04:43.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.861+0000 7f4029172700 1 -- start start 2023-10-06T03:04:43.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.861+0000 7f4029172700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f400c003a90 0x7f40240b0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.861+0000 7f4029172700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4024169020 0x7f40241544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.861+0000 7f4029172700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4024154a30 0x7f40240b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.861+0000 7f4029172700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4024154ed0 con 0x7f4024154a30 2023-10-06T03:04:43.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.861+0000 7f4029172700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40240c1c10 con 0x7f4024169020 2023-10-06T03:04:43.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.861+0000 7f4029172700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40240c4a00 con 0x7f400c003a90 2023-10-06T03:04:43.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.862+0000 7f402359e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4024154a30 0x7f40240b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.862+0000 7f402359e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4024154a30 0x7f40240b1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54018/0 (socket says 172.21.15.125:54018) 2023-10-06T03:04:43.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.862+0000 7f402359e700 1 -- 172.21.15.125:0/1269563129 learned_addr learned my addr 172.21.15.125:0/1269563129 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:43.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.862+0000 7f4022d9d700 1 --2- 172.21.15.125:0/1269563129 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f400c003a90 0x7f40240b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.862+0000 7f402259c700 1 --2- 172.21.15.125:0/1269563129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4024169020 0x7f40241544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.862+0000 7f402359e700 1 -- 172.21.15.125:0/1269563129 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f400c003a90 msgr2=0x7f40240b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:43.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.862+0000 7f402359e700 1 --2- 172.21.15.125:0/1269563129 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f400c003a90 0x7f40240b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.862+0000 7f402359e700 1 -- 172.21.15.125:0/1269563129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4024169020 msgr2=0x7f40241544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:43.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.862+0000 7f402359e700 1 --2- 172.21.15.125:0/1269563129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4024169020 0x7f40241544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:43.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.862+0000 7f402359e700 1 -- 172.21.15.125:0/1269563129 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4024169850 con 0x7f4024154a30 2023-10-06T03:04:43.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.862+0000 7f402359e700 1 --2- 172.21.15.125:0/1269563129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4024154a30 0x7f40240b1f10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f40240c8600 tx=0x7f401c0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:43.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.862+0000 7f400affd700 1 -- 172.21.15.125:0/1269563129 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c00eec0 con 0x7f4024154a30 2023-10-06T03:04:43.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.862+0000 7f400affd700 1 -- 172.21.15.125:0/1269563129 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401c00c7e0 con 0x7f4024154a30 2023-10-06T03:04:43.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.862+0000 7f4029172700 1 -- 172.21.15.125:0/1269563129 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4024169b30 con 0x7f4024154a30 2023-10-06T03:04:43.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.862+0000 7f400affd700 1 -- 172.21.15.125:0/1269563129 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401c00cba0 con 0x7f4024154a30 2023-10-06T03:04:43.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.862+0000 7f4029172700 1 -- 172.21.15.125:0/1269563129 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4024169490 con 0x7f4024154a30 2023-10-06T03:04:43.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.863+0000 7f4029172700 1 -- 172.21.15.125:0/1269563129 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40240c4b90 con 0x7f4024154a30 2023-10-06T03:04:43.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.863+0000 7f400affd700 1 -- 172.21.15.125:0/1269563129 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f401c01d460 con 0x7f4024154a30 2023-10-06T03:04:43.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.864+0000 7f400affd700 1 --2- 172.21.15.125:0/1269563129 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4010066f30 0x7f40100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:43.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.864+0000 7f400affd700 1 -- 172.21.15.125:0/1269563129 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f401c084790 con 0x7f4024154a30 2023-10-06T03:04:43.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.864+0000 7f4022d9d700 1 --2- 172.21.15.125:0/1269563129 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4010066f30 0x7f40100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:43.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.864+0000 7f4022d9d700 1 --2- 172.21.15.125:0/1269563129 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4010066f30 0x7f40100693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4014000ef0 tx=0x7f4014015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:43.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:43.868+0000 7f400affd700 1 -- 172.21.15.125:0/1269563129 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f401c051670 con 0x7f4024154a30 2023-10-06T03:04:44.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.104+0000 7f4029172700 1 -- 172.21.15.125:0/1269563129 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f4024066510 con 0x7f4024154a30 2023-10-06T03:04:44.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.107+0000 7f400affd700 1 -- 172.21.15.125:0/1269563129 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163709 (secure 0 0 0) 0x7f401c054c90 con 0x7f4024154a30 2023-10-06T03:04:44.110 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:44.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.109+0000 7f4029172700 1 -- 172.21.15.125:0/1269563129 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4010066f30 msgr2=0x7f40100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:44.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.109+0000 7f4029172700 1 --2- 172.21.15.125:0/1269563129 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4010066f30 0x7f40100693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4014000ef0 tx=0x7f4014015000 comp rx=0 tx=0).stop 2023-10-06T03:04:44.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.109+0000 7f4029172700 1 -- 172.21.15.125:0/1269563129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4024154a30 msgr2=0x7f40240b1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:44.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.109+0000 7f4029172700 1 --2- 172.21.15.125:0/1269563129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4024154a30 0x7f40240b1f10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f40240c8600 tx=0x7f401c0016d0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.109+0000 7f4029172700 1 -- 172.21.15.125:0/1269563129 shutdown_connections 2023-10-06T03:04:44.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.109+0000 7f4029172700 1 --2- 172.21.15.125:0/1269563129 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4010066f30 0x7f40100693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.109+0000 7f4029172700 1 --2- 172.21.15.125:0/1269563129 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4024154a30 0x7f40240b1f10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.109+0000 7f4029172700 1 --2- 172.21.15.125:0/1269563129 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f400c003a90 0x7f40240b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.109+0000 7f4029172700 1 --2- 172.21.15.125:0/1269563129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4024169020 0x7f40241544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.109+0000 7f4029172700 1 -- 172.21.15.125:0/1269563129 >> 172.21.15.125:0/1269563129 conn(0x7f4024068f00 msgr2=0x7f4024067610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:44.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.109+0000 7f4029172700 1 -- 172.21.15.125:0/1269563129 shutdown_connections 2023-10-06T03:04:44.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.109+0000 7f4029172700 1 -- 172.21.15.125:0/1269563129 wait complete. 2023-10-06T03:04:44.122 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":5,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6832","nonce":119397},{"type":"v1","addr":"172.21.15.125:6833","nonce":119397}]},"active_addr":"172.21.15.125:6833/119397","active_change":"2023-10-06T03:04:09.799178+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":4071354101}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":1490063244}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":1688860543}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.125:0","nonce":1684019185}]}]} 2023-10-06T03:04:44.128 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T03:04:44.128 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T03:04:44.128 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:04:44.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.244+0000 7f72c9479700 1 Processor -- start 2023-10-06T03:04:44.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.244+0000 7f72c9479700 1 -- start start 2023-10-06T03:04:44.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.245+0000 7f72c9479700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f72c413f6a0 0x7f72c413fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:44.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.245+0000 7f72c9479700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c40c74c0 con 0x7f72c415a320 2023-10-06T03:04:44.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.245+0000 7f72c9479700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c40c7710 con 0x7f72c406bd10 2023-10-06T03:04:44.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.245+0000 7f72c9479700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c40c79f0 con 0x7f72c413f6a0 2023-10-06T03:04:44.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.245+0000 7f72c37fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f72c415a320 0x7f72c40cac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58056/0 (socket says 172.21.15.125:58056) 2023-10-06T03:04:44.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.245+0000 7f72c37fe700 1 -- 172.21.15.125:0/2707822946 learned_addr learned my addr 172.21.15.125:0/2707822946 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:44.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.245+0000 7f72c1ffb700 1 -- 172.21.15.125:0/2707822946 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912334254 0 0) 0x7f72c40c74c0 con 0x7f72c415a320 2023-10-06T03:04:44.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.245+0000 7f72c2ffd700 1 --2- 172.21.15.125:0/2707822946 >> v2:172.21.15.130:3300/0 conn(0x7f72c413f6a0 0x7f72c413fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:44.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.245+0000 7f72c1ffb700 1 -- 172.21.15.125:0/2707822946 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72ac003570 con 0x7f72c415a320 2023-10-06T03:04:44.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c1ffb700 1 -- 172.21.15.125:0/2707822946 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1157272793 0 0) 0x7f72ac003570 con 0x7f72c415a320 2023-10-06T03:04:44.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c1ffb700 1 -- 172.21.15.125:0/2707822946 >> v2:172.21.15.130:3300/0 conn(0x7f72c413f6a0 msgr2=0x7f72c413fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:44.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c1ffb700 1 --2- 172.21.15.125:0/2707822946 >> v2:172.21.15.130:3300/0 conn(0x7f72c413f6a0 0x7f72c413fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c1ffb700 1 -- 172.21.15.125:0/2707822946 >> v1:172.21.15.130:6789/0 conn(0x7f72c406bd10 legacy=0x7f72c4159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:44.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c1ffb700 1 -- 172.21.15.125:0/2707822946 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c40c9b40 con 0x7f72c415a320 2023-10-06T03:04:44.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c1ffb700 1 -- 172.21.15.125:0/2707822946 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f72bc0017f0 con 0x7f72c415a320 2023-10-06T03:04:44.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c1ffb700 1 -- 172.21.15.125:0/2707822946 >> v1:172.21.15.125:6789/0 conn(0x7f72c415a320 legacy=0x7f72c40cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:44.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c1ffb700 1 --2- 172.21.15.125:0/2707822946 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72ac003a60 0x7f72ac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:44.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c1ffb700 1 --2- 172.21.15.125:0/2707822946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72ac004810 0x7f72ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:44.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c1ffb700 1 --2- 172.21.15.125:0/2707822946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72ac0051c0 0x7f72ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:44.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c1ffb700 1 -- 172.21.15.125:0/2707822946 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c40c79f0 con 0x7f72ac004810 2023-10-06T03:04:44.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c1ffb700 1 -- 172.21.15.125:0/2707822946 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac00c160 con 0x7f72ac0051c0 2023-10-06T03:04:44.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c1ffb700 1 -- 172.21.15.125:0/2707822946 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac00c320 con 0x7f72ac003a60 2023-10-06T03:04:44.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c27fc700 1 --2- 172.21.15.125:0/2707822946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72ac004810 0x7f72ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:44.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c2ffd700 1 --2- 172.21.15.125:0/2707822946 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72ac003a60 0x7f72ac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:44.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c37fe700 1 --2- 172.21.15.125:0/2707822946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72ac0051c0 0x7f72ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:44.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c27fc700 1 -- 172.21.15.125:0/2707822946 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72ac003a60 msgr2=0x7f72ac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:44.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c27fc700 1 --2- 172.21.15.125:0/2707822946 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72ac003a60 0x7f72ac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c27fc700 1 -- 172.21.15.125:0/2707822946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72ac0051c0 msgr2=0x7f72ac00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:44.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c27fc700 1 --2- 172.21.15.125:0/2707822946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72ac0051c0 0x7f72ac00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c37fe700 1 -- 172.21.15.125:0/2707822946 reap_dead start 2023-10-06T03:04:44.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c27fc700 1 -- 172.21.15.125:0/2707822946 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac003570 con 0x7f72ac004810 2023-10-06T03:04:44.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c27fc700 1 --2- 172.21.15.125:0/2707822946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72ac004810 0x7f72ac004c80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f72b40018b0 tx=0x7f72b4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9071b222ef07c6d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:44.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c1ffb700 1 -- 172.21.15.125:0/2707822946 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4012420 con 0x7f72ac004810 2023-10-06T03:04:44.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.246+0000 7f72c1ffb700 1 -- 172.21.15.125:0/2707822946 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b40125a0 con 0x7f72ac004810 2023-10-06T03:04:44.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.247+0000 7f72c1ffb700 1 -- 172.21.15.125:0/2707822946 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4012960 con 0x7f72ac004810 2023-10-06T03:04:44.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.247+0000 7f72c9479700 1 -- 172.21.15.125:0/2707822946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72ac004810 msgr2=0x7f72ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:44.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.247+0000 7f72c9479700 1 --2- 172.21.15.125:0/2707822946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72ac004810 0x7f72ac004c80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f72b40018b0 tx=0x7f72b4007d30 comp rx=0 tx=0).stop 2023-10-06T03:04:44.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.247+0000 7f72c9479700 1 -- 172.21.15.125:0/2707822946 shutdown_connections 2023-10-06T03:04:44.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.247+0000 7f72c9479700 1 --2- 172.21.15.125:0/2707822946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72ac004810 0x7f72ac004c80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.247+0000 7f72c9479700 1 -- 172.21.15.125:0/2707822946 >> 172.21.15.125:0/2707822946 conn(0x7f72c406b190 msgr2=0x7f72c406b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:44.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.247+0000 7f72c9479700 1 -- 172.21.15.125:0/2707822946 shutdown_connections 2023-10-06T03:04:44.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.247+0000 7f72c9479700 1 -- 172.21.15.125:0/2707822946 wait complete. 2023-10-06T03:04:44.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.248+0000 7f72c9479700 1 Processor -- start 2023-10-06T03:04:44.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.248+0000 7f72c9479700 1 -- start start 2023-10-06T03:04:44.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.249+0000 7f72c9479700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72ac004810 0x7f72c4156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:44.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.249+0000 7f72c9479700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c4156c40 0x7f72c40b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:44.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.249+0000 7f72c9479700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72c4155040 0x7f72c40b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:44.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.249+0000 7f72c9479700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c4159590 con 0x7f72ac004810 2023-10-06T03:04:44.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.249+0000 7f72c9479700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c40caa30 con 0x7f72c4156c40 2023-10-06T03:04:44.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.249+0000 7f72c9479700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c40cad10 con 0x7f72c4155040 2023-10-06T03:04:44.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.249+0000 7f72c2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72ac004810 0x7f72c4156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:44.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.249+0000 7f72c2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72ac004810 0x7f72c4156700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54040/0 (socket says 172.21.15.125:54040) 2023-10-06T03:04:44.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.249+0000 7f72c2ffd700 1 -- 172.21.15.125:0/532093883 learned_addr learned my addr 172.21.15.125:0/532093883 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:44.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.249+0000 7f72c37fe700 1 --2- 172.21.15.125:0/532093883 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72c4155040 0x7f72c40b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:44.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.249+0000 7f72c27fc700 1 --2- 172.21.15.125:0/532093883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c4156c40 0x7f72c40b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:44.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.249+0000 7f72c2ffd700 1 -- 172.21.15.125:0/532093883 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72c4155040 msgr2=0x7f72c40b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:44.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.249+0000 7f72c2ffd700 1 --2- 172.21.15.125:0/532093883 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72c4155040 0x7f72c40b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.249+0000 7f72c2ffd700 1 -- 172.21.15.125:0/532093883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c4156c40 msgr2=0x7f72c40b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:44.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.249+0000 7f72c2ffd700 1 --2- 172.21.15.125:0/532093883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c4156c40 0x7f72c40b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.249+0000 7f72c2ffd700 1 -- 172.21.15.125:0/532093883 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c4157130 con 0x7f72ac004810 2023-10-06T03:04:44.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.249+0000 7f72c27fc700 1 --2- 172.21.15.125:0/532093883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c4156c40 0x7f72c40b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:04:44.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.250+0000 7f72c2ffd700 1 --2- 172.21.15.125:0/532093883 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72ac004810 0x7f72c4156700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f72b8011d70 tx=0x7f72b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:44.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.250+0000 7f72aaffd700 1 -- 172.21.15.125:0/532093883 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b8009e20 con 0x7f72ac004810 2023-10-06T03:04:44.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.250+0000 7f72aaffd700 1 -- 172.21.15.125:0/532093883 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b800fcd0 con 0x7f72ac004810 2023-10-06T03:04:44.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.250+0000 7f72aaffd700 1 -- 172.21.15.125:0/532093883 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b8014650 con 0x7f72ac004810 2023-10-06T03:04:44.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.250+0000 7f72c9479700 1 -- 172.21.15.125:0/532093883 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c4157410 con 0x7f72ac004810 2023-10-06T03:04:44.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.250+0000 7f72c9479700 1 -- 172.21.15.125:0/532093883 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c41556f0 con 0x7f72ac004810 2023-10-06T03:04:44.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.251+0000 7f72c9479700 1 -- 172.21.15.125:0/532093883 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c4066510 con 0x7f72ac004810 2023-10-06T03:04:44.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.251+0000 7f72aaffd700 1 -- 172.21.15.125:0/532093883 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72b8014a80 con 0x7f72ac004810 2023-10-06T03:04:44.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.251+0000 7f72aaffd700 1 --2- 172.21.15.125:0/532093883 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f72b0066f30 0x7f72b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:44.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.252+0000 7f72aaffd700 1 -- 172.21.15.125:0/532093883 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f72b8018030 con 0x7f72ac004810 2023-10-06T03:04:44.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.252+0000 7f72c27fc700 1 --2- 172.21.15.125:0/532093883 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f72b0066f30 0x7f72b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:44.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.252+0000 7f72c27fc700 1 --2- 172.21.15.125:0/532093883 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f72b0066f30 0x7f72b00693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f72c416adb0 tx=0x7f72b4015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:44.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.256+0000 7f72aaffd700 1 -- 172.21.15.125:0/532093883 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72b8052320 con 0x7f72ac004810 2023-10-06T03:04:44.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.439+0000 7f72c9479700 1 -- 172.21.15.125:0/532093883 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72c40c9e20 con 0x7f72ac004810 2023-10-06T03:04:44.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.440+0000 7f72aaffd700 1 -- 172.21.15.125:0/532093883 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18851 (secure 0 0 0) 0x7f72b8055940 con 0x7f72ac004810 2023-10-06T03:04:44.442 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:44.442 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:33.645139+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:04:26.828121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:04:28.179225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:04:31.256394+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:04:44.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.442+0000 7f72c9479700 1 -- 172.21.15.125:0/532093883 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f72b0066f30 msgr2=0x7f72b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:44.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.442+0000 7f72c9479700 1 --2- 172.21.15.125:0/532093883 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f72b0066f30 0x7f72b00693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f72c416adb0 tx=0x7f72b4015000 comp rx=0 tx=0).stop 2023-10-06T03:04:44.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.442+0000 7f72c9479700 1 -- 172.21.15.125:0/532093883 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72ac004810 msgr2=0x7f72c4156700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:44.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.442+0000 7f72c9479700 1 --2- 172.21.15.125:0/532093883 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72ac004810 0x7f72c4156700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f72b8011d70 tx=0x7f72b80091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.442+0000 7f72c9479700 1 -- 172.21.15.125:0/532093883 shutdown_connections 2023-10-06T03:04:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.442+0000 7f72c9479700 1 --2- 172.21.15.125:0/532093883 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f72b0066f30 0x7f72b00693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.442+0000 7f72c9479700 1 --2- 172.21.15.125:0/532093883 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72c4155040 0x7f72c40b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.442+0000 7f72c9479700 1 --2- 172.21.15.125:0/532093883 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72ac004810 0x7f72c4156700 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.442+0000 7f72c9479700 1 --2- 172.21.15.125:0/532093883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c4156c40 0x7f72c40b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.442+0000 7f72c9479700 1 -- 172.21.15.125:0/532093883 >> 172.21.15.125:0/532093883 conn(0x7f72c406b190 msgr2=0x7f72c40ac750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.442+0000 7f72c9479700 1 -- 172.21.15.125:0/532093883 shutdown_connections 2023-10-06T03:04:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.442+0000 7f72c9479700 1 -- 172.21.15.125:0/532093883 wait complete. 2023-10-06T03:04:44.456 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T03:04:44.456 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:04:44.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.572+0000 7fd779381700 1 Processor -- start 2023-10-06T03:04:44.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.572+0000 7fd779381700 1 -- start start 2023-10-06T03:04:44.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.573+0000 7fd779381700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7741595c0 0x7fd7740ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:44.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.573+0000 7fd779381700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7740cbb90 con 0x7fd7741591f0 2023-10-06T03:04:44.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.573+0000 7fd779381700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7740cbe70 con 0x7fd7740cd170 2023-10-06T03:04:44.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.573+0000 7fd779381700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7740afbf0 con 0x7fd7741595c0 2023-10-06T03:04:44.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.573+0000 7fd772ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd7741591f0 0x7fd7740b2f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:58064/0 (socket says 172.21.15.125:58064) 2023-10-06T03:04:44.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.573+0000 7fd772ffd700 1 -- 172.21.15.125:0/4166444321 learned_addr learned my addr 172.21.15.125:0/4166444321 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:44.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.573+0000 7fd7727fc700 1 --2- 172.21.15.125:0/4166444321 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7741595c0 0x7fd7740ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:44.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.573+0000 7fd771ffb700 1 -- 172.21.15.125:0/4166444321 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2049745015 0 0) 0x7fd7740cbb90 con 0x7fd7741591f0 2023-10-06T03:04:44.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.573+0000 7fd771ffb700 1 -- 172.21.15.125:0/4166444321 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd75c003570 con 0x7fd7741591f0 2023-10-06T03:04:44.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.573+0000 7fd771ffb700 1 -- 172.21.15.125:0/4166444321 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358983633 0 0) 0x7fd7740cbe70 con 0x7fd7740cd170 2023-10-06T03:04:44.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.573+0000 7fd771ffb700 1 -- 172.21.15.125:0/4166444321 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7740cbb90 con 0x7fd7740cd170 2023-10-06T03:04:44.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.573+0000 7fd771ffb700 1 -- 172.21.15.125:0/4166444321 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 442602256 0 0) 0x7fd75c003570 con 0x7fd7741591f0 2023-10-06T03:04:44.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.573+0000 7fd7727fc700 1 -- 172.21.15.125:0/4166444321 >> v1:172.21.15.130:6789/0 conn(0x7fd7740cd170 legacy=0x7fd7740caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:44.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.573+0000 7fd7727fc700 1 -- 172.21.15.125:0/4166444321 >> v1:172.21.15.125:6789/0 conn(0x7fd7741591f0 legacy=0x7fd7740b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:44.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.573+0000 7fd7727fc700 1 -- 172.21.15.125:0/4166444321 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7740cc150 con 0x7fd7741595c0 2023-10-06T03:04:44.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.573+0000 7fd7727fc700 1 --2- 172.21.15.125:0/4166444321 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7741595c0 0x7fd7740ccc30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd764009910 tx=0x7fd7640091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fda7655ffb474412 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:44.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.574+0000 7fd771ffb700 1 -- 172.21.15.125:0/4166444321 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd768001470 con 0x7fd7741595c0 2023-10-06T03:04:44.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.574+0000 7fd771ffb700 1 -- 172.21.15.125:0/4166444321 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd764011420 con 0x7fd7741595c0 2023-10-06T03:04:44.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.574+0000 7fd771ffb700 1 -- 172.21.15.125:0/4166444321 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7640117a0 con 0x7fd7741595c0 2023-10-06T03:04:44.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.574+0000 7fd779381700 1 -- 172.21.15.125:0/4166444321 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7741595c0 msgr2=0x7fd7740ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:44.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.574+0000 7fd779381700 1 --2- 172.21.15.125:0/4166444321 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7741595c0 0x7fd7740ccc30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd764009910 tx=0x7fd7640091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.574+0000 7fd779381700 1 -- 172.21.15.125:0/4166444321 shutdown_connections 2023-10-06T03:04:44.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.574+0000 7fd779381700 1 --2- 172.21.15.125:0/4166444321 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7741595c0 0x7fd7740ccc30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.574+0000 7fd779381700 1 -- 172.21.15.125:0/4166444321 >> 172.21.15.125:0/4166444321 conn(0x7fd77406ed40 msgr2=0x7fd77406f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:44.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.574+0000 7fd779381700 1 -- 172.21.15.125:0/4166444321 shutdown_connections 2023-10-06T03:04:44.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.574+0000 7fd779381700 1 -- 172.21.15.125:0/4166444321 wait complete. 2023-10-06T03:04:44.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.575+0000 7fd779381700 1 Processor -- start 2023-10-06T03:04:44.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.575+0000 7fd779381700 1 -- start start 2023-10-06T03:04:44.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.576+0000 7fd779381700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7740cd170 0x7fd7740c3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:44.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.576+0000 7fd779381700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7741591f0 0x7fd77415c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:44.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.576+0000 7fd779381700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7741595c0 0x7fd774148790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:44.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.576+0000 7fd779381700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77415c990 con 0x7fd7740cd170 2023-10-06T03:04:44.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.576+0000 7fd779381700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7740c4e60 con 0x7fd7741595c0 2023-10-06T03:04:44.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.576+0000 7fd779381700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd774148cd0 con 0x7fd7741591f0 2023-10-06T03:04:44.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.576+0000 7fd772ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7740cd170 0x7fd7740c3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:44.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.576+0000 7fd772ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7740cd170 0x7fd7740c3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54054/0 (socket says 172.21.15.125:54054) 2023-10-06T03:04:44.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.576+0000 7fd772ffd700 1 -- 172.21.15.125:0/1190672652 learned_addr learned my addr 172.21.15.125:0/1190672652 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:44.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.577+0000 7fd7727fc700 1 --2- 172.21.15.125:0/1190672652 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7741591f0 0x7fd77415c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:44.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.577+0000 7fd772ffd700 1 -- 172.21.15.125:0/1190672652 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7741591f0 msgr2=0x7fd77415c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:44.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.577+0000 7fd7737fe700 1 --2- 172.21.15.125:0/1190672652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7741595c0 0x7fd774148790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:44.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.577+0000 7fd772ffd700 1 --2- 172.21.15.125:0/1190672652 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7741591f0 0x7fd77415c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.577+0000 7fd772ffd700 1 -- 172.21.15.125:0/1190672652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7741595c0 msgr2=0x7fd774148790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:44.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.577+0000 7fd772ffd700 1 --2- 172.21.15.125:0/1190672652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7741595c0 0x7fd774148790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.577+0000 7fd772ffd700 1 -- 172.21.15.125:0/1190672652 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd764009420 con 0x7fd7740cd170 2023-10-06T03:04:44.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.577+0000 7fd772ffd700 1 --2- 172.21.15.125:0/1190672652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7740cd170 0x7fd7740c3bc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd76800c860 tx=0x7fd768001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:44.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.577+0000 7fd75affd700 1 -- 172.21.15.125:0/1190672652 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd768007360 con 0x7fd7740cd170 2023-10-06T03:04:44.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.577+0000 7fd75affd700 1 -- 172.21.15.125:0/1190672652 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7680074c0 con 0x7fd7740cd170 2023-10-06T03:04:44.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.577+0000 7fd779381700 1 -- 172.21.15.125:0/1190672652 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7740c4250 con 0x7fd7740cd170 2023-10-06T03:04:44.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.577+0000 7fd75affd700 1 -- 172.21.15.125:0/1190672652 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd768004830 con 0x7fd7740cd170 2023-10-06T03:04:44.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.577+0000 7fd779381700 1 -- 172.21.15.125:0/1190672652 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7740c4810 con 0x7fd7740cd170 2023-10-06T03:04:44.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.578+0000 7fd779381700 1 -- 172.21.15.125:0/1190672652 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd774066510 con 0x7fd7740cd170 2023-10-06T03:04:44.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.578+0000 7fd75affd700 1 -- 172.21.15.125:0/1190672652 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd768004bc0 con 0x7fd7740cd170 2023-10-06T03:04:44.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.579+0000 7fd75affd700 1 --2- 172.21.15.125:0/1190672652 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd760066f30 0x7fd7600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:44.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.579+0000 7fd75affd700 1 -- 172.21.15.125:0/1190672652 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd768084120 con 0x7fd7740cd170 2023-10-06T03:04:44.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.579+0000 7fd7727fc700 1 --2- 172.21.15.125:0/1190672652 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd760066f30 0x7fd7600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:44.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.579+0000 7fd7727fc700 1 --2- 172.21.15.125:0/1190672652 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd760066f30 0x7fd7600693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd764009860 tx=0x7fd764016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:44.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.583+0000 7fd75affd700 1 -- 172.21.15.125:0/1190672652 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd768050f20 con 0x7fd7740cd170 2023-10-06T03:04:44.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.765+0000 7fd779381700 1 -- 172.21.15.125:0/1190672652 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd77415cb70 con 0x7fd7740cd170 2023-10-06T03:04:44.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.766+0000 7fd75affd700 1 -- 172.21.15.125:0/1190672652 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18851 (secure 0 0 0) 0x7fd768054540 con 0x7fd7740cd170 2023-10-06T03:04:44.768 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:44.768 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:33.645139+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:04:26.828121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:04:28.179225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:04:31.256394+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:04:44.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.768+0000 7fd779381700 1 -- 172.21.15.125:0/1190672652 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd760066f30 msgr2=0x7fd7600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:44.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.768+0000 7fd779381700 1 --2- 172.21.15.125:0/1190672652 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd760066f30 0x7fd7600693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd764009860 tx=0x7fd764016000 comp rx=0 tx=0).stop 2023-10-06T03:04:44.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.768+0000 7fd779381700 1 -- 172.21.15.125:0/1190672652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7740cd170 msgr2=0x7fd7740c3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:44.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.768+0000 7fd779381700 1 --2- 172.21.15.125:0/1190672652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7740cd170 0x7fd7740c3bc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd76800c860 tx=0x7fd768001a30 comp rx=0 tx=0).stop 2023-10-06T03:04:44.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.768+0000 7fd779381700 1 -- 172.21.15.125:0/1190672652 shutdown_connections 2023-10-06T03:04:44.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.768+0000 7fd779381700 1 --2- 172.21.15.125:0/1190672652 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd760066f30 0x7fd7600693e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.768+0000 7fd779381700 1 --2- 172.21.15.125:0/1190672652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7741595c0 0x7fd774148790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.768+0000 7fd779381700 1 --2- 172.21.15.125:0/1190672652 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd7740cd170 0x7fd7740c3bc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.768+0000 7fd779381700 1 --2- 172.21.15.125:0/1190672652 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd7741591f0 0x7fd77415c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.768+0000 7fd779381700 1 -- 172.21.15.125:0/1190672652 >> 172.21.15.125:0/1190672652 conn(0x7fd77406ed40 msgr2=0x7fd7740ce850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:44.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.768+0000 7fd779381700 1 -- 172.21.15.125:0/1190672652 shutdown_connections 2023-10-06T03:04:44.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.768+0000 7fd779381700 1 -- 172.21.15.125:0/1190672652 wait complete. 2023-10-06T03:04:44.782 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T03:04:44.782 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T03:04:44.783 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T03:04:44.783 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T03:04:44.784 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T03:04:44.784 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T03:04:44.784 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T03:04:44.785 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T03:04:44.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.987+0000 7f6bf4841700 1 Processor -- start 2023-10-06T03:04:44.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.991+0000 7f198d2fc700 1 Processor -- start 2023-10-06T03:04:44.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.991+0000 7f198d2fc700 1 -- start start 2023-10-06T03:04:44.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.993+0000 7f198d2fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f19880cba50 0x7f19880c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:44.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.993+0000 7f198d2fc700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19880c8150 0x7f19880c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:44.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.993+0000 7f198d2fc700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19880c9470 con 0x7f19880af320 2023-10-06T03:04:44.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.993+0000 7f198d2fc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19880c85d0 con 0x7f19880cba50 2023-10-06T03:04:44.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.993+0000 7f198d2fc700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19880c9b40 con 0x7f19880c8150 2023-10-06T03:04:44.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.993+0000 7f19877fe700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19880c8150 0x7f19880c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:44.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.993+0000 7f19877fe700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19880c8150 0x7f19880c1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:53252/0 (socket says 172.21.15.125:53252) 2023-10-06T03:04:44.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.993+0000 7f19877fe700 1 -- 172.21.15.125:0/1858123556 learned_addr learned my addr 172.21.15.125:0/1858123556 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:44.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.993+0000 7f197e7fc700 1 --2- 172.21.15.125:0/1858123556 >> v2:172.21.15.125:3300/0 conn(0x7f19880cba50 0x7f19880c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:44.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.994+0000 7f197e7fc700 1 -- 172.21.15.125:0/1858123556 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19880c8150 msgr2=0x7f19880c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:44.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.994+0000 7f197e7fc700 1 --2- 172.21.15.125:0/1858123556 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19880c8150 0x7f19880c1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.994+0000 7f197e7fc700 1 -- 172.21.15.125:0/1858123556 >> v1:172.21.15.130:6789/0 conn(0x7f19880af320 legacy=0x7f19880cb340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T03:04:44.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.994+0000 7f197e7fc700 1 -- 172.21.15.125:0/1858123556 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19880c8860 con 0x7f19880cba50 2023-10-06T03:04:44.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.994+0000 7f197e7fc700 1 --2- 172.21.15.125:0/1858123556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880cba50 0x7f19880c7c10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1978009e60 tx=0x7f1978009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf5a7c13fdd4f66 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:44.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.993+0000 7f6bf4841700 1 -- start start 2023-10-06T03:04:44.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.994+0000 7f6bf4841700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6bf013b620 0x7f6bf0159980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:44.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.994+0000 7f6bf4841700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6bf013b9f0 0x7f6bf006e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:44.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.994+0000 7f6bf4841700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6bf006e570 0x7f6bf0155840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:44.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.994+0000 7f6bf4841700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf006ea10 con 0x7f6bf013b9f0 2023-10-06T03:04:44.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.994+0000 7f6bf4841700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf00cb4e0 con 0x7f6bf006e570 2023-10-06T03:04:44.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.994+0000 7f6bf4841700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf01594f0 con 0x7f6bf013b620 2023-10-06T03:04:44.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.994+0000 7f6bedd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6bf013b9f0 0x7f6bf006e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:44.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.995+0000 7f6bedd9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6bf013b9f0 0x7f6bf006e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54080/0 (socket says 172.21.15.125:54080) 2023-10-06T03:04:44.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.995+0000 7f6bedd9b700 1 -- 172.21.15.125:0/4177959638 learned_addr learned my addr 172.21.15.125:0/4177959638 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:44.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.995+0000 7f6bedd9b700 1 -- 172.21.15.125:0/4177959638 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6bf013b620 msgr2=0x7f6bf0159980 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T03:04:44.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.995+0000 7f6bedd9b700 1 --2- 172.21.15.125:0/4177959638 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6bf013b620 0x7f6bf0159980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.995+0000 7f6bedd9b700 1 -- 172.21.15.125:0/4177959638 >> v2:172.21.15.130:3300/0 conn(0x7f6bf006e570 msgr2=0x7f6bf0155840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T03:04:44.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.995+0000 7f6bedd9b700 1 --2- 172.21.15.125:0/4177959638 >> v2:172.21.15.130:3300/0 conn(0x7f6bf006e570 0x7f6bf0155840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.995+0000 7f6bedd9b700 1 -- 172.21.15.125:0/4177959638 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf0158ee0 con 0x7f6bf013b9f0 2023-10-06T03:04:44.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.995+0000 7f6bedd9b700 1 --2- 172.21.15.125:0/4177959638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bf013b9f0 0x7f6bf006e030 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00c7600 tx=0x7f6be0009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c298628c3a9dc85 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:44.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.995+0000 7f6bed59a700 1 -- 172.21.15.125:0/4177959638 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be000c970 con 0x7f6bf013b9f0 2023-10-06T03:04:44.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.995+0000 7f6bed59a700 1 -- 172.21.15.125:0/4177959638 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be000cad0 con 0x7f6bf013b9f0 2023-10-06T03:04:44.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.995+0000 7f6bed59a700 1 -- 172.21.15.125:0/4177959638 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be000ce70 con 0x7f6bf013b9f0 2023-10-06T03:04:44.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.996+0000 7f6bf4841700 1 -- 172.21.15.125:0/4177959638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bf013b9f0 msgr2=0x7f6bf006e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:44.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.996+0000 7f6bf4841700 1 --2- 172.21.15.125:0/4177959638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bf013b9f0 0x7f6bf006e030 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6bf00c7600 tx=0x7f6be0009ae0 comp rx=0 tx=0).stop 2023-10-06T03:04:44.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.997+0000 7f6bf4841700 1 -- 172.21.15.125:0/4177959638 shutdown_connections 2023-10-06T03:04:44.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.997+0000 7f6bf4841700 1 --2- 172.21.15.125:0/4177959638 >> v2:172.21.15.130:3300/0 conn(0x7f6bf006e570 0x7f6bf0155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.997+0000 7f6bf4841700 1 --2- 172.21.15.125:0/4177959638 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6bf013b620 0x7f6bf0159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.997+0000 7f6bf4841700 1 --2- 172.21.15.125:0/4177959638 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bf013b9f0 0x7f6bf006e030 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.997+0000 7f6bf4841700 1 -- 172.21.15.125:0/4177959638 >> 172.21.15.125:0/4177959638 conn(0x7f6bf00cbd30 msgr2=0x7f6bf00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.997+0000 7f6bf4841700 1 -- 172.21.15.125:0/4177959638 shutdown_connections 2023-10-06T03:04:45.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.997+0000 7f6bf4841700 1 -- 172.21.15.125:0/4177959638 wait complete. 2023-10-06T03:04:45.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.994+0000 7f19867fc700 1 -- 172.21.15.125:0/1858123556 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197800bb20 con 0x7f19880cba50 2023-10-06T03:04:45.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.994+0000 7f19867fc700 1 -- 172.21.15.125:0/1858123556 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197800bc80 con 0x7f19880cba50 2023-10-06T03:04:45.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.994+0000 7f19867fc700 1 -- 172.21.15.125:0/1858123556 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978011460 con 0x7f19880cba50 2023-10-06T03:04:45.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.995+0000 7f221c958700 1 Processor -- start 2023-10-06T03:04:45.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.995+0000 7f221c958700 1 -- start start 2023-10-06T03:04:45.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.996+0000 7f221c958700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f22180c7590 0x7f221806e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.996+0000 7f221c958700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f221806e570 0x7f221806b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.996+0000 7f221c958700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2218140a20 con 0x7f2218161c70 2023-10-06T03:04:45.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.996+0000 7f221c958700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221806e9b0 con 0x7f221806e570 2023-10-06T03:04:45.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.996+0000 7f221c958700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22180c7b70 con 0x7f22180c7590 2023-10-06T03:04:45.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.996+0000 7f2216d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f221806e570 0x7f221806b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.996+0000 7f2216d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f221806e570 0x7f221806b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54092/0 (socket says 172.21.15.125:54092) 2023-10-06T03:04:45.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.996+0000 7f2216d9d700 1 -- 172.21.15.125:0/1592743423 learned_addr learned my addr 172.21.15.125:0/1592743423 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.996+0000 7f2215d9b700 1 --2- 172.21.15.125:0/1592743423 >> v2:172.21.15.130:3300/0 conn(0x7f22180c7590 0x7f221806e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.997+0000 7f2216d9d700 1 -- 172.21.15.125:0/1592743423 >> v2:172.21.15.130:3300/0 conn(0x7f22180c7590 msgr2=0x7f221806e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:45.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.997+0000 7f2216d9d700 1 --2- 172.21.15.125:0/1592743423 >> v2:172.21.15.130:3300/0 conn(0x7f22180c7590 0x7f221806e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.997+0000 7f2216d9d700 1 -- 172.21.15.125:0/1592743423 >> v1:172.21.15.130:6789/0 conn(0x7f2218161c70 legacy=0x7f221815e610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:04:45.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.997+0000 7f2216d9d700 1 -- 172.21.15.125:0/1592743423 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22180c7e50 con 0x7f221806e570 2023-10-06T03:04:45.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.997+0000 7f2216d9d700 1 --2- 172.21.15.125:0/1592743423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f221806e570 0x7f221806b6b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f221806dae0 tx=0x7f2210009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ccc8df4dffd9e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.998+0000 7f221559a700 1 -- 172.21.15.125:0/1592743423 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210009ea0 con 0x7f221806e570 2023-10-06T03:04:45.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.998+0000 7f221559a700 1 -- 172.21.15.125:0/1592743423 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221000b7e0 con 0x7f221806e570 2023-10-06T03:04:45.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.998+0000 7f221559a700 1 -- 172.21.15.125:0/1592743423 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221000bb80 con 0x7f221806e570 2023-10-06T03:04:45.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.998+0000 7f198d2fc700 1 -- 172.21.15.125:0/1858123556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880cba50 msgr2=0x7f19880c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.998+0000 7f198d2fc700 1 --2- 172.21.15.125:0/1858123556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880cba50 0x7f19880c7c10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1978009e60 tx=0x7f1978009780 comp rx=0 tx=0).stop 2023-10-06T03:04:45.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.999+0000 7f6bf4841700 1 Processor -- start 2023-10-06T03:04:45.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.999+0000 7f6bf4841700 1 -- start start 2023-10-06T03:04:45.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.999+0000 7f221c958700 1 -- 172.21.15.125:0/1592743423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f221806e570 msgr2=0x7f221806b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.999+0000 7f221c958700 1 --2- 172.21.15.125:0/1592743423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f221806e570 0x7f221806b6b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f221806dae0 tx=0x7f2210009250 comp rx=0 tx=0).stop 2023-10-06T03:04:45.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.999+0000 7f221c958700 1 -- 172.21.15.125:0/1592743423 shutdown_connections 2023-10-06T03:04:45.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.999+0000 7f221c958700 1 --2- 172.21.15.125:0/1592743423 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f221806e570 0x7f221806b6b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.999+0000 7f221c958700 1 --2- 172.21.15.125:0/1592743423 >> v2:172.21.15.130:3300/0 conn(0x7f22180c7590 0x7f221806e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.999+0000 7f221c958700 1 -- 172.21.15.125:0/1592743423 >> 172.21.15.125:0/1592743423 conn(0x7f22180cbd30 msgr2=0x7f22180cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.999+0000 7f221c958700 1 -- 172.21.15.125:0/1592743423 shutdown_connections 2023-10-06T03:04:45.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.999+0000 7f198d2fc700 1 -- 172.21.15.125:0/1858123556 shutdown_connections 2023-10-06T03:04:45.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.999+0000 7f198d2fc700 1 --2- 172.21.15.125:0/1858123556 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19880c8150 0x7f19880c1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.999+0000 7f198d2fc700 1 --2- 172.21.15.125:0/1858123556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880cba50 0x7f19880c7c10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.999+0000 7f198d2fc700 1 -- 172.21.15.125:0/1858123556 >> 172.21.15.125:0/1858123556 conn(0x7f1988096120 msgr2=0x7f1988068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:44.999+0000 7f221c958700 1 -- 172.21.15.125:0/1592743423 wait complete. 2023-10-06T03:04:45.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.000+0000 7f198d2fc700 1 -- 172.21.15.125:0/1858123556 shutdown_connections 2023-10-06T03:04:45.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.000+0000 7f198d2fc700 1 -- 172.21.15.125:0/1858123556 wait complete. 2023-10-06T03:04:45.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.002+0000 7f198d2fc700 1 Processor -- start 2023-10-06T03:04:45.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.002+0000 7f198d2fc700 1 -- start start 2023-10-06T03:04:45.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.000+0000 7f6bf4841700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6bf006e570 0x7f6bf013aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.000+0000 7f6bf4841700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bf013b620 0x7f6bf00b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.000+0000 7f6bf4841700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bf013b9f0 0x7f6bf00b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.000+0000 7f6bf4841700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf013c5f0 con 0x7f6bf013b9f0 2023-10-06T03:04:45.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.000+0000 7f6bf4841700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00b0540 con 0x7f6bf013b620 2023-10-06T03:04:45.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.000+0000 7f6bf4841700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00b1720 con 0x7f6bf006e570 2023-10-06T03:04:45.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.000+0000 7f6bee59c700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6bf006e570 0x7f6bf013aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.000+0000 7f6bedd9b700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bf013b620 0x7f6bf00b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.000+0000 7f6beed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bf013b9f0 0x7f6bf00b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.000+0000 7f6beed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bf013b9f0 0x7f6bf00b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54100/0 (socket says 172.21.15.125:54100) 2023-10-06T03:04:45.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.000+0000 7f6beed9d700 1 -- 172.21.15.125:0/2886200447 learned_addr learned my addr 172.21.15.125:0/2886200447 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.001+0000 7f6beed9d700 1 -- 172.21.15.125:0/2886200447 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6bf006e570 msgr2=0x7f6bf013aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.001+0000 7f6beed9d700 1 --2- 172.21.15.125:0/2886200447 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6bf006e570 0x7f6bf013aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.001+0000 7f6beed9d700 1 -- 172.21.15.125:0/2886200447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bf013b620 msgr2=0x7f6bf00b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.001+0000 7f6beed9d700 1 --2- 172.21.15.125:0/2886200447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bf013b620 0x7f6bf00b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.001+0000 7f6beed9d700 1 -- 172.21.15.125:0/2886200447 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0009d80 con 0x7f6bf013b9f0 2023-10-06T03:04:45.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.001+0000 7f6beed9d700 1 --2- 172.21.15.125:0/2886200447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bf013b9f0 0x7f6bf00b1130 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6be800bbb0 tx=0x7f6be8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.001+0000 7f6bde7fc700 1 -- 172.21.15.125:0/2886200447 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be800c630 con 0x7f6bf013b9f0 2023-10-06T03:04:45.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.002+0000 7f6bde7fc700 1 -- 172.21.15.125:0/2886200447 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be800c7b0 con 0x7f6bf013b9f0 2023-10-06T03:04:45.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.002+0000 7f6bde7fc700 1 -- 172.21.15.125:0/2886200447 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be800cb70 con 0x7f6bf013b9f0 2023-10-06T03:04:45.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.001+0000 7f220dae3700 1 Processor -- start 2023-10-06T03:04:45.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.001+0000 7f221c958700 1 Processor -- start 2023-10-06T03:04:45.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.001+0000 7f221c958700 1 -- start start 2023-10-06T03:04:45.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.002+0000 7f221c958700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f221806e570 0x7f2218154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.002+0000 7f221c958700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22180c7590 0x7f22180c3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.002+0000 7f221c958700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2218161c70 0x7f22180c3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.002+0000 7f221c958700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22180c7140 con 0x7f22180c7590 2023-10-06T03:04:45.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.002+0000 7f221c958700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22180c6810 con 0x7f221806e570 2023-10-06T03:04:45.009 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.002+0000 7f221c958700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22180c6af0 con 0x7f2218161c70 2023-10-06T03:04:45.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f1a6db55700 1 Processor -- start 2023-10-06T03:04:45.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f198d2fc700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19880af320 0x7f1988152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f198d2fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880c8150 0x7f19880b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f198d2fc700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19880cba50 0x7f19880b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f198d2fc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19880b1e00 con 0x7f19880c8150 2023-10-06T03:04:45.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f198d2fc700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1988153000 con 0x7f19880af320 2023-10-06T03:04:45.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f198d2fc700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1988158a50 con 0x7f19880cba50 2023-10-06T03:04:45.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f6bf4841700 1 -- 172.21.15.125:0/2886200447 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf013bfa0 con 0x7f6bf013b9f0 2023-10-06T03:04:45.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f6bf4841700 1 -- 172.21.15.125:0/2886200447 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf013ca60 con 0x7f6bf013b9f0 2023-10-06T03:04:45.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.001+0000 7f220dae3700 1 -- start start 2023-10-06T03:04:45.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f220dae3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f220813b620 0x7f2208159980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f220dae3700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f220813b9f0 0x7f220806e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f220dae3700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f220806e570 0x7f2208155840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f220dae3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f220806ea10 con 0x7f220813b620 2023-10-06T03:04:45.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f220dae3700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22080cb4e0 con 0x7f220806e570 2023-10-06T03:04:45.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f220dae3700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22081594f0 con 0x7f220813b9f0 2023-10-06T03:04:45.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f2215d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22180c7590 0x7f22180c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f2215d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22180c7590 0x7f22180c3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54116/0 (socket says 172.21.15.125:54116) 2023-10-06T03:04:45.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f2215d9b700 1 -- 172.21.15.125:0/2191931936 learned_addr learned my addr 172.21.15.125:0/2191931936 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f1986ffd700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19880af320 0x7f1988152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f1986ffd700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19880af320 0x7f1988152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:40622/0 (socket says 172.21.15.125:40622) 2023-10-06T03:04:45.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f1986ffd700 1 -- 172.21.15.125:0/4027564860 learned_addr learned my addr 172.21.15.125:0/4027564860 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f2215d9b700 1 -- 172.21.15.125:0/2191931936 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2218161c70 msgr2=0x7f22180c3860 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:04:45.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f2215d9b700 1 --2- 172.21.15.125:0/2191931936 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2218161c70 0x7f22180c3860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f2215d9b700 1 -- 172.21.15.125:0/2191931936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f221806e570 msgr2=0x7f2218154390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:04:45.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f2215d9b700 1 --2- 172.21.15.125:0/2191931936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f221806e570 0x7f2218154390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f2215d9b700 1 -- 172.21.15.125:0/2191931936 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22100094f0 con 0x7f22180c7590 2023-10-06T03:04:45.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.004+0000 7f2215d9b700 1 --2- 172.21.15.125:0/2191931936 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22180c7590 0x7f22180c3320 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f220c00ec80 tx=0x7f220c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.004+0000 7f1986ffd700 1 -- 172.21.15.125:0/4027564860 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19880cba50 msgr2=0x7f19880b0b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:04:45.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.004+0000 7f1986ffd700 1 --2- 172.21.15.125:0/4027564860 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f19880cba50 0x7f19880b0b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.004+0000 7f1986ffd700 1 -- 172.21.15.125:0/4027564860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880c8150 msgr2=0x7f19880b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.004+0000 7f1986ffd700 1 --2- 172.21.15.125:0/4027564860 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f19880c8150 0x7f19880b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.004+0000 7f1986ffd700 1 -- 172.21.15.125:0/4027564860 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1978009a20 con 0x7f19880af320 2023-10-06T03:04:45.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.004+0000 7f22067fc700 1 -- 172.21.15.125:0/2191931936 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c00c9d0 con 0x7f22180c7590 2023-10-06T03:04:45.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.004+0000 7f22067fc700 1 -- 172.21.15.125:0/2191931936 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220c00cb30 con 0x7f22180c7590 2023-10-06T03:04:45.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.004+0000 7f22067fc700 1 -- 172.21.15.125:0/2191931936 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c013470 con 0x7f22180c7590 2023-10-06T03:04:45.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.004+0000 7f221c958700 1 -- 172.21.15.125:0/2191931936 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22180c6dd0 con 0x7f22180c7590 2023-10-06T03:04:45.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f1a6db55700 1 -- start start 2023-10-06T03:04:45.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.004+0000 7f1a6db55700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a681558e0 0x7f1a680cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.004+0000 7f1a6db55700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1a680ca440 0x7f1a680ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.004+0000 7f1a6db55700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a680c1d50 con 0x7f1a68155cb0 2023-10-06T03:04:45.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.004+0000 7f1a6db55700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a680ca1b0 con 0x7f1a680ca440 2023-10-06T03:04:45.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.004+0000 7f1a6db55700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a680c1740 con 0x7f1a681558e0 2023-10-06T03:04:45.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.004+0000 7f221c958700 1 -- 172.21.15.125:0/2191931936 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2218154a90 con 0x7f22180c7590 2023-10-06T03:04:45.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.004+0000 7f1986ffd700 1 --2- 172.21.15.125:0/4027564860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19880af320 0x7f1988152ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f197000b7e0 tx=0x7f19700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.005+0000 7f1a67fff700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1a680ca440 0x7f1a680ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.005+0000 7f1a677fe700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a681558e0 0x7f1a680cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.005+0000 7f1a677fe700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a681558e0 0x7f1a680cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:53296/0 (socket says 172.21.15.125:53296) 2023-10-06T03:04:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.005+0000 7f1a677fe700 1 -- 172.21.15.125:0/40851081 learned_addr learned my addr 172.21.15.125:0/40851081 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.005+0000 7f1a67fff700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1a680ca440 0x7f1a680ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:40630/0 (socket says 172.21.15.125:40630) 2023-10-06T03:04:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.005+0000 7f1a677fe700 1 -- 172.21.15.125:0/40851081 >> v2:172.21.15.130:3300/0 conn(0x7f1a680ca440 msgr2=0x7f1a680ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.005+0000 7f1a677fe700 1 --2- 172.21.15.125:0/40851081 >> v2:172.21.15.130:3300/0 conn(0x7f1a680ca440 0x7f1a680ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.005+0000 7f1a677fe700 1 -- 172.21.15.125:0/40851081 >> v1:172.21.15.125:6789/0 conn(0x7f1a68155cb0 legacy=0x7f1a681595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.005+0000 7f1a677fe700 1 -- 172.21.15.125:0/40851081 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a680c9ed0 con 0x7f1a681558e0 2023-10-06T03:04:45.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.005+0000 7f1a677fe700 1 --2- 172.21.15.125:0/40851081 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a681558e0 0x7f1a680cc870 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1a6000b040 tx=0x7f1a6000c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dad600ba443f165f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.006+0000 7f197f7fe700 1 -- 172.21.15.125:0/4027564860 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197000f510 con 0x7f19880af320 2023-10-06T03:04:45.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.006+0000 7f6bde7fc700 1 -- 172.21.15.125:0/2886200447 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6be8012070 con 0x7f6bf013b9f0 2023-10-06T03:04:45.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.006+0000 7f6bde7fc700 1 --2- 172.21.15.125:0/2886200447 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6bd0089090 0x7f6bd008b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.006+0000 7f6bde7fc700 1 -- 172.21.15.125:0/2886200447 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f6be8084620 con 0x7f6bf013b9f0 2023-10-06T03:04:45.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.006+0000 7f197f7fe700 1 -- 172.21.15.125:0/4027564860 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197000f690 con 0x7f19880af320 2023-10-06T03:04:45.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.006+0000 7f197f7fe700 1 -- 172.21.15.125:0/4027564860 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197000fa50 con 0x7f19880af320 2023-10-06T03:04:45.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.006+0000 7f198d2fc700 1 -- 172.21.15.125:0/4027564860 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19880b11f0 con 0x7f19880af320 2023-10-06T03:04:45.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.006+0000 7f198d2fc700 1 -- 172.21.15.125:0/4027564860 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19880b17b0 con 0x7f19880af320 2023-10-06T03:04:45.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.007+0000 7f6bee59c700 1 --2- 172.21.15.125:0/2886200447 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6bd0089090 0x7f6bd008b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.007+0000 7f22067fc700 1 -- 172.21.15.125:0/2191931936 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f220c013820 con 0x7f22180c7590 2023-10-06T03:04:45.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.007+0000 7f221c958700 1 -- 172.21.15.125:0/2191931936 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2218066510 con 0x7f22180c7590 2023-10-06T03:04:45.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.007+0000 7f22067fc700 1 --2- 172.21.15.125:0/2191931936 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f21f8067080 0x7f21f8069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.007+0000 7f6bee59c700 1 --2- 172.21.15.125:0/2886200447 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6bd0089090 0x7f6bd008b540 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6be4006fd0 tx=0x7f6be40090f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.005+0000 7f1a667fc700 1 -- 172.21.15.125:0/40851081 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6000a2e0 con 0x7f1a681558e0 2023-10-06T03:04:45.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.005+0000 7f1a667fc700 1 -- 172.21.15.125:0/40851081 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6000ba60 con 0x7f1a681558e0 2023-10-06T03:04:45.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.005+0000 7f1a667fc700 1 -- 172.21.15.125:0/40851081 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6000be00 con 0x7f1a681558e0 2023-10-06T03:04:45.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.006+0000 7f1a6db55700 1 -- 172.21.15.125:0/40851081 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a681558e0 msgr2=0x7f1a680cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.006+0000 7f1a6db55700 1 --2- 172.21.15.125:0/40851081 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a681558e0 0x7f1a680cc870 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1a6000b040 tx=0x7f1a6000c040 comp rx=0 tx=0).stop 2023-10-06T03:04:45.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.007+0000 7f22067fc700 1 -- 172.21.15.125:0/2191931936 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f220c084c20 con 0x7f22180c7590 2023-10-06T03:04:45.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.007+0000 7f22067fc700 1 --2- 172.21.15.125:0/2191931936 >> [v2:172.21.15.130:6816/119973,v1:172.21.15.130:6817/119973] conn(0x7f21f8070cd0 0x7f21f8073100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.007+0000 7f22067fc700 1 -- 172.21.15.125:0/2191931936 --> [v2:172.21.15.130:6816/119973,v1:172.21.15.130:6817/119973] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f21f80737d0 con 0x7f21f8070cd0 2023-10-06T03:04:45.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f2206ffd700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f220813b9f0 0x7f220806e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f2206ffd700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f220813b9f0 0x7f220806e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:53276/0 (socket says 172.21.15.125:53276) 2023-10-06T03:04:45.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f2206ffd700 1 -- 172.21.15.125:0/1702584466 learned_addr learned my addr 172.21.15.125:0/1702584466 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f2206ffd700 1 -- 172.21.15.125:0/1702584466 >> v2:172.21.15.130:3300/0 conn(0x7f220806e570 msgr2=0x7f2208155840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T03:04:45.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f2206ffd700 1 --2- 172.21.15.125:0/1702584466 >> v2:172.21.15.130:3300/0 conn(0x7f220806e570 0x7f2208155840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f2206ffd700 1 -- 172.21.15.125:0/1702584466 >> v2:172.21.15.125:3300/0 conn(0x7f220813b620 msgr2=0x7f2208159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:45.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.003+0000 7f2206ffd700 1 --2- 172.21.15.125:0/1702584466 >> v2:172.21.15.125:3300/0 conn(0x7f220813b620 0x7f2208159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.004+0000 7f2206ffd700 1 -- 172.21.15.125:0/1702584466 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2208158ee0 con 0x7f220813b9f0 2023-10-06T03:04:45.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.004+0000 7f2206ffd700 1 --2- 172.21.15.125:0/1702584466 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f220813b9f0 0x7f220806e030 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f22080c7600 tx=0x7f21fc00a2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8d7846e17134c2d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.007+0000 7f22067fc700 1 -- 172.21.15.125:0/1702584466 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc00ad70 con 0x7f220813b9f0 2023-10-06T03:04:45.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.007+0000 7f22067fc700 1 -- 172.21.15.125:0/1702584466 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc009c20 con 0x7f220813b9f0 2023-10-06T03:04:45.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.007+0000 7f2216d9d700 1 --2- 172.21.15.125:0/2191931936 >> [v2:172.21.15.130:6816/119973,v1:172.21.15.130:6817/119973] conn(0x7f21f8070cd0 0x7f21f8073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.007+0000 7f22067fc700 1 -- 172.21.15.125:0/2191931936 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f220c051a20 con 0x7f22180c7590 2023-10-06T03:04:45.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.008+0000 7f2216d9d700 1 --2- 172.21.15.125:0/2191931936 >> [v2:172.21.15.130:6816/119973,v1:172.21.15.130:6817/119973] conn(0x7f21f8070cd0 0x7f21f8073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.008+0000 7f221659c700 1 --2- 172.21.15.125:0/2191931936 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f21f8067080 0x7f21f8069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f221659c700 1 --2- 172.21.15.125:0/2191931936 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f21f8067080 0x7f21f8069530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f220800acf0 tx=0x7f2208009350 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7fb1b42ad700 1 Processor -- start 2023-10-06T03:04:45.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f1a6db55700 1 -- 172.21.15.125:0/40851081 shutdown_connections 2023-10-06T03:04:45.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f1a6db55700 1 --2- 172.21.15.125:0/40851081 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a681558e0 0x7f1a680cc870 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f1a6db55700 1 --2- 172.21.15.125:0/40851081 >> v2:172.21.15.130:3300/0 conn(0x7f1a680ca440 0x7f1a680ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f1a6db55700 1 -- 172.21.15.125:0/40851081 >> 172.21.15.125:0/40851081 conn(0x7f1a680af730 msgr2=0x7f1a680afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.008+0000 7f197f7fe700 1 -- 172.21.15.125:0/4027564860 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f197001a400 con 0x7f19880af320 2023-10-06T03:04:45.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f198d2fc700 1 -- 172.21.15.125:0/4027564860 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1988066510 con 0x7f19880af320 2023-10-06T03:04:45.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f197f7fe700 1 --2- 172.21.15.125:0/4027564860 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1968067000 0x7f19680694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f197f7fe700 1 -- 172.21.15.125:0/4027564860 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1970084410 con 0x7f19880af320 2023-10-06T03:04:45.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f197e7fc700 1 --2- 172.21.15.125:0/4027564860 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1968067000 0x7f19680694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f197f7fe700 1 --2- 172.21.15.125:0/4027564860 >> [v2:172.21.15.125:6800/119697,v1:172.21.15.125:6801/119697] conn(0x7f1968070c40 0x7f1968073070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f197f7fe700 1 -- 172.21.15.125:0/4027564860 --> [v2:172.21.15.125:6800/119697,v1:172.21.15.125:6801/119697] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1968073740 con 0x7f1968070c40 2023-10-06T03:04:45.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f6bf4841700 1 --2- 172.21.15.125:0/2886200447 >> [v2:172.21.15.125:6803/119699,v1:172.21.15.125:6807/119699] conn(0x7f6bf0154b60 0x7f6bf0154f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f6bf4841700 1 -- 172.21.15.125:0/2886200447 --> [v2:172.21.15.125:6803/119699,v1:172.21.15.125:6807/119699] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6bf013bdc0 con 0x7f6bf0154b60 2023-10-06T03:04:45.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f6bedd9b700 1 --2- 172.21.15.125:0/2886200447 >> [v2:172.21.15.125:6803/119699,v1:172.21.15.125:6807/119699] conn(0x7f6bf0154b60 0x7f6bf0154f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f22067fc700 1 -- 172.21.15.125:0/2191931936 <== osd.4 v2:172.21.15.130:6816/119973 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f21f80737d0 con 0x7f21f8070cd0 2023-10-06T03:04:45.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f1a6db55700 1 -- 172.21.15.125:0/40851081 shutdown_connections 2023-10-06T03:04:45.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f46f50cf700 1 Processor -- start 2023-10-06T03:04:45.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f19877fe700 1 --2- 172.21.15.125:0/4027564860 >> [v2:172.21.15.125:6800/119697,v1:172.21.15.125:6801/119697] conn(0x7f1968070c40 0x7f1968073070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f46f50cf700 1 -- start start 2023-10-06T03:04:45.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f197f7fe700 1 -- 172.21.15.125:0/4027564860 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1970054d20 con 0x7f19880af320 2023-10-06T03:04:45.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f6bedd9b700 1 --2- 172.21.15.125:0/2886200447 >> [v2:172.21.15.125:6803/119699,v1:172.21.15.125:6807/119699] conn(0x7f6bf0154b60 0x7f6bf0154f30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.010+0000 7f46f50cf700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46f0154930 0x7f46f006ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.010+0000 7f46f50cf700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f46f0154d00 0x7f46f006e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.010+0000 7f46f50cf700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46f01584d0 con 0x7f46f006e570 2023-10-06T03:04:45.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.010+0000 7f46f50cf700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46f006ea10 con 0x7f46f0154d00 2023-10-06T03:04:45.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.010+0000 7f46f50cf700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f01581f0 con 0x7f46f0154930 2023-10-06T03:04:45.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.010+0000 7f46eed9d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46f0154930 0x7f46f006ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.010+0000 7f46eed9d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46f0154930 0x7f46f006ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:53306/0 (socket says 172.21.15.125:53306) 2023-10-06T03:04:45.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.010+0000 7f46ef59e700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f46f006e570 0x7f46f0157530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:37608/0 (socket says 172.21.15.125:37608) 2023-10-06T03:04:45.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.010+0000 7f46eed9d700 1 -- 172.21.15.125:0/2996537299 learned_addr learned my addr 172.21.15.125:0/2996537299 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.011+0000 7f46eed9d700 1 -- 172.21.15.125:0/2996537299 >> v2:172.21.15.130:3300/0 conn(0x7f46f0154d00 msgr2=0x7f46f006e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:45.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.011+0000 7f46eed9d700 1 --2- 172.21.15.125:0/2996537299 >> v2:172.21.15.130:3300/0 conn(0x7f46f0154d00 0x7f46f006e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.011+0000 7f46eed9d700 1 -- 172.21.15.125:0/2996537299 >> v1:172.21.15.130:6789/0 conn(0x7f46f006e570 legacy=0x7f46f0157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.011+0000 7f46eed9d700 1 -- 172.21.15.125:0/2996537299 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46f006a150 con 0x7f46f0154930 2023-10-06T03:04:45.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.011+0000 7f46edd9b700 1 -- 172.21.15.125:0/2996537299 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2379031424 0 0) 0x7f46f01584d0 con 0x7f46f006e570 2023-10-06T03:04:45.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.011+0000 7f46eed9d700 1 --2- 172.21.15.125:0/2996537299 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46f0154930 0x7f46f006ac30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f46e00099b0 tx=0x7f46e0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6567c1fae842f22b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.011+0000 7f46edd9b700 1 -- 172.21.15.125:0/2996537299 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e000b860 con 0x7f46f0154930 2023-10-06T03:04:45.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.010+0000 7f22067fc700 1 -- 172.21.15.125:0/1702584466 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc009fc0 con 0x7f220813b9f0 2023-10-06T03:04:45.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.011+0000 7f220dae3700 1 -- 172.21.15.125:0/1702584466 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f220813b9f0 msgr2=0x7f220806e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.011+0000 7f220dae3700 1 --2- 172.21.15.125:0/1702584466 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f220813b9f0 0x7f220806e030 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f22080c7600 tx=0x7f21fc00a2f0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.009+0000 7f1a6db55700 1 -- 172.21.15.125:0/40851081 wait complete. 2023-10-06T03:04:45.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.011+0000 7f220dae3700 1 -- 172.21.15.125:0/1702584466 shutdown_connections 2023-10-06T03:04:45.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.011+0000 7f220dae3700 1 --2- 172.21.15.125:0/1702584466 >> v2:172.21.15.130:3300/0 conn(0x7f220806e570 0x7f2208155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.011+0000 7f1a6db55700 1 Processor -- start 2023-10-06T03:04:45.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.011+0000 7f220dae3700 1 --2- 172.21.15.125:0/1702584466 >> v2:172.21.15.125:3300/0 conn(0x7f220813b620 0x7f2208159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.011+0000 7f220dae3700 1 --2- 172.21.15.125:0/1702584466 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f220813b9f0 0x7f220806e030 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.011+0000 7f220dae3700 1 -- 172.21.15.125:0/1702584466 >> 172.21.15.125:0/1702584466 conn(0x7f22080cbd30 msgr2=0x7f22080cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.011+0000 7f6bde7fc700 1 -- 172.21.15.125:0/2886200447 <== osd.2 v2:172.21.15.125:6803/119699 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6bf013bdc0 con 0x7f6bf0154b60 2023-10-06T03:04:45.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.011+0000 7f220dae3700 1 -- 172.21.15.125:0/1702584466 shutdown_connections 2023-10-06T03:04:45.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.011+0000 7f1a6db55700 1 -- start start 2023-10-06T03:04:45.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.011+0000 7f220dae3700 1 -- 172.21.15.125:0/1702584466 wait complete. 2023-10-06T03:04:45.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.013+0000 7f220dae3700 1 Processor -- start 2023-10-06T03:04:45.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.013+0000 7f220dae3700 1 -- start start 2023-10-06T03:04:45.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.013+0000 7f1a6db55700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a680ca440 0x7f1a68147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.013+0000 7f1a6db55700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a681558e0 0x7f1a68144530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.013+0000 7f1a6db55700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a68145d70 0x7f1a681580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.013+0000 7f1a6db55700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a68148520 con 0x7f1a681558e0 2023-10-06T03:04:45.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.013+0000 7f1a6db55700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6816e0d0 con 0x7f1a68145d70 2023-10-06T03:04:45.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.013+0000 7f1a6db55700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a68144a70 con 0x7f1a680ca440 2023-10-06T03:04:45.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.013+0000 7f1a66ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a681558e0 0x7f1a68144530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.013+0000 7f1a66ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a681558e0 0x7f1a68144530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54148/0 (socket says 172.21.15.125:54148) 2023-10-06T03:04:45.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.013+0000 7f1a66ffd700 1 -- 172.21.15.125:0/3671788496 learned_addr learned my addr 172.21.15.125:0/3671788496 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.013+0000 7f1a677fe700 1 --2- 172.21.15.125:0/3671788496 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a680ca440 0x7f1a68147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.013+0000 7f1a66ffd700 1 -- 172.21.15.125:0/3671788496 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a680ca440 msgr2=0x7f1a68147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.013+0000 7f1a66ffd700 1 --2- 172.21.15.125:0/3671788496 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1a680ca440 0x7f1a68147fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.013+0000 7f1a66ffd700 1 -- 172.21.15.125:0/3671788496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a68145d70 msgr2=0x7f1a681580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.013+0000 7f1a66ffd700 1 --2- 172.21.15.125:0/3671788496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a68145d70 0x7f1a681580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.013+0000 7f1a66ffd700 1 -- 172.21.15.125:0/3671788496 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6000aaf0 con 0x7f1a681558e0 2023-10-06T03:04:45.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.013+0000 7f19877fe700 1 --2- 172.21.15.125:0/4027564860 >> [v2:172.21.15.125:6800/119697,v1:172.21.15.125:6801/119697] conn(0x7f1968070c40 0x7f1968073070 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.014+0000 7f1a66ffd700 1 --2- 172.21.15.125:0/3671788496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a681558e0 0x7f1a68144530 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00b5e0 tx=0x7f1a5c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.014+0000 7f1a577fe700 1 -- 172.21.15.125:0/3671788496 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c00f510 con 0x7f1a681558e0 2023-10-06T03:04:45.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.014+0000 7f1a577fe700 1 -- 172.21.15.125:0/3671788496 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c00f690 con 0x7f1a681558e0 2023-10-06T03:04:45.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.014+0000 7f1a577fe700 1 -- 172.21.15.125:0/3671788496 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c00fa50 con 0x7f1a681558e0 2023-10-06T03:04:45.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7f220dae3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f220806e570 0x7f2208175cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7f220dae3700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f220813b620 0x7f22080b0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7f197f7fe700 1 -- 172.21.15.125:0/4027564860 <== osd.1 v2:172.21.15.125:6800/119697 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1968073740 con 0x7f1968070c40 2023-10-06T03:04:45.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7f220dae3700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f220813b9f0 0x7f22081500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7f220dae3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2208125200 con 0x7f220806e570 2023-10-06T03:04:45.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7f220dae3700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22080b0f90 con 0x7f220813b620 2023-10-06T03:04:45.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7f220dae3700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22080b1270 con 0x7f220813b9f0 2023-10-06T03:04:45.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.014+0000 7fb1b42ad700 1 -- start start 2023-10-06T03:04:45.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7fb1b42ad700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb1ac0cc840 0x7fb1ac159980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7fb1b42ad700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1ac06e740 0x7fb1ac155840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7fb1b42ad700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac0cb4e0 con 0x7fb1ac13b620 2023-10-06T03:04:45.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7fb1b42ad700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ac1594f0 con 0x7fb1ac0cc840 2023-10-06T03:04:45.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7fb1b42ad700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac158ee0 con 0x7fb1ac06e740 2023-10-06T03:04:45.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7fb1b2049700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb1ac0cc840 0x7fb1ac159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7fb1b2049700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb1ac0cc840 0x7fb1ac159980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:40668/0 (socket says 172.21.15.125:40668) 2023-10-06T03:04:45.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7fb1b2049700 1 -- 172.21.15.125:0/2745096200 learned_addr learned my addr 172.21.15.125:0/2745096200 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.016+0000 7fb1b284a700 1 --2- 172.21.15.125:0/2745096200 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1ac06e740 0x7fb1ac155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7f1a6db55700 1 -- 172.21.15.125:0/3671788496 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a681461e0 con 0x7f1a681558e0 2023-10-06T03:04:45.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7f1a6db55700 1 -- 172.21.15.125:0/3671788496 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a681467a0 con 0x7f1a681558e0 2023-10-06T03:04:45.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.016+0000 7fb1b2049700 1 -- 172.21.15.125:0/2745096200 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1ac06e740 msgr2=0x7fb1ac155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:45.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.016+0000 7fb1b2049700 1 --2- 172.21.15.125:0/2745096200 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1ac06e740 0x7fb1ac155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.016+0000 7fb1b2049700 1 -- 172.21.15.125:0/2745096200 >> v1:172.21.15.130:6789/0 conn(0x7fb1ac13b620 legacy=0x7fb1ac06e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.016+0000 7fb1b2049700 1 -- 172.21.15.125:0/2745096200 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac156490 con 0x7fb1ac0cc840 2023-10-06T03:04:45.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.016+0000 7f1a6db55700 1 -- 172.21.15.125:0/3671788496 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a68066510 con 0x7f1a681558e0 2023-10-06T03:04:45.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.016+0000 7fb1b2049700 1 --2- 172.21.15.125:0/2745096200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1ac0cc840 0x7fb1ac159980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80099b0 tx=0x7fb1a8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d8b9f2dfcd0ed41 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.017+0000 7fb1b1047700 1 -- 172.21.15.125:0/2745096200 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a800b760 con 0x7fb1ac0cc840 2023-10-06T03:04:45.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.017+0000 7fb1b1047700 1 -- 172.21.15.125:0/2745096200 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a800b8c0 con 0x7fb1ac0cc840 2023-10-06T03:04:45.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.017+0000 7fb1b1047700 1 -- 172.21.15.125:0/2745096200 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a800bc60 con 0x7fb1ac0cc840 2023-10-06T03:04:45.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.017+0000 7f197e7fc700 1 --2- 172.21.15.125:0/4027564860 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1968067000 0x7f19680694b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1978009e60 tx=0x7f197801a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.018+0000 7fb1b42ad700 1 -- 172.21.15.125:0/2745096200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1ac0cc840 msgr2=0x7fb1ac159980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.018+0000 7fb1b42ad700 1 --2- 172.21.15.125:0/2745096200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1ac0cc840 0x7fb1ac159980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80099b0 tx=0x7fb1a8009250 comp rx=0 tx=0).stop 2023-10-06T03:04:45.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.018+0000 7fb1b42ad700 1 -- 172.21.15.125:0/2745096200 shutdown_connections 2023-10-06T03:04:45.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.018+0000 7fb1b42ad700 1 --2- 172.21.15.125:0/2745096200 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1ac06e740 0x7fb1ac155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.018+0000 7fb1b42ad700 1 --2- 172.21.15.125:0/2745096200 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1ac0cc840 0x7fb1ac159980 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.018+0000 7fb1b42ad700 1 -- 172.21.15.125:0/2745096200 >> 172.21.15.125:0/2745096200 conn(0x7fb1ac0cbd30 msgr2=0x7fb1ac0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.018+0000 7fb1b42ad700 1 -- 172.21.15.125:0/2745096200 shutdown_connections 2023-10-06T03:04:45.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.018+0000 7f1db8968700 1 Processor -- start 2023-10-06T03:04:45.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.018+0000 7f1db8968700 1 -- start start 2023-10-06T03:04:45.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.020+0000 7f1db8968700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1db40cba50 0x7f1db40c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.020+0000 7f1db8968700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db40c9470 con 0x7f1db40af320 2023-10-06T03:04:45.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.020+0000 7f1db8968700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db40c9b40 con 0x7f1db40c8150 2023-10-06T03:04:45.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.020+0000 7f1db8968700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db40c85a0 con 0x7f1db40cba50 2023-10-06T03:04:45.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.018+0000 7fb1b42ad700 1 -- 172.21.15.125:0/2745096200 wait complete. 2023-10-06T03:04:45.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.020+0000 7fb1b42ad700 1 Processor -- start 2023-10-06T03:04:45.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.020+0000 7f1db2d9d700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f1db40c8150 0x7f1db40c1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:37620/0 (socket says 172.21.15.125:37620) 2023-10-06T03:04:45.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.020+0000 7f1db2d9d700 1 -- 172.21.15.125:0/1195981302 learned_addr learned my addr 172.21.15.125:0/1195981302 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:45.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.020+0000 7f1db1d9b700 1 --2- 172.21.15.125:0/1195981302 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1db40cba50 0x7f1db40c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.020+0000 7f1db159a700 1 -- 172.21.15.125:0/1195981302 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3506261025 0 0) 0x7f1db40c9b40 con 0x7f1db40c8150 2023-10-06T03:04:45.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.020+0000 7f1db159a700 1 -- 172.21.15.125:0/1195981302 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d9c003570 con 0x7f1db40c8150 2023-10-06T03:04:45.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.020+0000 7f1db1d9b700 1 -- 172.21.15.125:0/1195981302 >> v1:172.21.15.130:6789/0 conn(0x7f1db40c8150 legacy=0x7f1db40c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.020+0000 7f1db1d9b700 1 -- 172.21.15.125:0/1195981302 >> v1:172.21.15.125:6789/0 conn(0x7f1db40af320 legacy=0x7f1db40cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:45.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.020+0000 7f1db1d9b700 1 -- 172.21.15.125:0/1195981302 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db40c8860 con 0x7f1db40cba50 2023-10-06T03:04:45.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.020+0000 7fb1b42ad700 1 -- start start 2023-10-06T03:04:45.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.021+0000 7f1db1d9b700 1 --2- 172.21.15.125:0/1195981302 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1db40cba50 0x7f1db40c7c10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1da8009910 tx=0x7f1da80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a456cd32ec1adddb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.021+0000 7f1db159a700 1 -- 172.21.15.125:0/1195981302 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da800b640 con 0x7f1db40cba50 2023-10-06T03:04:45.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.021+0000 7f1db159a700 1 -- 172.21.15.125:0/1195981302 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da800b7a0 con 0x7f1db40cba50 2023-10-06T03:04:45.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.021+0000 7f1db159a700 1 -- 172.21.15.125:0/1195981302 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da800bb60 con 0x7f1db40cba50 2023-10-06T03:04:45.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.021+0000 7fb1b42ad700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1ac06e740 0x7fb1ac144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.021+0000 7fb1b42ad700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1ac0cc840 0x7fb1ac0af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.021+0000 7fb1b42ad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1ac13b620 0x7fb1ac149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.021+0000 7fb1b42ad700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac0b18d0 con 0x7fb1ac13b620 2023-10-06T03:04:45.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.021+0000 7fb1b42ad700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac14c700 con 0x7fb1ac06e740 2023-10-06T03:04:45.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.021+0000 7fb1b42ad700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac14baf0 con 0x7fb1ac0cc840 2023-10-06T03:04:45.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.021+0000 7fb1b2049700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1ac06e740 0x7fb1ac144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.021+0000 7fb1b2049700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1ac06e740 0x7fb1ac144bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:40676/0 (socket says 172.21.15.125:40676) 2023-10-06T03:04:45.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.021+0000 7fb1b2049700 1 -- 172.21.15.125:0/2413190594 learned_addr learned my addr 172.21.15.125:0/2413190594 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.021+0000 7fb1b1848700 1 --2- 172.21.15.125:0/2413190594 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1ac0cc840 0x7fb1ac0af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.021+0000 7fb1b2049700 1 -- 172.21.15.125:0/2413190594 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1ac0cc840 msgr2=0x7fb1ac0af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.021+0000 7fb1b2049700 1 --2- 172.21.15.125:0/2413190594 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1ac0cc840 0x7fb1ac0af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.021+0000 7fb1b2049700 1 -- 172.21.15.125:0/2413190594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1ac13b620 msgr2=0x7fb1ac149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.021+0000 7fb1b2049700 1 --2- 172.21.15.125:0/2413190594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1ac13b620 0x7fb1ac149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.021+0000 7fb1b2049700 1 -- 172.21.15.125:0/2413190594 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a80094f0 con 0x7fb1ac06e740 2023-10-06T03:04:45.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.022+0000 7f1db8968700 1 -- 172.21.15.125:0/1195981302 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1db40cba50 msgr2=0x7f1db40c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.022+0000 7f1db8968700 1 --2- 172.21.15.125:0/1195981302 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1db40cba50 0x7f1db40c7c10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1da8009910 tx=0x7f1da80091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.022+0000 7fb1b2049700 1 --2- 172.21.15.125:0/2413190594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1ac06e740 0x7fb1ac144bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009290 tx=0x7fb1a8016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.022+0000 7f1db8968700 1 -- 172.21.15.125:0/1195981302 shutdown_connections 2023-10-06T03:04:45.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.022+0000 7f1db8968700 1 --2- 172.21.15.125:0/1195981302 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1db40cba50 0x7f1db40c7c10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.022+0000 7f1db8968700 1 -- 172.21.15.125:0/1195981302 >> 172.21.15.125:0/1195981302 conn(0x7f1db4096120 msgr2=0x7f1db4068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.022+0000 7f1db8968700 1 -- 172.21.15.125:0/1195981302 shutdown_connections 2023-10-06T03:04:45.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.022+0000 7f1db8968700 1 -- 172.21.15.125:0/1195981302 wait complete. 2023-10-06T03:04:45.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.022+0000 7fb1a27fc700 1 -- 172.21.15.125:0/2413190594 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a801dda0 con 0x7fb1ac06e740 2023-10-06T03:04:45.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.022+0000 7fb1a27fc700 1 -- 172.21.15.125:0/2413190594 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a801a420 con 0x7fb1ac06e740 2023-10-06T03:04:45.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.022+0000 7fb1a27fc700 1 -- 172.21.15.125:0/2413190594 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a801a7e0 con 0x7fb1ac06e740 2023-10-06T03:04:45.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.022+0000 7fb1b42ad700 1 -- 172.21.15.125:0/2413190594 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ac14bdd0 con 0x7fb1ac06e740 2023-10-06T03:04:45.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.022+0000 7fb1b42ad700 1 -- 172.21.15.125:0/2413190594 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ac14c390 con 0x7fb1ac06e740 2023-10-06T03:04:45.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.023+0000 7fb1b42ad700 1 -- 172.21.15.125:0/2413190594 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb1ac066510 con 0x7fb1ac06e740 2023-10-06T03:04:45.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.023+0000 7f1db8968700 1 Processor -- start 2023-10-06T03:04:45.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.023+0000 7f1db8968700 1 -- start start 2023-10-06T03:04:45.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.024+0000 7fb1a27fc700 1 -- 172.21.15.125:0/2413190594 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1a801ab90 con 0x7fb1ac06e740 2023-10-06T03:04:45.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.024+0000 7f1db8968700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1db40af320 0x7f1db40b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.024+0000 7f1db8968700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1db40c8150 0x7f1db416ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.024+0000 7f1db8968700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1db40cba50 0x7f1db40b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.024+0000 7f1db8968700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db4152bf0 con 0x7f1db40af320 2023-10-06T03:04:45.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.024+0000 7f1db8968700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db416e890 con 0x7f1db40cba50 2023-10-06T03:04:45.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.024+0000 7f1db8968700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db416eb70 con 0x7f1db40c8150 2023-10-06T03:04:45.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.024+0000 7fb1a27fc700 1 --2- 172.21.15.125:0/2413190594 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb190066f30 0x7fb1900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.024+0000 7fb1a27fc700 1 -- 172.21.15.125:0/2413190594 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb1a8086580 con 0x7fb1ac06e740 2023-10-06T03:04:45.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.024+0000 7f1db2d9d700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1db40cba50 0x7f1db40b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.024+0000 7f1db2d9d700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1db40cba50 0x7f1db40b07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:40680/0 (socket says 172.21.15.125:40680) 2023-10-06T03:04:45.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.024+0000 7f1db2d9d700 1 -- 172.21.15.125:0/1605690885 learned_addr learned my addr 172.21.15.125:0/1605690885 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.025+0000 7fb1a27fc700 1 --2- 172.21.15.125:0/2413190594 >> [v2:172.21.15.130:6808/119955,v1:172.21.15.130:6809/119955] conn(0x7fb190070c00 0x7fb190073030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.025+0000 7fb1a27fc700 1 -- 172.21.15.125:0/2413190594 --> [v2:172.21.15.130:6808/119955,v1:172.21.15.130:6809/119955] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb190073700 con 0x7fb190070c00 2023-10-06T03:04:45.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.025+0000 7fb1a27fc700 1 -- 172.21.15.125:0/2413190594 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1a8088ae0 con 0x7fb1ac06e740 2023-10-06T03:04:45.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.025+0000 7f1db1d9b700 1 --2- 172.21.15.125:0/1605690885 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1db40c8150 0x7f1db416ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.025+0000 7fb1b284a700 1 --2- 172.21.15.125:0/2413190594 >> [v2:172.21.15.130:6808/119955,v1:172.21.15.130:6809/119955] conn(0x7fb190070c00 0x7fb190073030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.025+0000 7f1db1d9b700 1 -- 172.21.15.125:0/1605690885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1db40cba50 msgr2=0x7f1db40b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.025+0000 7f1db1d9b700 1 --2- 172.21.15.125:0/1605690885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1db40cba50 0x7f1db40b07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.025+0000 7f1db1d9b700 1 -- 172.21.15.125:0/1605690885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1db40af320 msgr2=0x7f1db40b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.025+0000 7f1db1d9b700 1 --2- 172.21.15.125:0/1605690885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1db40af320 0x7f1db40b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.025+0000 7f1db1d9b700 1 -- 172.21.15.125:0/1605690885 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da8009420 con 0x7f1db40c8150 2023-10-06T03:04:45.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.025+0000 7f1db2d9d700 1 --2- 172.21.15.125:0/1605690885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1db40cba50 0x7f1db40b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:45.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.025+0000 7fb1b284a700 1 --2- 172.21.15.125:0/2413190594 >> [v2:172.21.15.130:6808/119955,v1:172.21.15.130:6809/119955] conn(0x7fb190070c00 0x7fb190073030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.025+0000 7f1db1d9b700 1 --2- 172.21.15.125:0/1605690885 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1db40c8150 0x7f1db416ee30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1da8015000 tx=0x7f1da8016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.025+0000 7f1da27fc700 1 -- 172.21.15.125:0/1605690885 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da800b910 con 0x7f1db40c8150 2023-10-06T03:04:45.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.025+0000 7f1da27fc700 1 -- 172.21.15.125:0/1605690885 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da8020070 con 0x7f1db40c8150 2023-10-06T03:04:45.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.025+0000 7f1da27fc700 1 -- 172.21.15.125:0/1605690885 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da801b450 con 0x7f1db40c8150 2023-10-06T03:04:45.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.025+0000 7f1db8968700 1 -- 172.21.15.125:0/1605690885 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db40afd10 con 0x7f1db40c8150 2023-10-06T03:04:45.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.025+0000 7f1db8968700 1 -- 172.21.15.125:0/1605690885 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db40b02d0 con 0x7f1db40c8150 2023-10-06T03:04:45.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7f22077fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f220806e570 0x7f2208175cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7f22077fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f220806e570 0x7f2208175cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:54150/0 (socket says 172.21.15.125:54150) 2023-10-06T03:04:45.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7f22077fe700 1 -- 172.21.15.125:0/3044517826 learned_addr learned my addr 172.21.15.125:0/3044517826 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7f2206ffd700 1 --2- 172.21.15.125:0/3044517826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f220813b620 0x7f22080b0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.015+0000 7f2207fff700 1 --2- 172.21.15.125:0/3044517826 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f220813b9f0 0x7f22081500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.016+0000 7f2206ffd700 1 -- 172.21.15.125:0/3044517826 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f220813b9f0 msgr2=0x7f22081500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.016+0000 7f2206ffd700 1 --2- 172.21.15.125:0/3044517826 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f220813b9f0 0x7f22081500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.016+0000 7f2206ffd700 1 -- 172.21.15.125:0/3044517826 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f220806e570 msgr2=0x7f2208175cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.016+0000 7f2206ffd700 1 --2- 172.21.15.125:0/3044517826 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f220806e570 0x7f2208175cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.016+0000 7f2206ffd700 1 -- 172.21.15.125:0/3044517826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc00a590 con 0x7f220813b620 2023-10-06T03:04:45.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.017+0000 7f46edd9b700 1 -- 172.21.15.125:0/2996537299 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e000b9c0 con 0x7f46f0154930 2023-10-06T03:04:45.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.017+0000 7f46edd9b700 1 -- 172.21.15.125:0/2996537299 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e000bd40 con 0x7f46f0154930 2023-10-06T03:04:45.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.017+0000 7f46f50cf700 1 -- 172.21.15.125:0/2996537299 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46f0154930 msgr2=0x7f46f006ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.017+0000 7f46f50cf700 1 --2- 172.21.15.125:0/2996537299 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46f0154930 0x7f46f006ac30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f46e00099b0 tx=0x7f46e0009250 comp rx=0 tx=0).stop 2023-10-06T03:04:45.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.026+0000 7f46f50cf700 1 -- 172.21.15.125:0/2996537299 shutdown_connections 2023-10-06T03:04:45.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.026+0000 7f46f50cf700 1 --2- 172.21.15.125:0/2996537299 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46f0154930 0x7f46f006ac30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.026+0000 7f46f50cf700 1 --2- 172.21.15.125:0/2996537299 >> v2:172.21.15.130:3300/0 conn(0x7f46f0154d00 0x7f46f006e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.026+0000 7f46f50cf700 1 -- 172.21.15.125:0/2996537299 >> 172.21.15.125:0/2996537299 conn(0x7f46f00cbd30 msgr2=0x7f46f00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.026+0000 7f46f50cf700 1 -- 172.21.15.125:0/2996537299 shutdown_connections 2023-10-06T03:04:45.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.026+0000 7fb1a27fc700 1 -- 172.21.15.125:0/2413190594 <== osd.5 v2:172.21.15.130:6808/119955 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb190073700 con 0x7fb190070c00 2023-10-06T03:04:45.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.026+0000 7f1db8968700 1 -- 172.21.15.125:0/1605690885 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1db4066510 con 0x7f1db40c8150 2023-10-06T03:04:45.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.027+0000 7f2206ffd700 1 --2- 172.21.15.125:0/3044517826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f220813b620 0x7f22080b0480 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2208069dd0 tx=0x7f21fc020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.026+0000 7f46f50cf700 1 -- 172.21.15.125:0/2996537299 wait complete. 2023-10-06T03:04:45.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.028+0000 7f1a577fe700 1 -- 172.21.15.125:0/3671788496 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a5c01a400 con 0x7f1a681558e0 2023-10-06T03:04:45.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.028+0000 7f1a577fe700 1 --2- 172.21.15.125:0/3671788496 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1a4c066f00 0x7f1a4c0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.028+0000 7f1a577fe700 1 -- 172.21.15.125:0/3671788496 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1a5c0844a0 con 0x7f1a681558e0 2023-10-06T03:04:45.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.029+0000 7f1a577fe700 1 --2- 172.21.15.125:0/3671788496 >> [v2:172.21.15.125:6805/119696,v1:172.21.15.125:6809/119696] conn(0x7f1a4c070b50 0x7f1a4c072f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.029+0000 7f1a577fe700 1 -- 172.21.15.125:0/3671788496 --> [v2:172.21.15.125:6805/119696,v1:172.21.15.125:6809/119696] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a4c073650 con 0x7f1a4c070b50 2023-10-06T03:04:45.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.029+0000 7f1a677fe700 1 --2- 172.21.15.125:0/3671788496 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1a4c066f00 0x7f1a4c0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.029+0000 7f1da27fc700 1 -- 172.21.15.125:0/1605690885 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1da8022030 con 0x7f1db40c8150 2023-10-06T03:04:45.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.029+0000 7f1a677fe700 1 --2- 172.21.15.125:0/3671788496 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1a4c066f00 0x7f1a4c0693b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1a600084e0 tx=0x7f1a60015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.028+0000 7f46f50cf700 1 Processor -- start 2023-10-06T03:04:45.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.030+0000 7f1da27fc700 1 --2- 172.21.15.125:0/1605690885 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1d94066f30 0x7f1d940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.030+0000 7f1da27fc700 1 -- 172.21.15.125:0/1605690885 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1da8086740 con 0x7f1db40c8150 2023-10-06T03:04:45.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.030+0000 7f1da27fc700 1 --2- 172.21.15.125:0/1605690885 >> [v2:172.21.15.130:6800/119956,v1:172.21.15.130:6801/119956] conn(0x7f1d94070b00 0x7f1d94072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.030+0000 7f1da27fc700 1 -- 172.21.15.125:0/1605690885 --> [v2:172.21.15.130:6800/119956,v1:172.21.15.130:6801/119956] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d94073600 con 0x7f1d94070b00 2023-10-06T03:04:45.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.030+0000 7f1db2d9d700 1 --2- 172.21.15.125:0/1605690885 >> [v2:172.21.15.130:6800/119956,v1:172.21.15.130:6801/119956] conn(0x7f1d94070b00 0x7f1d94072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.030+0000 7f221c958700 1 -- 172.21.15.125:0/2191931936 --> [v2:172.21.15.130:6816/119973,v1:172.21.15.130:6817/119973] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f22180c8130 con 0x7f21f8070cd0 2023-10-06T03:04:45.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.030+0000 7f1a67fff700 1 --2- 172.21.15.125:0/3671788496 >> [v2:172.21.15.125:6805/119696,v1:172.21.15.125:6809/119696] conn(0x7f1a4c070b50 0x7f1a4c072f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.031+0000 7f1a67fff700 1 --2- 172.21.15.125:0/3671788496 >> [v2:172.21.15.125:6805/119696,v1:172.21.15.125:6809/119696] conn(0x7f1a4c070b50 0x7f1a4c072f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.031+0000 7f1a577fe700 1 -- 172.21.15.125:0/3671788496 <== osd.0 v2:172.21.15.125:6805/119696 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1a4c073650 con 0x7f1a4c070b50 2023-10-06T03:04:45.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.029+0000 7fb1b1848700 1 --2- 172.21.15.125:0/2413190594 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb190066f30 0x7fb1900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.029+0000 7fb1b1848700 1 --2- 172.21.15.125:0/2413190594 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb190066f30 0x7fb1900693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4002fc0 tx=0x7fb1a4001710 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.034+0000 7f1db259c700 1 --2- 172.21.15.125:0/1605690885 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1d94066f30 0x7f1d940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.034+0000 7f1db2d9d700 1 --2- 172.21.15.125:0/1605690885 >> [v2:172.21.15.130:6800/119956,v1:172.21.15.130:6801/119956] conn(0x7f1d94070b00 0x7f1d94072f30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.034+0000 7f1db259c700 1 --2- 172.21.15.125:0/1605690885 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1d94066f30 0x7f1d940693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1da4006fd0 tx=0x7f1da4006cd0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.034+0000 7f1da27fc700 1 -- 172.21.15.125:0/1605690885 <== osd.7 v2:172.21.15.130:6800/119956 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1d94073600 con 0x7f1d94070b00 2023-10-06T03:04:45.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.029+0000 7f46f50cf700 1 -- start start 2023-10-06T03:04:45.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.036+0000 7f1da27fc700 1 -- 172.21.15.125:0/1605690885 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1da8053560 con 0x7f1db40c8150 2023-10-06T03:04:45.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.036+0000 7f22067fc700 1 -- 172.21.15.125:0/2191931936 <== osd.4 v2:172.21.15.130:6816/119973 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f22180c8130 con 0x7f21f8070cd0 2023-10-06T03:04:45.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.040+0000 7f1a577fe700 1 -- 172.21.15.125:0/3671788496 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a5c051340 con 0x7f1a681558e0 2023-10-06T03:04:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.040+0000 7f221c958700 1 -- 172.21.15.125:0/2191931936 >> [v2:172.21.15.130:6816/119973,v1:172.21.15.130:6817/119973] conn(0x7f21f8070cd0 msgr2=0x7f21f8073100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.040+0000 7f221c958700 1 --2- 172.21.15.125:0/2191931936 >> [v2:172.21.15.130:6816/119973,v1:172.21.15.130:6817/119973] conn(0x7f21f8070cd0 0x7f21f8073100 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.040+0000 7f221c958700 1 -- 172.21.15.125:0/2191931936 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f21f8067080 msgr2=0x7f21f8069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.040+0000 7f221c958700 1 --2- 172.21.15.125:0/2191931936 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f21f8067080 0x7f21f8069530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f220800acf0 tx=0x7f2208009350 comp rx=0 tx=0).stop 2023-10-06T03:04:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.040+0000 7f221c958700 1 -- 172.21.15.125:0/2191931936 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22180c7590 msgr2=0x7f22180c3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.040+0000 7f221c958700 1 --2- 172.21.15.125:0/2191931936 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f22180c7590 0x7f22180c3320 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f220c00ec80 tx=0x7f220c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.040+0000 7f2216d9d700 1 -- 172.21.15.125:0/2191931936 reap_dead start 2023-10-06T03:04:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.040+0000 7f221c958700 1 -- 172.21.15.125:0/2191931936 shutdown_connections 2023-10-06T03:04:45.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.040+0000 7f221c958700 1 -- 172.21.15.125:0/2191931936 >> 172.21.15.125:0/2191931936 conn(0x7f22180cbd30 msgr2=0x7f221806b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.040+0000 7f21ef7fe700 1 -- 172.21.15.125:0/3044517826 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc0191d0 con 0x7f220813b620 2023-10-06T03:04:45.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.040+0000 7f21ef7fe700 1 -- 172.21.15.125:0/3044517826 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc019390 con 0x7f220813b620 2023-10-06T03:04:45.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.040+0000 7f21ef7fe700 1 -- 172.21.15.125:0/3044517826 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc015660 con 0x7f220813b620 2023-10-06T03:04:45.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.042+0000 7f220dae3700 1 -- 172.21.15.125:0/3044517826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2208124e90 con 0x7f220813b620 2023-10-06T03:04:45.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.042+0000 7f220dae3700 1 -- 172.21.15.125:0/3044517826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22081537a0 con 0x7f220813b620 2023-10-06T03:04:45.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.042+0000 7f221c958700 1 -- 172.21.15.125:0/2191931936 shutdown_connections 2023-10-06T03:04:45.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.042+0000 7f221c958700 1 -- 172.21.15.125:0/2191931936 wait complete. 2023-10-06T03:04:45.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.044+0000 7fb1b42ad700 1 -- 172.21.15.125:0/2413190594 --> [v2:172.21.15.130:6808/119955,v1:172.21.15.130:6809/119955] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb1ac159180 con 0x7fb190070c00 2023-10-06T03:04:45.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.044+0000 7f21ef7fe700 1 -- 172.21.15.125:0/3044517826 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21fc015a50 con 0x7f220813b620 2023-10-06T03:04:45.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.044+0000 7f21ef7fe700 1 --2- 172.21.15.125:0/3044517826 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f21f4067080 0x7f21f4069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.044+0000 7f21ef7fe700 1 -- 172.21.15.125:0/3044517826 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f21fc085c60 con 0x7f220813b620 2023-10-06T03:04:45.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.045+0000 7f22077fe700 1 --2- 172.21.15.125:0/3044517826 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f21f4067080 0x7f21f4069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.045+0000 7f22077fe700 1 --2- 172.21.15.125:0/3044517826 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f21f4067080 0x7f21f4069530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2200009ee0 tx=0x7f2200009840 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.047+0000 7fb1a27fc700 1 -- 172.21.15.125:0/2413190594 <== osd.5 v2:172.21.15.130:6808/119955 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb1ac159180 con 0x7fb190070c00 2023-10-06T03:04:45.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.046+0000 7f220dae3700 1 --2- 172.21.15.125:0/3044517826 >> [v2:172.21.15.125:6802/119698,v1:172.21.15.125:6806/119698] conn(0x7f22081505e0 0x7f22080cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.046+0000 7f220dae3700 1 -- 172.21.15.125:0/3044517826 --> [v2:172.21.15.125:6802/119698,v1:172.21.15.125:6806/119698] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2208125020 con 0x7f22081505e0 2023-10-06T03:04:45.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.047+0000 7f2207fff700 1 --2- 172.21.15.125:0/3044517826 >> [v2:172.21.15.125:6802/119698,v1:172.21.15.125:6806/119698] conn(0x7f22081505e0 0x7f22080cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.047+0000 7f2207fff700 1 --2- 172.21.15.125:0/3044517826 >> [v2:172.21.15.125:6802/119698,v1:172.21.15.125:6806/119698] conn(0x7f22081505e0 0x7f22080cc100 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.050+0000 7fb1b42ad700 1 -- 172.21.15.125:0/2413190594 >> [v2:172.21.15.130:6808/119955,v1:172.21.15.130:6809/119955] conn(0x7fb190070c00 msgr2=0x7fb190073030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.050+0000 7fb1b42ad700 1 --2- 172.21.15.125:0/2413190594 >> [v2:172.21.15.130:6808/119955,v1:172.21.15.130:6809/119955] conn(0x7fb190070c00 0x7fb190073030 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.051+0000 7f21ef7fe700 1 -- 172.21.15.125:0/3044517826 <== osd.3 v2:172.21.15.125:6802/119698 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2208125020 con 0x7f22081505e0 2023-10-06T03:04:45.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.031+0000 7f46f50cf700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46f006e570 0x7f46f014a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.031+0000 7f46f50cf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46f0154930 0x7f46f00c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.031+0000 7f46f50cf700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46f0154d00 0x7f46f0155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.031+0000 7f46f50cf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f014a600 con 0x7f46f0154930 2023-10-06T03:04:45.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.052+0000 7f198d2fc700 1 -- 172.21.15.125:0/4027564860 --> [v2:172.21.15.125:6800/119697,v1:172.21.15.125:6801/119697] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f19880c8b40 con 0x7f1968070c40 2023-10-06T03:04:45.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.052+0000 7fb1b42ad700 1 -- 172.21.15.125:0/2413190594 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb190066f30 msgr2=0x7fb1900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.052+0000 7fb1b42ad700 1 --2- 172.21.15.125:0/2413190594 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb190066f30 0x7fb1900693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4002fc0 tx=0x7fb1a4001710 comp rx=0 tx=0).stop 2023-10-06T03:04:45.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.052+0000 7fb1b42ad700 1 -- 172.21.15.125:0/2413190594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1ac06e740 msgr2=0x7fb1ac144bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.052+0000 7fb1b42ad700 1 --2- 172.21.15.125:0/2413190594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1ac06e740 0x7fb1ac144bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009290 tx=0x7fb1a8016000 comp rx=0 tx=0).stop 2023-10-06T03:04:45.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.052+0000 7fb1b284a700 1 -- 172.21.15.125:0/2413190594 reap_dead start 2023-10-06T03:04:45.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.031+0000 7f46f50cf700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46f014ea80 con 0x7f46f0154d00 2023-10-06T03:04:45.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.031+0000 7f46f50cf700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46f014f040 con 0x7f46f006e570 2023-10-06T03:04:45.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.031+0000 7f46eed9d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46f006e570 0x7f46f014a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.031+0000 7f46eed9d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46f006e570 0x7f46f014a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:53372/0 (socket says 172.21.15.125:53372) 2023-10-06T03:04:45.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.031+0000 7f46eed9d700 1 -- 172.21.15.125:0/2556889520 learned_addr learned my addr 172.21.15.125:0/2556889520 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.031+0000 7f46eed9d700 1 -- 172.21.15.125:0/2556889520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46f0154d00 msgr2=0x7f46f0155880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:04:45.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.031+0000 7f46eed9d700 1 --2- 172.21.15.125:0/2556889520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f46f0154d00 0x7f46f0155880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.031+0000 7f46eed9d700 1 -- 172.21.15.125:0/2556889520 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46f0154930 msgr2=0x7f46f00c9080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:04:45.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.031+0000 7f46eed9d700 1 --2- 172.21.15.125:0/2556889520 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f46f0154930 0x7f46f00c9080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.031+0000 7f46eed9d700 1 -- 172.21.15.125:0/2556889520 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e00094f0 con 0x7f46f006e570 2023-10-06T03:04:45.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.032+0000 7f46eed9d700 1 --2- 172.21.15.125:0/2556889520 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46f006e570 0x7f46f014a0c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f46e00090b0 tx=0x7f46e0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.032+0000 7f46e6ffd700 1 -- 172.21.15.125:0/2556889520 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e001a450 con 0x7f46f006e570 2023-10-06T03:04:45.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.032+0000 7f46e6ffd700 1 -- 172.21.15.125:0/2556889520 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e001a5d0 con 0x7f46f006e570 2023-10-06T03:04:45.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.032+0000 7f46f50cf700 1 -- 172.21.15.125:0/2556889520 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f00c9b90 con 0x7f46f006e570 2023-10-06T03:04:45.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.032+0000 7f46e6ffd700 1 -- 172.21.15.125:0/2556889520 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e001a990 con 0x7f46f006e570 2023-10-06T03:04:45.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.052+0000 7f46f50cf700 1 -- 172.21.15.125:0/2556889520 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46f014ecd0 con 0x7f46f006e570 2023-10-06T03:04:45.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.052+0000 7f1db8968700 1 -- 172.21.15.125:0/1605690885 --> [v2:172.21.15.130:6800/119956,v1:172.21.15.130:6801/119956] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1db40c8b40 con 0x7f1d94070b00 2023-10-06T03:04:45.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.052+0000 7fb1b42ad700 1 -- 172.21.15.125:0/2413190594 shutdown_connections 2023-10-06T03:04:45.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.052+0000 7fb1b42ad700 1 -- 172.21.15.125:0/2413190594 >> 172.21.15.125:0/2413190594 conn(0x7fb1ac0cbd30 msgr2=0x7fb1ac14e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.053+0000 7fb1b42ad700 1 -- 172.21.15.125:0/2413190594 shutdown_connections 2023-10-06T03:04:45.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.053+0000 7f1a6db55700 1 -- 172.21.15.125:0/3671788496 --> [v2:172.21.15.125:6805/119696,v1:172.21.15.125:6809/119696] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1a680c19e0 con 0x7f1a4c070b50 2023-10-06T03:04:45.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.053+0000 7fb1b42ad700 1 -- 172.21.15.125:0/2413190594 wait complete. 2023-10-06T03:04:45.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.053+0000 7f46f50cf700 1 -- 172.21.15.125:0/2556889520 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f46f0066510 con 0x7f46f006e570 2023-10-06T03:04:45.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.053+0000 7f1da27fc700 1 -- 172.21.15.125:0/1605690885 <== osd.7 v2:172.21.15.130:6800/119956 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1db40c8b40 con 0x7f1d94070b00 2023-10-06T03:04:45.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.053+0000 7f197f7fe700 1 -- 172.21.15.125:0/4027564860 <== osd.1 v2:172.21.15.125:6800/119697 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f19880c8b40 con 0x7f1968070c40 2023-10-06T03:04:45.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.053+0000 7f6bf4841700 1 -- 172.21.15.125:0/2886200447 --> [v2:172.21.15.125:6803/119699,v1:172.21.15.125:6807/119699] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6bf0066510 con 0x7f6bf0154b60 2023-10-06T03:04:45.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.053+0000 7f1db8968700 1 -- 172.21.15.125:0/1605690885 >> [v2:172.21.15.130:6800/119956,v1:172.21.15.130:6801/119956] conn(0x7f1d94070b00 msgr2=0x7f1d94072f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.053+0000 7f1db8968700 1 --2- 172.21.15.125:0/1605690885 >> [v2:172.21.15.130:6800/119956,v1:172.21.15.130:6801/119956] conn(0x7f1d94070b00 0x7f1d94072f30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.054+0000 7f6bde7fc700 1 -- 172.21.15.125:0/2886200447 <== osd.2 v2:172.21.15.125:6803/119699 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6bf0066510 con 0x7f6bf0154b60 2023-10-06T03:04:45.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.054+0000 7f1db8968700 1 -- 172.21.15.125:0/1605690885 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1d94066f30 msgr2=0x7f1d940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.054+0000 7f1db8968700 1 --2- 172.21.15.125:0/1605690885 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1d94066f30 0x7f1d940693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1da4006fd0 tx=0x7f1da4006cd0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.054+0000 7f1db8968700 1 -- 172.21.15.125:0/1605690885 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1db40c8150 msgr2=0x7f1db416ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.054+0000 7f1db8968700 1 --2- 172.21.15.125:0/1605690885 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1db40c8150 0x7f1db416ee30 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1da8015000 tx=0x7f1da8016000 comp rx=0 tx=0).stop 2023-10-06T03:04:45.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.054+0000 7f1db2d9d700 1 -- 172.21.15.125:0/1605690885 reap_dead start 2023-10-06T03:04:45.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.054+0000 7f1db8968700 1 -- 172.21.15.125:0/1605690885 shutdown_connections 2023-10-06T03:04:45.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.054+0000 7f1db8968700 1 -- 172.21.15.125:0/1605690885 >> 172.21.15.125:0/1605690885 conn(0x7f1db4096120 msgr2=0x7f1db40c2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.054+0000 7f1a577fe700 1 -- 172.21.15.125:0/3671788496 <== osd.0 v2:172.21.15.125:6805/119696 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1a680c19e0 con 0x7f1a4c070b50 2023-10-06T03:04:45.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.054+0000 7f1db8968700 1 -- 172.21.15.125:0/1605690885 shutdown_connections 2023-10-06T03:04:45.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.054+0000 7f1db8968700 1 -- 172.21.15.125:0/1605690885 wait complete. 2023-10-06T03:04:45.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.054+0000 7f1a6db55700 1 -- 172.21.15.125:0/3671788496 >> [v2:172.21.15.125:6805/119696,v1:172.21.15.125:6809/119696] conn(0x7f1a4c070b50 msgr2=0x7f1a4c072f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.054+0000 7f1a6db55700 1 --2- 172.21.15.125:0/3671788496 >> [v2:172.21.15.125:6805/119696,v1:172.21.15.125:6809/119696] conn(0x7f1a4c070b50 0x7f1a4c072f80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.054+0000 7f46e6ffd700 1 -- 172.21.15.125:0/2556889520 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46e001b430 con 0x7f46f006e570 2023-10-06T03:04:45.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f1a6db55700 1 -- 172.21.15.125:0/3671788496 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1a4c066f00 msgr2=0x7f1a4c0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f1a6db55700 1 --2- 172.21.15.125:0/3671788496 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1a4c066f00 0x7f1a4c0693b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1a600084e0 tx=0x7f1a60015000 comp rx=0 tx=0).stop 2023-10-06T03:04:45.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f1a6db55700 1 -- 172.21.15.125:0/3671788496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a681558e0 msgr2=0x7f1a68144530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f1a6db55700 1 --2- 172.21.15.125:0/3671788496 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1a681558e0 0x7f1a68144530 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00b5e0 tx=0x7f1a5c0090f0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f1a67fff700 1 -- 172.21.15.125:0/3671788496 reap_dead start 2023-10-06T03:04:45.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f1a6db55700 1 -- 172.21.15.125:0/3671788496 shutdown_connections 2023-10-06T03:04:45.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f1a6db55700 1 -- 172.21.15.125:0/3671788496 >> 172.21.15.125:0/3671788496 conn(0x7f1a680af730 msgr2=0x7f1a6814c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f46e6ffd700 1 --2- 172.21.15.125:0/2556889520 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f46d0066fb0 0x7f46d0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f46e6ffd700 1 -- 172.21.15.125:0/2556889520 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f46e0086a70 con 0x7f46f006e570 2023-10-06T03:04:45.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f198d2fc700 1 -- 172.21.15.125:0/4027564860 >> [v2:172.21.15.125:6800/119697,v1:172.21.15.125:6801/119697] conn(0x7f1968070c40 msgr2=0x7f1968073070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f198d2fc700 1 --2- 172.21.15.125:0/4027564860 >> [v2:172.21.15.125:6800/119697,v1:172.21.15.125:6801/119697] conn(0x7f1968070c40 0x7f1968073070 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f198d2fc700 1 -- 172.21.15.125:0/4027564860 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1968067000 msgr2=0x7f19680694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f198d2fc700 1 --2- 172.21.15.125:0/4027564860 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1968067000 0x7f19680694b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1978009e60 tx=0x7f197801a000 comp rx=0 tx=0).stop 2023-10-06T03:04:45.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f198d2fc700 1 -- 172.21.15.125:0/4027564860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19880af320 msgr2=0x7f1988152ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f198d2fc700 1 --2- 172.21.15.125:0/4027564860 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19880af320 0x7f1988152ac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f197000b7e0 tx=0x7f19700091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f19877fe700 1 -- 172.21.15.125:0/4027564860 reap_dead start 2023-10-06T03:04:45.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f46e6ffd700 1 --2- 172.21.15.125:0/2556889520 >> [v2:172.21.15.130:6824/119980,v1:172.21.15.130:6825/119980] conn(0x7f46d0070c80 0x7f46d00730b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f46e6ffd700 1 -- 172.21.15.125:0/2556889520 --> [v2:172.21.15.130:6824/119980,v1:172.21.15.130:6825/119980] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46d0073780 con 0x7f46d0070c80 2023-10-06T03:04:45.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f46e6ffd700 1 -- 172.21.15.125:0/2556889520 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46e0086da0 con 0x7f46f006e570 2023-10-06T03:04:45.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f198d2fc700 1 -- 172.21.15.125:0/4027564860 shutdown_connections 2023-10-06T03:04:45.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.055+0000 7f198d2fc700 1 -- 172.21.15.125:0/4027564860 >> 172.21.15.125:0/4027564860 conn(0x7f1988096120 msgr2=0x7f1988155b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.056+0000 7f198d2fc700 1 -- 172.21.15.125:0/4027564860 shutdown_connections 2023-10-06T03:04:45.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.056+0000 7f46ef59e700 1 --2- 172.21.15.125:0/2556889520 >> [v2:172.21.15.130:6824/119980,v1:172.21.15.130:6825/119980] conn(0x7f46d0070c80 0x7f46d00730b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.056+0000 7f198d2fc700 1 -- 172.21.15.125:0/4027564860 wait complete. 2023-10-06T03:04:45.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.056+0000 7f46ee59c700 1 --2- 172.21.15.125:0/2556889520 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f46d0066fb0 0x7f46d0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.056+0000 7f46ef59e700 1 --2- 172.21.15.125:0/2556889520 >> [v2:172.21.15.130:6824/119980,v1:172.21.15.130:6825/119980] conn(0x7f46d0070c80 0x7f46d00730b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.056+0000 7f46ee59c700 1 --2- 172.21.15.125:0/2556889520 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f46d0066fb0 0x7f46d0069460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f46f0171630 tx=0x7f46d8006c90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.057+0000 7f1a6db55700 1 -- 172.21.15.125:0/3671788496 shutdown_connections 2023-10-06T03:04:45.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.057+0000 7f1a6db55700 1 -- 172.21.15.125:0/3671788496 wait complete. 2023-10-06T03:04:45.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.057+0000 7f6bf4841700 1 -- 172.21.15.125:0/2886200447 >> [v2:172.21.15.125:6803/119699,v1:172.21.15.125:6807/119699] conn(0x7f6bf0154b60 msgr2=0x7f6bf0154f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.057+0000 7f6bf4841700 1 --2- 172.21.15.125:0/2886200447 >> [v2:172.21.15.125:6803/119699,v1:172.21.15.125:6807/119699] conn(0x7f6bf0154b60 0x7f6bf0154f30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.057+0000 7f6bf4841700 1 -- 172.21.15.125:0/2886200447 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6bd0089090 msgr2=0x7f6bd008b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.057+0000 7f6bf4841700 1 --2- 172.21.15.125:0/2886200447 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6bd0089090 0x7f6bd008b540 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6be4006fd0 tx=0x7f6be40090f0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.057+0000 7f6bf4841700 1 -- 172.21.15.125:0/2886200447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bf013b9f0 msgr2=0x7f6bf00b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.057+0000 7f6bf4841700 1 --2- 172.21.15.125:0/2886200447 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6bf013b9f0 0x7f6bf00b1130 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6be800bbb0 tx=0x7f6be8009840 comp rx=0 tx=0).stop 2023-10-06T03:04:45.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.057+0000 7f6beed9d700 1 -- 172.21.15.125:0/2886200447 reap_dead start 2023-10-06T03:04:45.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.057+0000 7f6bf4841700 1 -- 172.21.15.125:0/2886200447 shutdown_connections 2023-10-06T03:04:45.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.057+0000 7f6bf4841700 1 -- 172.21.15.125:0/2886200447 >> 172.21.15.125:0/2886200447 conn(0x7f6bf00cbd30 msgr2=0x7f6bf01575a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.057+0000 7f6bf4841700 1 -- 172.21.15.125:0/2886200447 shutdown_connections 2023-10-06T03:04:45.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.057+0000 7f6bf4841700 1 -- 172.21.15.125:0/2886200447 wait complete. 2023-10-06T03:04:45.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.057+0000 7f46e6ffd700 1 -- 172.21.15.125:0/2556889520 <== osd.6 v2:172.21.15.130:6824/119980 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f46d0073780 con 0x7f46d0070c80 2023-10-06T03:04:45.091 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-10-06T03:04:45.092 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T03:04:45.092 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-10-06T03:04:45.093 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T03:04:45.093 INFO:teuthology.orchestra.run.smithi125.stdout:55834574857 2023-10-06T03:04:45.094 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T03:04:45.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.078+0000 7f220dae3700 1 -- 172.21.15.125:0/3044517826 --> [v2:172.21.15.125:6802/119698,v1:172.21.15.125:6806/119698] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f22080b13b0 con 0x7f22081505e0 2023-10-06T03:04:45.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.078+0000 7f21ef7fe700 1 -- 172.21.15.125:0/3044517826 <== osd.3 v2:172.21.15.125:6802/119698 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f22080b13b0 con 0x7f22081505e0 2023-10-06T03:04:45.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.079+0000 7f220dae3700 1 -- 172.21.15.125:0/3044517826 >> [v2:172.21.15.125:6802/119698,v1:172.21.15.125:6806/119698] conn(0x7f22081505e0 msgr2=0x7f22080cc100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.079+0000 7f220dae3700 1 --2- 172.21.15.125:0/3044517826 >> [v2:172.21.15.125:6802/119698,v1:172.21.15.125:6806/119698] conn(0x7f22081505e0 0x7f22080cc100 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.079+0000 7f220dae3700 1 -- 172.21.15.125:0/3044517826 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f21f4067080 msgr2=0x7f21f4069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.079+0000 7f220dae3700 1 --2- 172.21.15.125:0/3044517826 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f21f4067080 0x7f21f4069530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2200009ee0 tx=0x7f2200009840 comp rx=0 tx=0).stop 2023-10-06T03:04:45.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.079+0000 7f220dae3700 1 -- 172.21.15.125:0/3044517826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f220813b620 msgr2=0x7f22080b0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.079+0000 7f220dae3700 1 --2- 172.21.15.125:0/3044517826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f220813b620 0x7f22080b0480 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2208069dd0 tx=0x7f21fc020000 comp rx=0 tx=0).stop 2023-10-06T03:04:45.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.079+0000 7f2207fff700 1 -- 172.21.15.125:0/3044517826 reap_dead start 2023-10-06T03:04:45.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.079+0000 7f220dae3700 1 -- 172.21.15.125:0/3044517826 shutdown_connections 2023-10-06T03:04:45.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.079+0000 7f220dae3700 1 -- 172.21.15.125:0/3044517826 >> 172.21.15.125:0/3044517826 conn(0x7f22080cbd30 msgr2=0x7f2208156d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.079+0000 7f220dae3700 1 -- 172.21.15.125:0/3044517826 shutdown_connections 2023-10-06T03:04:45.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.079+0000 7f220dae3700 1 -- 172.21.15.125:0/3044517826 wait complete. 2023-10-06T03:04:45.096 INFO:teuthology.orchestra.run.smithi125.stdout:55834574857 2023-10-06T03:04:45.097 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T03:04:45.097 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-10-06T03:04:45.098 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T03:04:45.098 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-10-06T03:04:45.099 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T03:04:45.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.085+0000 7f46f50cf700 1 -- 172.21.15.125:0/2556889520 --> [v2:172.21.15.130:6824/119980,v1:172.21.15.130:6825/119980] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f46f00c8450 con 0x7f46d0070c80 2023-10-06T03:04:45.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.086+0000 7f46e6ffd700 1 -- 172.21.15.125:0/2556889520 <== osd.6 v2:172.21.15.130:6824/119980 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f46f00c8450 con 0x7f46d0070c80 2023-10-06T03:04:45.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.086+0000 7f46f50cf700 1 -- 172.21.15.125:0/2556889520 >> [v2:172.21.15.130:6824/119980,v1:172.21.15.130:6825/119980] conn(0x7f46d0070c80 msgr2=0x7f46d00730b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.086+0000 7f46f50cf700 1 --2- 172.21.15.125:0/2556889520 >> [v2:172.21.15.130:6824/119980,v1:172.21.15.130:6825/119980] conn(0x7f46d0070c80 0x7f46d00730b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.086+0000 7f46f50cf700 1 -- 172.21.15.125:0/2556889520 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f46d0066fb0 msgr2=0x7f46d0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.086+0000 7f46f50cf700 1 --2- 172.21.15.125:0/2556889520 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f46d0066fb0 0x7f46d0069460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f46f0171630 tx=0x7f46d8006c90 comp rx=0 tx=0).stop 2023-10-06T03:04:45.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.086+0000 7f46f50cf700 1 -- 172.21.15.125:0/2556889520 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46f006e570 msgr2=0x7f46f014a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.086+0000 7f46f50cf700 1 --2- 172.21.15.125:0/2556889520 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f46f006e570 0x7f46f014a0c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f46e00090b0 tx=0x7f46e0017000 comp rx=0 tx=0).stop 2023-10-06T03:04:45.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.086+0000 7f46ef59e700 1 -- 172.21.15.125:0/2556889520 reap_dead start 2023-10-06T03:04:45.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.086+0000 7f46f50cf700 1 -- 172.21.15.125:0/2556889520 shutdown_connections 2023-10-06T03:04:45.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.086+0000 7f46f50cf700 1 -- 172.21.15.125:0/2556889520 >> 172.21.15.125:0/2556889520 conn(0x7f46f00cbd30 msgr2=0x7f46f015b450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.086+0000 7f46f50cf700 1 -- 172.21.15.125:0/2556889520 shutdown_connections 2023-10-06T03:04:45.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.086+0000 7f46f50cf700 1 -- 172.21.15.125:0/2556889520 wait complete. 2023-10-06T03:04:45.102 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-10-06T03:04:45.103 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T03:04:45.104 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-10-06T03:04:45.104 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T03:04:45.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.285+0000 7ffb77c44700 1 Processor -- start 2023-10-06T03:04:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.286+0000 7ffb77c44700 1 -- start start 2023-10-06T03:04:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.287+0000 7ffb77c44700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ffb7013b620 0x7ffb70159980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.287+0000 7ffb77c44700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb7013b9f0 0x7ffb7006e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.287+0000 7ffb77c44700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb700cb4e0 con 0x7ffb7006e570 2023-10-06T03:04:45.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.287+0000 7ffb77c44700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7006ea10 con 0x7ffb7013b620 2023-10-06T03:04:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.287+0000 7ffb77c44700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb701594f0 con 0x7ffb7013b9f0 2023-10-06T03:04:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.288+0000 7ffb759e0700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ffb7013b620 0x7ffb70159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.288+0000 7ffb759e0700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ffb7013b620 0x7ffb70159980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:50382/0 (socket says 172.21.15.125:50382) 2023-10-06T03:04:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.288+0000 7ffb759e0700 1 -- 172.21.15.125:0/249337724 learned_addr learned my addr 172.21.15.125:0/249337724 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.288+0000 7ffb751df700 1 --2- 172.21.15.125:0/249337724 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb7013b9f0 0x7ffb7006e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.288+0000 7ffb759e0700 1 -- 172.21.15.125:0/249337724 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb7013b9f0 msgr2=0x7ffb7006e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.288+0000 7ffb759e0700 1 --2- 172.21.15.125:0/249337724 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb7013b9f0 0x7ffb7006e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.288+0000 7ffb759e0700 1 -- 172.21.15.125:0/249337724 >> v1:172.21.15.130:6789/0 conn(0x7ffb7006e570 legacy=0x7ffb70155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.288+0000 7ffb759e0700 1 -- 172.21.15.125:0/249337724 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb70158ee0 con 0x7ffb7013b620 2023-10-06T03:04:45.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.289+0000 7ffb759e0700 1 --2- 172.21.15.125:0/249337724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb7013b620 0x7ffb70159980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00aa50 tx=0x7ffb6c00d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be0cd73081d6d5a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.290+0000 7ffb749de700 1 -- 172.21.15.125:0/249337724 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c00abb0 con 0x7ffb7013b620 2023-10-06T03:04:45.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.290+0000 7ffb749de700 1 -- 172.21.15.125:0/249337724 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6c00ad10 con 0x7ffb7013b620 2023-10-06T03:04:45.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.291+0000 7ffb77c44700 1 -- 172.21.15.125:0/249337724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb7013b620 msgr2=0x7ffb70159980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.291+0000 7ffb77c44700 1 --2- 172.21.15.125:0/249337724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb7013b620 0x7ffb70159980 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00aa50 tx=0x7ffb6c00d040 comp rx=0 tx=0).stop 2023-10-06T03:04:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.291+0000 7ffb77c44700 1 -- 172.21.15.125:0/249337724 shutdown_connections 2023-10-06T03:04:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.291+0000 7ffb77c44700 1 --2- 172.21.15.125:0/249337724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb7013b620 0x7ffb70159980 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00aa50 tx=0x7ffb6c00d040 comp rx=0 tx=0).stop 2023-10-06T03:04:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.291+0000 7ffb77c44700 1 --2- 172.21.15.125:0/249337724 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb7013b9f0 0x7ffb7006e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.291+0000 7ffb77c44700 1 -- 172.21.15.125:0/249337724 >> 172.21.15.125:0/249337724 conn(0x7ffb700cbd30 msgr2=0x7ffb700cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.292+0000 7ffb77c44700 1 -- 172.21.15.125:0/249337724 shutdown_connections 2023-10-06T03:04:45.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.292+0000 7ffb77c44700 1 -- 172.21.15.125:0/249337724 wait complete. 2023-10-06T03:04:45.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.293+0000 7ffb77c44700 1 Processor -- start 2023-10-06T03:04:45.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.294+0000 7ffb77c44700 1 -- start start 2023-10-06T03:04:45.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.295+0000 7ffb77c44700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb7006e570 0x7ffb701531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.295+0000 7ffb77c44700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb7013b9f0 0x7ffb7013c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.295+0000 7ffb77c44700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb7013cd10 0x7ffb7016d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.295+0000 7ffb77c44700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7013bdc0 con 0x7ffb7013b9f0 2023-10-06T03:04:45.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.295+0000 7ffb77c44700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7013c340 con 0x7ffb7006e570 2023-10-06T03:04:45.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.295+0000 7ffb77c44700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7016e3a0 con 0x7ffb7013cd10 2023-10-06T03:04:45.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.297+0000 7ffb759e0700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb7006e570 0x7ffb701531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.297+0000 7ffb761e1700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb7013cd10 0x7ffb7016d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.297+0000 7ffb751df700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb7013b9f0 0x7ffb7013c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.297+0000 7ffb751df700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb7013b9f0 0x7ffb7013c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40222/0 (socket says 172.21.15.125:40222) 2023-10-06T03:04:45.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.297+0000 7ffb751df700 1 -- 172.21.15.125:0/978236962 learned_addr learned my addr 172.21.15.125:0/978236962 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.298+0000 7ffb751df700 1 -- 172.21.15.125:0/978236962 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb7013cd10 msgr2=0x7ffb7016d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.298+0000 7ffb751df700 1 --2- 172.21.15.125:0/978236962 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb7013cd10 0x7ffb7016d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.298+0000 7ffb751df700 1 -- 172.21.15.125:0/978236962 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb7006e570 msgr2=0x7ffb701531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.298+0000 7ffb751df700 1 --2- 172.21.15.125:0/978236962 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb7006e570 0x7ffb701531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.298+0000 7ffb751df700 1 -- 172.21.15.125:0/978236962 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6c00a590 con 0x7ffb7013b9f0 2023-10-06T03:04:45.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.298+0000 7ffb751df700 1 --2- 172.21.15.125:0/978236962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb7013b9f0 0x7ffb7013c7d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009650 tx=0x7ffb6800f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.301+0000 7ffb65ffb700 1 -- 172.21.15.125:0/978236962 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800b450 con 0x7ffb7013b9f0 2023-10-06T03:04:45.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.301+0000 7ffb65ffb700 1 -- 172.21.15.125:0/978236962 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6800d0d0 con 0x7ffb7013b9f0 2023-10-06T03:04:45.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.301+0000 7ffb65ffb700 1 -- 172.21.15.125:0/978236962 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800d490 con 0x7ffb7013b9f0 2023-10-06T03:04:45.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.301+0000 7ffb77c44700 1 -- 172.21.15.125:0/978236962 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7016e680 con 0x7ffb7013b9f0 2023-10-06T03:04:45.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.301+0000 7ffb77c44700 1 -- 172.21.15.125:0/978236962 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb701536f0 con 0x7ffb7013b9f0 2023-10-06T03:04:45.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.311+0000 7ffb77c44700 1 -- 172.21.15.125:0/978236962 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb500052b0 con 0x7ffb7013b9f0 2023-10-06T03:04:45.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.320+0000 7ffb65ffb700 1 -- 172.21.15.125:0/978236962 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb68014070 con 0x7ffb7013b9f0 2023-10-06T03:04:45.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.321+0000 7ffb65ffb700 1 --2- 172.21.15.125:0/978236962 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ffb5c067200 0x7ffb5c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.321+0000 7ffb65ffb700 1 -- 172.21.15.125:0/978236962 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ffb68084c90 con 0x7ffb7013b9f0 2023-10-06T03:04:45.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.321+0000 7ffb65ffb700 1 -- 172.21.15.125:0/978236962 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb6808b250 con 0x7ffb7013b9f0 2023-10-06T03:04:45.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.322+0000 7ffb759e0700 1 --2- 172.21.15.125:0/978236962 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ffb5c067200 0x7ffb5c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.335+0000 7ffb759e0700 1 --2- 172.21.15.125:0/978236962 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ffb5c067200 0x7ffb5c0696b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00aa50 tx=0x7ffb6c018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.350+0000 7f588b55f700 1 Processor -- start 2023-10-06T03:04:45.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.350+0000 7f588b55f700 1 -- start start 2023-10-06T03:04:45.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.351+0000 7f588b55f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f588413b620 0x7f5884159980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.352+0000 7f588b55f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f588406e740 0x7f5884155840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.352+0000 7f588b55f700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58840cb4e0 con 0x7f588413b9f0 2023-10-06T03:04:45.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.352+0000 7f588b55f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58841594f0 con 0x7f588413b620 2023-10-06T03:04:45.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.352+0000 7f588b55f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5884158ee0 con 0x7f588406e740 2023-10-06T03:04:45.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.352+0000 7f5889afc700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f588406e740 0x7f5884155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.352+0000 7f5889afc700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f588406e740 0x7f5884155840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:58792/0 (socket says 172.21.15.125:58792) 2023-10-06T03:04:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.352+0000 7f5889afc700 1 -- 172.21.15.125:0/1625473424 learned_addr learned my addr 172.21.15.125:0/1625473424 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.352+0000 7f58892fb700 1 --2- 172.21.15.125:0/1625473424 >> v2:172.21.15.125:3300/0 conn(0x7f588413b620 0x7f5884159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.352+0000 7f58892fb700 1 -- 172.21.15.125:0/1625473424 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f588406e740 msgr2=0x7f5884155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.353+0000 7f58892fb700 1 --2- 172.21.15.125:0/1625473424 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f588406e740 0x7f5884155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.353+0000 7f58892fb700 1 -- 172.21.15.125:0/1625473424 >> v1:172.21.15.130:6789/0 conn(0x7f588413b9f0 legacy=0x7f588406e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.353+0000 7f58892fb700 1 -- 172.21.15.125:0/1625473424 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5884156490 con 0x7f588413b620 2023-10-06T03:04:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.353+0000 7f58892fb700 1 --2- 172.21.15.125:0/1625473424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f588413b620 0x7f5884159980 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f58740090e0 tx=0x7f5874009a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17dcbb6959b58320 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.353+0000 7f587bfff700 1 -- 172.21.15.125:0/1625473424 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587400b710 con 0x7f588413b620 2023-10-06T03:04:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.353+0000 7f587bfff700 1 -- 172.21.15.125:0/1625473424 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587400b870 con 0x7f588413b620 2023-10-06T03:04:45.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.353+0000 7f587bfff700 1 -- 172.21.15.125:0/1625473424 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587400bc30 con 0x7f588413b620 2023-10-06T03:04:45.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.354+0000 7f588b55f700 1 -- 172.21.15.125:0/1625473424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f588413b620 msgr2=0x7f5884159980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.354+0000 7f588b55f700 1 --2- 172.21.15.125:0/1625473424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f588413b620 0x7f5884159980 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f58740090e0 tx=0x7f5874009a30 comp rx=0 tx=0).stop 2023-10-06T03:04:45.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.353+0000 7f7610a2f700 1 Processor -- start 2023-10-06T03:04:45.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.354+0000 7f588b55f700 1 -- 172.21.15.125:0/1625473424 shutdown_connections 2023-10-06T03:04:45.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.354+0000 7f588b55f700 1 --2- 172.21.15.125:0/1625473424 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f588406e740 0x7f5884155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.354+0000 7f588b55f700 1 --2- 172.21.15.125:0/1625473424 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f588413b620 0x7f5884159980 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.354+0000 7f588b55f700 1 -- 172.21.15.125:0/1625473424 >> 172.21.15.125:0/1625473424 conn(0x7f58840cbd30 msgr2=0x7f58840cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.354+0000 7f7610a2f700 1 -- start start 2023-10-06T03:04:45.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.355+0000 7f588b55f700 1 -- 172.21.15.125:0/1625473424 shutdown_connections 2023-10-06T03:04:45.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.355+0000 7f588b55f700 1 -- 172.21.15.125:0/1625473424 wait complete. 2023-10-06T03:04:45.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.356+0000 7f7610a2f700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f760c0cc840 0x7f760c159980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.356+0000 7f7610a2f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0cb4e0 con 0x7f760c06e740 2023-10-06T03:04:45.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.356+0000 7f7610a2f700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c1594f0 con 0x7f760c13b3d0 2023-10-06T03:04:45.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.356+0000 7f7610a2f700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c156490 con 0x7f760c0cc840 2023-10-06T03:04:45.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.356+0000 7f760ad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f760c06e740 0x7f760c155840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53130/0 (socket says 172.21.15.125:53130) 2023-10-06T03:04:45.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.356+0000 7f760ad9d700 1 -- 172.21.15.125:0/685318104 learned_addr learned my addr 172.21.15.125:0/685318104 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:45.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.357+0000 7f588b55f700 1 Processor -- start 2023-10-06T03:04:45.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.357+0000 7f760959a700 1 -- 172.21.15.125:0/685318104 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502364796 0 0) 0x7f760c0cb4e0 con 0x7f760c06e740 2023-10-06T03:04:45.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.357+0000 7f760959a700 1 -- 172.21.15.125:0/685318104 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75f4003570 con 0x7f760c06e740 2023-10-06T03:04:45.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.357+0000 7f760a59c700 1 --2- 172.21.15.125:0/685318104 >> v2:172.21.15.130:3300/0 conn(0x7f760c0cc840 0x7f760c159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.357+0000 7f760959a700 1 -- 172.21.15.125:0/685318104 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189244317 0 0) 0x7f760c1594f0 con 0x7f760c13b3d0 2023-10-06T03:04:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.357+0000 7f760959a700 1 -- 172.21.15.125:0/685318104 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f760c0cb4e0 con 0x7f760c13b3d0 2023-10-06T03:04:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.357+0000 7f760959a700 1 -- 172.21.15.125:0/685318104 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3135227408 0 0) 0x7f75f4003570 con 0x7f760c06e740 2023-10-06T03:04:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.357+0000 7f760959a700 1 -- 172.21.15.125:0/685318104 >> v2:172.21.15.130:3300/0 conn(0x7f760c0cc840 msgr2=0x7f760c159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.357+0000 7f760959a700 1 --2- 172.21.15.125:0/685318104 >> v2:172.21.15.130:3300/0 conn(0x7f760c0cc840 0x7f760c159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.357+0000 7f760959a700 1 -- 172.21.15.125:0/685318104 >> v1:172.21.15.130:6789/0 conn(0x7f760c13b3d0 legacy=0x7f760c06e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.357+0000 7f760959a700 1 -- 172.21.15.125:0/685318104 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c159180 con 0x7f760c06e740 2023-10-06T03:04:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.357+0000 7f760959a700 1 -- 172.21.15.125:0/685318104 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f75fc001470 con 0x7f760c06e740 2023-10-06T03:04:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.357+0000 7f760959a700 1 -- 172.21.15.125:0/685318104 >> v1:172.21.15.125:6789/0 conn(0x7f760c06e740 legacy=0x7f760c155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.357+0000 7f760959a700 1 --2- 172.21.15.125:0/685318104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75f4003c40 0x7f75f4004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.357+0000 7f760959a700 1 --2- 172.21.15.125:0/685318104 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75f4004810 0x7f75f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.361 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.357+0000 7f760959a700 1 --2- 172.21.15.125:0/685318104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75f4005210 0x7f75f400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.357+0000 7f760959a700 1 -- 172.21.15.125:0/685318104 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c156490 con 0x7f75f4005210 2023-10-06T03:04:45.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.357+0000 7f760959a700 1 -- 172.21.15.125:0/685318104 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f400c130 con 0x7f75f4003c40 2023-10-06T03:04:45.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.357+0000 7f760959a700 1 -- 172.21.15.125:0/685318104 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f400c2c0 con 0x7f75f4004810 2023-10-06T03:04:45.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.358+0000 7f760a59c700 1 --2- 172.21.15.125:0/685318104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75f4003c40 0x7f75f4004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.358+0000 7f7609d9b700 1 --2- 172.21.15.125:0/685318104 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75f4004810 0x7f75f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.358+0000 7f760ad9d700 1 --2- 172.21.15.125:0/685318104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75f4005210 0x7f75f400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.362 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.358+0000 7f588b55f700 1 -- start start 2023-10-06T03:04:45.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.358+0000 7f760a59c700 1 -- 172.21.15.125:0/685318104 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75f4004810 msgr2=0x7f75f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:45.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.358+0000 7f760a59c700 1 --2- 172.21.15.125:0/685318104 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f75f4004810 0x7f75f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.358+0000 7f760a59c700 1 -- 172.21.15.125:0/685318104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75f4005210 msgr2=0x7f75f400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:45.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.358+0000 7f760a59c700 1 --2- 172.21.15.125:0/685318104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75f4005210 0x7f75f400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.358+0000 7f760a59c700 1 -- 172.21.15.125:0/685318104 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f4003570 con 0x7f75f4003c40 2023-10-06T03:04:45.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.358+0000 7f760ad9d700 1 -- 172.21.15.125:0/685318104 reap_dead start 2023-10-06T03:04:45.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.358+0000 7f760a59c700 1 --2- 172.21.15.125:0/685318104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75f4003c40 0x7f75f4004030 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7600009c00 tx=0x7f76000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a974d8dfc6e6ec0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.358+0000 7f760959a700 1 -- 172.21.15.125:0/685318104 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760000e710 con 0x7f75f4003c40 2023-10-06T03:04:45.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.359+0000 7f760959a700 1 -- 172.21.15.125:0/685318104 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760000e870 con 0x7f75f4003c40 2023-10-06T03:04:45.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.359+0000 7f760959a700 1 -- 172.21.15.125:0/685318104 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760000ec30 con 0x7f75f4003c40 2023-10-06T03:04:45.364 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.359+0000 7f588b55f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f588406e740 0x7f58841518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.359+0000 7f588b55f700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f588413b620 0x7f5884139a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.359+0000 7f588b55f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f588413b9f0 0x7f588414fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.359+0000 7f588b55f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5884151460 con 0x7f588413b9f0 2023-10-06T03:04:45.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.359+0000 7f588b55f700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5884150850 con 0x7f588413b620 2023-10-06T03:04:45.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.359+0000 7f588b55f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5884150b30 con 0x7f588406e740 2023-10-06T03:04:45.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.359+0000 7f5889afc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f588413b9f0 0x7f588414fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.359+0000 7f5889afc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f588413b9f0 0x7f588414fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40246/0 (socket says 172.21.15.125:40246) 2023-10-06T03:04:45.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.359+0000 7f5889afc700 1 -- 172.21.15.125:0/1513827011 learned_addr learned my addr 172.21.15.125:0/1513827011 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.359+0000 7f58892fb700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f588406e740 0x7f58841518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.359+0000 7f5888afa700 1 --2- 172.21.15.125:0/1513827011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f588413b620 0x7f5884139a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.359+0000 7f7610a2f700 1 -- 172.21.15.125:0/685318104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75f4003c40 msgr2=0x7f75f4004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.359+0000 7f7610a2f700 1 --2- 172.21.15.125:0/685318104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75f4003c40 0x7f75f4004030 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7600009c00 tx=0x7f76000091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.360+0000 7f7610a2f700 1 -- 172.21.15.125:0/685318104 shutdown_connections 2023-10-06T03:04:45.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.360+0000 7f7610a2f700 1 --2- 172.21.15.125:0/685318104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75f4003c40 0x7f75f4004030 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.360+0000 7f7610a2f700 1 -- 172.21.15.125:0/685318104 >> 172.21.15.125:0/685318104 conn(0x7f760c0cbd30 msgr2=0x7f760c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.360+0000 7f33a91be700 1 Processor -- start 2023-10-06T03:04:45.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.360+0000 7f58892fb700 1 -- 172.21.15.125:0/1513827011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f588413b620 msgr2=0x7f5884139a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.360+0000 7f58892fb700 1 --2- 172.21.15.125:0/1513827011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f588413b620 0x7f5884139a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.360+0000 7f58892fb700 1 -- 172.21.15.125:0/1513827011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f588413b9f0 msgr2=0x7f588414fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.360+0000 7f58892fb700 1 --2- 172.21.15.125:0/1513827011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f588413b9f0 0x7f588414fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.360+0000 7f58892fb700 1 -- 172.21.15.125:0/1513827011 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5874009cb0 con 0x7f588406e740 2023-10-06T03:04:45.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.360+0000 7f33a91be700 1 -- start start 2023-10-06T03:04:45.368 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.360+0000 7f7610a2f700 1 -- 172.21.15.125:0/685318104 shutdown_connections 2023-10-06T03:04:45.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.360+0000 7f58892fb700 1 --2- 172.21.15.125:0/1513827011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f588406e740 0x7f58841518f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5874016000 tx=0x7f5874017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.361+0000 7f58797fa700 1 -- 172.21.15.125:0/1513827011 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f587401d070 con 0x7f588406e740 2023-10-06T03:04:45.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.361+0000 7f58797fa700 1 -- 172.21.15.125:0/1513827011 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f587400bbf0 con 0x7f588406e740 2023-10-06T03:04:45.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.361+0000 7f58797fa700 1 -- 172.21.15.125:0/1513827011 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58740226e0 con 0x7f588406e740 2023-10-06T03:04:45.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.361+0000 7f588b55f700 1 -- 172.21.15.125:0/1513827011 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5884150e10 con 0x7f588406e740 2023-10-06T03:04:45.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.361+0000 7f588b55f700 1 -- 172.21.15.125:0/1513827011 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5884139fa0 con 0x7f588406e740 2023-10-06T03:04:45.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.360+0000 7f7610a2f700 1 -- 172.21.15.125:0/685318104 wait complete. 2023-10-06T03:04:45.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.362+0000 7f7610a2f700 1 Processor -- start 2023-10-06T03:04:45.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.361+0000 7f33a91be700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f33a40b0240 0x7f33a40cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.361+0000 7f33a91be700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a40c1d50 con 0x7f33a40c3440 2023-10-06T03:04:45.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.361+0000 7f33a91be700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a40ca1b0 con 0x7f33a40ca440 2023-10-06T03:04:45.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.361+0000 7f33a91be700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a4063940 con 0x7f33a40b0240 2023-10-06T03:04:45.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.362+0000 7f588b55f700 1 -- 172.21.15.125:0/1513827011 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5884151740 con 0x7f588406e740 2023-10-06T03:04:45.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.362+0000 7f33a359e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f33a40b0240 0x7f33a40cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.363+0000 7f33a359e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f33a40b0240 0x7f33a40cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40252/0 (socket says 172.21.15.125:40252) 2023-10-06T03:04:45.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.363+0000 7f33a359e700 1 -- 172.21.15.125:0/912103777 learned_addr learned my addr 172.21.15.125:0/912103777 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.362+0000 7f7610a2f700 1 -- start start 2023-10-06T03:04:45.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.363+0000 7f7610a2f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75f4003c40 0x7f760c14c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.363+0000 7f7610a2f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f760c175e90 0x7f760c13cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.363+0000 7f7610a2f700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f760c14b8e0 0x7f760c13d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.363+0000 7f7610a2f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c14d410 con 0x7f75f4003c40 2023-10-06T03:04:45.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.363+0000 7f7610a2f700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c13dfa0 con 0x7f760c14b8e0 2023-10-06T03:04:45.372 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.363+0000 7f7610a2f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c14ce50 con 0x7f760c175e90 2023-10-06T03:04:45.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.363+0000 7f33a359e700 1 -- 172.21.15.125:0/912103777 >> v1:172.21.15.130:6789/0 conn(0x7f33a40ca440 legacy=0x7f33a4155850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:04:45.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.363+0000 7f33a359e700 1 -- 172.21.15.125:0/912103777 >> v1:172.21.15.125:6789/0 conn(0x7f33a40c3440 legacy=0x7f33a4063230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:45.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.363+0000 7f33a359e700 1 -- 172.21.15.125:0/912103777 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a40c1740 con 0x7f33a40b0240 2023-10-06T03:04:45.373 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.363+0000 7f33a359e700 1 --2- 172.21.15.125:0/912103777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a40b0240 0x7f33a40cc870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f339c009f20 tx=0x7f339c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b985a96906567ed7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.363+0000 7f4bee464700 1 Processor -- start 2023-10-06T03:04:45.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.363+0000 7f4bee464700 1 -- start start 2023-10-06T03:04:45.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.363+0000 7f58797fa700 1 -- 172.21.15.125:0/1513827011 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5874022b10 con 0x7f588406e740 2023-10-06T03:04:45.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.364+0000 7f58797fa700 1 --2- 172.21.15.125:0/1513827011 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5868067080 0x7f5868069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.364+0000 7f58797fa700 1 -- 172.21.15.125:0/1513827011 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5874085fc0 con 0x7f588406e740 2023-10-06T03:04:45.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.364+0000 7f4bee464700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4be806e030 0x7f4be806e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.364+0000 7f4bee464700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be806b210 con 0x7f4be806c0f0 2023-10-06T03:04:45.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.364+0000 7f4bee464700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be806a600 con 0x7f4be806a020 2023-10-06T03:04:45.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.364+0000 7f4bee464700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be806e9f0 con 0x7f4be806e030 2023-10-06T03:04:45.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.365+0000 7f4be7fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4be806c0f0 0x7f4be80c7fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53158/0 (socket says 172.21.15.125:53158) 2023-10-06T03:04:45.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.365+0000 7f4be77fe700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f4be806a020 0x7f4be813b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:52334/0 (socket says 172.21.15.125:52334) 2023-10-06T03:04:45.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.365+0000 7f4be7fff700 1 -- 172.21.15.125:0/1738059140 learned_addr learned my addr 172.21.15.125:0/1738059140 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:45.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.363+0000 7f760a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75f4003c40 0x7f760c14c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.363+0000 7f760a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75f4003c40 0x7f760c14c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40266/0 (socket says 172.21.15.125:40266) 2023-10-06T03:04:45.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.363+0000 7f760a59c700 1 -- 172.21.15.125:0/526943862 learned_addr learned my addr 172.21.15.125:0/526943862 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.364+0000 7f760ad9d700 1 --2- 172.21.15.125:0/526943862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f760c14b8e0 0x7f760c13d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.364+0000 7f760a59c700 1 -- 172.21.15.125:0/526943862 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f760c175e90 msgr2=0x7f760c13cc20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:04:45.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.364+0000 7f760a59c700 1 --2- 172.21.15.125:0/526943862 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f760c175e90 0x7f760c13cc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.364+0000 7f760a59c700 1 -- 172.21.15.125:0/526943862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f760c14b8e0 msgr2=0x7f760c13d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.364+0000 7f760a59c700 1 --2- 172.21.15.125:0/526943862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f760c14b8e0 0x7f760c13d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.364+0000 7f760a59c700 1 -- 172.21.15.125:0/526943862 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c14d130 con 0x7f75f4003c40 2023-10-06T03:04:45.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.364+0000 7f760a59c700 1 --2- 172.21.15.125:0/526943862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75f4003c40 0x7f760c14c7a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7600013ef0 tx=0x7f760001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.364+0000 7f75fa7fc700 1 -- 172.21.15.125:0/526943862 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600022070 con 0x7f75f4003c40 2023-10-06T03:04:45.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.364+0000 7f75fa7fc700 1 -- 172.21.15.125:0/526943862 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760000ebf0 con 0x7f75f4003c40 2023-10-06T03:04:45.377 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.364+0000 7f75fa7fc700 1 -- 172.21.15.125:0/526943862 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760001c6a0 con 0x7f75f4003c40 2023-10-06T03:04:45.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.365+0000 7f4beca01700 1 --2- 172.21.15.125:0/1738059140 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4be806e030 0x7f4be806e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.365+0000 7f5888afa700 1 --2- 172.21.15.125:0/1513827011 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5868067080 0x7f5868069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.365+0000 7f4be6ffd700 1 -- 172.21.15.125:0/1738059140 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388239761 0 0) 0x7f4be806a600 con 0x7f4be806a020 2023-10-06T03:04:45.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.365+0000 7f4be6ffd700 1 -- 172.21.15.125:0/1738059140 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bd0003570 con 0x7f4be806a020 2023-10-06T03:04:45.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.365+0000 7f4be6ffd700 1 -- 172.21.15.125:0/1738059140 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855260707 0 0) 0x7f4be806b210 con 0x7f4be806c0f0 2023-10-06T03:04:45.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.365+0000 7f4be6ffd700 1 -- 172.21.15.125:0/1738059140 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be806a600 con 0x7f4be806c0f0 2023-10-06T03:04:45.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.365+0000 7f33a1d9b700 1 -- 172.21.15.125:0/912103777 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c00e070 con 0x7f33a40b0240 2023-10-06T03:04:45.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.366+0000 7f33a1d9b700 1 -- 172.21.15.125:0/912103777 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339c00ba40 con 0x7f33a40b0240 2023-10-06T03:04:45.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.366+0000 7f33a1d9b700 1 -- 172.21.15.125:0/912103777 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c0092e0 con 0x7f33a40b0240 2023-10-06T03:04:45.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.366+0000 7f7610a2f700 1 -- 172.21.15.125:0/526943862 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c0aec20 con 0x7f75f4003c40 2023-10-06T03:04:45.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.366+0000 7f7610a2f700 1 -- 172.21.15.125:0/526943862 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c13d6a0 con 0x7f75f4003c40 2023-10-06T03:04:45.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.366+0000 7fba8e4e8700 1 Processor -- start 2023-10-06T03:04:45.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.366+0000 7f5888afa700 1 --2- 172.21.15.125:0/1513827011 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5868067080 0x7f5868069530 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5884152070 tx=0x7f587c009760 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.366+0000 7f33a91be700 1 -- 172.21.15.125:0/912103777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a40b0240 msgr2=0x7f33a40cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.366+0000 7f33a91be700 1 --2- 172.21.15.125:0/912103777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a40b0240 0x7f33a40cc870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f339c009f20 tx=0x7f339c009840 comp rx=0 tx=0).stop 2023-10-06T03:04:45.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.366+0000 7f33a91be700 1 -- 172.21.15.125:0/912103777 shutdown_connections 2023-10-06T03:04:45.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.366+0000 7f33a91be700 1 --2- 172.21.15.125:0/912103777 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a40b0240 0x7f33a40cc870 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.366+0000 7f33a91be700 1 -- 172.21.15.125:0/912103777 >> 172.21.15.125:0/912103777 conn(0x7f33a40af730 msgr2=0x7f33a40afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.367+0000 7f33a91be700 1 -- 172.21.15.125:0/912103777 shutdown_connections 2023-10-06T03:04:45.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.367+0000 7f33a91be700 1 -- 172.21.15.125:0/912103777 wait complete. 2023-10-06T03:04:45.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.367+0000 7f4beca01700 1 -- 172.21.15.125:0/1738059140 >> v1:172.21.15.130:6789/0 conn(0x7f4be806a020 legacy=0x7f4be813b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.367+0000 7f4beca01700 1 -- 172.21.15.125:0/1738059140 >> v1:172.21.15.125:6789/0 conn(0x7f4be806c0f0 legacy=0x7f4be80c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.367+0000 7f4beca01700 1 -- 172.21.15.125:0/1738059140 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be806a8e0 con 0x7f4be806e030 2023-10-06T03:04:45.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.366+0000 7fba8e4e8700 1 -- start start 2023-10-06T03:04:45.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.367+0000 7f7610a2f700 1 -- 172.21.15.125:0/526943862 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c0af140 con 0x7f75f4003c40 2023-10-06T03:04:45.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.367+0000 7fba8e4e8700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba880b2290 0x7fba880b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.367+0000 7fba8e4e8700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fba881594d0 0x7fba88069040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.367+0000 7fba8e4e8700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba88069580 con 0x7fba88068bd0 2023-10-06T03:04:45.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.367+0000 7fba8e4e8700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba880b0020 con 0x7fba881594d0 2023-10-06T03:04:45.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.367+0000 7fba8e4e8700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba880697b0 con 0x7fba880b2290 2023-10-06T03:04:45.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.367+0000 7fba87fff700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba880b2290 0x7fba880b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.368+0000 7fba87fff700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba880b2290 0x7fba880b2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:58846/0 (socket says 172.21.15.125:58846) 2023-10-06T03:04:45.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.368+0000 7fba87fff700 1 -- 172.21.15.125:0/1737092804 learned_addr learned my addr 172.21.15.125:0/1737092804 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.368+0000 7fba8ca85700 1 --2- 172.21.15.125:0/1737092804 >> v2:172.21.15.130:3300/0 conn(0x7fba881594d0 0x7fba88069040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.368+0000 7f4beca01700 1 --2- 172.21.15.125:0/1738059140 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4be806e030 0x7f4be806e4b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80098c0 tx=0x7f4bd80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=779080448169e430 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.368+0000 7fba8ca85700 1 -- 172.21.15.125:0/1737092804 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba880b2290 msgr2=0x7fba880b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:45.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.368+0000 7fba8ca85700 1 --2- 172.21.15.125:0/1737092804 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba880b2290 0x7fba880b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.368+0000 7fba8ca85700 1 -- 172.21.15.125:0/1737092804 >> v1:172.21.15.130:6789/0 conn(0x7fba88068bd0 legacy=0x7fba88158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:45.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.368+0000 7fba8ca85700 1 -- 172.21.15.125:0/1737092804 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba88069a90 con 0x7fba881594d0 2023-10-06T03:04:45.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.368+0000 7fba8ca85700 1 --2- 172.21.15.125:0/1737092804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba881594d0 0x7fba88069040 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba80009e60 tx=0x7fba80009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ef925e9926f395 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.385 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.368+0000 7f33a91be700 1 Processor -- start 2023-10-06T03:04:45.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.368+0000 7fba86ffd700 1 -- 172.21.15.125:0/1737092804 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8000e070 con 0x7fba881594d0 2023-10-06T03:04:45.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.369+0000 7fba86ffd700 1 -- 172.21.15.125:0/1737092804 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8000bb20 con 0x7fba881594d0 2023-10-06T03:04:45.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.369+0000 7fba86ffd700 1 -- 172.21.15.125:0/1737092804 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80012430 con 0x7fba881594d0 2023-10-06T03:04:45.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.369+0000 7f4be6ffd700 1 -- 172.21.15.125:0/1738059140 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be00017f0 con 0x7f4be806e030 2023-10-06T03:04:45.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.369+0000 7f4be6ffd700 1 -- 172.21.15.125:0/1738059140 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd8011420 con 0x7f4be806e030 2023-10-06T03:04:45.386 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.369+0000 7f4be6ffd700 1 -- 172.21.15.125:0/1738059140 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd80117c0 con 0x7f4be806e030 2023-10-06T03:04:45.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.368+0000 7f33a91be700 1 -- start start 2023-10-06T03:04:45.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.369+0000 7f33a91be700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a40b0240 0x7f33a4141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.369+0000 7f33a91be700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33a40c3440 0x7f33a4148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.369+0000 7f33a91be700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33a40ca440 0x7f33a4149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.369+0000 7f33a91be700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a4141fd0 con 0x7f33a40b0240 2023-10-06T03:04:45.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.369+0000 7f33a91be700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a4097e50 con 0x7f33a40c3440 2023-10-06T03:04:45.387 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.369+0000 7f33a91be700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a4097240 con 0x7f33a40ca440 2023-10-06T03:04:45.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.369+0000 7fba8e4e8700 1 -- 172.21.15.125:0/1737092804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba881594d0 msgr2=0x7fba88069040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.369+0000 7fba8e4e8700 1 --2- 172.21.15.125:0/1737092804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba881594d0 0x7fba88069040 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fba80009e60 tx=0x7fba80009780 comp rx=0 tx=0).stop 2023-10-06T03:04:45.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.370+0000 7f33a2d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a40b0240 0x7f33a4141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.370+0000 7f33a2d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a40b0240 0x7f33a4141a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40280/0 (socket says 172.21.15.125:40280) 2023-10-06T03:04:45.388 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.370+0000 7f33a2d9d700 1 -- 172.21.15.125:0/3735201021 learned_addr learned my addr 172.21.15.125:0/3735201021 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.370+0000 7fba8e4e8700 1 -- 172.21.15.125:0/1737092804 shutdown_connections 2023-10-06T03:04:45.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.370+0000 7fba8e4e8700 1 --2- 172.21.15.125:0/1737092804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba881594d0 0x7fba88069040 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.370+0000 7fba8e4e8700 1 --2- 172.21.15.125:0/1737092804 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba880b2290 0x7fba880b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.370+0000 7fba8e4e8700 1 -- 172.21.15.125:0/1737092804 >> 172.21.15.125:0/1737092804 conn(0x7fba8806ed40 msgr2=0x7fba8806f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.370+0000 7f33a259c700 1 --2- 172.21.15.125:0/3735201021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33a40c3440 0x7f33a4148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.389 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.370+0000 7f33a259c700 1 -- 172.21.15.125:0/3735201021 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33a40ca440 msgr2=0x7f33a4149300 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:04:45.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.370+0000 7f33a259c700 1 --2- 172.21.15.125:0/3735201021 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33a40ca440 0x7f33a4149300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.370+0000 7f33a259c700 1 -- 172.21.15.125:0/3735201021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a40b0240 msgr2=0x7f33a4141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.370+0000 7f33a259c700 1 --2- 172.21.15.125:0/3735201021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a40b0240 0x7f33a4141a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.370+0000 7f33a259c700 1 -- 172.21.15.125:0/3735201021 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339c009ae0 con 0x7f33a40c3440 2023-10-06T03:04:45.390 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.370+0000 7fba8e4e8700 1 -- 172.21.15.125:0/1737092804 shutdown_connections 2023-10-06T03:04:45.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.370+0000 7f33a259c700 1 --2- 172.21.15.125:0/3735201021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33a40c3440 0x7f33a4148720 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f339400b5b0 tx=0x7f33940090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.370+0000 7f338affd700 1 -- 172.21.15.125:0/3735201021 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339400f510 con 0x7f33a40c3440 2023-10-06T03:04:45.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.370+0000 7f338affd700 1 -- 172.21.15.125:0/3735201021 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339400f690 con 0x7f33a40c3440 2023-10-06T03:04:45.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.370+0000 7f338affd700 1 -- 172.21.15.125:0/3735201021 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339400fa50 con 0x7f33a40c3440 2023-10-06T03:04:45.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.371+0000 7f33a91be700 1 -- 172.21.15.125:0/3735201021 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a4097520 con 0x7f33a40c3440 2023-10-06T03:04:45.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.371+0000 7f33a91be700 1 -- 172.21.15.125:0/3735201021 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a4097ae0 con 0x7f33a40c3440 2023-10-06T03:04:45.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.370+0000 7fba8e4e8700 1 -- 172.21.15.125:0/1737092804 wait complete. 2023-10-06T03:04:45.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.372+0000 7fba8e4e8700 1 Processor -- start 2023-10-06T03:04:45.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.372+0000 7f33a91be700 1 -- 172.21.15.125:0/3735201021 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33840052b0 con 0x7f33a40c3440 2023-10-06T03:04:45.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.372+0000 7f338affd700 1 -- 172.21.15.125:0/3735201021 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f339401a400 con 0x7f33a40c3440 2023-10-06T03:04:45.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.368+0000 7f75fa7fc700 1 -- 172.21.15.125:0/526943862 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f760001ca90 con 0x7f75f4003c40 2023-10-06T03:04:45.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.369+0000 7f75fa7fc700 1 --2- 172.21.15.125:0/526943862 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f75ec066fe0 0x7f75ec069490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.369+0000 7f75fa7fc700 1 -- 172.21.15.125:0/526943862 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f76000864a0 con 0x7f75f4003c40 2023-10-06T03:04:45.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.373+0000 7f338affd700 1 --2- 172.21.15.125:0/3735201021 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f338c0670a0 0x7f338c069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.373+0000 7f338affd700 1 -- 172.21.15.125:0/3735201021 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3394084270 con 0x7f33a40c3440 2023-10-06T03:04:45.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.372+0000 7fba8e4e8700 1 -- start start 2023-10-06T03:04:45.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.373+0000 7fba8e4e8700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba88068bd0 0x7fba88170500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.373+0000 7fba8e4e8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba880b2290 0x7fba880c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.373+0000 7fba8e4e8700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba881594d0 0x7fba880c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.373+0000 7fba8e4e8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba880c75e0 con 0x7fba880b2290 2023-10-06T03:04:45.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.373+0000 7fba8e4e8700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba880c7ba0 con 0x7fba881594d0 2023-10-06T03:04:45.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.373+0000 7fba8e4e8700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba880c4630 con 0x7fba88068bd0 2023-10-06T03:04:45.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.373+0000 7f4bee464700 1 -- 172.21.15.125:0/1738059140 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4be806e030 msgr2=0x7f4be806e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.373+0000 7f4bee464700 1 --2- 172.21.15.125:0/1738059140 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4be806e030 0x7f4be806e4b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80098c0 tx=0x7f4bd80091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.372+0000 7f58797fa700 1 -- 172.21.15.125:0/1513827011 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5874052e70 con 0x7f588406e740 2023-10-06T03:04:45.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.374+0000 7fe54fd7c700 1 Processor -- start 2023-10-06T03:04:45.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.374+0000 7fe54fd7c700 1 -- start start 2023-10-06T03:04:45.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.374+0000 7f7609d9b700 1 --2- 172.21.15.125:0/526943862 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f75ec066fe0 0x7f75ec069490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.374+0000 7f33a2d9d700 1 --2- 172.21.15.125:0/3735201021 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f338c0670a0 0x7f338c069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.374+0000 7fba87fff700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba88068bd0 0x7fba88170500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.374+0000 7fba87fff700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba88068bd0 0x7fba88170500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:58862/0 (socket says 172.21.15.125:58862) 2023-10-06T03:04:45.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.374+0000 7fba87fff700 1 -- 172.21.15.125:0/2348248419 learned_addr learned my addr 172.21.15.125:0/2348248419 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.374+0000 7fba8ca85700 1 --2- 172.21.15.125:0/2348248419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba881594d0 0x7fba880c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.375+0000 7f75fa7fc700 1 -- 172.21.15.125:0/526943862 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76000532a0 con 0x7f75f4003c40 2023-10-06T03:04:45.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.375+0000 7f4bee464700 1 -- 172.21.15.125:0/1738059140 shutdown_connections 2023-10-06T03:04:45.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.375+0000 7f4bee464700 1 --2- 172.21.15.125:0/1738059140 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4be806e030 0x7f4be806e4b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.375+0000 7f4bee464700 1 -- 172.21.15.125:0/1738059140 >> 172.21.15.125:0/1738059140 conn(0x7f4be80680e0 msgr2=0x7f4be80cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.375+0000 7f7609d9b700 1 --2- 172.21.15.125:0/526943862 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f75ec066fe0 0x7f75ec069490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f760c158610 tx=0x7f76040017a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.375+0000 7fba8ca85700 1 -- 172.21.15.125:0/2348248419 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba88068bd0 msgr2=0x7fba88170500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.375+0000 7fba8ca85700 1 --2- 172.21.15.125:0/2348248419 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba88068bd0 0x7fba88170500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.375+0000 7fba8ca85700 1 -- 172.21.15.125:0/2348248419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba880b2290 msgr2=0x7fba880c5130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T03:04:45.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.375+0000 7fba8ca85700 1 --2- 172.21.15.125:0/2348248419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba880b2290 0x7fba880c5130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.375+0000 7fba8ca85700 1 -- 172.21.15.125:0/2348248419 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba80009a20 con 0x7fba881594d0 2023-10-06T03:04:45.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.375+0000 7fba8ca85700 1 --2- 172.21.15.125:0/2348248419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba881594d0 0x7fba880c8030 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fba80015000 tx=0x7fba80018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.375+0000 7f33a2d9d700 1 --2- 172.21.15.125:0/3735201021 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f338c0670a0 0x7f338c069550 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f33a4159510 tx=0x7f33980091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.375+0000 7fe54fd7c700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe5480cba50 0x7fe5480c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.375+0000 7fe54fd7c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5480c9470 con 0x7fe5480c8150 2023-10-06T03:04:45.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.375+0000 7fe54fd7c700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5480c9b40 con 0x7fe5480af320 2023-10-06T03:04:45.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.375+0000 7fe54fd7c700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5480c85b0 con 0x7fe5480cba50 2023-10-06T03:04:45.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.376+0000 7fe54d317700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe5480cba50 0x7fe5480c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.376+0000 7fe54d317700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe5480cba50 0x7fe5480c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:50472/0 (socket says 172.21.15.125:50472) 2023-10-06T03:04:45.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.376+0000 7fe54d317700 1 -- 172.21.15.125:0/1701456774 learned_addr learned my addr 172.21.15.125:0/1701456774 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.376+0000 7fe54d317700 1 -- 172.21.15.125:0/1701456774 >> v1:172.21.15.130:6789/0 conn(0x7fe5480af320 legacy=0x7fe5480cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.376+0000 7fe54d317700 1 -- 172.21.15.125:0/1701456774 >> v1:172.21.15.125:6789/0 conn(0x7fe5480c8150 legacy=0x7fe5480c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.376+0000 7fe54d317700 1 -- 172.21.15.125:0/1701456774 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5480c8860 con 0x7fe5480cba50 2023-10-06T03:04:45.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.376+0000 7f4bee464700 1 -- 172.21.15.125:0/1738059140 shutdown_connections 2023-10-06T03:04:45.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.376+0000 7f4bee464700 1 -- 172.21.15.125:0/1738059140 wait complete. 2023-10-06T03:04:45.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.376+0000 7fe54d317700 1 --2- 172.21.15.125:0/1701456774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5480cba50 0x7fe5480c7c10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe5380099b0 tx=0x7fe538009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=676b0d642ccdbd3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.378+0000 7f4bee464700 1 Processor -- start 2023-10-06T03:04:45.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.378+0000 7f4bee464700 1 -- start start 2023-10-06T03:04:45.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.379+0000 7f4bee464700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4be806a020 0x7f4be8156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.379+0000 7f4bee464700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4be806c0f0 0x7f4be81583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.379+0000 7f4bee464700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4be806e030 0x7f4be813e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.379+0000 7f4bee464700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be813e260 con 0x7f4be806a020 2023-10-06T03:04:45.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.380+0000 7f4bee464700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be80af940 con 0x7f4be806e030 2023-10-06T03:04:45.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.380+0000 7f4bee464700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be80afce0 con 0x7f4be806c0f0 2023-10-06T03:04:45.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.380+0000 7f4be77fe700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4be806c0f0 0x7f4be81583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.380+0000 7f4be77fe700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4be806c0f0 0x7f4be81583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:58864/0 (socket says 172.21.15.125:58864) 2023-10-06T03:04:45.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.380+0000 7f4be77fe700 1 -- 172.21.15.125:0/4033981353 learned_addr learned my addr 172.21.15.125:0/4033981353 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.380+0000 7f4beca01700 1 --2- 172.21.15.125:0/4033981353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4be806e030 0x7f4be813e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.380+0000 7f4be77fe700 1 -- 172.21.15.125:0/4033981353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4be806e030 msgr2=0x7f4be813e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.380+0000 7f4be77fe700 1 --2- 172.21.15.125:0/4033981353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4be806e030 0x7f4be813e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.380+0000 7f4be77fe700 1 -- 172.21.15.125:0/4033981353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4be806a020 msgr2=0x7f4be8156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.380+0000 7f4be77fe700 1 --2- 172.21.15.125:0/4033981353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4be806a020 0x7f4be8156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.380+0000 7f4be77fe700 1 -- 172.21.15.125:0/4033981353 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd8009420 con 0x7f4be806c0f0 2023-10-06T03:04:45.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.380+0000 7f4be77fe700 1 --2- 172.21.15.125:0/4033981353 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4be806c0f0 0x7f4be81583a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4be0001560 tx=0x7f4be0007eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.380+0000 7f4bcffff700 1 -- 172.21.15.125:0/4033981353 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be0004dc0 con 0x7f4be806c0f0 2023-10-06T03:04:45.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.381+0000 7f4bcffff700 1 -- 172.21.15.125:0/4033981353 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be000a960 con 0x7f4be806c0f0 2023-10-06T03:04:45.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.381+0000 7f4bcffff700 1 -- 172.21.15.125:0/4033981353 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be000ad20 con 0x7f4be806c0f0 2023-10-06T03:04:45.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.381+0000 7f4bee464700 1 -- 172.21.15.125:0/4033981353 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be80af380 con 0x7f4be806c0f0 2023-10-06T03:04:45.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.381+0000 7f4bee464700 1 -- 172.21.15.125:0/4033981353 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be80aff80 con 0x7f4be806c0f0 2023-10-06T03:04:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.382+0000 7fe54cb16700 1 -- 172.21.15.125:0/1701456774 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53800b860 con 0x7fe5480cba50 2023-10-06T03:04:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.382+0000 7fe54cb16700 1 -- 172.21.15.125:0/1701456774 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53800b9c0 con 0x7fe5480cba50 2023-10-06T03:04:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.382+0000 7fe54cb16700 1 -- 172.21.15.125:0/1701456774 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53800bd60 con 0x7fe5480cba50 2023-10-06T03:04:45.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.382+0000 7fba6ffff700 1 -- 172.21.15.125:0/2348248419 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8001e430 con 0x7fba881594d0 2023-10-06T03:04:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.383+0000 7fe54fd7c700 1 -- 172.21.15.125:0/1701456774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5480cba50 msgr2=0x7fe5480c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.383+0000 7fe54fd7c700 1 --2- 172.21.15.125:0/1701456774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5480cba50 0x7fe5480c7c10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe5380099b0 tx=0x7fe538009250 comp rx=0 tx=0).stop 2023-10-06T03:04:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.382+0000 7fba8e4e8700 1 -- 172.21.15.125:0/2348248419 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba880c4910 con 0x7fba881594d0 2023-10-06T03:04:45.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.382+0000 7fba8e4e8700 1 -- 172.21.15.125:0/2348248419 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba880c5670 con 0x7fba881594d0 2023-10-06T03:04:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.383+0000 7fe54fd7c700 1 -- 172.21.15.125:0/1701456774 shutdown_connections 2023-10-06T03:04:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.383+0000 7fe54fd7c700 1 --2- 172.21.15.125:0/1701456774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5480cba50 0x7fe5480c7c10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.383+0000 7fe54fd7c700 1 -- 172.21.15.125:0/1701456774 >> 172.21.15.125:0/1701456774 conn(0x7fe548096120 msgr2=0x7fe548068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.382+0000 7f4bcffff700 1 -- 172.21.15.125:0/4033981353 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4be0007360 con 0x7f4be806c0f0 2023-10-06T03:04:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.383+0000 7f4bcffff700 1 --2- 172.21.15.125:0/4033981353 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4bd4066f30 0x7f4bd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.383+0000 7f4bcffff700 1 -- 172.21.15.125:0/4033981353 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4be00841d0 con 0x7f4be806c0f0 2023-10-06T03:04:45.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.384+0000 7fe54fd7c700 1 -- 172.21.15.125:0/1701456774 shutdown_connections 2023-10-06T03:04:45.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.384+0000 7f4be7fff700 1 --2- 172.21.15.125:0/4033981353 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4bd4066f30 0x7f4bd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.384+0000 7fba6ffff700 1 -- 172.21.15.125:0/2348248419 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8001e5b0 con 0x7fba881594d0 2023-10-06T03:04:45.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.384+0000 7fba6ffff700 1 -- 172.21.15.125:0/2348248419 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8001e970 con 0x7fba881594d0 2023-10-06T03:04:45.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.384+0000 7f4be7fff700 1 --2- 172.21.15.125:0/4033981353 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4bd4066f30 0x7f4bd40693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc001690 tx=0x7f4bdc007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.385+0000 7f4bee464700 1 -- 172.21.15.125:0/4033981353 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be80b01a0 con 0x7f4be806c0f0 2023-10-06T03:04:45.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.384+0000 7fe54fd7c700 1 -- 172.21.15.125:0/1701456774 wait complete. 2023-10-06T03:04:45.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.385+0000 7fe54fd7c700 1 Processor -- start 2023-10-06T03:04:45.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.384+0000 7f338affd700 1 -- 172.21.15.125:0/3735201021 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3394051110 con 0x7f33a40c3440 2023-10-06T03:04:45.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.386+0000 7fe54fd7c700 1 -- start start 2023-10-06T03:04:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.387+0000 7fe54fd7c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5480af320 0x7fe548179730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.387+0000 7fe54fd7c700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5480c8150 0x7fe548154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.387+0000 7fe54fd7c700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5480cba50 0x7fe5480c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.387+0000 7fe54fd7c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe548179c70 con 0x7fe5480af320 2023-10-06T03:04:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.387+0000 7fe54fd7c700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe548179f10 con 0x7fe5480c8150 2023-10-06T03:04:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.387+0000 7fe54fd7c700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54817a1f0 con 0x7fe5480cba50 2023-10-06T03:04:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.387+0000 7fe54db18700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5480af320 0x7fe548179730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.387+0000 7fe54db18700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5480af320 0x7fe548179730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40290/0 (socket says 172.21.15.125:40290) 2023-10-06T03:04:45.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.387+0000 7fe54db18700 1 -- 172.21.15.125:0/827983587 learned_addr learned my addr 172.21.15.125:0/827983587 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.385+0000 7fba8e4e8700 1 -- 172.21.15.125:0/2348248419 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba88066510 con 0x7fba881594d0 2023-10-06T03:04:45.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.388+0000 7fe54db18700 1 -- 172.21.15.125:0/827983587 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5480cba50 msgr2=0x7fe5480c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.388+0000 7fe54db18700 1 --2- 172.21.15.125:0/827983587 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5480cba50 0x7fe5480c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.388+0000 7fe54db18700 1 -- 172.21.15.125:0/827983587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5480c8150 msgr2=0x7fe548154b90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:04:45.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.388+0000 7fe54db18700 1 --2- 172.21.15.125:0/827983587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5480c8150 0x7fe548154b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.388+0000 7fe54db18700 1 -- 172.21.15.125:0/827983587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5380094f0 con 0x7fe5480af320 2023-10-06T03:04:45.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.388+0000 7fba6ffff700 1 -- 172.21.15.125:0/2348248419 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba8001ece0 con 0x7fba881594d0 2023-10-06T03:04:45.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.389+0000 7fba6ffff700 1 --2- 172.21.15.125:0/2348248419 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fba74066f30 0x7fba740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.389+0000 7fba6ffff700 1 -- 172.21.15.125:0/2348248419 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fba80086e40 con 0x7fba881594d0 2023-10-06T03:04:45.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.389+0000 7fe54db18700 1 --2- 172.21.15.125:0/827983587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5480af320 0x7fe548179730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe54400c7c0 tx=0x7fe544007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.390+0000 7fe53dffb700 1 -- 172.21.15.125:0/827983587 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544012630 con 0x7fe5480af320 2023-10-06T03:04:45.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.390+0000 7fe53dffb700 1 -- 172.21.15.125:0/827983587 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5440127b0 con 0x7fe5480af320 2023-10-06T03:04:45.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.390+0000 7fe54fd7c700 1 -- 172.21.15.125:0/827983587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54817a4d0 con 0x7fe5480af320 2023-10-06T03:04:45.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.390+0000 7fe54fd7c700 1 -- 172.21.15.125:0/827983587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5480c4260 con 0x7fe5480af320 2023-10-06T03:04:45.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.390+0000 7fe53dffb700 1 -- 172.21.15.125:0/827983587 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544012b70 con 0x7fe5480af320 2023-10-06T03:04:45.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.391+0000 7fe54fd7c700 1 -- 172.21.15.125:0/827983587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5480c4450 con 0x7fe5480af320 2023-10-06T03:04:45.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.393+0000 7fe53dffb700 1 -- 172.21.15.125:0/827983587 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe54401b400 con 0x7fe5480af320 2023-10-06T03:04:45.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.393+0000 7fe53dffb700 1 --2- 172.21.15.125:0/827983587 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe52c067000 0x7fe52c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.393+0000 7fe53dffb700 1 -- 172.21.15.125:0/827983587 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe5440846a0 con 0x7fe5480af320 2023-10-06T03:04:45.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.393+0000 7fe54d317700 1 --2- 172.21.15.125:0/827983587 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe52c067000 0x7fe52c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.393+0000 7fba6ffff700 1 -- 172.21.15.125:0/2348248419 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba80053bc0 con 0x7fba881594d0 2023-10-06T03:04:45.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.394+0000 7fe9fe965700 1 Processor -- start 2023-10-06T03:04:45.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.394+0000 7fba87fff700 1 --2- 172.21.15.125:0/2348248419 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fba74066f30 0x7fba740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.394+0000 7fe54d317700 1 --2- 172.21.15.125:0/827983587 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe52c067000 0x7fe52c0694b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe5380099b0 tx=0x7fe538017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.395+0000 7fba87fff700 1 --2- 172.21.15.125:0/2348248419 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fba74066f30 0x7fba740693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fba880b5e90 tx=0x7fba78009250 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.394+0000 7fe9fe965700 1 -- start start 2023-10-06T03:04:45.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.395+0000 7fe9fe965700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9f80c8630 0x7fe9f80b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.395+0000 7fe9fe965700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f80c6eb0 con 0x7fe9f8067860 2023-10-06T03:04:45.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.395+0000 7fe9fe965700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f80c7190 con 0x7fe9f8068340 2023-10-06T03:04:45.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.395+0000 7fe9fe965700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f80c37c0 con 0x7fe9f80c8630 2023-10-06T03:04:45.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.395+0000 7fe9f7fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fe9f8067860 0x7fe9f8067c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53178/0 (socket says 172.21.15.125:53178) 2023-10-06T03:04:45.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.395+0000 7fe9f7fff700 1 -- 172.21.15.125:0/428720211 learned_addr learned my addr 172.21.15.125:0/428720211 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:45.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.396+0000 7fe9f6ffd700 1 -- 172.21.15.125:0/428720211 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1465812208 0 0) 0x7fe9f80c7190 con 0x7fe9f8068340 2023-10-06T03:04:45.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.396+0000 7fe9f6ffd700 1 -- 172.21.15.125:0/428720211 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9e4003570 con 0x7fe9f8068340 2023-10-06T03:04:45.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.396+0000 7fe9f6ffd700 1 -- 172.21.15.125:0/428720211 <== mon.1 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4173087257 0 0) 0x7fe9e4003570 con 0x7fe9f8068340 2023-10-06T03:04:45.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.396+0000 7fe9f6ffd700 1 -- 172.21.15.125:0/428720211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9f80c8630 msgr2=0x7fe9f80b0240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:04:45.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.396+0000 7fe9f6ffd700 1 --2- 172.21.15.125:0/428720211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9f80c8630 0x7fe9f80b0240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.396+0000 7fe9f6ffd700 1 -- 172.21.15.125:0/428720211 >> v1:172.21.15.125:6789/0 conn(0x7fe9f8067860 legacy=0x7fe9f8067c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.396+0000 7fe9f6ffd700 1 -- 172.21.15.125:0/428720211 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f8068890 con 0x7fe9f8068340 2023-10-06T03:04:45.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.396+0000 7fe9f6ffd700 1 -- 172.21.15.125:0/428720211 <== mon.1 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7fe9e80013a0 con 0x7fe9f8068340 2023-10-06T03:04:45.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.396+0000 7fe9f6ffd700 1 -- 172.21.15.125:0/428720211 >> v1:172.21.15.130:6789/0 conn(0x7fe9f8068340 legacy=0x7fe9f8161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.396+0000 7fe9f6ffd700 1 --2- 172.21.15.125:0/428720211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9e4003a60 0x7fe9e4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.396+0000 7fe9f6ffd700 1 --2- 172.21.15.125:0/428720211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9e4004810 0x7fe9e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.396+0000 7fe9f6ffd700 1 --2- 172.21.15.125:0/428720211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9e40053c0 0x7fe9e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.396+0000 7fe9f6ffd700 1 -- 172.21.15.125:0/428720211 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f80c37c0 con 0x7fe9e4004810 2023-10-06T03:04:45.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.396+0000 7fe9f6ffd700 1 -- 172.21.15.125:0/428720211 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e400c1e0 con 0x7fe9e4003a60 2023-10-06T03:04:45.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.396+0000 7fe9f6ffd700 1 -- 172.21.15.125:0/428720211 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e400c3a0 con 0x7fe9e40053c0 2023-10-06T03:04:45.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.396+0000 7fe9f7fff700 1 --2- 172.21.15.125:0/428720211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9e4003a60 0x7fe9e4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.397+0000 7fe9f7fff700 1 -- 172.21.15.125:0/428720211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9e40053c0 msgr2=0x7fe9e400ba60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:04:45.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.397+0000 7fe9f7fff700 1 --2- 172.21.15.125:0/428720211 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9e40053c0 0x7fe9e400ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.397+0000 7fe9f7fff700 1 -- 172.21.15.125:0/428720211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9e4004810 msgr2=0x7fe9e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:45.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.397+0000 7fe9f7fff700 1 --2- 172.21.15.125:0/428720211 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9e4004810 0x7fe9e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.397+0000 7fe9f7fff700 1 -- 172.21.15.125:0/428720211 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e4003570 con 0x7fe9e4003a60 2023-10-06T03:04:45.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.397+0000 7fe9f7fff700 1 --2- 172.21.15.125:0/428720211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9e4003a60 0x7fe9e4003e70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0001420 tx=0x7fe9e0007cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90be15159bbe78ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.397+0000 7fe9f6ffd700 1 -- 172.21.15.125:0/428720211 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0007110 con 0x7fe9e4003a60 2023-10-06T03:04:45.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.401+0000 7fe9f6ffd700 1 -- 172.21.15.125:0/428720211 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e0007270 con 0x7fe9e4003a60 2023-10-06T03:04:45.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.401+0000 7fe9f6ffd700 1 -- 172.21.15.125:0/428720211 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e00075f0 con 0x7fe9e4003a60 2023-10-06T03:04:45.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.406+0000 7fe9fe965700 1 -- 172.21.15.125:0/428720211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9e4003a60 msgr2=0x7fe9e4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.406+0000 7fe9fe965700 1 --2- 172.21.15.125:0/428720211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9e4003a60 0x7fe9e4003e70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0001420 tx=0x7fe9e0007cb0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.406+0000 7fe9fcf02700 1 -- 172.21.15.125:0/428720211 reap_dead start 2023-10-06T03:04:45.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.406+0000 7fe9fe965700 1 -- 172.21.15.125:0/428720211 shutdown_connections 2023-10-06T03:04:45.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.406+0000 7fe9fe965700 1 -- 172.21.15.125:0/428720211 >> 172.21.15.125:0/428720211 conn(0x7fe9f80af730 msgr2=0x7fe9f80afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.406+0000 7fe9fe965700 1 -- 172.21.15.125:0/428720211 shutdown_connections 2023-10-06T03:04:45.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.406+0000 7fe9fe965700 1 -- 172.21.15.125:0/428720211 wait complete. 2023-10-06T03:04:45.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.407+0000 7f4bcffff700 1 -- 172.21.15.125:0/4033981353 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4be0051070 con 0x7f4be806c0f0 2023-10-06T03:04:45.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.408+0000 7fe53dffb700 1 -- 172.21.15.125:0/827983587 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe544051420 con 0x7fe5480af320 2023-10-06T03:04:45.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.408+0000 7fe9fe965700 1 Processor -- start 2023-10-06T03:04:45.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.408+0000 7fe9fe965700 1 -- start start 2023-10-06T03:04:45.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.409+0000 7fe9fe965700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9e4003a60 0x7fe9f80c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.409+0000 7fe9fe965700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9f80c4aa0 0x7fe9f8149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.409+0000 7fe9fe965700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9f814a200 0x7fe9f80cb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.409+0000 7fe9fe965700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f80c5b90 con 0x7fe9e4003a60 2023-10-06T03:04:45.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.409+0000 7fe9fe965700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f80c4f80 con 0x7fe9f80c4aa0 2023-10-06T03:04:45.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.409+0000 7fe9fe965700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f80c5260 con 0x7fe9f814a200 2023-10-06T03:04:45.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.410+0000 7fe9f77fe700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9f80c4aa0 0x7fe9f8149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.410+0000 7fe9f77fe700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9f80c4aa0 0x7fe9f8149cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:50496/0 (socket says 172.21.15.125:50496) 2023-10-06T03:04:45.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.410+0000 7fe9f77fe700 1 -- 172.21.15.125:0/877402352 learned_addr learned my addr 172.21.15.125:0/877402352 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:45.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.410+0000 7fe9fcf02700 1 --2- 172.21.15.125:0/877402352 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9f814a200 0x7fe9f80cb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.410+0000 7fe9f77fe700 1 -- 172.21.15.125:0/877402352 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9f814a200 msgr2=0x7fe9f80cb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.410+0000 7fe9f77fe700 1 --2- 172.21.15.125:0/877402352 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9f814a200 0x7fe9f80cb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.410+0000 7fe9f77fe700 1 -- 172.21.15.125:0/877402352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9e4003a60 msgr2=0x7fe9f80c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.410+0000 7fe9f77fe700 1 --2- 172.21.15.125:0/877402352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9e4003a60 0x7fe9f80c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.410+0000 7fe9f77fe700 1 -- 172.21.15.125:0/877402352 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f80c5540 con 0x7fe9f80c4aa0 2023-10-06T03:04:45.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.413+0000 7fe9f77fe700 1 --2- 172.21.15.125:0/877402352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9f80c4aa0 0x7fe9f8149cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800cd90 tx=0x7fe9e800a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.413+0000 7fe9effff700 1 -- 172.21.15.125:0/877402352 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e800ce90 con 0x7fe9f80c4aa0 2023-10-06T03:04:45.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.413+0000 7fe9effff700 1 -- 172.21.15.125:0/877402352 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e8007d60 con 0x7fe9f80c4aa0 2023-10-06T03:04:45.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.413+0000 7fe9effff700 1 -- 172.21.15.125:0/877402352 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8001bb0 con 0x7fe9f80c4aa0 2023-10-06T03:04:45.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.413+0000 7fe9fe965700 1 -- 172.21.15.125:0/877402352 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f80c5820 con 0x7fe9f80c4aa0 2023-10-06T03:04:45.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.413+0000 7fe9fe965700 1 -- 172.21.15.125:0/877402352 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f8142b80 con 0x7fe9f80c4aa0 2023-10-06T03:04:45.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.415+0000 7fe9effff700 1 -- 172.21.15.125:0/877402352 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9e8003110 con 0x7fe9f80c4aa0 2023-10-06T03:04:45.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.415+0000 7fe9effff700 1 --2- 172.21.15.125:0/877402352 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe9d8066fb0 0x7fe9d8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:45.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.415+0000 7fe9effff700 1 -- 172.21.15.125:0/877402352 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe9e8085290 con 0x7fe9f80c4aa0 2023-10-06T03:04:45.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.416+0000 7fe9f7fff700 1 --2- 172.21.15.125:0/877402352 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe9d8066fb0 0x7fe9d8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:45.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.416+0000 7fe9f7fff700 1 --2- 172.21.15.125:0/877402352 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe9d8066fb0 0x7fe9d8069460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0001750 tx=0x7fe9e0037000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:45.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.420+0000 7fe9fe965700 1 -- 172.21.15.125:0/877402352 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f80c5d00 con 0x7fe9f80c4aa0 2023-10-06T03:04:45.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.425+0000 7fe9effff700 1 -- 172.21.15.125:0/877402352 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9e8052010 con 0x7fe9f80c4aa0 2023-10-06T03:04:45.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.679+0000 7ffb77c44700 1 -- 172.21.15.125:0/978236962 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ffb50005560 con 0x7ffb7013b9f0 2023-10-06T03:04:45.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.680+0000 7ffb65ffb700 1 -- 172.21.15.125:0/978236962 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffb68051ab0 con 0x7ffb7013b9f0 2023-10-06T03:04:45.684 INFO:teuthology.orchestra.run.smithi125.stdout:55834574855 2023-10-06T03:04:45.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.683+0000 7ffb77c44700 1 -- 172.21.15.125:0/978236962 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ffb5c067200 msgr2=0x7ffb5c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.684+0000 7ffb77c44700 1 --2- 172.21.15.125:0/978236962 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ffb5c067200 0x7ffb5c0696b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00aa50 tx=0x7ffb6c018000 comp rx=0 tx=0).stop 2023-10-06T03:04:45.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.684+0000 7ffb77c44700 1 -- 172.21.15.125:0/978236962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb7013b9f0 msgr2=0x7ffb7013c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.684+0000 7ffb77c44700 1 --2- 172.21.15.125:0/978236962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb7013b9f0 0x7ffb7013c7d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009650 tx=0x7ffb6800f040 comp rx=0 tx=0).stop 2023-10-06T03:04:45.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.684+0000 7ffb77c44700 1 -- 172.21.15.125:0/978236962 shutdown_connections 2023-10-06T03:04:45.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.684+0000 7ffb77c44700 1 --2- 172.21.15.125:0/978236962 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ffb5c067200 0x7ffb5c0696b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.684+0000 7ffb77c44700 1 --2- 172.21.15.125:0/978236962 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffb7013cd10 0x7ffb7016d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.684+0000 7ffb77c44700 1 --2- 172.21.15.125:0/978236962 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb7006e570 0x7ffb701531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.684+0000 7ffb77c44700 1 --2- 172.21.15.125:0/978236962 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffb7013b9f0 0x7ffb7013c7d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.684+0000 7ffb77c44700 1 -- 172.21.15.125:0/978236962 >> 172.21.15.125:0/978236962 conn(0x7ffb700cbd30 msgr2=0x7ffb700c8710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.684+0000 7ffb77c44700 1 -- 172.21.15.125:0/978236962 shutdown_connections 2023-10-06T03:04:45.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.684+0000 7ffb77c44700 1 -- 172.21.15.125:0/978236962 wait complete. 2023-10-06T03:04:45.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2023-10-06T03:04:45.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.740+0000 7f588b55f700 1 -- 172.21.15.125:0/1513827011 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5884066510 con 0x7f588406e740 2023-10-06T03:04:45.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.740+0000 7f58797fa700 1 -- 172.21.15.125:0/1513827011 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5874027090 con 0x7f588406e740 2023-10-06T03:04:45.742 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-10-06T03:04:45.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.741+0000 7f7610a2f700 1 -- 172.21.15.125:0/526943862 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f760c0af140 con 0x7f75f4003c40 2023-10-06T03:04:45.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.743+0000 7f75fa7fc700 1 -- 172.21.15.125:0/526943862 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7600017020 con 0x7f75f4003c40 2023-10-06T03:04:45.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.744+0000 7f588b55f700 1 -- 172.21.15.125:0/1513827011 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5868067080 msgr2=0x7f5868069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.744+0000 7f588b55f700 1 --2- 172.21.15.125:0/1513827011 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5868067080 0x7f5868069530 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5884152070 tx=0x7f587c009760 comp rx=0 tx=0).stop 2023-10-06T03:04:45.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.744+0000 7f588b55f700 1 -- 172.21.15.125:0/1513827011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f588406e740 msgr2=0x7f58841518f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.744+0000 7f588b55f700 1 --2- 172.21.15.125:0/1513827011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f588406e740 0x7f58841518f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5874016000 tx=0x7f5874017000 comp rx=0 tx=0).stop 2023-10-06T03:04:45.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.744+0000 7f588b55f700 1 -- 172.21.15.125:0/1513827011 shutdown_connections 2023-10-06T03:04:45.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.744+0000 7f588b55f700 1 --2- 172.21.15.125:0/1513827011 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5868067080 0x7f5868069530 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5884152070 tx=0x7f587c009760 comp rx=0 tx=0).stop 2023-10-06T03:04:45.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.744+0000 7f588b55f700 1 --2- 172.21.15.125:0/1513827011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f588413b9f0 0x7f588414fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.744+0000 7f588b55f700 1 --2- 172.21.15.125:0/1513827011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f588406e740 0x7f58841518f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.744+0000 7f588b55f700 1 --2- 172.21.15.125:0/1513827011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f588413b620 0x7f5884139a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.744+0000 7f588b55f700 1 -- 172.21.15.125:0/1513827011 >> 172.21.15.125:0/1513827011 conn(0x7f58840cbd30 msgr2=0x7f5884156770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.747 INFO:teuthology.orchestra.run.smithi125.stdout:55834574855 2023-10-06T03:04:45.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.744+0000 7f588b55f700 1 -- 172.21.15.125:0/1513827011 shutdown_connections 2023-10-06T03:04:45.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.744+0000 7f588b55f700 1 -- 172.21.15.125:0/1513827011 wait complete. 2023-10-06T03:04:45.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.747+0000 7f7610a2f700 1 -- 172.21.15.125:0/526943862 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f75ec066fe0 msgr2=0x7f75ec069490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.747+0000 7f7610a2f700 1 --2- 172.21.15.125:0/526943862 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f75ec066fe0 0x7f75ec069490 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f760c158610 tx=0x7f76040017a0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.747+0000 7f7610a2f700 1 -- 172.21.15.125:0/526943862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75f4003c40 msgr2=0x7f760c14c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.747+0000 7f7610a2f700 1 --2- 172.21.15.125:0/526943862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75f4003c40 0x7f760c14c7a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7600013ef0 tx=0x7f760001a000 comp rx=0 tx=0).stop 2023-10-06T03:04:45.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.747+0000 7f7610a2f700 1 -- 172.21.15.125:0/526943862 shutdown_connections 2023-10-06T03:04:45.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.747+0000 7f7610a2f700 1 --2- 172.21.15.125:0/526943862 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f75ec066fe0 0x7f75ec069490 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.747+0000 7f7610a2f700 1 --2- 172.21.15.125:0/526943862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f760c14b8e0 0x7f760c13d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.747+0000 7f7610a2f700 1 --2- 172.21.15.125:0/526943862 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f75f4003c40 0x7f760c14c7a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.747+0000 7f7610a2f700 1 --2- 172.21.15.125:0/526943862 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f760c175e90 0x7f760c13cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.747+0000 7f7610a2f700 1 -- 172.21.15.125:0/526943862 >> 172.21.15.125:0/526943862 conn(0x7f760c0cbd30 msgr2=0x7f760c14e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.747+0000 7f7610a2f700 1 -- 172.21.15.125:0/526943862 shutdown_connections 2023-10-06T03:04:45.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.747+0000 7f7610a2f700 1 -- 172.21.15.125:0/526943862 wait complete. 2023-10-06T03:04:45.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.753+0000 7f4bee464700 1 -- 172.21.15.125:0/4033981353 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4be8066510 con 0x7f4be806c0f0 2023-10-06T03:04:45.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.754+0000 7f4bcffff700 1 -- 172.21.15.125:0/4033981353 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4be0018030 con 0x7f4be806c0f0 2023-10-06T03:04:45.755 INFO:teuthology.orchestra.run.smithi125.stdout:55834574855 2023-10-06T03:04:45.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.756+0000 7f4bee464700 1 -- 172.21.15.125:0/4033981353 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4bd4066f30 msgr2=0x7f4bd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.756+0000 7f4bee464700 1 --2- 172.21.15.125:0/4033981353 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4bd4066f30 0x7f4bd40693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc001690 tx=0x7f4bdc007a30 comp rx=0 tx=0).stop 2023-10-06T03:04:45.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.756+0000 7f4bee464700 1 -- 172.21.15.125:0/4033981353 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4be806c0f0 msgr2=0x7f4be81583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.756+0000 7f4bee464700 1 --2- 172.21.15.125:0/4033981353 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4be806c0f0 0x7f4be81583a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4be0001560 tx=0x7f4be0007eb0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.756+0000 7f4bee464700 1 -- 172.21.15.125:0/4033981353 shutdown_connections 2023-10-06T03:04:45.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.756+0000 7f4bee464700 1 --2- 172.21.15.125:0/4033981353 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4bd4066f30 0x7f4bd40693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.756+0000 7f4bee464700 1 --2- 172.21.15.125:0/4033981353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4be806e030 0x7f4be813e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.756+0000 7f4bee464700 1 --2- 172.21.15.125:0/4033981353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4be806a020 0x7f4be8156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.756+0000 7f4bee464700 1 --2- 172.21.15.125:0/4033981353 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4be806c0f0 0x7f4be81583a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.756+0000 7f4bee464700 1 -- 172.21.15.125:0/4033981353 >> 172.21.15.125:0/4033981353 conn(0x7f4be80680e0 msgr2=0x7f4be8070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.757+0000 7f4bee464700 1 -- 172.21.15.125:0/4033981353 shutdown_connections 2023-10-06T03:04:45.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.757+0000 7f4bee464700 1 -- 172.21.15.125:0/4033981353 wait complete. 2023-10-06T03:04:45.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2023-10-06T03:04:45.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.5 2023-10-06T03:04:45.771 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2023-10-06T03:04:45.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.776+0000 7f33a91be700 1 -- 172.21.15.125:0/3735201021 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f3384005830 con 0x7f33a40c3440 2023-10-06T03:04:45.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.777+0000 7f338affd700 1 -- 172.21.15.125:0/3735201021 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3394054730 con 0x7f33a40c3440 2023-10-06T03:04:45.778 INFO:teuthology.orchestra.run.smithi125.stdout:55834574855 2023-10-06T03:04:45.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.780+0000 7f33a91be700 1 -- 172.21.15.125:0/3735201021 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f338c0670a0 msgr2=0x7f338c069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.780+0000 7f33a91be700 1 --2- 172.21.15.125:0/3735201021 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f338c0670a0 0x7f338c069550 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f33a4159510 tx=0x7f33980091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.780+0000 7f33a91be700 1 -- 172.21.15.125:0/3735201021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33a40c3440 msgr2=0x7f33a4148720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.780+0000 7f33a91be700 1 --2- 172.21.15.125:0/3735201021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33a40c3440 0x7f33a4148720 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f339400b5b0 tx=0x7f33940090f0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.780+0000 7f33a91be700 1 -- 172.21.15.125:0/3735201021 shutdown_connections 2023-10-06T03:04:45.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.780+0000 7f33a91be700 1 --2- 172.21.15.125:0/3735201021 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f338c0670a0 0x7f338c069550 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.780+0000 7f33a91be700 1 --2- 172.21.15.125:0/3735201021 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f33a40ca440 0x7f33a4149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.780+0000 7f33a91be700 1 --2- 172.21.15.125:0/3735201021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f33a40b0240 0x7f33a4141a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.780+0000 7f33a91be700 1 --2- 172.21.15.125:0/3735201021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33a40c3440 0x7f33a4148720 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.780+0000 7f33a91be700 1 -- 172.21.15.125:0/3735201021 >> 172.21.15.125:0/3735201021 conn(0x7f33a40af730 msgr2=0x7f33a406c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.780+0000 7f33a91be700 1 -- 172.21.15.125:0/3735201021 shutdown_connections 2023-10-06T03:04:45.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.780+0000 7f33a91be700 1 -- 172.21.15.125:0/3735201021 wait complete. 2023-10-06T03:04:45.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.781+0000 7fba8e4e8700 1 -- 172.21.15.125:0/2348248419 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fba880c7ce0 con 0x7fba881594d0 2023-10-06T03:04:45.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.782+0000 7fba6ffff700 1 -- 172.21.15.125:0/2348248419 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fba800571e0 con 0x7fba881594d0 2023-10-06T03:04:45.783 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-10-06T03:04:45.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.784+0000 7fba8e4e8700 1 -- 172.21.15.125:0/2348248419 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fba74066f30 msgr2=0x7fba740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.784+0000 7fba8e4e8700 1 --2- 172.21.15.125:0/2348248419 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fba74066f30 0x7fba740693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fba880b5e90 tx=0x7fba78009250 comp rx=0 tx=0).stop 2023-10-06T03:04:45.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.784+0000 7fba8e4e8700 1 -- 172.21.15.125:0/2348248419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba881594d0 msgr2=0x7fba880c8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.784+0000 7fba8e4e8700 1 --2- 172.21.15.125:0/2348248419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba881594d0 0x7fba880c8030 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fba80015000 tx=0x7fba80018000 comp rx=0 tx=0).stop 2023-10-06T03:04:45.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.784+0000 7fba8e4e8700 1 -- 172.21.15.125:0/2348248419 shutdown_connections 2023-10-06T03:04:45.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.784+0000 7fba8e4e8700 1 --2- 172.21.15.125:0/2348248419 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fba74066f30 0x7fba740693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.784+0000 7fba8e4e8700 1 --2- 172.21.15.125:0/2348248419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba881594d0 0x7fba880c8030 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.784+0000 7fba8e4e8700 1 --2- 172.21.15.125:0/2348248419 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fba88068bd0 0x7fba88170500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.784+0000 7fba8e4e8700 1 --2- 172.21.15.125:0/2348248419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fba880b2290 0x7fba880c5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.784+0000 7fba8e4e8700 1 -- 172.21.15.125:0/2348248419 >> 172.21.15.125:0/2348248419 conn(0x7fba8806ed40 msgr2=0x7fba880b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.784+0000 7fba8e4e8700 1 -- 172.21.15.125:0/2348248419 shutdown_connections 2023-10-06T03:04:45.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.784+0000 7fba8e4e8700 1 -- 172.21.15.125:0/2348248419 wait complete. 2023-10-06T03:04:45.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.790+0000 7fe9fe965700 1 -- 172.21.15.125:0/877402352 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe9f8066510 con 0x7fe9f80c4aa0 2023-10-06T03:04:45.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.791+0000 7fe9effff700 1 -- 172.21.15.125:0/877402352 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe9e8012090 con 0x7fe9f80c4aa0 2023-10-06T03:04:45.792 INFO:teuthology.orchestra.run.smithi125.stdout:55834574855 2023-10-06T03:04:45.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.793+0000 7fe9fe965700 1 -- 172.21.15.125:0/877402352 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe9d8066fb0 msgr2=0x7fe9d8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.793+0000 7fe9fe965700 1 --2- 172.21.15.125:0/877402352 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe9d8066fb0 0x7fe9d8069460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe9e0001750 tx=0x7fe9e0037000 comp rx=0 tx=0).stop 2023-10-06T03:04:45.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.793+0000 7fe9fe965700 1 -- 172.21.15.125:0/877402352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9f80c4aa0 msgr2=0x7fe9f8149cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.793+0000 7fe9fe965700 1 --2- 172.21.15.125:0/877402352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9f80c4aa0 0x7fe9f8149cc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe9e800cd90 tx=0x7fe9e800a620 comp rx=0 tx=0).stop 2023-10-06T03:04:45.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.793+0000 7fe9fe965700 1 -- 172.21.15.125:0/877402352 shutdown_connections 2023-10-06T03:04:45.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.793+0000 7fe9fe965700 1 --2- 172.21.15.125:0/877402352 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe9d8066fb0 0x7fe9d8069460 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.793+0000 7fe9fe965700 1 --2- 172.21.15.125:0/877402352 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe9f814a200 0x7fe9f80cb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.793+0000 7fe9fe965700 1 --2- 172.21.15.125:0/877402352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe9e4003a60 0x7fe9f80c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.793+0000 7fe9fe965700 1 --2- 172.21.15.125:0/877402352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9f80c4aa0 0x7fe9f8149cc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.793+0000 7fe9fe965700 1 -- 172.21.15.125:0/877402352 >> 172.21.15.125:0/877402352 conn(0x7fe9f80af730 msgr2=0x7fe9f80c8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.793+0000 7fe9fe965700 1 -- 172.21.15.125:0/877402352 shutdown_connections 2023-10-06T03:04:45.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.793+0000 7fe9fe965700 1 -- 172.21.15.125:0/877402352 wait complete. 2023-10-06T03:04:45.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2023-10-06T03:04:45.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2023-10-06T03:04:45.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.799+0000 7fe54fd7c700 1 -- 172.21.15.125:0/827983587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe548066510 con 0x7fe5480af320 2023-10-06T03:04:45.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.800+0000 7fe53dffb700 1 -- 172.21.15.125:0/827983587 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe544054a40 con 0x7fe5480af320 2023-10-06T03:04:45.801 INFO:teuthology.orchestra.run.smithi125.stdout:55834574855 2023-10-06T03:04:45.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.802+0000 7fe54fd7c700 1 -- 172.21.15.125:0/827983587 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe52c067000 msgr2=0x7fe52c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.802+0000 7fe54fd7c700 1 --2- 172.21.15.125:0/827983587 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe52c067000 0x7fe52c0694b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe5380099b0 tx=0x7fe538017000 comp rx=0 tx=0).stop 2023-10-06T03:04:45.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.802+0000 7fe54fd7c700 1 -- 172.21.15.125:0/827983587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5480af320 msgr2=0x7fe548179730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:45.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.802+0000 7fe54fd7c700 1 --2- 172.21.15.125:0/827983587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5480af320 0x7fe548179730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe54400c7c0 tx=0x7fe544007ed0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.802+0000 7fe54fd7c700 1 -- 172.21.15.125:0/827983587 shutdown_connections 2023-10-06T03:04:45.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.802+0000 7fe54fd7c700 1 --2- 172.21.15.125:0/827983587 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe52c067000 0x7fe52c0694b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.802+0000 7fe54fd7c700 1 --2- 172.21.15.125:0/827983587 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5480cba50 0x7fe5480c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.802+0000 7fe54fd7c700 1 --2- 172.21.15.125:0/827983587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5480af320 0x7fe548179730 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.802+0000 7fe54fd7c700 1 --2- 172.21.15.125:0/827983587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5480c8150 0x7fe548154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:45.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.802+0000 7fe54fd7c700 1 -- 172.21.15.125:0/827983587 >> 172.21.15.125:0/827983587 conn(0x7fe548096120 msgr2=0x7fe548070ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:45.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.802+0000 7fe54fd7c700 1 -- 172.21.15.125:0/827983587 shutdown_connections 2023-10-06T03:04:45.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:45.802+0000 7fe54fd7c700 1 -- 172.21.15.125:0/827983587 wait complete. 2023-10-06T03:04:45.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2023-10-06T03:04:45.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2023-10-06T03:04:46.704 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T03:04:46.771 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T03:04:46.771 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T03:04:46.772 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T03:04:46.800 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T03:04:46.801 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T03:04:46.809 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T03:04:46.815 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T03:04:46.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.864+0000 7ff35345e700 1 Processor -- start 2023-10-06T03:04:46.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.864+0000 7ff35345e700 1 -- start start 2023-10-06T03:04:46.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.866+0000 7ff35345e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff34c0692e0 0x7ff34c0b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.866+0000 7ff35345e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34c0b0020 con 0x7ff34c0b2290 2023-10-06T03:04:46.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.866+0000 7ff35345e700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34c0697b0 con 0x7ff34c158dc0 2023-10-06T03:04:46.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.866+0000 7ff35345e700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c069a90 con 0x7ff34c0692e0 2023-10-06T03:04:46.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.866+0000 7ff3519fb700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff34c158dc0 0x7ff34c159240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:52378/0 (socket says 172.21.15.125:52378) 2023-10-06T03:04:46.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.866+0000 7ff3519fb700 1 -- 172.21.15.125:0/3872226688 learned_addr learned my addr 172.21.15.125:0/3872226688 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:46.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.882+0000 7ff3509f9700 1 --2- 172.21.15.125:0/3872226688 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff34c0692e0 0x7ff34c0b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:46.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.882+0000 7ff343fff700 1 -- 172.21.15.125:0/3872226688 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2708301056 0 0) 0x7ff34c0697b0 con 0x7ff34c158dc0 2023-10-06T03:04:46.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.882+0000 7ff343fff700 1 -- 172.21.15.125:0/3872226688 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff338003570 con 0x7ff34c158dc0 2023-10-06T03:04:46.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.882+0000 7ff343fff700 1 -- 172.21.15.125:0/3872226688 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719110090 0 0) 0x7ff34c0b0020 con 0x7ff34c0b2290 2023-10-06T03:04:46.884 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.882+0000 7ff343fff700 1 -- 172.21.15.125:0/3872226688 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff34c0697b0 con 0x7ff34c0b2290 2023-10-06T03:04:46.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.883+0000 7ff343fff700 1 -- 172.21.15.125:0/3872226688 <== mon.1 v1:172.21.15.130:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3501981875 0 0) 0x7ff338003570 con 0x7ff34c158dc0 2023-10-06T03:04:46.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.883+0000 7ff343fff700 1 -- 172.21.15.125:0/3872226688 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff34c0692e0 msgr2=0x7ff34c0b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:46.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.883+0000 7ff343fff700 1 --2- 172.21.15.125:0/3872226688 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff34c0692e0 0x7ff34c0b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:46.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.883+0000 7ff343fff700 1 -- 172.21.15.125:0/3872226688 >> v1:172.21.15.125:6789/0 conn(0x7ff34c0b2290 legacy=0x7ff34c068bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:46.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.883+0000 7ff343fff700 1 -- 172.21.15.125:0/3872226688 --> v1:172.21.15.130:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c0cb000 con 0x7ff34c158dc0 2023-10-06T03:04:46.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.883+0000 7ff343fff700 1 -- 172.21.15.125:0/3872226688 <== mon.1 v1:172.21.15.130:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7ff3440017f0 con 0x7ff34c158dc0 2023-10-06T03:04:46.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.883+0000 7ff343fff700 1 -- 172.21.15.125:0/3872226688 >> v1:172.21.15.130:6789/0 conn(0x7ff34c158dc0 legacy=0x7ff34c159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:46.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.883+0000 7ff343fff700 1 --2- 172.21.15.125:0/3872226688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff338004cd0 0x7ff3380050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.883+0000 7ff343fff700 1 --2- 172.21.15.125:0/3872226688 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3380037b0 0x7ff338003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.883+0000 7ff343fff700 1 --2- 172.21.15.125:0/3872226688 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff338004160 0x7ff33800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.883+0000 7ff343fff700 1 -- 172.21.15.125:0/3872226688 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c069a90 con 0x7ff338004cd0 2023-10-06T03:04:46.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.883+0000 7ff343fff700 1 -- 172.21.15.125:0/3872226688 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33800c100 con 0x7ff338004160 2023-10-06T03:04:46.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.883+0000 7ff343fff700 1 -- 172.21.15.125:0/3872226688 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33800c2c0 con 0x7ff3380037b0 2023-10-06T03:04:46.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.884+0000 7ff3519fb700 1 --2- 172.21.15.125:0/3872226688 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff338004160 0x7ff33800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:46.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.884+0000 7ff3509f9700 1 --2- 172.21.15.125:0/3872226688 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3380037b0 0x7ff338003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:46.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.884+0000 7ff3519fb700 1 -- 172.21.15.125:0/3872226688 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3380037b0 msgr2=0x7ff338003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:46.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.884+0000 7ff3519fb700 1 --2- 172.21.15.125:0/3872226688 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3380037b0 0x7ff338003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:46.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.884+0000 7ff3519fb700 1 -- 172.21.15.125:0/3872226688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff338004cd0 msgr2=0x7ff3380050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:46.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.884+0000 7ff3519fb700 1 --2- 172.21.15.125:0/3872226688 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff338004cd0 0x7ff3380050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:46.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.884+0000 7ff3519fb700 1 -- 172.21.15.125:0/3872226688 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c0cb000 con 0x7ff338004160 2023-10-06T03:04:46.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.884+0000 7ff3519fb700 1 --2- 172.21.15.125:0/3872226688 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff338004160 0x7ff33800ba60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff34400a960 tx=0x7ff34400ac70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d35fc6f51c9cf69 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:46.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.885+0000 7ff343fff700 1 -- 172.21.15.125:0/3872226688 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344007110 con 0x7ff338004160 2023-10-06T03:04:46.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.886+0000 7ff343fff700 1 -- 172.21.15.125:0/3872226688 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff344007290 con 0x7ff338004160 2023-10-06T03:04:46.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.886+0000 7ff343fff700 1 -- 172.21.15.125:0/3872226688 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344007650 con 0x7ff338004160 2023-10-06T03:04:46.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.887+0000 7ff35345e700 1 -- 172.21.15.125:0/3872226688 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff338004160 msgr2=0x7ff33800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:46.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.887+0000 7ff35345e700 1 --2- 172.21.15.125:0/3872226688 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff338004160 0x7ff33800ba60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff34400a960 tx=0x7ff34400ac70 comp rx=0 tx=0).stop 2023-10-06T03:04:46.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.887+0000 7ff3519fb700 1 -- 172.21.15.125:0/3872226688 reap_dead start 2023-10-06T03:04:46.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.892+0000 7ff35345e700 1 -- 172.21.15.125:0/3872226688 shutdown_connections 2023-10-06T03:04:46.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.892+0000 7ff35345e700 1 -- 172.21.15.125:0/3872226688 >> 172.21.15.125:0/3872226688 conn(0x7ff34c06ed40 msgr2=0x7ff34c06f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:46.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.892+0000 7ff35345e700 1 -- 172.21.15.125:0/3872226688 shutdown_connections 2023-10-06T03:04:46.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.892+0000 7ff35345e700 1 -- 172.21.15.125:0/3872226688 wait complete. 2023-10-06T03:04:46.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.894+0000 7ff35345e700 1 Processor -- start 2023-10-06T03:04:46.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.894+0000 7ff35345e700 1 -- start start 2023-10-06T03:04:46.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.895+0000 7ff35345e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff338004160 0x7ff34c06e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.896+0000 7ff35345e700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff34c173510 0x7ff34c15dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.896+0000 7ff35345e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff34c173980 0x7ff34c15e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.896+0000 7ff35345e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c06e0c0 con 0x7ff34c173980 2023-10-06T03:04:46.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.896+0000 7ff35345e700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c06d4f0 con 0x7ff34c173510 2023-10-06T03:04:46.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.896+0000 7ff35345e700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c06c070 con 0x7ff338004160 2023-10-06T03:04:46.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.896+0000 7ff3511fa700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff338004160 0x7ff34c06e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:46.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.896+0000 7ff3509f9700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff34c173510 0x7ff34c15dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:46.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.896+0000 7ff3519fb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff34c173980 0x7ff34c15e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:46.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.896+0000 7ff3519fb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff34c173980 0x7ff34c15e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40324/0 (socket says 172.21.15.125:40324) 2023-10-06T03:04:46.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.896+0000 7ff3519fb700 1 -- 172.21.15.125:0/2294295859 learned_addr learned my addr 172.21.15.125:0/2294295859 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:46.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.897+0000 7ff3509f9700 1 -- 172.21.15.125:0/2294295859 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff338004160 msgr2=0x7ff34c06e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:46.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.897+0000 7ff3509f9700 1 --2- 172.21.15.125:0/2294295859 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff338004160 0x7ff34c06e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:46.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.897+0000 7ff3509f9700 1 -- 172.21.15.125:0/2294295859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff34c173980 msgr2=0x7ff34c15e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:46.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.897+0000 7ff3509f9700 1 --2- 172.21.15.125:0/2294295859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff34c173980 0x7ff34c15e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:46.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.897+0000 7ff3509f9700 1 -- 172.21.15.125:0/2294295859 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c06d790 con 0x7ff34c173510 2023-10-06T03:04:46.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.897+0000 7ff3509f9700 1 --2- 172.21.15.125:0/2294295859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff34c173510 0x7ff34c15dc70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff34c068aa0 tx=0x7ff33c008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:46.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.910+0000 7ff3417fa700 1 -- 172.21.15.125:0/2294295859 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c015670 con 0x7ff34c173510 2023-10-06T03:04:46.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.910+0000 7ff3417fa700 1 -- 172.21.15.125:0/2294295859 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33c0157d0 con 0x7ff34c173510 2023-10-06T03:04:46.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.910+0000 7ff3417fa700 1 -- 172.21.15.125:0/2294295859 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c015b70 con 0x7ff34c173510 2023-10-06T03:04:46.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.911+0000 7ff35345e700 1 -- 172.21.15.125:0/2294295859 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34c06da70 con 0x7ff34c173510 2023-10-06T03:04:46.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.911+0000 7ff35345e700 1 -- 172.21.15.125:0/2294295859 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34c06ea90 con 0x7ff34c173510 2023-10-06T03:04:46.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.913+0000 7ff3417fa700 1 -- 172.21.15.125:0/2294295859 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff33c013410 con 0x7ff34c173510 2023-10-06T03:04:46.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.914+0000 7ff3417fa700 1 --2- 172.21.15.125:0/2294295859 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff330067080 0x7ff330069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.914+0000 7ff3417fa700 1 -- 172.21.15.125:0/2294295859 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff33c084f30 con 0x7ff34c173510 2023-10-06T03:04:46.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.915+0000 7ff3511fa700 1 --2- 172.21.15.125:0/2294295859 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff330067080 0x7ff330069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:46.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.915+0000 7ff3511fa700 1 --2- 172.21.15.125:0/2294295859 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff330067080 0x7ff330069530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff348002a70 tx=0x7ff348007e80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:46.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.916+0000 7ff35345e700 1 -- 172.21.15.125:0/2294295859 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34c06e230 con 0x7ff34c173510 2023-10-06T03:04:46.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.921+0000 7ff3417fa700 1 -- 172.21.15.125:0/2294295859 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff33c051d30 con 0x7ff34c173510 2023-10-06T03:04:46.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.961+0000 7f3bf5b5e700 1 Processor -- start 2023-10-06T03:04:46.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.961+0000 7f3bf5b5e700 1 -- start start 2023-10-06T03:04:46.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.962+0000 7f3bf5b5e700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3bf0161c70 0x7f3bf00c7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.962+0000 7f3bf5b5e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3bf006e740 0x7f3bf006b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.962+0000 7f3bf5b5e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf0140a20 con 0x7f3bf015e610 2023-10-06T03:04:46.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.962+0000 7f3bf5b5e700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf00c7b70 con 0x7f3bf0161c70 2023-10-06T03:04:46.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.962+0000 7f3bf5b5e700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00c7e50 con 0x7f3bf006e740 2023-10-06T03:04:46.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.963+0000 7f3beeffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3bf015e610 0x7f3bf006e030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53194/0 (socket says 172.21.15.125:53194) 2023-10-06T03:04:46.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.963+0000 7f3beeffd700 1 -- 172.21.15.125:0/910314549 learned_addr learned my addr 172.21.15.125:0/910314549 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:46.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.963+0000 7f3bef7fe700 1 --2- 172.21.15.125:0/910314549 >> v2:172.21.15.130:3300/0 conn(0x7f3bf0161c70 0x7f3bf00c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:46.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.964+0000 7f3bee7fc700 1 -- 172.21.15.125:0/910314549 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400093427 0 0) 0x7f3bf0140a20 con 0x7f3bf015e610 2023-10-06T03:04:46.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.964+0000 7f3bee7fc700 1 -- 172.21.15.125:0/910314549 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bd8003570 con 0x7f3bf015e610 2023-10-06T03:04:46.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.964+0000 7f3bee7fc700 1 -- 172.21.15.125:0/910314549 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3446633325 0 0) 0x7f3bd8003570 con 0x7f3bf015e610 2023-10-06T03:04:46.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.964+0000 7f3bee7fc700 1 -- 172.21.15.125:0/910314549 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3bf006e740 msgr2=0x7f3bf006b6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T03:04:46.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.964+0000 7f3bee7fc700 1 --2- 172.21.15.125:0/910314549 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3bf006e740 0x7f3bf006b6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:46.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.964+0000 7f3bee7fc700 1 -- 172.21.15.125:0/910314549 >> v2:172.21.15.130:3300/0 conn(0x7f3bf0161c70 msgr2=0x7f3bf00c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:46.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.964+0000 7f3bee7fc700 1 --2- 172.21.15.125:0/910314549 >> v2:172.21.15.130:3300/0 conn(0x7f3bf0161c70 0x7f3bf00c7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:46.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.964+0000 7f3bee7fc700 1 -- 172.21.15.125:0/910314549 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf00c8130 con 0x7f3bf015e610 2023-10-06T03:04:46.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.964+0000 7f3bee7fc700 1 -- 172.21.15.125:0/910314549 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f3be4001470 con 0x7f3bf015e610 2023-10-06T03:04:46.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.964+0000 7f3bee7fc700 1 -- 172.21.15.125:0/910314549 >> v1:172.21.15.125:6789/0 conn(0x7f3bf015e610 legacy=0x7f3bf006e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:46.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.964+0000 7f3bee7fc700 1 --2- 172.21.15.125:0/910314549 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3bd8003ae0 0x7f3bd8003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.964+0000 7f3bee7fc700 1 --2- 172.21.15.125:0/910314549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bd8004810 0x7f3bd8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.964+0000 7f3bee7fc700 1 --2- 172.21.15.125:0/910314549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bd8005310 0x7f3bd800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.965+0000 7f3bee7fc700 1 -- 172.21.15.125:0/910314549 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00c7b70 con 0x7f3bd8005310 2023-10-06T03:04:46.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.965+0000 7f3bee7fc700 1 -- 172.21.15.125:0/910314549 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf00c7e50 con 0x7f3bd8004810 2023-10-06T03:04:46.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.965+0000 7f3bee7fc700 1 -- 172.21.15.125:0/910314549 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd800c280 con 0x7f3bd8003ae0 2023-10-06T03:04:46.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.965+0000 7f3beffff700 1 --2- 172.21.15.125:0/910314549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bd8005310 0x7f3bd800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:46.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.966+0000 7f3bef7fe700 1 --2- 172.21.15.125:0/910314549 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3bd8003ae0 0x7f3bd8003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:46.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.966+0000 7f3beeffd700 1 --2- 172.21.15.125:0/910314549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bd8004810 0x7f3bd8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:46.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.966+0000 7f3beffff700 1 -- 172.21.15.125:0/910314549 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3bd8003ae0 msgr2=0x7f3bd8003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:46.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.966+0000 7f3beffff700 1 --2- 172.21.15.125:0/910314549 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3bd8003ae0 0x7f3bd8003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:46.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.966+0000 7f3beffff700 1 -- 172.21.15.125:0/910314549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bd8004810 msgr2=0x7f3bd8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:46.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.966+0000 7f3beffff700 1 --2- 172.21.15.125:0/910314549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bd8004810 0x7f3bd8004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:46.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.966+0000 7f3beffff700 1 -- 172.21.15.125:0/910314549 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf00c8130 con 0x7f3bd8005310 2023-10-06T03:04:46.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.966+0000 7f3beffff700 1 --2- 172.21.15.125:0/910314549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bd8005310 0x7f3bd800ba60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3bf006eb10 tx=0x7f3be0006ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e9cfbccee68d79 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:46.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.966+0000 7f3bee7fc700 1 -- 172.21.15.125:0/910314549 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0011400 con 0x7f3bd8005310 2023-10-06T03:04:46.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.966+0000 7f3bee7fc700 1 -- 172.21.15.125:0/910314549 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be0011560 con 0x7f3bd8005310 2023-10-06T03:04:46.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.966+0000 7f3bee7fc700 1 -- 172.21.15.125:0/910314549 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be0011900 con 0x7f3bd8005310 2023-10-06T03:04:46.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.967+0000 7f3bf5b5e700 1 -- 172.21.15.125:0/910314549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bd8005310 msgr2=0x7f3bd800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:46.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.967+0000 7f3bf5b5e700 1 --2- 172.21.15.125:0/910314549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bd8005310 0x7f3bd800ba60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3bf006eb10 tx=0x7f3be0006ef0 comp rx=0 tx=0).stop 2023-10-06T03:04:46.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.967+0000 7f3beffff700 1 -- 172.21.15.125:0/910314549 reap_dead start 2023-10-06T03:04:46.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.968+0000 7f3bf5b5e700 1 -- 172.21.15.125:0/910314549 shutdown_connections 2023-10-06T03:04:46.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.968+0000 7f3bf5b5e700 1 -- 172.21.15.125:0/910314549 >> 172.21.15.125:0/910314549 conn(0x7f3bf00cbd30 msgr2=0x7f3bf00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:46.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.969+0000 7f3bf5b5e700 1 -- 172.21.15.125:0/910314549 shutdown_connections 2023-10-06T03:04:46.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.969+0000 7f3bf5b5e700 1 -- 172.21.15.125:0/910314549 wait complete. 2023-10-06T03:04:46.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.971+0000 7f3bf5b5e700 1 Processor -- start 2023-10-06T03:04:46.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.971+0000 7f3bf5b5e700 1 -- start start 2023-10-06T03:04:46.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.972+0000 7f3bf5b5e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bd8005310 0x7f3bf0154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.972+0000 7f3bf5b5e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3bf0133510 0x7f3bf0133980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.972+0000 7f3bf5b5e700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bf01323d0 0x7f3bf0132840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.972+0000 7f3bf5b5e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf0133ec0 con 0x7f3bd8005310 2023-10-06T03:04:46.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.972+0000 7f3bf5b5e700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf0154d90 con 0x7f3bf01323d0 2023-10-06T03:04:46.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.972+0000 7f3bf5b5e700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf0131f40 con 0x7f3bf0133510 2023-10-06T03:04:46.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.972+0000 7f3bef7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bd8005310 0x7f3bf0154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:46.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.972+0000 7f3bef7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bd8005310 0x7f3bf0154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40348/0 (socket says 172.21.15.125:40348) 2023-10-06T03:04:46.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.972+0000 7f3bef7fe700 1 -- 172.21.15.125:0/1822210830 learned_addr learned my addr 172.21.15.125:0/1822210830 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:46.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.973+0000 7f3bef7fe700 1 -- 172.21.15.125:0/1822210830 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3bf0133510 msgr2=0x7f3bf0133980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:04:46.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.973+0000 7f3bef7fe700 1 --2- 172.21.15.125:0/1822210830 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3bf0133510 0x7f3bf0133980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:46.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.973+0000 7f3bef7fe700 1 -- 172.21.15.125:0/1822210830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bf01323d0 msgr2=0x7f3bf0132840 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:04:46.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.973+0000 7f3bef7fe700 1 --2- 172.21.15.125:0/1822210830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bf01323d0 0x7f3bf0132840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:46.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.973+0000 7f3bef7fe700 1 -- 172.21.15.125:0/1822210830 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf0131610 con 0x7f3bd8005310 2023-10-06T03:04:46.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.973+0000 7f3bef7fe700 1 --2- 172.21.15.125:0/1822210830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bd8005310 0x7f3bf0154fe0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3be800ef80 tx=0x7f3be8007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:46.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.974+0000 7ff24e2b0700 1 Processor -- start 2023-10-06T03:04:46.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.974+0000 7ff24e2b0700 1 -- start start 2023-10-06T03:04:46.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.975+0000 7ff24e2b0700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff248161c70 0x7ff2480c7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.977+0000 7ff2477fe700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7ff24815e610 0x7ff24806e030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:52394/0 (socket says 172.21.15.125:52394) 2023-10-06T03:04:46.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.975+0000 7f3bdf7fe700 1 -- 172.21.15.125:0/1822210830 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be801a480 con 0x7f3bd8005310 2023-10-06T03:04:46.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.976+0000 7f3bdf7fe700 1 -- 172.21.15.125:0/1822210830 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be8013070 con 0x7f3bd8005310 2023-10-06T03:04:46.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.976+0000 7f3bdf7fe700 1 -- 172.21.15.125:0/1822210830 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be801a7f0 con 0x7f3bd8005310 2023-10-06T03:04:46.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.976+0000 7f3bf5b5e700 1 -- 172.21.15.125:0/1822210830 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf01318f0 con 0x7f3bd8005310 2023-10-06T03:04:46.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.976+0000 7f3bf5b5e700 1 -- 172.21.15.125:0/1822210830 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf0132d80 con 0x7f3bd8005310 2023-10-06T03:04:46.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.977+0000 7f3bf5b5e700 1 -- 172.21.15.125:0/1822210830 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf0066510 con 0x7f3bd8005310 2023-10-06T03:04:46.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.979+0000 7ff24e2b0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff24806e740 0x7ff24806b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.979+0000 7ff24e2b0700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff248140a20 con 0x7ff24815e610 2023-10-06T03:04:46.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.979+0000 7ff24e2b0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2480c7b70 con 0x7ff24806e740 2023-10-06T03:04:46.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.979+0000 7ff24e2b0700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2480c7e50 con 0x7ff248161c70 2023-10-06T03:04:46.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.979+0000 7ff247fff700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff248161c70 0x7ff2480c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:46.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.979+0000 7ff2477fe700 1 -- 172.21.15.125:0/936988407 learned_addr learned my addr 172.21.15.125:0/936988407 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.981+0000 7ff247fff700 1 -- 172.21.15.125:0/936988407 >> v2:172.21.15.125:3300/0 conn(0x7ff24806e740 msgr2=0x7ff24806b6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:04:46.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.981+0000 7ff247fff700 1 --2- 172.21.15.125:0/936988407 >> v2:172.21.15.125:3300/0 conn(0x7ff24806e740 0x7ff24806b6b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.981+0000 7ff247fff700 1 -- 172.21.15.125:0/936988407 >> v1:172.21.15.130:6789/0 conn(0x7ff24815e610 legacy=0x7ff24806e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.981+0000 7ff247fff700 1 -- 172.21.15.125:0/936988407 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2480c8130 con 0x7ff248161c70 2023-10-06T03:04:46.989 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.981+0000 7ff247fff700 1 --2- 172.21.15.125:0/936988407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff248161c70 0x7ff2480c7590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff248069e70 tx=0x7ff240009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67b90334a8207d50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:46.990 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.989+0000 7f3bdf7fe700 1 -- 172.21.15.125:0/1822210830 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3be8009040 con 0x7f3bd8005310 2023-10-06T03:04:46.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.989+0000 7ff246ffd700 1 -- 172.21.15.125:0/936988407 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24000e070 con 0x7ff248161c70 2023-10-06T03:04:46.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.989+0000 7ff246ffd700 1 -- 172.21.15.125:0/936988407 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff24000bb30 con 0x7ff248161c70 2023-10-06T03:04:46.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.989+0000 7ff246ffd700 1 -- 172.21.15.125:0/936988407 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff24000bed0 con 0x7ff248161c70 2023-10-06T03:04:46.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.990+0000 7ff24e2b0700 1 -- 172.21.15.125:0/936988407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff248161c70 msgr2=0x7ff2480c7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:46.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.990+0000 7ff24e2b0700 1 --2- 172.21.15.125:0/936988407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff248161c70 0x7ff2480c7590 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff248069e70 tx=0x7ff240009780 comp rx=0 tx=0).stop 2023-10-06T03:04:46.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.989+0000 7f3bdf7fe700 1 --2- 172.21.15.125:0/1822210830 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3bd4067050 0x7f3bd4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.989+0000 7f3bdf7fe700 1 -- 172.21.15.125:0/1822210830 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3be8015070 con 0x7f3bd8005310 2023-10-06T03:04:46.992 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.989+0000 7f3bdf7fe700 1 -- 172.21.15.125:0/1822210830 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3be80879c0 con 0x7f3bd8005310 2023-10-06T03:04:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.993+0000 7ff24e2b0700 1 -- 172.21.15.125:0/936988407 shutdown_connections 2023-10-06T03:04:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.993+0000 7ff24e2b0700 1 --2- 172.21.15.125:0/936988407 >> v2:172.21.15.125:3300/0 conn(0x7ff24806e740 0x7ff24806b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.993+0000 7ff24e2b0700 1 --2- 172.21.15.125:0/936988407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff248161c70 0x7ff2480c7590 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:46.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.993+0000 7ff24e2b0700 1 -- 172.21.15.125:0/936988407 >> 172.21.15.125:0/936988407 conn(0x7ff2480cbd30 msgr2=0x7ff2480cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:46.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.993+0000 7ff24e2b0700 1 -- 172.21.15.125:0/936988407 shutdown_connections 2023-10-06T03:04:46.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.993+0000 7ff24e2b0700 1 -- 172.21.15.125:0/936988407 wait complete. 2023-10-06T03:04:46.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.995+0000 7ff24e2b0700 1 Processor -- start 2023-10-06T03:04:46.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.996+0000 7ff24e2b0700 1 -- start start 2023-10-06T03:04:46.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.997+0000 7ff24e2b0700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24806e740 0x7ff248175a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.997+0000 7ff24e2b0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff24815e610 0x7ff2480c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.997+0000 7ff24e2b0700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff248161c70 0x7ff2480c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:46.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.997+0000 7ff24e2b0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2480c5cd0 con 0x7ff24815e610 2023-10-06T03:04:46.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.997+0000 7ff24e2b0700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2480c30d0 con 0x7ff24806e740 2023-10-06T03:04:46.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.997+0000 7ff24e2b0700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2480c5710 con 0x7ff248161c70 2023-10-06T03:04:46.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.998+0000 7ff247fff700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24806e740 0x7ff248175a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.998+0000 7ff247fff700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24806e740 0x7ff248175a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:50558/0 (socket says 172.21.15.125:50558) 2023-10-06T03:04:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.998+0000 7ff247fff700 1 -- 172.21.15.125:0/1044358953 learned_addr learned my addr 172.21.15.125:0/1044358953 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.998+0000 7ff24c84d700 1 --2- 172.21.15.125:0/1044358953 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff248161c70 0x7ff2480c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.999+0000 7ff247fff700 1 -- 172.21.15.125:0/1044358953 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff248161c70 msgr2=0x7ff2480c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.999+0000 7ff247fff700 1 --2- 172.21.15.125:0/1044358953 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff248161c70 0x7ff2480c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.999+0000 7ff247fff700 1 -- 172.21.15.125:0/1044358953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff24815e610 msgr2=0x7ff2480c4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.999+0000 7ff247fff700 1 --2- 172.21.15.125:0/1044358953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff24815e610 0x7ff2480c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.999+0000 7ff247fff700 1 -- 172.21.15.125:0/1044358953 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff240009a20 con 0x7ff24806e740 2023-10-06T03:04:47.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.999+0000 7ff247fff700 1 --2- 172.21.15.125:0/1044358953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24806e740 0x7ff248175a60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff2480c7f90 tx=0x7ff240018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.999+0000 7ff22ffff700 1 -- 172.21.15.125:0/1044358953 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff240012c50 con 0x7ff24806e740 2023-10-06T03:04:47.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.999+0000 7ff22ffff700 1 -- 172.21.15.125:0/1044358953 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff240021070 con 0x7ff24806e740 2023-10-06T03:04:47.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.999+0000 7ff22ffff700 1 -- 172.21.15.125:0/1044358953 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff240026430 con 0x7ff24806e740 2023-10-06T03:04:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.999+0000 7ff24e2b0700 1 -- 172.21.15.125:0/1044358953 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2480c59f0 con 0x7ff24806e740 2023-10-06T03:04:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.999+0000 7f3beeffd700 1 --2- 172.21.15.125:0/1822210830 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3bd4067050 0x7f3bd4069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:46.999+0000 7f3beeffd700 1 --2- 172.21.15.125:0/1822210830 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3bd4067050 0x7f3bd4069500 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3be4001ed0 tx=0x7f3be4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.002 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.000+0000 7ff24e2b0700 1 -- 172.21.15.125:0/1044358953 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff248155160 con 0x7ff24806e740 2023-10-06T03:04:47.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.002+0000 7ff24e2b0700 1 -- 172.21.15.125:0/1044358953 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2280052b0 con 0x7ff24806e740 2023-10-06T03:04:47.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.002+0000 7ff22ffff700 1 -- 172.21.15.125:0/1044358953 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff240023030 con 0x7ff24806e740 2023-10-06T03:04:47.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.003+0000 7ff24c84d700 1 --2- 172.21.15.125:0/1044358953 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff248161c70 0x7ff2480c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:04:47.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.003+0000 7ff22ffff700 1 --2- 172.21.15.125:0/1044358953 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff234066fb0 0x7ff234069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.003+0000 7ff22ffff700 1 -- 172.21.15.125:0/1044358953 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff240086ac0 con 0x7ff24806e740 2023-10-06T03:04:47.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.004+0000 7ff2477fe700 1 --2- 172.21.15.125:0/1044358953 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff234066fb0 0x7ff234069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.004+0000 7ff2477fe700 1 --2- 172.21.15.125:0/1044358953 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff234066fb0 0x7ff234069460 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2380058d0 tx=0x7ff238007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.008+0000 7ff22ffff700 1 -- 172.21.15.125:0/1044358953 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff240088e60 con 0x7ff24806e740 2023-10-06T03:04:47.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.019+0000 7f707a2d1700 1 Processor -- start 2023-10-06T03:04:47.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.017+0000 7f7696b7b700 1 Processor -- start 2023-10-06T03:04:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.017+0000 7f7696b7b700 1 -- start start 2023-10-06T03:04:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.019+0000 7f7696b7b700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7690161c70 0x7f76900c7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.019+0000 7f7696b7b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f769006e740 0x7f769006b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.019+0000 7f7696b7b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7690140a20 con 0x7f769015e610 2023-10-06T03:04:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.019+0000 7f7696b7b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76900c7b70 con 0x7f769006e740 2023-10-06T03:04:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.019+0000 7f7696b7b700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76900c7e50 con 0x7f7690161c70 2023-10-06T03:04:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.019+0000 7f7687fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f769015e610 0x7f769006e030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53200/0 (socket says 172.21.15.125:53200) 2023-10-06T03:04:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.019+0000 7f7687fff700 1 -- 172.21.15.125:0/2535684288 learned_addr learned my addr 172.21.15.125:0/2535684288 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:47.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.020+0000 7f7694917700 1 --2- 172.21.15.125:0/2535684288 >> v2:172.21.15.130:3300/0 conn(0x7f7690161c70 0x7f76900c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.019+0000 7f707a2d1700 1 -- start start 2023-10-06T03:04:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.020+0000 7f707a2d1700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f70740af320 0x7f70740cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.020+0000 7f707a2d1700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70740c8320 0x7f70740c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.020+0000 7f707a2d1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70740c9470 con 0x7f70740cb880 2023-10-06T03:04:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.020+0000 7f707a2d1700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70740c9b40 con 0x7f70740af320 2023-10-06T03:04:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.020+0000 7f707a2d1700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70740c8860 con 0x7f70740c8320 2023-10-06T03:04:47.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.020+0000 7f7695118700 1 --2- 172.21.15.125:0/2535684288 >> v2:172.21.15.125:3300/0 conn(0x7f769006e740 0x7f769006b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.020+0000 7f70737fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f70740cb880 0x7f70740c7c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53212/0 (socket says 172.21.15.125:53212) 2023-10-06T03:04:47.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.020+0000 7f70737fe700 1 -- 172.21.15.125:0/3322657639 learned_addr learned my addr 172.21.15.125:0/3322657639 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:47.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.021+0000 7f7073fff700 1 --2- 172.21.15.125:0/3322657639 >> v2:172.21.15.130:3300/0 conn(0x7f70740af320 0x7f70740cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.021+0000 7f7694917700 1 -- 172.21.15.125:0/2535684288 >> v2:172.21.15.125:3300/0 conn(0x7f769006e740 msgr2=0x7f769006b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:47.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.021+0000 7f7694917700 1 --2- 172.21.15.125:0/2535684288 >> v2:172.21.15.125:3300/0 conn(0x7f769006e740 0x7f769006b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.021+0000 7f7694917700 1 -- 172.21.15.125:0/2535684288 >> v1:172.21.15.125:6789/0 conn(0x7f769015e610 legacy=0x7f769006e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.021+0000 7f7694917700 1 -- 172.21.15.125:0/2535684288 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76900c8130 con 0x7f7690161c70 2023-10-06T03:04:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.021+0000 7f707886e700 1 --2- 172.21.15.125:0/3322657639 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70740c8320 0x7f70740c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.021+0000 7f7073fff700 1 -- 172.21.15.125:0/3322657639 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70740c8320 msgr2=0x7f70740c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.021+0000 7f7073fff700 1 --2- 172.21.15.125:0/3322657639 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70740c8320 0x7f70740c1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.021+0000 7f7073fff700 1 -- 172.21.15.125:0/3322657639 >> v1:172.21.15.125:6789/0 conn(0x7f70740cb880 legacy=0x7f70740c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.021+0000 7f7073fff700 1 -- 172.21.15.125:0/3322657639 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70740cbcf0 con 0x7f70740af320 2023-10-06T03:04:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.021+0000 7f7694917700 1 --2- 172.21.15.125:0/2535684288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7690161c70 0x7f76900c7590 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7690069e70 tx=0x7f76800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b92d17739a227fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.022+0000 7f76877fe700 1 -- 172.21.15.125:0/2535684288 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680011630 con 0x7f7690161c70 2023-10-06T03:04:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.022+0000 7f76877fe700 1 -- 172.21.15.125:0/2535684288 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7680011790 con 0x7f7690161c70 2023-10-06T03:04:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.022+0000 7f76877fe700 1 -- 172.21.15.125:0/2535684288 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7680011b30 con 0x7f7690161c70 2023-10-06T03:04:47.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.022+0000 7f7073fff700 1 --2- 172.21.15.125:0/3322657639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70740af320 0x7f70740cb340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f70680098d0 tx=0x7f7068009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a204cc674a21e1b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.023+0000 7f7696b7b700 1 -- 172.21.15.125:0/2535684288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7690161c70 msgr2=0x7f76900c7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.023+0000 7f7696b7b700 1 --2- 172.21.15.125:0/2535684288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7690161c70 0x7f76900c7590 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7690069e70 tx=0x7f76800091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.023+0000 7f7c382bb700 1 Processor -- start 2023-10-06T03:04:47.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.023+0000 7f7696b7b700 1 -- 172.21.15.125:0/2535684288 shutdown_connections 2023-10-06T03:04:47.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.023+0000 7f7696b7b700 1 --2- 172.21.15.125:0/2535684288 >> v2:172.21.15.125:3300/0 conn(0x7f769006e740 0x7f769006b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.023+0000 7f7696b7b700 1 --2- 172.21.15.125:0/2535684288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7690161c70 0x7f76900c7590 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.023+0000 7f7696b7b700 1 -- 172.21.15.125:0/2535684288 >> 172.21.15.125:0/2535684288 conn(0x7f76900cbd30 msgr2=0x7f76900cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:47.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.024+0000 7f7696b7b700 1 -- 172.21.15.125:0/2535684288 shutdown_connections 2023-10-06T03:04:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.023+0000 7f7c382bb700 1 -- start start 2023-10-06T03:04:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.025+0000 7f7c382bb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7c3006e740 0x7f7c30159980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.025+0000 7f7c382bb700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c3013b9f0 0x7f7c30155840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.025+0000 7f7c382bb700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c300cb4e0 con 0x7f7c3013b620 2023-10-06T03:04:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.025+0000 7f7c382bb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c301594f0 con 0x7f7c3006e740 2023-10-06T03:04:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.025+0000 7f7c382bb700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c30158ee0 con 0x7f7c3013b9f0 2023-10-06T03:04:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.025+0000 7f7c36057700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f7c3013b620 0x7f7c3006e030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:52396/0 (socket says 172.21.15.125:52396) 2023-10-06T03:04:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.025+0000 7f7c36057700 1 -- 172.21.15.125:0/1499901876 learned_addr learned my addr 172.21.15.125:0/1499901876 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:47.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.025+0000 7f7c35856700 1 --2- 172.21.15.125:0/1499901876 >> v2:172.21.15.125:3300/0 conn(0x7f7c3006e740 0x7f7c30159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.026+0000 7f7c35856700 1 -- 172.21.15.125:0/1499901876 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c3013b9f0 msgr2=0x7f7c30155840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:04:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.026+0000 7f7c35856700 1 --2- 172.21.15.125:0/1499901876 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c3013b9f0 0x7f7c30155840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.026+0000 7f7c35856700 1 -- 172.21.15.125:0/1499901876 >> v1:172.21.15.130:6789/0 conn(0x7f7c3013b620 legacy=0x7f7c3006e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.026+0000 7f7c35856700 1 -- 172.21.15.125:0/1499901876 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c30156490 con 0x7f7c3006e740 2023-10-06T03:04:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.026+0000 7f7c35856700 1 --2- 172.21.15.125:0/1499901876 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c3006e740 0x7f7c30159980 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0098e0 tx=0x7f7c2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779ff49bee6a4c0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.027+0000 7f7c35055700 1 -- 172.21.15.125:0/1499901876 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c009e80 con 0x7f7c3006e740 2023-10-06T03:04:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.027+0000 7f7c35055700 1 -- 172.21.15.125:0/1499901876 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c00c930 con 0x7f7c3006e740 2023-10-06T03:04:47.030 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.027+0000 7f7c35055700 1 -- 172.21.15.125:0/1499901876 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c00ccf0 con 0x7f7c3006e740 2023-10-06T03:04:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.025+0000 7f7696b7b700 1 -- 172.21.15.125:0/2535684288 wait complete. 2023-10-06T03:04:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.026+0000 7f7696b7b700 1 Processor -- start 2023-10-06T03:04:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.027+0000 7f7696b7b700 1 -- start start 2023-10-06T03:04:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.025+0000 7f7072ffd700 1 -- 172.21.15.125:0/3322657639 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068014ca0 con 0x7f70740af320 2023-10-06T03:04:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.025+0000 7f7072ffd700 1 -- 172.21.15.125:0/3322657639 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7068014e00 con 0x7f70740af320 2023-10-06T03:04:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.025+0000 7f7072ffd700 1 -- 172.21.15.125:0/3322657639 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068005c50 con 0x7f70740af320 2023-10-06T03:04:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.027+0000 7f707a2d1700 1 -- 172.21.15.125:0/3322657639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70740af320 msgr2=0x7f70740cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.027+0000 7f707a2d1700 1 --2- 172.21.15.125:0/3322657639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70740af320 0x7f70740cb340 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f70680098d0 tx=0x7f7068009120 comp rx=0 tx=0).stop 2023-10-06T03:04:47.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.028+0000 7f0978f87700 1 Processor -- start 2023-10-06T03:04:47.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.028+0000 7f7c382bb700 1 -- 172.21.15.125:0/1499901876 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c3006e740 msgr2=0x7f7c30159980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.028+0000 7f7c382bb700 1 --2- 172.21.15.125:0/1499901876 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c3006e740 0x7f7c30159980 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0098e0 tx=0x7f7c2c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.028+0000 7f7696b7b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f769006e740 0x7f76900b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.028+0000 7f7696b7b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f769015e610 0x7f7690086890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.028+0000 7f7696b7b700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7690161c70 0x7f7690157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.028+0000 7f7696b7b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76900b0cd0 con 0x7f769015e610 2023-10-06T03:04:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.028+0000 7f7696b7b700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7690155460 con 0x7f7690161c70 2023-10-06T03:04:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.028+0000 7f7696b7b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7690086dd0 con 0x7f769006e740 2023-10-06T03:04:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.028+0000 7f7c382bb700 1 -- 172.21.15.125:0/1499901876 shutdown_connections 2023-10-06T03:04:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.028+0000 7f7c382bb700 1 --2- 172.21.15.125:0/1499901876 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c3013b9f0 0x7f7c30155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.028+0000 7f7c382bb700 1 --2- 172.21.15.125:0/1499901876 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c3006e740 0x7f7c30159980 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.028+0000 7f7c382bb700 1 -- 172.21.15.125:0/1499901876 >> 172.21.15.125:0/1499901876 conn(0x7f7c300cbd30 msgr2=0x7f7c300cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:47.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.028+0000 7f0978f87700 1 -- start start 2023-10-06T03:04:47.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.028+0000 7f7694917700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f769006e740 0x7f76900b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.029+0000 7f7687fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f769015e610 0x7f7690086890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.029+0000 7f7687fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f769015e610 0x7f7690086890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40388/0 (socket says 172.21.15.125:40388) 2023-10-06T03:04:47.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.029+0000 7f7694917700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f769006e740 0x7f76900b0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:58946/0 (socket says 172.21.15.125:58946) 2023-10-06T03:04:47.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.029+0000 7f7687fff700 1 -- 172.21.15.125:0/230779085 learned_addr learned my addr 172.21.15.125:0/230779085 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:47.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.029+0000 7f7687fff700 1 -- 172.21.15.125:0/230779085 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f769006e740 msgr2=0x7f76900b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.029+0000 7f7687fff700 1 --2- 172.21.15.125:0/230779085 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f769006e740 0x7f76900b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.029+0000 7f7687fff700 1 -- 172.21.15.125:0/230779085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7690161c70 msgr2=0x7f7690157130 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:04:47.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.029+0000 7f7687fff700 1 --2- 172.21.15.125:0/230779085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7690161c70 0x7f7690157130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.029+0000 7f7687fff700 1 -- 172.21.15.125:0/230779085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7680009420 con 0x7f769015e610 2023-10-06T03:04:47.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.029+0000 7f7694917700 1 --2- 172.21.15.125:0/230779085 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f769006e740 0x7f76900b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:47.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.029+0000 7f0978f87700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09740c8de0 0x7f09741576b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.029+0000 7f0978f87700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f0974161420 0x7f0974161840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.029+0000 7f0978f87700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0974162190 con 0x7f09740c91b0 2023-10-06T03:04:47.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.029+0000 7f0978f87700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f097415e730 con 0x7f0974161420 2023-10-06T03:04:47.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.029+0000 7f0978f87700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097415ebc0 con 0x7f09740c8de0 2023-10-06T03:04:47.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.029+0000 7f7687fff700 1 --2- 172.21.15.125:0/230779085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f769015e610 0x7f7690086890 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f768c00c7c0 tx=0x7f768c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.030+0000 7f7c382bb700 1 -- 172.21.15.125:0/1499901876 shutdown_connections 2023-10-06T03:04:47.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.030+0000 7f7c382bb700 1 -- 172.21.15.125:0/1499901876 wait complete. 2023-10-06T03:04:47.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.030+0000 7f707a2d1700 1 -- 172.21.15.125:0/3322657639 shutdown_connections 2023-10-06T03:04:47.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.030+0000 7f707a2d1700 1 --2- 172.21.15.125:0/3322657639 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70740c8320 0x7f70740c1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.030+0000 7f707a2d1700 1 --2- 172.21.15.125:0/3322657639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70740af320 0x7f70740cb340 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.030+0000 7f707a2d1700 1 -- 172.21.15.125:0/3322657639 >> 172.21.15.125:0/3322657639 conn(0x7f7074096120 msgr2=0x7f7074068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:47.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.030+0000 7f7684ff9700 1 -- 172.21.15.125:0/230779085 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c005b30 con 0x7f769015e610 2023-10-06T03:04:47.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.030+0000 7f097259c700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09740c8de0 0x7f09741576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.030+0000 7f097259c700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09740c8de0 0x7f09741576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:58960/0 (socket says 172.21.15.125:58960) 2023-10-06T03:04:47.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.030+0000 7f097259c700 1 -- 172.21.15.125:0/4093604575 learned_addr learned my addr 172.21.15.125:0/4093604575 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:47.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.030+0000 7f0972d9d700 1 --2- 172.21.15.125:0/4093604575 >> v2:172.21.15.130:3300/0 conn(0x7f0974161420 0x7f0974161840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.030+0000 7f7684ff9700 1 -- 172.21.15.125:0/230779085 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f768c005c90 con 0x7f769015e610 2023-10-06T03:04:47.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.030+0000 7f7684ff9700 1 -- 172.21.15.125:0/230779085 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768c004a80 con 0x7f769015e610 2023-10-06T03:04:47.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.030+0000 7f7696b7b700 1 -- 172.21.15.125:0/230779085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76900b09f0 con 0x7f769015e610 2023-10-06T03:04:47.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.030+0000 7f7696b7b700 1 -- 172.21.15.125:0/230779085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76901550f0 con 0x7f769015e610 2023-10-06T03:04:47.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.031+0000 7f7c382bb700 1 Processor -- start 2023-10-06T03:04:47.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.032+0000 7f7c382bb700 1 -- start start 2023-10-06T03:04:47.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f7c382bb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c3006e740 0x7f7c3013e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.039 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f7c382bb700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c3013b620 0x7f7c3013a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f7c382bb700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c3013b9f0 0x7f7c30152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f7c382bb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3013dc00 con 0x7f7c3006e740 2023-10-06T03:04:47.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f7c382bb700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3013e5d0 con 0x7f7c3013b9f0 2023-10-06T03:04:47.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f7c382bb700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3013d010 con 0x7f7c3013b620 2023-10-06T03:04:47.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f7c35856700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c3013b620 0x7f7c3013a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f7c35856700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c3013b620 0x7f7c3013a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:58976/0 (socket says 172.21.15.125:58976) 2023-10-06T03:04:47.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f7c35856700 1 -- 172.21.15.125:0/4170058792 learned_addr learned my addr 172.21.15.125:0/4170058792 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:47.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f7c35856700 1 -- 172.21.15.125:0/4170058792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c3013b9f0 msgr2=0x7f7c30152a70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:04:47.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f7c35856700 1 --2- 172.21.15.125:0/4170058792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c3013b9f0 0x7f7c30152a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f7c35856700 1 -- 172.21.15.125:0/4170058792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c3006e740 msgr2=0x7f7c3013e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f7c35856700 1 --2- 172.21.15.125:0/4170058792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c3006e740 0x7f7c3013e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.040 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f7c35856700 1 -- 172.21.15.125:0/4170058792 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c009420 con 0x7f7c3013b620 2023-10-06T03:04:47.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.034+0000 7f7c35856700 1 --2- 172.21.15.125:0/4170058792 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c3013b620 0x7f7c3013a6b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0091e0 tx=0x7f7c2c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.034+0000 7f7c267fc700 1 -- 172.21.15.125:0/4170058792 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c01e070 con 0x7f7c3013b620 2023-10-06T03:04:47.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.034+0000 7f7c267fc700 1 -- 172.21.15.125:0/4170058792 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c000bc0 con 0x7f7c3013b620 2023-10-06T03:04:47.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.034+0000 7f7c267fc700 1 -- 172.21.15.125:0/4170058792 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c024670 con 0x7f7c3013b620 2023-10-06T03:04:47.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.035+0000 7f7c382bb700 1 -- 172.21.15.125:0/4170058792 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3013d2d0 con 0x7f7c3013b620 2023-10-06T03:04:47.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.035+0000 7f7c382bb700 1 -- 172.21.15.125:0/4170058792 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3013d890 con 0x7f7c3013b620 2023-10-06T03:04:47.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.031+0000 7f7696b7b700 1 -- 172.21.15.125:0/230779085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76700052b0 con 0x7f769015e610 2023-10-06T03:04:47.041 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.036+0000 7f7684ff9700 1 -- 172.21.15.125:0/230779085 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f768c0070d0 con 0x7f769015e610 2023-10-06T03:04:47.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.036+0000 7f7684ff9700 1 --2- 172.21.15.125:0/230779085 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f767c067080 0x7f767c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.037+0000 7f7684ff9700 1 -- 172.21.15.125:0/230779085 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f768c0848b0 con 0x7f769015e610 2023-10-06T03:04:47.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.031+0000 7f097259c700 1 -- 172.21.15.125:0/4093604575 >> v2:172.21.15.130:3300/0 conn(0x7f0974161420 msgr2=0x7f0974161840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:47.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.031+0000 7f097259c700 1 --2- 172.21.15.125:0/4093604575 >> v2:172.21.15.130:3300/0 conn(0x7f0974161420 0x7f0974161840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.031+0000 7f097259c700 1 -- 172.21.15.125:0/4093604575 >> v1:172.21.15.125:6789/0 conn(0x7f09740c91b0 legacy=0x7f0974157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:47.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.031+0000 7f097259c700 1 -- 172.21.15.125:0/4093604575 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097415de00 con 0x7f09740c8de0 2023-10-06T03:04:47.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.031+0000 7f097259c700 1 --2- 172.21.15.125:0/4093604575 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09740c8de0 0x7f09741576b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f095c0099b0 tx=0x7f095c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5754a0128c611d06 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.032+0000 7f0971d9b700 1 -- 172.21.15.125:0/4093604575 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c009ea0 con 0x7f09740c8de0 2023-10-06T03:04:47.042 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.032+0000 7f0971d9b700 1 -- 172.21.15.125:0/4093604575 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095c00b820 con 0x7f09740c8de0 2023-10-06T03:04:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.032+0000 7f0971d9b700 1 -- 172.21.15.125:0/4093604575 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c00bbc0 con 0x7f09740c8de0 2023-10-06T03:04:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f0978f87700 1 -- 172.21.15.125:0/4093604575 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09740c8de0 msgr2=0x7f09741576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f0978f87700 1 --2- 172.21.15.125:0/4093604575 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09740c8de0 0x7f09741576b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f095c0099b0 tx=0x7f095c009250 comp rx=0 tx=0).stop 2023-10-06T03:04:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f0978f87700 1 -- 172.21.15.125:0/4093604575 shutdown_connections 2023-10-06T03:04:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f0978f87700 1 --2- 172.21.15.125:0/4093604575 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f09740c8de0 0x7f09741576b0 secure :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f095c0099b0 tx=0x7f095c009250 comp rx=0 tx=0).stop 2023-10-06T03:04:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f0978f87700 1 --2- 172.21.15.125:0/4093604575 >> v2:172.21.15.130:3300/0 conn(0x7f0974161420 0x7f0974161840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.033+0000 7f0978f87700 1 -- 172.21.15.125:0/4093604575 >> 172.21.15.125:0/4093604575 conn(0x7f097406a680 msgr2=0x7f097406aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.032+0000 7f707a2d1700 1 -- 172.21.15.125:0/3322657639 shutdown_connections 2023-10-06T03:04:47.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.032+0000 7f707a2d1700 1 -- 172.21.15.125:0/3322657639 wait complete. 2023-10-06T03:04:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.034+0000 7f707a2d1700 1 Processor -- start 2023-10-06T03:04:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.034+0000 7f707a2d1700 1 -- start start 2023-10-06T03:04:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.036+0000 7f707a2d1700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70740af320 0x7f70740b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.036+0000 7f707a2d1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70740c8320 0x7f7074168eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.036+0000 7f707a2d1700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70740cb880 0x7f7074150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.036+0000 7f707a2d1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7074168a20 con 0x7f70740c8320 2023-10-06T03:04:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.036+0000 7f707a2d1700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70740aeed0 con 0x7f70740cb880 2023-10-06T03:04:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.036+0000 7f707a2d1700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70740b2510 con 0x7f70740af320 2023-10-06T03:04:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.036+0000 7f707886e700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70740cb880 0x7f7074150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.036+0000 7f7073fff700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70740af320 0x7f70740b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.036+0000 7f707886e700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70740cb880 0x7f7074150210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:50630/0 (socket says 172.21.15.125:50630) 2023-10-06T03:04:47.044 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.036+0000 7f707886e700 1 -- 172.21.15.125:0/3325861305 learned_addr learned my addr 172.21.15.125:0/3325861305 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:47.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.036+0000 7f707886e700 1 -- 172.21.15.125:0/3325861305 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70740af320 msgr2=0x7f70740b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.036+0000 7f707886e700 1 --2- 172.21.15.125:0/3325861305 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70740af320 0x7f70740b1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.036+0000 7f707886e700 1 -- 172.21.15.125:0/3325861305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70740c8320 msgr2=0x7f7074168eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.036+0000 7f707886e700 1 --2- 172.21.15.125:0/3325861305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70740c8320 0x7f7074168eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.036+0000 7f707886e700 1 -- 172.21.15.125:0/3325861305 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70680093c0 con 0x7f70740cb880 2023-10-06T03:04:47.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.037+0000 7f707886e700 1 --2- 172.21.15.125:0/3325861305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70740cb880 0x7f7074150210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f706c00e470 tx=0x7f706c00d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.037+0000 7f7c382bb700 1 -- 172.21.15.125:0/4170058792 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c30066510 con 0x7f7c3013b620 2023-10-06T03:04:47.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.037+0000 7f7694917700 1 --2- 172.21.15.125:0/230779085 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f767c067080 0x7f767c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.037+0000 7f705bfff700 1 -- 172.21.15.125:0/3325861305 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c010040 con 0x7f70740cb880 2023-10-06T03:04:47.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.037+0000 7f705bfff700 1 -- 172.21.15.125:0/3325861305 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c00bcc0 con 0x7f70740cb880 2023-10-06T03:04:47.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.037+0000 7f705bfff700 1 -- 172.21.15.125:0/3325861305 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c00b300 con 0x7f70740cb880 2023-10-06T03:04:47.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.038+0000 7f707a2d1700 1 -- 172.21.15.125:0/3325861305 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70740b27f0 con 0x7f70740cb880 2023-10-06T03:04:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.038+0000 7f707a2d1700 1 -- 172.21.15.125:0/3325861305 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70741686b0 con 0x7f70740cb880 2023-10-06T03:04:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.037+0000 7f7c267fc700 1 -- 172.21.15.125:0/4170058792 <== mon.2 v2:172.21.15.130:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c2c022070 con 0x7f7c3013b620 2023-10-06T03:04:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.038+0000 7f7c267fc700 1 --2- 172.21.15.125:0/4170058792 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7c1408b2a0 0x7f7c1408d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.038+0000 7f7c267fc700 1 -- 172.21.15.125:0/4170058792 <== mon.2 v2:172.21.15.130:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7c2c086fc0 con 0x7f7c3013b620 2023-10-06T03:04:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.038+0000 7f7c36057700 1 --2- 172.21.15.125:0/4170058792 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7c1408b2a0 0x7f7c1408d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.039+0000 7f7694917700 1 --2- 172.21.15.125:0/230779085 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f767c067080 0x7f767c069530 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f76800091e0 tx=0x7f7680017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.039+0000 7f707a2d1700 1 -- 172.21.15.125:0/3325861305 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7074168bd0 con 0x7f70740cb880 2023-10-06T03:04:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.039+0000 7f7c36057700 1 --2- 172.21.15.125:0/4170058792 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7c1408b2a0 0x7f7c1408d750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c28007bc0 tx=0x7f7c28006060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.040+0000 7f0978f87700 1 -- 172.21.15.125:0/4093604575 shutdown_connections 2023-10-06T03:04:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.040+0000 7f7684ff9700 1 -- 172.21.15.125:0/230779085 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f768c051730 con 0x7f769015e610 2023-10-06T03:04:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.041+0000 7f903e653700 1 Processor -- start 2023-10-06T03:04:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.040+0000 7f0978f87700 1 -- 172.21.15.125:0/4093604575 wait complete. 2023-10-06T03:04:47.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.042+0000 7f0978f87700 1 Processor -- start 2023-10-06T03:04:47.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.041+0000 7f903e653700 1 -- start start 2023-10-06T03:04:47.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.043+0000 7f903e653700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9038156de0 0x7f90381571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.043+0000 7f903e653700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f90380cd790 0x7f90380ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.043+0000 7f903e653700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90380cd300 con 0x7f90380cc060 2023-10-06T03:04:47.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.043+0000 7f903e653700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90380cc4d0 con 0x7f90380cd790 2023-10-06T03:04:47.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.043+0000 7f903e653700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90380cc6f0 con 0x7f9038156de0 2023-10-06T03:04:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.043+0000 7f90377fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f90380cc060 0x7f903815b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53218/0 (socket says 172.21.15.125:53218) 2023-10-06T03:04:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.043+0000 7f90377fe700 1 -- 172.21.15.125:0/4172379942 learned_addr learned my addr 172.21.15.125:0/4172379942 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.043+0000 7f903cbf0700 1 --2- 172.21.15.125:0/4172379942 >> v2:172.21.15.130:3300/0 conn(0x7f90380cd790 0x7f90380ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.043+0000 7f903cbf0700 1 -- 172.21.15.125:0/4172379942 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9038156de0 msgr2=0x7f90381571b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T03:04:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.043+0000 7f903cbf0700 1 --2- 172.21.15.125:0/4172379942 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9038156de0 0x7f90381571b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.043+0000 7f903cbf0700 1 -- 172.21.15.125:0/4172379942 >> v1:172.21.15.125:6789/0 conn(0x7f90380cc060 legacy=0x7f903815b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.043+0000 7f9036ffd700 1 -- 172.21.15.125:0/4172379942 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428774520 0 0) 0x7f90380cd300 con 0x7f90380cc060 2023-10-06T03:04:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.043+0000 7f903cbf0700 1 -- 172.21.15.125:0/4172379942 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90380cc9d0 con 0x7f90380cd790 2023-10-06T03:04:47.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.042+0000 7f0978f87700 1 -- start start 2023-10-06T03:04:47.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.043+0000 7f0978f87700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09740c91b0 0x7f09741513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.043+0000 7f0978f87700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0974161420 0x7f09740b0470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.043+0000 7f0978f87700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0974171480 0x7f09740abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.043+0000 7f0978f87700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09740b09b0 con 0x7f09740c91b0 2023-10-06T03:04:47.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.043+0000 7f0978f87700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09740ad6c0 con 0x7f0974171480 2023-10-06T03:04:47.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.043+0000 7f0978f87700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09740ac190 con 0x7f0974161420 2023-10-06T03:04:47.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.044+0000 7f097259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09740c91b0 0x7f09741513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.044+0000 7f097259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09740c91b0 0x7f09741513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40410/0 (socket says 172.21.15.125:40410) 2023-10-06T03:04:47.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.044+0000 7f097259c700 1 -- 172.21.15.125:0/1593973845 learned_addr learned my addr 172.21.15.125:0/1593973845 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:47.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.041+0000 7f705bfff700 1 -- 172.21.15.125:0/3325861305 <== mon.1 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f706c009760 con 0x7f70740cb880 2023-10-06T03:04:47.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.041+0000 7f705bfff700 1 --2- 172.21.15.125:0/3325861305 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7060067000 0x7f70600694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.041+0000 7f705bfff700 1 -- 172.21.15.125:0/3325861305 <== mon.1 v2:172.21.15.130:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f706c084d60 con 0x7f70740cb880 2023-10-06T03:04:47.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.042+0000 7f7073fff700 1 --2- 172.21.15.125:0/3325861305 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7060067000 0x7f70600694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.044+0000 7f7073fff700 1 --2- 172.21.15.125:0/3325861305 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7060067000 0x7f70600694b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f706801e040 tx=0x7f706801b000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.044+0000 7f097259c700 1 -- 172.21.15.125:0/1593973845 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0974161420 msgr2=0x7f09740b0470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:04:47.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.044+0000 7f097259c700 1 --2- 172.21.15.125:0/1593973845 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0974161420 0x7f09740b0470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.044+0000 7f097259c700 1 -- 172.21.15.125:0/1593973845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0974171480 msgr2=0x7f09740abc50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:04:47.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.044+0000 7f097259c700 1 --2- 172.21.15.125:0/1593973845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0974171480 0x7f09740abc50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.044+0000 7f097259c700 1 -- 172.21.15.125:0/1593973845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095c0094f0 con 0x7f09740c91b0 2023-10-06T03:04:47.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.044+0000 7f7c267fc700 1 -- 172.21.15.125:0/4170058792 <== mon.2 v2:172.21.15.130:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c2c053dc0 con 0x7f7c3013b620 2023-10-06T03:04:47.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.044+0000 7f705bfff700 1 -- 172.21.15.125:0/3325861305 <== mon.1 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f706c051ce0 con 0x7f70740cb880 2023-10-06T03:04:47.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.044+0000 7f097259c700 1 --2- 172.21.15.125:0/1593973845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09740c91b0 0x7f09741513d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f095c006fd0 tx=0x7f095c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.047+0000 7f903cbf0700 1 --2- 172.21.15.125:0/4172379942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90380cd790 0x7f90380ca890 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9030009360 tx=0x7f9030009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56db95e4f92ee2e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.048+0000 7f096affd700 1 -- 172.21.15.125:0/1593973845 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c011ab0 con 0x7f09740c91b0 2023-10-06T03:04:47.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.048+0000 7f096affd700 1 -- 172.21.15.125:0/1593973845 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095c020070 con 0x7f09740c91b0 2023-10-06T03:04:47.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.048+0000 7f096affd700 1 -- 172.21.15.125:0/1593973845 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c011e80 con 0x7f09740c91b0 2023-10-06T03:04:47.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.048+0000 7f9036ffd700 1 -- 172.21.15.125:0/4172379942 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903000e070 con 0x7f90380cd790 2023-10-06T03:04:47.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.048+0000 7f9036ffd700 1 -- 172.21.15.125:0/4172379942 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90300102f0 con 0x7f90380cd790 2023-10-06T03:04:47.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.048+0000 7f9036ffd700 1 -- 172.21.15.125:0/4172379942 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903000be40 con 0x7f90380cd790 2023-10-06T03:04:47.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.048+0000 7f0978f87700 1 -- 172.21.15.125:0/1593973845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09740ac410 con 0x7f09740c91b0 2023-10-06T03:04:47.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.048+0000 7f0978f87700 1 -- 172.21.15.125:0/1593973845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09740ac9d0 con 0x7f09740c91b0 2023-10-06T03:04:47.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.049+0000 7f903e653700 1 -- 172.21.15.125:0/4172379942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90380cd790 msgr2=0x7f90380ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.049+0000 7f903e653700 1 --2- 172.21.15.125:0/4172379942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90380cd790 0x7f90380ca890 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9030009360 tx=0x7f9030009780 comp rx=0 tx=0).stop 2023-10-06T03:04:47.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.051+0000 7f096affd700 1 -- 172.21.15.125:0/1593973845 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f095c022030 con 0x7f09740c91b0 2023-10-06T03:04:47.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.052+0000 7f096affd700 1 --2- 172.21.15.125:0/1593973845 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0954067080 0x7f0954069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.052+0000 7f096affd700 1 -- 172.21.15.125:0/1593973845 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f095c0866c0 con 0x7f09740c91b0 2023-10-06T03:04:47.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.052+0000 7f903e653700 1 -- 172.21.15.125:0/4172379942 shutdown_connections 2023-10-06T03:04:47.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.052+0000 7f903e653700 1 --2- 172.21.15.125:0/4172379942 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9038156de0 0x7f90381571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.052+0000 7f903e653700 1 --2- 172.21.15.125:0/4172379942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90380cd790 0x7f90380ca890 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.052+0000 7f903e653700 1 -- 172.21.15.125:0/4172379942 >> 172.21.15.125:0/4172379942 conn(0x7f90380cdf80 msgr2=0x7f90380ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:47.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.052+0000 7f0969d9b700 1 --2- 172.21.15.125:0/1593973845 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0954067080 0x7f0954069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.052+0000 7f0978f87700 1 -- 172.21.15.125:0/1593973845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0974066510 con 0x7f09740c91b0 2023-10-06T03:04:47.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.052+0000 7f903e653700 1 -- 172.21.15.125:0/4172379942 shutdown_connections 2023-10-06T03:04:47.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.053+0000 7f0969d9b700 1 --2- 172.21.15.125:0/1593973845 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0954067080 0x7f0954069530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f09740ca9b0 tx=0x7f0964006c60 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.062+0000 7f096affd700 1 -- 172.21.15.125:0/1593973845 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f095c0534c0 con 0x7f09740c91b0 2023-10-06T03:04:47.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.052+0000 7f903e653700 1 -- 172.21.15.125:0/4172379942 wait complete. 2023-10-06T03:04:47.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.054+0000 7f903e653700 1 Processor -- start 2023-10-06T03:04:47.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.055+0000 7f903e653700 1 -- start start 2023-10-06T03:04:47.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.056+0000 7f903e653700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90380cc060 0x7f903814de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.056+0000 7f903e653700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90380cd790 0x7f90380ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.056+0000 7f903e653700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9038156de0 0x7f90380aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.056+0000 7f903e653700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90380c5440 con 0x7f9038156de0 2023-10-06T03:04:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.056+0000 7f903e653700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90380b0580 con 0x7f90380cc060 2023-10-06T03:04:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.056+0000 7f903e653700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903814e380 con 0x7f90380cd790 2023-10-06T03:04:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.056+0000 7f903cbf0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9038156de0 0x7f90380aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.057+0000 7f903cbf0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9038156de0 0x7f90380aeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40422/0 (socket says 172.21.15.125:40422) 2023-10-06T03:04:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.057+0000 7f903cbf0700 1 -- 172.21.15.125:0/2422765461 learned_addr learned my addr 172.21.15.125:0/2422765461 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.057+0000 7f903cbf0700 1 -- 172.21.15.125:0/2422765461 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90380cd790 msgr2=0x7f90380ae580 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:04:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.057+0000 7f903cbf0700 1 --2- 172.21.15.125:0/2422765461 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90380cd790 0x7f90380ae580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.057+0000 7f903cbf0700 1 -- 172.21.15.125:0/2422765461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90380cc060 msgr2=0x7f903814de40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T03:04:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.057+0000 7f903cbf0700 1 --2- 172.21.15.125:0/2422765461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90380cc060 0x7f903814de40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.057+0000 7f903cbf0700 1 -- 172.21.15.125:0/2422765461 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9030009a20 con 0x7f9038156de0 2023-10-06T03:04:47.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.057+0000 7f903cbf0700 1 --2- 172.21.15.125:0/2422765461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9038156de0 0x7f90380aeac0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f903806ea30 tx=0x7f9030020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.062+0000 7f901ffff700 1 -- 172.21.15.125:0/2422765461 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030018470 con 0x7f9038156de0 2023-10-06T03:04:47.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.062+0000 7f901ffff700 1 -- 172.21.15.125:0/2422765461 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90300185d0 con 0x7f9038156de0 2023-10-06T03:04:47.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.062+0000 7f901ffff700 1 -- 172.21.15.125:0/2422765461 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030018950 con 0x7f9038156de0 2023-10-06T03:04:47.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.062+0000 7f903e653700 1 -- 172.21.15.125:0/2422765461 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90380af140 con 0x7f9038156de0 2023-10-06T03:04:47.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.062+0000 7f903e653700 1 -- 172.21.15.125:0/2422765461 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90380af700 con 0x7f9038156de0 2023-10-06T03:04:47.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.065+0000 7f901ffff700 1 -- 172.21.15.125:0/2422765461 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9030003020 con 0x7f9038156de0 2023-10-06T03:04:47.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.065+0000 7f901ffff700 1 --2- 172.21.15.125:0/2422765461 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9020067190 0x7f9020069640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.065+0000 7f901ffff700 1 -- 172.21.15.125:0/2422765461 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9030085c10 con 0x7f9038156de0 2023-10-06T03:04:47.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.066+0000 7f903e653700 1 -- 172.21.15.125:0/2422765461 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90180052b0 con 0x7f9038156de0 2023-10-06T03:04:47.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.075+0000 7f9037fff700 1 --2- 172.21.15.125:0/2422765461 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9020067190 0x7f9020069640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.075+0000 7f901ffff700 1 -- 172.21.15.125:0/2422765461 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9030052a40 con 0x7f9038156de0 2023-10-06T03:04:47.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.076+0000 7f9037fff700 1 --2- 172.21.15.125:0/2422765461 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9020067190 0x7f9020069640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f90280096a0 tx=0x7f9028006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.319+0000 7ff35345e700 1 -- 172.21.15.125:0/2294295859 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff34c066510 con 0x7ff34c173510 2023-10-06T03:04:47.331 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.330+0000 7ff3417fa700 1 -- 172.21.15.125:0/2294295859 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff33c055350 con 0x7ff34c173510 2023-10-06T03:04:47.334 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-10-06T03:04:47.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.336+0000 7ff35345e700 1 -- 172.21.15.125:0/2294295859 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff330067080 msgr2=0x7ff330069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.336+0000 7ff35345e700 1 --2- 172.21.15.125:0/2294295859 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff330067080 0x7ff330069530 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff348002a70 tx=0x7ff348007e80 comp rx=0 tx=0).stop 2023-10-06T03:04:47.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.336+0000 7ff35345e700 1 -- 172.21.15.125:0/2294295859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff34c173510 msgr2=0x7ff34c15dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.336+0000 7ff35345e700 1 --2- 172.21.15.125:0/2294295859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff34c173510 0x7ff34c15dc70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff34c068aa0 tx=0x7ff33c008040 comp rx=0 tx=0).stop 2023-10-06T03:04:47.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.336+0000 7ff35345e700 1 -- 172.21.15.125:0/2294295859 shutdown_connections 2023-10-06T03:04:47.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.336+0000 7ff35345e700 1 --2- 172.21.15.125:0/2294295859 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff330067080 0x7ff330069530 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.336+0000 7ff35345e700 1 --2- 172.21.15.125:0/2294295859 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff34c173980 0x7ff34c15e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.336+0000 7ff35345e700 1 --2- 172.21.15.125:0/2294295859 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff338004160 0x7ff34c06e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.336+0000 7ff35345e700 1 --2- 172.21.15.125:0/2294295859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff34c173510 0x7ff34c15dc70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.336+0000 7ff35345e700 1 -- 172.21.15.125:0/2294295859 >> 172.21.15.125:0/2294295859 conn(0x7ff34c06ed40 msgr2=0x7ff34c0ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:47.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.337+0000 7ff35345e700 1 -- 172.21.15.125:0/2294295859 shutdown_connections 2023-10-06T03:04:47.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.337+0000 7ff35345e700 1 -- 172.21.15.125:0/2294295859 wait complete. 2023-10-06T03:04:47.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-10-06T03:04:47.356 DEBUG:teuthology.parallel:result is None 2023-10-06T03:04:47.375 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.373+0000 7f3bf5b5e700 1 -- 172.21.15.125:0/1822210830 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3bf00c8410 con 0x7f3bd8005310 2023-10-06T03:04:47.376 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-10-06T03:04:47.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.375+0000 7f3bdf7fe700 1 -- 172.21.15.125:0/1822210830 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3be80523e0 con 0x7f3bd8005310 2023-10-06T03:04:47.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.376+0000 7f3bf5b5e700 1 -- 172.21.15.125:0/1822210830 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3bd4067050 msgr2=0x7f3bd4069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.377+0000 7f3bf5b5e700 1 --2- 172.21.15.125:0/1822210830 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3bd4067050 0x7f3bd4069500 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3be4001ed0 tx=0x7f3be4009040 comp rx=0 tx=0).stop 2023-10-06T03:04:47.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.377+0000 7f3bf5b5e700 1 -- 172.21.15.125:0/1822210830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bd8005310 msgr2=0x7f3bf0154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.377+0000 7f3bf5b5e700 1 --2- 172.21.15.125:0/1822210830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bd8005310 0x7f3bf0154fe0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3be800ef80 tx=0x7f3be8007830 comp rx=0 tx=0).stop 2023-10-06T03:04:47.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.377+0000 7f3bf5b5e700 1 -- 172.21.15.125:0/1822210830 shutdown_connections 2023-10-06T03:04:47.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.377+0000 7f3bf5b5e700 1 --2- 172.21.15.125:0/1822210830 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3bd4067050 0x7f3bd4069500 secure :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3be4001ed0 tx=0x7f3be4009040 comp rx=0 tx=0).stop 2023-10-06T03:04:47.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.377+0000 7f3bf5b5e700 1 --2- 172.21.15.125:0/1822210830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bf01323d0 0x7f3bf0132840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.377+0000 7f3bf5b5e700 1 --2- 172.21.15.125:0/1822210830 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3bd8005310 0x7f3bf0154fe0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.377+0000 7f3bf5b5e700 1 --2- 172.21.15.125:0/1822210830 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3bf0133510 0x7f3bf0133980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.377+0000 7f3bf5b5e700 1 -- 172.21.15.125:0/1822210830 >> 172.21.15.125:0/1822210830 conn(0x7f3bf00cbd30 msgr2=0x7f3bf00c2660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:47.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.377+0000 7f3bf5b5e700 1 -- 172.21.15.125:0/1822210830 shutdown_connections 2023-10-06T03:04:47.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.377+0000 7f3bf5b5e700 1 -- 172.21.15.125:0/1822210830 wait complete. 2023-10-06T03:04:47.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.390+0000 7ff24e2b0700 1 -- 172.21.15.125:0/1044358953 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff228005560 con 0x7ff24806e740 2023-10-06T03:04:47.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.391+0000 7ff22ffff700 1 -- 172.21.15.125:0/1044358953 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff240053840 con 0x7ff24806e740 2023-10-06T03:04:47.393 INFO:teuthology.orchestra.run.smithi125.stdout:55834574857 2023-10-06T03:04:47.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-10-06T03:04:47.394 DEBUG:teuthology.parallel:result is None 2023-10-06T03:04:47.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.394+0000 7ff24e2b0700 1 -- 172.21.15.125:0/1044358953 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff234066fb0 msgr2=0x7ff234069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.394+0000 7ff24e2b0700 1 --2- 172.21.15.125:0/1044358953 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff234066fb0 0x7ff234069460 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff2380058d0 tx=0x7ff238007ac0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.394+0000 7ff24e2b0700 1 -- 172.21.15.125:0/1044358953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24806e740 msgr2=0x7ff248175a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.394+0000 7ff24e2b0700 1 --2- 172.21.15.125:0/1044358953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24806e740 0x7ff248175a60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff2480c7f90 tx=0x7ff240018000 comp rx=0 tx=0).stop 2023-10-06T03:04:47.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.394+0000 7ff24e2b0700 1 -- 172.21.15.125:0/1044358953 shutdown_connections 2023-10-06T03:04:47.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.394+0000 7ff24e2b0700 1 --2- 172.21.15.125:0/1044358953 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff234066fb0 0x7ff234069460 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.394+0000 7ff24e2b0700 1 --2- 172.21.15.125:0/1044358953 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff248161c70 0x7ff2480c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.394+0000 7ff24e2b0700 1 --2- 172.21.15.125:0/1044358953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff24806e740 0x7ff248175a60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.394+0000 7ff24e2b0700 1 --2- 172.21.15.125:0/1044358953 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff24815e610 0x7ff2480c4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.394+0000 7ff24e2b0700 1 -- 172.21.15.125:0/1044358953 >> 172.21.15.125:0/1044358953 conn(0x7ff2480cbd30 msgr2=0x7ff24806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:47.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.394+0000 7ff24e2b0700 1 -- 172.21.15.125:0/1044358953 shutdown_connections 2023-10-06T03:04:47.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.394+0000 7ff24e2b0700 1 -- 172.21.15.125:0/1044358953 wait complete. 2023-10-06T03:04:47.411 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2023-10-06T03:04:47.411 DEBUG:teuthology.parallel:result is None 2023-10-06T03:04:47.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.429+0000 7f0978f87700 1 -- 172.21.15.125:0/1593973845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0974066510 con 0x7f09740c91b0 2023-10-06T03:04:47.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.429+0000 7f096affd700 1 -- 172.21.15.125:0/1593973845 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f095c01aeb0 con 0x7f09740c91b0 2023-10-06T03:04:47.431 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-10-06T03:04:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.431+0000 7f0978f87700 1 -- 172.21.15.125:0/1593973845 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0954067080 msgr2=0x7f0954069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.431+0000 7f0978f87700 1 --2- 172.21.15.125:0/1593973845 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0954067080 0x7f0954069530 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f09740ca9b0 tx=0x7f0964006c60 comp rx=0 tx=0).stop 2023-10-06T03:04:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.431+0000 7f0978f87700 1 -- 172.21.15.125:0/1593973845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09740c91b0 msgr2=0x7f09741513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.431+0000 7f0978f87700 1 --2- 172.21.15.125:0/1593973845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09740c91b0 0x7f09741513d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f095c006fd0 tx=0x7f095c016000 comp rx=0 tx=0).stop 2023-10-06T03:04:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.431+0000 7f0978f87700 1 -- 172.21.15.125:0/1593973845 shutdown_connections 2023-10-06T03:04:47.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.431+0000 7f0978f87700 1 --2- 172.21.15.125:0/1593973845 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0954067080 0x7f0954069530 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.431+0000 7f0978f87700 1 --2- 172.21.15.125:0/1593973845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0974171480 0x7f09740abc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.431+0000 7f0978f87700 1 --2- 172.21.15.125:0/1593973845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f09740c91b0 0x7f09741513d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.431+0000 7f0978f87700 1 --2- 172.21.15.125:0/1593973845 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0974161420 0x7f09740b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.431+0000 7f0978f87700 1 -- 172.21.15.125:0/1593973845 >> 172.21.15.125:0/1593973845 conn(0x7f097406a680 msgr2=0x7f09740c2600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:47.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.431+0000 7f0978f87700 1 -- 172.21.15.125:0/1593973845 shutdown_connections 2023-10-06T03:04:47.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.431+0000 7f0978f87700 1 -- 172.21.15.125:0/1593973845 wait complete. 2023-10-06T03:04:47.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.439+0000 7f7696b7b700 1 -- 172.21.15.125:0/230779085 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7670005830 con 0x7f769015e610 2023-10-06T03:04:47.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.439+0000 7f7684ff9700 1 -- 172.21.15.125:0/230779085 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f768c054d50 con 0x7f769015e610 2023-10-06T03:04:47.441 INFO:teuthology.orchestra.run.smithi125.stdout:55834574857 2023-10-06T03:04:47.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.442+0000 7f7696b7b700 1 -- 172.21.15.125:0/230779085 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f767c067080 msgr2=0x7f767c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.442+0000 7f7696b7b700 1 --2- 172.21.15.125:0/230779085 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f767c067080 0x7f767c069530 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f76800091e0 tx=0x7f7680017000 comp rx=0 tx=0).stop 2023-10-06T03:04:47.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.442+0000 7f7696b7b700 1 -- 172.21.15.125:0/230779085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f769015e610 msgr2=0x7f7690086890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.442+0000 7f7696b7b700 1 --2- 172.21.15.125:0/230779085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f769015e610 0x7f7690086890 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f768c00c7c0 tx=0x7f768c007f70 comp rx=0 tx=0).stop 2023-10-06T03:04:47.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.443+0000 7f7696b7b700 1 -- 172.21.15.125:0/230779085 shutdown_connections 2023-10-06T03:04:47.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.443+0000 7f7696b7b700 1 --2- 172.21.15.125:0/230779085 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f767c067080 0x7f767c069530 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.443+0000 7f7696b7b700 1 --2- 172.21.15.125:0/230779085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7690161c70 0x7f7690157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.443+0000 7f7696b7b700 1 --2- 172.21.15.125:0/230779085 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f769006e740 0x7f76900b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.443+0000 7f7696b7b700 1 --2- 172.21.15.125:0/230779085 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f769015e610 0x7f7690086890 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.443+0000 7f7696b7b700 1 -- 172.21.15.125:0/230779085 >> 172.21.15.125:0/230779085 conn(0x7f76900cbd30 msgr2=0x7f769006b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:47.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.443+0000 7f7696b7b700 1 -- 172.21.15.125:0/230779085 shutdown_connections 2023-10-06T03:04:47.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.443+0000 7f7696b7b700 1 -- 172.21.15.125:0/230779085 wait complete. 2023-10-06T03:04:47.446 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2023-10-06T03:04:47.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.444+0000 7f7c382bb700 1 -- 172.21.15.125:0/4170058792 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7c3013dd70 con 0x7f7c3013b620 2023-10-06T03:04:47.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.444+0000 7f7c267fc700 1 -- 172.21.15.125:0/4170058792 <== mon.2 v2:172.21.15.130:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7c2c029090 con 0x7f7c3013b620 2023-10-06T03:04:47.446 DEBUG:teuthology.parallel:result is None 2023-10-06T03:04:47.446 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-10-06T03:04:47.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.445+0000 7f707a2d1700 1 -- 172.21.15.125:0/3325861305 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7074168bd0 con 0x7f70740cb880 2023-10-06T03:04:47.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.446+0000 7f705bfff700 1 -- 172.21.15.125:0/3325861305 <== mon.1 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7074168bd0 con 0x7f70740cb880 2023-10-06T03:04:47.447 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-10-06T03:04:47.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.447+0000 7f7c382bb700 1 -- 172.21.15.125:0/4170058792 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7c1408b2a0 msgr2=0x7f7c1408d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.447+0000 7f7c382bb700 1 --2- 172.21.15.125:0/4170058792 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7c1408b2a0 0x7f7c1408d750 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c28007bc0 tx=0x7f7c28006060 comp rx=0 tx=0).stop 2023-10-06T03:04:47.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.447+0000 7f7c382bb700 1 -- 172.21.15.125:0/4170058792 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c3013b620 msgr2=0x7f7c3013a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.447+0000 7f7c382bb700 1 --2- 172.21.15.125:0/4170058792 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c3013b620 0x7f7c3013a6b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c0091e0 tx=0x7f7c2c017000 comp rx=0 tx=0).stop 2023-10-06T03:04:47.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.447+0000 7f7c382bb700 1 -- 172.21.15.125:0/4170058792 shutdown_connections 2023-10-06T03:04:47.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.447+0000 7f7c382bb700 1 --2- 172.21.15.125:0/4170058792 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7c1408b2a0 0x7f7c1408d750 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.447+0000 7f7c382bb700 1 --2- 172.21.15.125:0/4170058792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c3013b9f0 0x7f7c30152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.447+0000 7f7c382bb700 1 --2- 172.21.15.125:0/4170058792 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c3006e740 0x7f7c3013e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.447+0000 7f7c382bb700 1 --2- 172.21.15.125:0/4170058792 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c3013b620 0x7f7c3013a6b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.447+0000 7f7c382bb700 1 -- 172.21.15.125:0/4170058792 >> 172.21.15.125:0/4170058792 conn(0x7f7c300cbd30 msgr2=0x7f7c300cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:47.449 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.447+0000 7f7c382bb700 1 -- 172.21.15.125:0/4170058792 shutdown_connections 2023-10-06T03:04:47.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.447+0000 7f7c382bb700 1 -- 172.21.15.125:0/4170058792 wait complete. 2023-10-06T03:04:47.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.449+0000 7f707a2d1700 1 -- 172.21.15.125:0/3325861305 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7060067000 msgr2=0x7f70600694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.449+0000 7f707a2d1700 1 --2- 172.21.15.125:0/3325861305 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7060067000 0x7f70600694b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f706801e040 tx=0x7f706801b000 comp rx=0 tx=0).stop 2023-10-06T03:04:47.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.449+0000 7f707a2d1700 1 -- 172.21.15.125:0/3325861305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70740cb880 msgr2=0x7f7074150210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.449+0000 7f707a2d1700 1 --2- 172.21.15.125:0/3325861305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70740cb880 0x7f7074150210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f706c00e470 tx=0x7f706c00d040 comp rx=0 tx=0).stop 2023-10-06T03:04:47.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.449+0000 7f707a2d1700 1 -- 172.21.15.125:0/3325861305 shutdown_connections 2023-10-06T03:04:47.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.449+0000 7f707a2d1700 1 --2- 172.21.15.125:0/3325861305 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7060067000 0x7f70600694b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.449+0000 7f707a2d1700 1 --2- 172.21.15.125:0/3325861305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70740cb880 0x7f7074150210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.449+0000 7f707a2d1700 1 --2- 172.21.15.125:0/3325861305 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70740af320 0x7f70740b1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.449+0000 7f707a2d1700 1 --2- 172.21.15.125:0/3325861305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f70740c8320 0x7f7074168eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.449+0000 7f707a2d1700 1 -- 172.21.15.125:0/3325861305 >> 172.21.15.125:0/3325861305 conn(0x7f7074096120 msgr2=0x7f707406c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:47.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.449+0000 7f707a2d1700 1 -- 172.21.15.125:0/3325861305 shutdown_connections 2023-10-06T03:04:47.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.449+0000 7f707a2d1700 1 -- 172.21.15.125:0/3325861305 wait complete. 2023-10-06T03:04:47.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.454+0000 7f903e653700 1 -- 172.21.15.125:0/2422765461 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f9018005560 con 0x7f9038156de0 2023-10-06T03:04:47.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.454+0000 7f901ffff700 1 -- 172.21.15.125:0/2422765461 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9030025070 con 0x7f9038156de0 2023-10-06T03:04:47.456 INFO:teuthology.orchestra.run.smithi125.stdout:55834574856 2023-10-06T03:04:47.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.457+0000 7f903e653700 1 -- 172.21.15.125:0/2422765461 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9020067190 msgr2=0x7f9020069640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.457+0000 7f903e653700 1 --2- 172.21.15.125:0/2422765461 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9020067190 0x7f9020069640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f90280096a0 tx=0x7f9028006bc0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.457+0000 7f903e653700 1 -- 172.21.15.125:0/2422765461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9038156de0 msgr2=0x7f90380aeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.457+0000 7f903e653700 1 --2- 172.21.15.125:0/2422765461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9038156de0 0x7f90380aeac0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f903806ea30 tx=0x7f9030020000 comp rx=0 tx=0).stop 2023-10-06T03:04:47.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.457+0000 7f903e653700 1 -- 172.21.15.125:0/2422765461 shutdown_connections 2023-10-06T03:04:47.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.457+0000 7f903e653700 1 --2- 172.21.15.125:0/2422765461 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9020067190 0x7f9020069640 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.457+0000 7f903e653700 1 --2- 172.21.15.125:0/2422765461 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9038156de0 0x7f90380aeac0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.457+0000 7f903e653700 1 --2- 172.21.15.125:0/2422765461 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90380cc060 0x7f903814de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.457+0000 7f903e653700 1 --2- 172.21.15.125:0/2422765461 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90380cd790 0x7f90380ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.457+0000 7f903e653700 1 -- 172.21.15.125:0/2422765461 >> 172.21.15.125:0/2422765461 conn(0x7f90380cdf80 msgr2=0x7f903815ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:47.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.457+0000 7f903e653700 1 -- 172.21.15.125:0/2422765461 shutdown_connections 2023-10-06T03:04:47.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.457+0000 7f903e653700 1 -- 172.21.15.125:0/2422765461 wait complete. 2023-10-06T03:04:47.463 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2023-10-06T03:04:47.464 DEBUG:teuthology.parallel:result is None 2023-10-06T03:04:47.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2023-10-06T03:04:47.464 DEBUG:teuthology.parallel:result is None 2023-10-06T03:04:47.469 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2023-10-06T03:04:47.469 DEBUG:teuthology.parallel:result is None 2023-10-06T03:04:47.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2023-10-06T03:04:47.472 DEBUG:teuthology.parallel:result is None 2023-10-06T03:04:47.472 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T03:04:47.472 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:04:47.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.627+0000 7ff1b932e700 1 Processor -- start 2023-10-06T03:04:47.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.627+0000 7ff1b932e700 1 -- start start 2023-10-06T03:04:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.628+0000 7ff1b932e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff1b4067c30 0x7ff1b40c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.628+0000 7ff1b932e700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff1b40c6940 0x7ff1b40c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.628+0000 7ff1b932e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1b415a340 con 0x7ff1b4067860 2023-10-06T03:04:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.628+0000 7ff1b932e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b40c72b0 con 0x7ff1b4067c30 2023-10-06T03:04:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.628+0000 7ff1b932e700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1b415a620 con 0x7ff1b40c6940 2023-10-06T03:04:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.628+0000 7ff1b2ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff1b4067860 0x7ff1b4159b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53220/0 (socket says 172.21.15.125:53220) 2023-10-06T03:04:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.628+0000 7ff1b2ffd700 1 -- 172.21.15.125:0/3070612055 learned_addr learned my addr 172.21.15.125:0/3070612055 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.628+0000 7ff1b27fc700 1 --2- 172.21.15.125:0/3070612055 >> v2:172.21.15.125:3300/0 conn(0x7ff1b4067c30 0x7ff1b40c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.628+0000 7ff1b37fe700 1 --2- 172.21.15.125:0/3070612055 >> v2:172.21.15.130:3300/0 conn(0x7ff1b40c6940 0x7ff1b40c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.628+0000 7ff1b1ffb700 1 -- 172.21.15.125:0/3070612055 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177565288 0 0) 0x7ff1b415a340 con 0x7ff1b4067860 2023-10-06T03:04:47.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.628+0000 7ff1b1ffb700 1 -- 172.21.15.125:0/3070612055 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff19c003570 con 0x7ff1b4067860 2023-10-06T03:04:47.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.628+0000 7ff1b27fc700 1 -- 172.21.15.125:0/3070612055 >> v2:172.21.15.130:3300/0 conn(0x7ff1b40c6940 msgr2=0x7ff1b40c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:47.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.628+0000 7ff1b27fc700 1 --2- 172.21.15.125:0/3070612055 >> v2:172.21.15.130:3300/0 conn(0x7ff1b40c6940 0x7ff1b40c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.628+0000 7ff1b27fc700 1 -- 172.21.15.125:0/3070612055 >> v1:172.21.15.125:6789/0 conn(0x7ff1b4067860 legacy=0x7ff1b4159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.628+0000 7ff1b27fc700 1 -- 172.21.15.125:0/3070612055 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1b415a900 con 0x7ff1b4067c30 2023-10-06T03:04:47.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.628+0000 7ff1b27fc700 1 --2- 172.21.15.125:0/3070612055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1b4067c30 0x7ff1b40c81b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40ae3b0 tx=0x7ff1a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793edc6336f463e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.628+0000 7ff1b1ffb700 1 -- 172.21.15.125:0/3070612055 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8011630 con 0x7ff1b4067c30 2023-10-06T03:04:47.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.629+0000 7ff1b1ffb700 1 -- 172.21.15.125:0/3070612055 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a80117b0 con 0x7ff1b4067c30 2023-10-06T03:04:47.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.629+0000 7ff1b1ffb700 1 -- 172.21.15.125:0/3070612055 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a8011b70 con 0x7ff1b4067c30 2023-10-06T03:04:47.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.629+0000 7ff1b932e700 1 -- 172.21.15.125:0/3070612055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1b4067c30 msgr2=0x7ff1b40c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.629+0000 7ff1b932e700 1 --2- 172.21.15.125:0/3070612055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1b4067c30 0x7ff1b40c81b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40ae3b0 tx=0x7ff1a80091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.629+0000 7ff1b932e700 1 -- 172.21.15.125:0/3070612055 shutdown_connections 2023-10-06T03:04:47.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.629+0000 7ff1b932e700 1 --2- 172.21.15.125:0/3070612055 >> v2:172.21.15.130:3300/0 conn(0x7ff1b40c6940 0x7ff1b40c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.629+0000 7ff1b932e700 1 --2- 172.21.15.125:0/3070612055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1b4067c30 0x7ff1b40c81b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.629+0000 7ff1b932e700 1 -- 172.21.15.125:0/3070612055 >> 172.21.15.125:0/3070612055 conn(0x7ff1b40cbd00 msgr2=0x7ff1b40cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:47.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.629+0000 7ff1b932e700 1 -- 172.21.15.125:0/3070612055 shutdown_connections 2023-10-06T03:04:47.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.629+0000 7ff1b932e700 1 -- 172.21.15.125:0/3070612055 wait complete. 2023-10-06T03:04:47.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.630+0000 7ff1b932e700 1 Processor -- start 2023-10-06T03:04:47.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.630+0000 7ff1b932e700 1 -- start start 2023-10-06T03:04:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.631+0000 7ff1b932e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1b4067860 0x7ff1b414d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.631+0000 7ff1b932e700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b4067c30 0x7ff1b40a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.631+0000 7ff1b932e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff1b40c6940 0x7ff1b40ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.631+0000 7ff1b932e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b40c4be0 con 0x7ff1b4067860 2023-10-06T03:04:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.631+0000 7ff1b932e700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b40c3aa0 con 0x7ff1b4067c30 2023-10-06T03:04:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.631+0000 7ff1b932e700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b40c3d80 con 0x7ff1b40c6940 2023-10-06T03:04:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.631+0000 7ff1b2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1b4067860 0x7ff1b414d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.631+0000 7ff1b2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1b4067860 0x7ff1b414d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40452/0 (socket says 172.21.15.125:40452) 2023-10-06T03:04:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.631+0000 7ff1b2ffd700 1 -- 172.21.15.125:0/4053186679 learned_addr learned my addr 172.21.15.125:0/4053186679 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.631+0000 7ff1b27fc700 1 --2- 172.21.15.125:0/4053186679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b4067c30 0x7ff1b40a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.636 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.631+0000 7ff1b37fe700 1 --2- 172.21.15.125:0/4053186679 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff1b40c6940 0x7ff1b40ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.632+0000 7ff1b2ffd700 1 -- 172.21.15.125:0/4053186679 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff1b40c6940 msgr2=0x7ff1b40ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.632+0000 7ff1b2ffd700 1 --2- 172.21.15.125:0/4053186679 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff1b40c6940 0x7ff1b40ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.632+0000 7ff1b2ffd700 1 -- 172.21.15.125:0/4053186679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b4067c30 msgr2=0x7ff1b40a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.632+0000 7ff1b2ffd700 1 --2- 172.21.15.125:0/4053186679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b4067c30 0x7ff1b40a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.632+0000 7ff1b2ffd700 1 -- 172.21.15.125:0/4053186679 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a8009420 con 0x7ff1b4067860 2023-10-06T03:04:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.632+0000 7ff1b37fe700 1 --2- 172.21.15.125:0/4053186679 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff1b40c6940 0x7ff1b40ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:04:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.632+0000 7ff1b2ffd700 1 --2- 172.21.15.125:0/4053186679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1b4067860 0x7ff1b414d350 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400c7c0 tx=0x7ff1a4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.632+0000 7ff19affd700 1 -- 172.21.15.125:0/4053186679 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4005b30 con 0x7ff1b4067860 2023-10-06T03:04:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.632+0000 7ff19affd700 1 -- 172.21.15.125:0/4053186679 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a4005c90 con 0x7ff1b4067860 2023-10-06T03:04:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.632+0000 7ff19affd700 1 -- 172.21.15.125:0/4053186679 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4007340 con 0x7ff1b4067860 2023-10-06T03:04:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.632+0000 7ff1b932e700 1 -- 172.21.15.125:0/4053186679 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b40c4870 con 0x7ff1b4067860 2023-10-06T03:04:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.632+0000 7ff1b932e700 1 -- 172.21.15.125:0/4053186679 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b415ad00 con 0x7ff1b4067860 2023-10-06T03:04:47.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.633+0000 7ff1b932e700 1 -- 172.21.15.125:0/4053186679 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b4066510 con 0x7ff1b4067860 2023-10-06T03:04:47.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.633+0000 7ff19affd700 1 -- 172.21.15.125:0/4053186679 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1a401b400 con 0x7ff1b4067860 2023-10-06T03:04:47.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.633+0000 7ff19affd700 1 --2- 172.21.15.125:0/4053186679 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff1a0066f30 0x7ff1a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:47.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.634+0000 7ff19affd700 1 -- 172.21.15.125:0/4053186679 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff1a4084580 con 0x7ff1b4067860 2023-10-06T03:04:47.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.634+0000 7ff1b27fc700 1 --2- 172.21.15.125:0/4053186679 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff1a0066f30 0x7ff1a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:47.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.634+0000 7ff1b27fc700 1 --2- 172.21.15.125:0/4053186679 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff1a0066f30 0x7ff1a00693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40ae3b0 tx=0x7ff1a8017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:47.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.638+0000 7ff19affd700 1 -- 172.21.15.125:0/4053186679 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1a40513a0 con 0x7ff1b4067860 2023-10-06T03:04:47.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.816+0000 7ff1b932e700 1 -- 172.21.15.125:0/4053186679 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1b40c4d20 con 0x7ff1a0066f30 2023-10-06T03:04:47.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.826+0000 7ff19affd700 1 -- 172.21.15.125:0/4053186679 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367326 (secure 0 0 0) 0x7ff1a8000cd0 con 0x7ff1a0066f30 2023-10-06T03:04:47.831 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:47.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.829+0000 7ff1b932e700 1 -- 172.21.15.125:0/4053186679 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff1a0066f30 msgr2=0x7ff1a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.833 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.829+0000 7ff1b932e700 1 --2- 172.21.15.125:0/4053186679 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff1a0066f30 0x7ff1a00693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40ae3b0 tx=0x7ff1a8017000 comp rx=0 tx=0).stop 2023-10-06T03:04:47.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.829+0000 7ff1b932e700 1 -- 172.21.15.125:0/4053186679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1b4067860 msgr2=0x7ff1b414d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:47.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.829+0000 7ff1b932e700 1 --2- 172.21.15.125:0/4053186679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1b4067860 0x7ff1b414d350 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400c7c0 tx=0x7ff1a4007e00 comp rx=0 tx=0).stop 2023-10-06T03:04:47.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.829+0000 7ff1b932e700 1 -- 172.21.15.125:0/4053186679 shutdown_connections 2023-10-06T03:04:47.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.829+0000 7ff1b932e700 1 --2- 172.21.15.125:0/4053186679 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff1a0066f30 0x7ff1a00693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.829+0000 7ff1b932e700 1 --2- 172.21.15.125:0/4053186679 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff1b40c6940 0x7ff1b40ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.829+0000 7ff1b932e700 1 --2- 172.21.15.125:0/4053186679 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff1b4067860 0x7ff1b414d350 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.829+0000 7ff1b932e700 1 --2- 172.21.15.125:0/4053186679 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1b4067c30 0x7ff1b40a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:47.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.829+0000 7ff1b932e700 1 -- 172.21.15.125:0/4053186679 >> 172.21.15.125:0/4053186679 conn(0x7ff1b40cbd00 msgr2=0x7ff1b40c8770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:47.834 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.829+0000 7ff1b932e700 1 -- 172.21.15.125:0/4053186679 shutdown_connections 2023-10-06T03:04:47.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.829+0000 7ff1b932e700 1 -- 172.21.15.125:0/4053186679 wait complete. 2023-10-06T03:04:47.835 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-06T03:04:47.843 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-10-06T03:04:47.811097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594853,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381796,"kb_used_data":3492,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592924,"statfs":{"total":773094113280,"available":770655154176,"internally_reserved":0,"allocated":3575808,"data_stored":2145279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2179,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003176"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257885+0000","last_change":"2023-10-06T03:04:29.236716+0000","last_active":"2023-10-06T03:04:33.257885+0000","last_peered":"2023-10-06T03:04:33.257885+0000","last_clean":"2023-10-06T03:04:33.257885+0000","last_became_active":"2023-10-06T03:04:29.236437+0000","last_became_peered":"2023-10-06T03:04:29.236437+0000","last_unstale":"2023-10-06T03:04:33.257885+0000","last_undegraded":"2023-10-06T03:04:33.257885+0000","last_fullsized":"2023-10-06T03:04:33.257885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:20.456488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.248189+0000","last_change":"2023-10-06T03:04:29.250536+0000","last_active":"2023-10-06T03:04:33.248189+0000","last_peered":"2023-10-06T03:04:33.248189+0000","last_clean":"2023-10-06T03:04:33.248189+0000","last_became_active":"2023-10-06T03:04:29.249872+0000","last_became_peered":"2023-10-06T03:04:29.249872+0000","last_unstale":"2023-10-06T03:04:33.248189+0000","last_undegraded":"2023-10-06T03:04:33.248189+0000","last_fullsized":"2023-10-06T03:04:33.248189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:06.710555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251359+0000","last_change":"2023-10-06T03:04:29.244837+0000","last_active":"2023-10-06T03:04:33.251359+0000","last_peered":"2023-10-06T03:04:33.251359+0000","last_clean":"2023-10-06T03:04:33.251359+0000","last_became_active":"2023-10-06T03:04:29.244485+0000","last_became_peered":"2023-10-06T03:04:29.244485+0000","last_unstale":"2023-10-06T03:04:33.251359+0000","last_undegraded":"2023-10-06T03:04:33.251359+0000","last_fullsized":"2023-10-06T03:04:33.251359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:22.025761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251807+0000","last_change":"2023-10-06T03:04:29.244101+0000","last_active":"2023-10-06T03:04:33.251807+0000","last_peered":"2023-10-06T03:04:33.251807+0000","last_clean":"2023-10-06T03:04:33.251807+0000","last_became_active":"2023-10-06T03:04:29.243769+0000","last_became_peered":"2023-10-06T03:04:29.243769+0000","last_unstale":"2023-10-06T03:04:33.251807+0000","last_undegraded":"2023-10-06T03:04:33.251807+0000","last_fullsized":"2023-10-06T03:04:33.251807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:03.973528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260210+0000","last_change":"2023-10-06T03:04:29.245074+0000","last_active":"2023-10-06T03:04:33.260210+0000","last_peered":"2023-10-06T03:04:33.260210+0000","last_clean":"2023-10-06T03:04:33.260210+0000","last_became_active":"2023-10-06T03:04:29.244794+0000","last_became_peered":"2023-10-06T03:04:29.244794+0000","last_unstale":"2023-10-06T03:04:33.260210+0000","last_undegraded":"2023-10-06T03:04:33.260210+0000","last_fullsized":"2023-10-06T03:04:33.260210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:14.635872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251200+0000","last_change":"2023-10-06T03:04:29.248647+0000","last_active":"2023-10-06T03:04:33.251200+0000","last_peered":"2023-10-06T03:04:33.251200+0000","last_clean":"2023-10-06T03:04:33.251200+0000","last_became_active":"2023-10-06T03:04:29.248380+0000","last_became_peered":"2023-10-06T03:04:29.248380+0000","last_unstale":"2023-10-06T03:04:33.251200+0000","last_undegraded":"2023-10-06T03:04:33.251200+0000","last_fullsized":"2023-10-06T03:04:33.251200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:03.691892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255155+0000","last_change":"2023-10-06T03:04:29.249718+0000","last_active":"2023-10-06T03:04:33.255155+0000","last_peered":"2023-10-06T03:04:33.255155+0000","last_clean":"2023-10-06T03:04:33.255155+0000","last_became_active":"2023-10-06T03:04:29.249402+0000","last_became_peered":"2023-10-06T03:04:29.249402+0000","last_unstale":"2023-10-06T03:04:33.255155+0000","last_undegraded":"2023-10-06T03:04:33.255155+0000","last_fullsized":"2023-10-06T03:04:33.255155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247799+0000","last_change":"2023-10-06T03:04:29.252781+0000","last_active":"2023-10-06T03:04:33.247799+0000","last_peered":"2023-10-06T03:04:33.247799+0000","last_clean":"2023-10-06T03:04:33.247799+0000","last_became_active":"2023-10-06T03:04:29.252492+0000","last_became_peered":"2023-10-06T03:04:29.252492+0000","last_unstale":"2023-10-06T03:04:33.247799+0000","last_undegraded":"2023-10-06T03:04:33.247799+0000","last_fullsized":"2023-10-06T03:04:33.247799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:27.111880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260274+0000","last_change":"2023-10-06T03:04:29.248896+0000","last_active":"2023-10-06T03:04:33.260274+0000","last_peered":"2023-10-06T03:04:33.260274+0000","last_clean":"2023-10-06T03:04:33.260274+0000","last_became_active":"2023-10-06T03:04:29.248629+0000","last_became_peered":"2023-10-06T03:04:29.248629+0000","last_unstale":"2023-10-06T03:04:33.260274+0000","last_undegraded":"2023-10-06T03:04:33.260274+0000","last_fullsized":"2023-10-06T03:04:33.260274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:07.410542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.248372+0000","last_change":"2023-10-06T03:04:29.249187+0000","last_active":"2023-10-06T03:04:33.248372+0000","last_peered":"2023-10-06T03:04:33.248372+0000","last_clean":"2023-10-06T03:04:33.248372+0000","last_became_active":"2023-10-06T03:04:29.248914+0000","last_became_peered":"2023-10-06T03:04:29.248914+0000","last_unstale":"2023-10-06T03:04:33.248372+0000","last_undegraded":"2023-10-06T03:04:33.248372+0000","last_fullsized":"2023-10-06T03:04:33.248372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:07.410542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251508+0000","last_change":"2023-10-06T03:04:29.254043+0000","last_active":"2023-10-06T03:04:33.251508+0000","last_peered":"2023-10-06T03:04:33.251508+0000","last_clean":"2023-10-06T03:04:33.251508+0000","last_became_active":"2023-10-06T03:04:29.253749+0000","last_became_peered":"2023-10-06T03:04:29.253749+0000","last_unstale":"2023-10-06T03:04:33.251508+0000","last_undegraded":"2023-10-06T03:04:33.251508+0000","last_fullsized":"2023-10-06T03:04:33.251508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:56.032368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256021+0000","last_change":"2023-10-06T03:04:29.248689+0000","last_active":"2023-10-06T03:04:33.256021+0000","last_peered":"2023-10-06T03:04:33.256021+0000","last_clean":"2023-10-06T03:04:33.256021+0000","last_became_active":"2023-10-06T03:04:29.248400+0000","last_became_peered":"2023-10-06T03:04:29.248400+0000","last_unstale":"2023-10-06T03:04:33.256021+0000","last_undegraded":"2023-10-06T03:04:33.256021+0000","last_fullsized":"2023-10-06T03:04:33.256021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:23.078369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252308+0000","last_change":"2023-10-06T03:04:29.238874+0000","last_active":"2023-10-06T03:04:33.252308+0000","last_peered":"2023-10-06T03:04:33.252308+0000","last_clean":"2023-10-06T03:04:33.252308+0000","last_became_active":"2023-10-06T03:04:29.238616+0000","last_became_peered":"2023-10-06T03:04:29.238616+0000","last_unstale":"2023-10-06T03:04:33.252308+0000","last_undegraded":"2023-10-06T03:04:33.252308+0000","last_fullsized":"2023-10-06T03:04:33.252308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:05.482076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247717+0000","last_change":"2023-10-06T03:04:29.248968+0000","last_active":"2023-10-06T03:04:33.247717+0000","last_peered":"2023-10-06T03:04:33.247717+0000","last_clean":"2023-10-06T03:04:33.247717+0000","last_became_active":"2023-10-06T03:04:29.248709+0000","last_became_peered":"2023-10-06T03:04:29.248709+0000","last_unstale":"2023-10-06T03:04:33.247717+0000","last_undegraded":"2023-10-06T03:04:33.247717+0000","last_fullsized":"2023-10-06T03:04:33.247717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:41.163677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254258+0000","last_change":"2023-10-06T03:04:29.253102+0000","last_active":"2023-10-06T03:04:33.254258+0000","last_peered":"2023-10-06T03:04:33.254258+0000","last_clean":"2023-10-06T03:04:33.254258+0000","last_became_active":"2023-10-06T03:04:29.252836+0000","last_became_peered":"2023-10-06T03:04:29.252836+0000","last_unstale":"2023-10-06T03:04:33.254258+0000","last_undegraded":"2023-10-06T03:04:33.254258+0000","last_fullsized":"2023-10-06T03:04:33.254258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251098+0000","last_change":"2023-10-06T03:04:29.244988+0000","last_active":"2023-10-06T03:04:33.251098+0000","last_peered":"2023-10-06T03:04:33.251098+0000","last_clean":"2023-10-06T03:04:33.251098+0000","last_became_active":"2023-10-06T03:04:29.244457+0000","last_became_peered":"2023-10-06T03:04:29.244457+0000","last_unstale":"2023-10-06T03:04:33.251098+0000","last_undegraded":"2023-10-06T03:04:33.251098+0000","last_fullsized":"2023-10-06T03:04:33.251098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:20.580002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260392+0000","last_change":"2023-10-06T03:04:29.242343+0000","last_active":"2023-10-06T03:04:33.260392+0000","last_peered":"2023-10-06T03:04:33.260392+0000","last_clean":"2023-10-06T03:04:33.260392+0000","last_became_active":"2023-10-06T03:04:29.242032+0000","last_became_peered":"2023-10-06T03:04:29.242032+0000","last_unstale":"2023-10-06T03:04:33.260392+0000","last_undegraded":"2023-10-06T03:04:33.260392+0000","last_fullsized":"2023-10-06T03:04:33.260392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.258197+0000","last_change":"2023-10-06T03:04:29.246372+0000","last_active":"2023-10-06T03:04:33.258197+0000","last_peered":"2023-10-06T03:04:33.258197+0000","last_clean":"2023-10-06T03:04:33.258197+0000","last_became_active":"2023-10-06T03:04:29.246058+0000","last_became_peered":"2023-10-06T03:04:29.246058+0000","last_unstale":"2023-10-06T03:04:33.258197+0000","last_undegraded":"2023-10-06T03:04:33.258197+0000","last_fullsized":"2023-10-06T03:04:33.258197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253617+0000","last_change":"2023-10-06T03:04:29.242029+0000","last_active":"2023-10-06T03:04:33.253617+0000","last_peered":"2023-10-06T03:04:33.253617+0000","last_clean":"2023-10-06T03:04:33.253617+0000","last_became_active":"2023-10-06T03:04:29.241785+0000","last_became_peered":"2023-10-06T03:04:29.241785+0000","last_unstale":"2023-10-06T03:04:33.253617+0000","last_undegraded":"2023-10-06T03:04:33.253617+0000","last_fullsized":"2023-10-06T03:04:33.253617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:48.653156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253130+0000","last_change":"2023-10-06T03:04:29.246603+0000","last_active":"2023-10-06T03:04:33.253130+0000","last_peered":"2023-10-06T03:04:33.253130+0000","last_clean":"2023-10-06T03:04:33.253130+0000","last_became_active":"2023-10-06T03:04:29.246405+0000","last_became_peered":"2023-10-06T03:04:29.246405+0000","last_unstale":"2023-10-06T03:04:33.253130+0000","last_undegraded":"2023-10-06T03:04:33.253130+0000","last_fullsized":"2023-10-06T03:04:33.253130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:41.436589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254147+0000","last_change":"2023-10-06T03:04:29.250839+0000","last_active":"2023-10-06T03:04:33.254147+0000","last_peered":"2023-10-06T03:04:33.254147+0000","last_clean":"2023-10-06T03:04:33.254147+0000","last_became_active":"2023-10-06T03:04:29.250600+0000","last_became_peered":"2023-10-06T03:04:29.250600+0000","last_unstale":"2023-10-06T03:04:33.254147+0000","last_undegraded":"2023-10-06T03:04:33.254147+0000","last_fullsized":"2023-10-06T03:04:33.254147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:27.111880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252975+0000","last_change":"2023-10-06T03:04:29.247916+0000","last_active":"2023-10-06T03:04:33.252975+0000","last_peered":"2023-10-06T03:04:33.252975+0000","last_clean":"2023-10-06T03:04:33.252975+0000","last_became_active":"2023-10-06T03:04:29.247638+0000","last_became_peered":"2023-10-06T03:04:29.247638+0000","last_unstale":"2023-10-06T03:04:33.252975+0000","last_undegraded":"2023-10-06T03:04:33.252975+0000","last_fullsized":"2023-10-06T03:04:33.252975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:06.710555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255737+0000","last_change":"2023-10-06T03:04:29.244948+0000","last_active":"2023-10-06T03:04:33.255737+0000","last_peered":"2023-10-06T03:04:33.255737+0000","last_clean":"2023-10-06T03:04:33.255737+0000","last_became_active":"2023-10-06T03:04:29.244458+0000","last_became_peered":"2023-10-06T03:04:29.244458+0000","last_unstale":"2023-10-06T03:04:33.255737+0000","last_undegraded":"2023-10-06T03:04:33.255737+0000","last_fullsized":"2023-10-06T03:04:33.255737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:07.410542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253458+0000","last_change":"2023-10-06T03:04:29.246013+0000","last_active":"2023-10-06T03:04:33.253458+0000","last_peered":"2023-10-06T03:04:33.253458+0000","last_clean":"2023-10-06T03:04:33.253458+0000","last_became_active":"2023-10-06T03:04:29.245107+0000","last_became_peered":"2023-10-06T03:04:29.245107+0000","last_unstale":"2023-10-06T03:04:33.253458+0000","last_undegraded":"2023-10-06T03:04:33.253458+0000","last_fullsized":"2023-10-06T03:04:33.253458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257429+0000","last_change":"2023-10-06T03:04:29.249697+0000","last_active":"2023-10-06T03:04:33.257429+0000","last_peered":"2023-10-06T03:04:33.257429+0000","last_clean":"2023-10-06T03:04:33.257429+0000","last_became_active":"2023-10-06T03:04:29.249523+0000","last_became_peered":"2023-10-06T03:04:29.249523+0000","last_unstale":"2023-10-06T03:04:33.257429+0000","last_undegraded":"2023-10-06T03:04:33.257429+0000","last_fullsized":"2023-10-06T03:04:33.257429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:22.258796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256711+0000","last_change":"2023-10-06T03:04:29.249776+0000","last_active":"2023-10-06T03:04:33.256711+0000","last_peered":"2023-10-06T03:04:33.256711+0000","last_clean":"2023-10-06T03:04:33.256711+0000","last_became_active":"2023-10-06T03:04:29.249512+0000","last_became_peered":"2023-10-06T03:04:29.249512+0000","last_unstale":"2023-10-06T03:04:33.256711+0000","last_undegraded":"2023-10-06T03:04:33.256711+0000","last_fullsized":"2023-10-06T03:04:33.256711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:03.973528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.248523+0000","last_change":"2023-10-06T03:04:29.253464+0000","last_active":"2023-10-06T03:04:33.248523+0000","last_peered":"2023-10-06T03:04:33.248523+0000","last_clean":"2023-10-06T03:04:33.248523+0000","last_became_active":"2023-10-06T03:04:29.253186+0000","last_became_peered":"2023-10-06T03:04:29.253186+0000","last_unstale":"2023-10-06T03:04:33.248523+0000","last_undegraded":"2023-10-06T03:04:33.248523+0000","last_fullsized":"2023-10-06T03:04:33.248523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.277035+0000","last_change":"2023-10-06T03:04:33.272809+0000","last_active":"2023-10-06T03:04:33.277035+0000","last_peered":"2023-10-06T03:04:33.277035+0000","last_clean":"2023-10-06T03:04:33.277035+0000","last_became_active":"2023-10-06T03:04:33.272457+0000","last_became_peered":"2023-10-06T03:04:33.272457+0000","last_unstale":"2023-10-06T03:04:33.277035+0000","last_undegraded":"2023-10-06T03:04:33.277035+0000","last_fullsized":"2023-10-06T03:04:33.277035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:00.208098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251101+0000","last_change":"2023-10-06T03:04:28.838285+0000","last_active":"2023-10-06T03:04:33.251101+0000","last_peered":"2023-10-06T03:04:33.251101+0000","last_clean":"2023-10-06T03:04:33.251101+0000","last_became_active":"2023-10-06T03:04:28.837675+0000","last_became_peered":"2023-10-06T03:04:28.837675+0000","last_unstale":"2023-10-06T03:04:33.251101+0000","last_undegraded":"2023-10-06T03:04:33.251101+0000","last_fullsized":"2023-10-06T03:04:33.251101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:01.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256585+0000","last_change":"2023-10-06T03:04:29.251007+0000","last_active":"2023-10-06T03:04:33.256585+0000","last_peered":"2023-10-06T03:04:33.256585+0000","last_clean":"2023-10-06T03:04:33.256585+0000","last_became_active":"2023-10-06T03:04:29.250760+0000","last_became_peered":"2023-10-06T03:04:29.250760+0000","last_unstale":"2023-10-06T03:04:33.256585+0000","last_undegraded":"2023-10-06T03:04:33.256585+0000","last_fullsized":"2023-10-06T03:04:33.256585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:14.635872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274464+0000","last_change":"2023-10-06T03:04:33.270233+0000","last_active":"2023-10-06T03:04:33.274464+0000","last_peered":"2023-10-06T03:04:33.274464+0000","last_clean":"2023-10-06T03:04:33.274464+0000","last_became_active":"2023-10-06T03:04:33.269917+0000","last_became_peered":"2023-10-06T03:04:33.269917+0000","last_unstale":"2023-10-06T03:04:33.274464+0000","last_undegraded":"2023-10-06T03:04:33.274464+0000","last_fullsized":"2023-10-06T03:04:33.274464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:25.913975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254184+0000","last_change":"2023-10-06T03:04:28.831735+0000","last_active":"2023-10-06T03:04:33.254184+0000","last_peered":"2023-10-06T03:04:33.254184+0000","last_clean":"2023-10-06T03:04:33.254184+0000","last_became_active":"2023-10-06T03:04:28.831448+0000","last_became_peered":"2023-10-06T03:04:28.831448+0000","last_unstale":"2023-10-06T03:04:33.254184+0000","last_undegraded":"2023-10-06T03:04:33.254184+0000","last_fullsized":"2023-10-06T03:04:33.254184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:16.444923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260988+0000","last_change":"2023-10-06T03:04:29.244005+0000","last_active":"2023-10-06T03:04:33.260988+0000","last_peered":"2023-10-06T03:04:33.260988+0000","last_clean":"2023-10-06T03:04:33.260988+0000","last_became_active":"2023-10-06T03:04:29.243597+0000","last_became_peered":"2023-10-06T03:04:29.243597+0000","last_unstale":"2023-10-06T03:04:33.260988+0000","last_undegraded":"2023-10-06T03:04:33.260988+0000","last_fullsized":"2023-10-06T03:04:33.260988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279041+0000","last_change":"2023-10-06T03:04:33.275920+0000","last_active":"2023-10-06T03:04:33.279041+0000","last_peered":"2023-10-06T03:04:33.279041+0000","last_clean":"2023-10-06T03:04:33.279041+0000","last_became_active":"2023-10-06T03:04:33.275198+0000","last_became_peered":"2023-10-06T03:04:33.275198+0000","last_unstale":"2023-10-06T03:04:33.279041+0000","last_undegraded":"2023-10-06T03:04:33.279041+0000","last_fullsized":"2023-10-06T03:04:33.279041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:53.801187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255924+0000","last_change":"2023-10-06T03:04:28.839035+0000","last_active":"2023-10-06T03:04:33.255924+0000","last_peered":"2023-10-06T03:04:33.255924+0000","last_clean":"2023-10-06T03:04:33.255924+0000","last_became_active":"2023-10-06T03:04:28.838799+0000","last_became_peered":"2023-10-06T03:04:28.838799+0000","last_unstale":"2023-10-06T03:04:33.255924+0000","last_undegraded":"2023-10-06T03:04:33.255924+0000","last_fullsized":"2023-10-06T03:04:33.255924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:16.444923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252657+0000","last_change":"2023-10-06T03:04:29.250582+0000","last_active":"2023-10-06T03:04:33.252657+0000","last_peered":"2023-10-06T03:04:33.252657+0000","last_clean":"2023-10-06T03:04:33.252657+0000","last_became_active":"2023-10-06T03:04:29.250300+0000","last_became_peered":"2023-10-06T03:04:29.250300+0000","last_unstale":"2023-10-06T03:04:33.252657+0000","last_undegraded":"2023-10-06T03:04:33.252657+0000","last_fullsized":"2023-10-06T03:04:33.252657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:20.456488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.273611+0000","last_change":"2023-10-06T03:04:33.268665+0000","last_active":"2023-10-06T03:04:33.273611+0000","last_peered":"2023-10-06T03:04:33.273611+0000","last_clean":"2023-10-06T03:04:33.273611+0000","last_became_active":"2023-10-06T03:04:33.268265+0000","last_became_peered":"2023-10-06T03:04:33.268265+0000","last_unstale":"2023-10-06T03:04:33.273611+0000","last_undegraded":"2023-10-06T03:04:33.273611+0000","last_fullsized":"2023-10-06T03:04:33.273611+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:44.857274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260397+0000","last_change":"2023-10-06T03:04:28.840063+0000","last_active":"2023-10-06T03:04:33.260397+0000","last_peered":"2023-10-06T03:04:33.260397+0000","last_clean":"2023-10-06T03:04:33.260397+0000","last_became_active":"2023-10-06T03:04:28.839810+0000","last_became_peered":"2023-10-06T03:04:28.839810+0000","last_unstale":"2023-10-06T03:04:33.260397+0000","last_undegraded":"2023-10-06T03:04:33.260397+0000","last_fullsized":"2023-10-06T03:04:33.260397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:47.647784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255847+0000","last_change":"2023-10-06T03:04:29.246067+0000","last_active":"2023-10-06T03:04:33.255847+0000","last_peered":"2023-10-06T03:04:33.255847+0000","last_clean":"2023-10-06T03:04:33.255847+0000","last_became_active":"2023-10-06T03:04:29.245691+0000","last_became_peered":"2023-10-06T03:04:29.245691+0000","last_unstale":"2023-10-06T03:04:33.255847+0000","last_undegraded":"2023-10-06T03:04:33.255847+0000","last_fullsized":"2023-10-06T03:04:33.255847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274621+0000","last_change":"2023-10-06T03:04:33.271930+0000","last_active":"2023-10-06T03:04:33.274621+0000","last_peered":"2023-10-06T03:04:33.274621+0000","last_clean":"2023-10-06T03:04:33.274621+0000","last_became_active":"2023-10-06T03:04:33.271546+0000","last_became_peered":"2023-10-06T03:04:33.271546+0000","last_unstale":"2023-10-06T03:04:33.274621+0000","last_undegraded":"2023-10-06T03:04:33.274621+0000","last_fullsized":"2023-10-06T03:04:33.274621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:53.801187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.248282+0000","last_change":"2023-10-06T03:04:28.844581+0000","last_active":"2023-10-06T03:04:33.248282+0000","last_peered":"2023-10-06T03:04:33.248282+0000","last_clean":"2023-10-06T03:04:33.248282+0000","last_became_active":"2023-10-06T03:04:28.844305+0000","last_became_peered":"2023-10-06T03:04:28.844305+0000","last_unstale":"2023-10-06T03:04:33.248282+0000","last_undegraded":"2023-10-06T03:04:33.248282+0000","last_fullsized":"2023-10-06T03:04:33.248282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:02.968156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255764+0000","last_change":"2023-10-06T03:04:29.250970+0000","last_active":"2023-10-06T03:04:33.255764+0000","last_peered":"2023-10-06T03:04:33.255764+0000","last_clean":"2023-10-06T03:04:33.255764+0000","last_became_active":"2023-10-06T03:04:29.250699+0000","last_became_peered":"2023-10-06T03:04:29.250699+0000","last_unstale":"2023-10-06T03:04:33.255764+0000","last_undegraded":"2023-10-06T03:04:33.255764+0000","last_fullsized":"2023-10-06T03:04:33.255764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:00.194415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274257+0000","last_change":"2023-10-06T03:04:33.266174+0000","last_active":"2023-10-06T03:04:33.274257+0000","last_peered":"2023-10-06T03:04:33.274257+0000","last_clean":"2023-10-06T03:04:33.274257+0000","last_became_active":"2023-10-06T03:04:33.265684+0000","last_became_peered":"2023-10-06T03:04:33.265684+0000","last_unstale":"2023-10-06T03:04:33.274257+0000","last_undegraded":"2023-10-06T03:04:33.274257+0000","last_fullsized":"2023-10-06T03:04:33.274257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:25.279420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254696+0000","last_change":"2023-10-06T03:04:28.841750+0000","last_active":"2023-10-06T03:04:33.254696+0000","last_peered":"2023-10-06T03:04:33.254696+0000","last_clean":"2023-10-06T03:04:33.254696+0000","last_became_active":"2023-10-06T03:04:28.841494+0000","last_became_peered":"2023-10-06T03:04:28.841494+0000","last_unstale":"2023-10-06T03:04:33.254696+0000","last_undegraded":"2023-10-06T03:04:33.254696+0000","last_fullsized":"2023-10-06T03:04:33.254696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:37.754382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252743+0000","last_change":"2023-10-06T03:04:29.252516+0000","last_active":"2023-10-06T03:04:33.252743+0000","last_peered":"2023-10-06T03:04:33.252743+0000","last_clean":"2023-10-06T03:04:33.252743+0000","last_became_active":"2023-10-06T03:04:29.252229+0000","last_became_peered":"2023-10-06T03:04:29.252229+0000","last_unstale":"2023-10-06T03:04:33.252743+0000","last_undegraded":"2023-10-06T03:04:33.252743+0000","last_fullsized":"2023-10-06T03:04:33.252743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:41.163677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.273192+0000","last_change":"2023-10-06T03:04:33.270221+0000","last_active":"2023-10-06T03:04:33.273192+0000","last_peered":"2023-10-06T03:04:33.273192+0000","last_clean":"2023-10-06T03:04:33.273192+0000","last_became_active":"2023-10-06T03:04:33.269852+0000","last_became_peered":"2023-10-06T03:04:33.269852+0000","last_unstale":"2023-10-06T03:04:33.273192+0000","last_undegraded":"2023-10-06T03:04:33.273192+0000","last_fullsized":"2023-10-06T03:04:33.273192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:29.020898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'9","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:04:39.092973+0000","last_change":"2023-10-06T03:04:28.838015+0000","last_active":"2023-10-06T03:04:39.092973+0000","last_peered":"2023-10-06T03:04:39.092973+0000","last_clean":"2023-10-06T03:04:39.092973+0000","last_became_active":"2023-10-06T03:04:28.837321+0000","last_became_peered":"2023-10-06T03:04:28.837321+0000","last_unstale":"2023-10-06T03:04:39.092973+0000","last_undegraded":"2023-10-06T03:04:39.092973+0000","last_fullsized":"2023-10-06T03:04:39.092973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:16.444923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3715,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251923+0000","last_change":"2023-10-06T03:04:29.245423+0000","last_active":"2023-10-06T03:04:33.251923+0000","last_peered":"2023-10-06T03:04:33.251923+0000","last_clean":"2023-10-06T03:04:33.251923+0000","last_became_active":"2023-10-06T03:04:29.245125+0000","last_became_peered":"2023-10-06T03:04:29.245125+0000","last_unstale":"2023-10-06T03:04:33.251923+0000","last_undegraded":"2023-10-06T03:04:33.251923+0000","last_fullsized":"2023-10-06T03:04:33.251923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:16.298020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.272326+0000","last_change":"2023-10-06T03:04:33.269331+0000","last_active":"2023-10-06T03:04:33.272326+0000","last_peered":"2023-10-06T03:04:33.272326+0000","last_clean":"2023-10-06T03:04:33.272326+0000","last_became_active":"2023-10-06T03:04:33.268947+0000","last_became_peered":"2023-10-06T03:04:33.268947+0000","last_unstale":"2023-10-06T03:04:33.272326+0000","last_undegraded":"2023-10-06T03:04:33.272326+0000","last_fullsized":"2023-10-06T03:04:33.272326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:18.722157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254189+0000","last_change":"2023-10-06T03:04:28.844574+0000","last_active":"2023-10-06T03:04:33.254189+0000","last_peered":"2023-10-06T03:04:33.254189+0000","last_clean":"2023-10-06T03:04:33.254189+0000","last_became_active":"2023-10-06T03:04:28.844264+0000","last_became_peered":"2023-10-06T03:04:28.844264+0000","last_unstale":"2023-10-06T03:04:33.254189+0000","last_undegraded":"2023-10-06T03:04:33.254189+0000","last_fullsized":"2023-10-06T03:04:33.254189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:05.970777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256525+0000","last_change":"2023-10-06T03:04:29.247698+0000","last_active":"2023-10-06T03:04:33.256525+0000","last_peered":"2023-10-06T03:04:33.256525+0000","last_clean":"2023-10-06T03:04:33.256525+0000","last_became_active":"2023-10-06T03:04:29.247464+0000","last_became_peered":"2023-10-06T03:04:29.247464+0000","last_unstale":"2023-10-06T03:04:33.256525+0000","last_undegraded":"2023-10-06T03:04:33.256525+0000","last_fullsized":"2023-10-06T03:04:33.256525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:13.355371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.273888+0000","last_change":"2023-10-06T03:04:33.266947+0000","last_active":"2023-10-06T03:04:33.273888+0000","last_peered":"2023-10-06T03:04:33.273888+0000","last_clean":"2023-10-06T03:04:33.273888+0000","last_became_active":"2023-10-06T03:04:33.266543+0000","last_became_peered":"2023-10-06T03:04:33.266543+0000","last_unstale":"2023-10-06T03:04:33.273888+0000","last_undegraded":"2023-10-06T03:04:33.273888+0000","last_fullsized":"2023-10-06T03:04:33.273888+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:29.020898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252534+0000","last_change":"2023-10-06T03:04:28.838464+0000","last_active":"2023-10-06T03:04:33.252534+0000","last_peered":"2023-10-06T03:04:33.252534+0000","last_clean":"2023-10-06T03:04:33.252534+0000","last_became_active":"2023-10-06T03:04:28.838008+0000","last_became_peered":"2023-10-06T03:04:28.838008+0000","last_unstale":"2023-10-06T03:04:33.252534+0000","last_undegraded":"2023-10-06T03:04:33.252534+0000","last_fullsized":"2023-10-06T03:04:33.252534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:53.804099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247750+0000","last_change":"2023-10-06T03:04:29.252750+0000","last_active":"2023-10-06T03:04:33.247750+0000","last_peered":"2023-10-06T03:04:33.247750+0000","last_clean":"2023-10-06T03:04:33.247750+0000","last_became_active":"2023-10-06T03:04:29.252421+0000","last_became_peered":"2023-10-06T03:04:29.252421+0000","last_unstale":"2023-10-06T03:04:33.247750+0000","last_undegraded":"2023-10-06T03:04:33.247750+0000","last_fullsized":"2023-10-06T03:04:33.247750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274637+0000","last_change":"2023-10-06T03:04:33.267286+0000","last_active":"2023-10-06T03:04:33.274637+0000","last_peered":"2023-10-06T03:04:33.274637+0000","last_clean":"2023-10-06T03:04:33.274637+0000","last_became_active":"2023-10-06T03:04:33.266886+0000","last_became_peered":"2023-10-06T03:04:33.266886+0000","last_unstale":"2023-10-06T03:04:33.274637+0000","last_undegraded":"2023-10-06T03:04:33.274637+0000","last_fullsized":"2023-10-06T03:04:33.274637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:49.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254264+0000","last_change":"2023-10-06T03:04:28.841825+0000","last_active":"2023-10-06T03:04:33.254264+0000","last_peered":"2023-10-06T03:04:33.254264+0000","last_clean":"2023-10-06T03:04:33.254264+0000","last_became_active":"2023-10-06T03:04:28.841550+0000","last_became_peered":"2023-10-06T03:04:28.841550+0000","last_unstale":"2023-10-06T03:04:33.254264+0000","last_undegraded":"2023-10-06T03:04:33.254264+0000","last_fullsized":"2023-10-06T03:04:33.254264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:22.072997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260999+0000","last_change":"2023-10-06T03:04:29.243824+0000","last_active":"2023-10-06T03:04:33.260999+0000","last_peered":"2023-10-06T03:04:33.260999+0000","last_clean":"2023-10-06T03:04:33.260999+0000","last_became_active":"2023-10-06T03:04:29.243249+0000","last_became_peered":"2023-10-06T03:04:29.243249+0000","last_unstale":"2023-10-06T03:04:33.260999+0000","last_undegraded":"2023-10-06T03:04:33.260999+0000","last_fullsized":"2023-10-06T03:04:33.260999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:16.298020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.272146+0000","last_change":"2023-10-06T03:04:33.268277+0000","last_active":"2023-10-06T03:04:33.272146+0000","last_peered":"2023-10-06T03:04:33.272146+0000","last_clean":"2023-10-06T03:04:33.272146+0000","last_became_active":"2023-10-06T03:04:33.267827+0000","last_became_peered":"2023-10-06T03:04:33.267827+0000","last_unstale":"2023-10-06T03:04:33.272146+0000","last_undegraded":"2023-10-06T03:04:33.272146+0000","last_fullsized":"2023-10-06T03:04:33.272146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:03.744883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251717+0000","last_change":"2023-10-06T03:04:28.843010+0000","last_active":"2023-10-06T03:04:33.251717+0000","last_peered":"2023-10-06T03:04:33.251717+0000","last_clean":"2023-10-06T03:04:33.251717+0000","last_became_active":"2023-10-06T03:04:28.842743+0000","last_became_peered":"2023-10-06T03:04:28.842743+0000","last_unstale":"2023-10-06T03:04:33.251717+0000","last_undegraded":"2023-10-06T03:04:33.251717+0000","last_fullsized":"2023-10-06T03:04:33.251717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:01.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257848+0000","last_change":"2023-10-06T03:04:29.246248+0000","last_active":"2023-10-06T03:04:33.257848+0000","last_peered":"2023-10-06T03:04:33.257848+0000","last_clean":"2023-10-06T03:04:33.257848+0000","last_became_active":"2023-10-06T03:04:29.245660+0000","last_became_peered":"2023-10-06T03:04:29.245660+0000","last_unstale":"2023-10-06T03:04:33.257848+0000","last_undegraded":"2023-10-06T03:04:33.257848+0000","last_fullsized":"2023-10-06T03:04:33.257848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274535+0000","last_change":"2023-10-06T03:04:33.270753+0000","last_active":"2023-10-06T03:04:33.274535+0000","last_peered":"2023-10-06T03:04:33.274535+0000","last_clean":"2023-10-06T03:04:33.274535+0000","last_became_active":"2023-10-06T03:04:33.270285+0000","last_became_peered":"2023-10-06T03:04:33.270285+0000","last_unstale":"2023-10-06T03:04:33.274535+0000","last_undegraded":"2023-10-06T03:04:33.274535+0000","last_fullsized":"2023-10-06T03:04:33.274535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:38.040904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256306+0000","last_change":"2023-10-06T03:04:28.841768+0000","last_active":"2023-10-06T03:04:33.256306+0000","last_peered":"2023-10-06T03:04:33.256306+0000","last_clean":"2023-10-06T03:04:33.256306+0000","last_became_active":"2023-10-06T03:04:28.841466+0000","last_became_peered":"2023-10-06T03:04:28.841466+0000","last_unstale":"2023-10-06T03:04:33.256306+0000","last_undegraded":"2023-10-06T03:04:33.256306+0000","last_fullsized":"2023-10-06T03:04:33.256306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:18.790700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247445+0000","last_change":"2023-10-06T03:04:29.254847+0000","last_active":"2023-10-06T03:04:33.247445+0000","last_peered":"2023-10-06T03:04:33.247445+0000","last_clean":"2023-10-06T03:04:33.247445+0000","last_became_active":"2023-10-06T03:04:29.254566+0000","last_became_peered":"2023-10-06T03:04:29.254566+0000","last_unstale":"2023-10-06T03:04:33.247445+0000","last_undegraded":"2023-10-06T03:04:33.247445+0000","last_fullsized":"2023-10-06T03:04:33.247445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279105+0000","last_change":"2023-10-06T03:04:33.273474+0000","last_active":"2023-10-06T03:04:33.279105+0000","last_peered":"2023-10-06T03:04:33.279105+0000","last_clean":"2023-10-06T03:04:33.279105+0000","last_became_active":"2023-10-06T03:04:33.272844+0000","last_became_peered":"2023-10-06T03:04:33.272844+0000","last_unstale":"2023-10-06T03:04:33.279105+0000","last_undegraded":"2023-10-06T03:04:33.279105+0000","last_fullsized":"2023-10-06T03:04:33.279105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:22:18.478319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253676+0000","last_change":"2023-10-06T03:04:28.844454+0000","last_active":"2023-10-06T03:04:33.253676+0000","last_peered":"2023-10-06T03:04:33.253676+0000","last_clean":"2023-10-06T03:04:33.253676+0000","last_became_active":"2023-10-06T03:04:28.844159+0000","last_became_peered":"2023-10-06T03:04:28.844159+0000","last_unstale":"2023-10-06T03:04:33.253676+0000","last_undegraded":"2023-10-06T03:04:33.253676+0000","last_fullsized":"2023-10-06T03:04:33.253676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:02.968156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260414+0000","last_change":"2023-10-06T03:04:29.247815+0000","last_active":"2023-10-06T03:04:33.260414+0000","last_peered":"2023-10-06T03:04:33.260414+0000","last_clean":"2023-10-06T03:04:33.260414+0000","last_became_active":"2023-10-06T03:04:29.247468+0000","last_became_peered":"2023-10-06T03:04:29.247468+0000","last_unstale":"2023-10-06T03:04:33.260414+0000","last_undegraded":"2023-10-06T03:04:33.260414+0000","last_fullsized":"2023-10-06T03:04:33.260414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:00.742905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.281495+0000","last_change":"2023-10-06T03:04:33.274004+0000","last_active":"2023-10-06T03:04:33.281495+0000","last_peered":"2023-10-06T03:04:33.281495+0000","last_clean":"2023-10-06T03:04:33.281495+0000","last_became_active":"2023-10-06T03:04:33.273505+0000","last_became_peered":"2023-10-06T03:04:33.273505+0000","last_unstale":"2023-10-06T03:04:33.281495+0000","last_undegraded":"2023-10-06T03:04:33.281495+0000","last_fullsized":"2023-10-06T03:04:33.281495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:59.453052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254602+0000","last_change":"2023-10-06T03:04:28.844541+0000","last_active":"2023-10-06T03:04:33.254602+0000","last_peered":"2023-10-06T03:04:33.254602+0000","last_clean":"2023-10-06T03:04:33.254602+0000","last_became_active":"2023-10-06T03:04:28.844287+0000","last_became_peered":"2023-10-06T03:04:28.844287+0000","last_unstale":"2023-10-06T03:04:33.254602+0000","last_undegraded":"2023-10-06T03:04:33.254602+0000","last_fullsized":"2023-10-06T03:04:33.254602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:56.517421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251704+0000","last_change":"2023-10-06T03:04:29.247387+0000","last_active":"2023-10-06T03:04:33.251704+0000","last_peered":"2023-10-06T03:04:33.251704+0000","last_clean":"2023-10-06T03:04:33.251704+0000","last_became_active":"2023-10-06T03:04:29.247094+0000","last_became_peered":"2023-10-06T03:04:29.247094+0000","last_unstale":"2023-10-06T03:04:33.251704+0000","last_undegraded":"2023-10-06T03:04:33.251704+0000","last_fullsized":"2023-10-06T03:04:33.251704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:23.078369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275074+0000","last_change":"2023-10-06T03:04:33.268719+0000","last_active":"2023-10-06T03:04:33.275074+0000","last_peered":"2023-10-06T03:04:33.275074+0000","last_clean":"2023-10-06T03:04:33.275074+0000","last_became_active":"2023-10-06T03:04:33.268369+0000","last_became_peered":"2023-10-06T03:04:33.268369+0000","last_unstale":"2023-10-06T03:04:33.275074+0000","last_undegraded":"2023-10-06T03:04:33.275074+0000","last_fullsized":"2023-10-06T03:04:33.275074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:39.388410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247659+0000","last_change":"2023-10-06T03:04:28.836622+0000","last_active":"2023-10-06T03:04:33.247659+0000","last_peered":"2023-10-06T03:04:33.247659+0000","last_clean":"2023-10-06T03:04:33.247659+0000","last_became_active":"2023-10-06T03:04:28.836361+0000","last_became_peered":"2023-10-06T03:04:28.836361+0000","last_unstale":"2023-10-06T03:04:33.247659+0000","last_undegraded":"2023-10-06T03:04:33.247659+0000","last_fullsized":"2023-10-06T03:04:33.247659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:53.804099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260554+0000","last_change":"2023-10-06T03:04:29.246365+0000","last_active":"2023-10-06T03:04:33.260554+0000","last_peered":"2023-10-06T03:04:33.260554+0000","last_clean":"2023-10-06T03:04:33.260554+0000","last_became_active":"2023-10-06T03:04:29.246129+0000","last_became_peered":"2023-10-06T03:04:29.246129+0000","last_unstale":"2023-10-06T03:04:33.260554+0000","last_undegraded":"2023-10-06T03:04:33.260554+0000","last_fullsized":"2023-10-06T03:04:33.260554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.273557+0000","last_change":"2023-10-06T03:04:33.263768+0000","last_active":"2023-10-06T03:04:33.273557+0000","last_peered":"2023-10-06T03:04:33.273557+0000","last_clean":"2023-10-06T03:04:33.273557+0000","last_became_active":"2023-10-06T03:04:33.263379+0000","last_became_peered":"2023-10-06T03:04:33.263379+0000","last_unstale":"2023-10-06T03:04:33.273557+0000","last_undegraded":"2023-10-06T03:04:33.273557+0000","last_fullsized":"2023-10-06T03:04:33.273557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:03.615099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256254+0000","last_change":"2023-10-06T03:04:28.842173+0000","last_active":"2023-10-06T03:04:33.256254+0000","last_peered":"2023-10-06T03:04:33.256254+0000","last_clean":"2023-10-06T03:04:33.256254+0000","last_became_active":"2023-10-06T03:04:28.841904+0000","last_became_peered":"2023-10-06T03:04:28.841904+0000","last_unstale":"2023-10-06T03:04:33.256254+0000","last_undegraded":"2023-10-06T03:04:33.256254+0000","last_fullsized":"2023-10-06T03:04:33.256254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:47.647784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252916+0000","last_change":"2023-10-06T03:04:29.248275+0000","last_active":"2023-10-06T03:04:33.252916+0000","last_peered":"2023-10-06T03:04:33.252916+0000","last_clean":"2023-10-06T03:04:33.252916+0000","last_became_active":"2023-10-06T03:04:29.247441+0000","last_became_peered":"2023-10-06T03:04:29.247441+0000","last_unstale":"2023-10-06T03:04:33.252916+0000","last_undegraded":"2023-10-06T03:04:33.252916+0000","last_fullsized":"2023-10-06T03:04:33.252916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:41.084853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279289+0000","last_change":"2023-10-06T03:04:33.277569+0000","last_active":"2023-10-06T03:04:33.279289+0000","last_peered":"2023-10-06T03:04:33.279289+0000","last_clean":"2023-10-06T03:04:33.279289+0000","last_became_active":"2023-10-06T03:04:33.277036+0000","last_became_peered":"2023-10-06T03:04:33.277036+0000","last_unstale":"2023-10-06T03:04:33.279289+0000","last_undegraded":"2023-10-06T03:04:33.279289+0000","last_fullsized":"2023-10-06T03:04:33.279289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:16.342856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252435+0000","last_change":"2023-10-06T03:04:28.839083+0000","last_active":"2023-10-06T03:04:33.252435+0000","last_peered":"2023-10-06T03:04:33.252435+0000","last_clean":"2023-10-06T03:04:33.252435+0000","last_became_active":"2023-10-06T03:04:28.838794+0000","last_became_peered":"2023-10-06T03:04:28.838794+0000","last_unstale":"2023-10-06T03:04:33.252435+0000","last_undegraded":"2023-10-06T03:04:33.252435+0000","last_fullsized":"2023-10-06T03:04:33.252435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:08.701124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251200+0000","last_change":"2023-10-06T03:04:29.245977+0000","last_active":"2023-10-06T03:04:33.251200+0000","last_peered":"2023-10-06T03:04:33.251200+0000","last_clean":"2023-10-06T03:04:33.251200+0000","last_became_active":"2023-10-06T03:04:29.245626+0000","last_became_peered":"2023-10-06T03:04:29.245626+0000","last_unstale":"2023-10-06T03:04:33.251200+0000","last_undegraded":"2023-10-06T03:04:33.251200+0000","last_fullsized":"2023-10-06T03:04:33.251200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275700+0000","last_change":"2023-10-06T03:04:33.273132+0000","last_active":"2023-10-06T03:04:33.275700+0000","last_peered":"2023-10-06T03:04:33.275700+0000","last_clean":"2023-10-06T03:04:33.275700+0000","last_became_active":"2023-10-06T03:04:33.270004+0000","last_became_peered":"2023-10-06T03:04:33.270004+0000","last_unstale":"2023-10-06T03:04:33.275700+0000","last_undegraded":"2023-10-06T03:04:33.275700+0000","last_fullsized":"2023-10-06T03:04:33.275700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:29.588904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.262618+0000","last_change":"2023-10-06T03:04:28.834924+0000","last_active":"2023-10-06T03:04:33.262618+0000","last_peered":"2023-10-06T03:04:33.262618+0000","last_clean":"2023-10-06T03:04:33.262618+0000","last_became_active":"2023-10-06T03:04:28.833593+0000","last_became_peered":"2023-10-06T03:04:28.833593+0000","last_unstale":"2023-10-06T03:04:33.262618+0000","last_undegraded":"2023-10-06T03:04:33.262618+0000","last_fullsized":"2023-10-06T03:04:33.262618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:01.349764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.258286+0000","last_change":"2023-10-06T03:04:29.242813+0000","last_active":"2023-10-06T03:04:33.258286+0000","last_peered":"2023-10-06T03:04:33.258286+0000","last_clean":"2023-10-06T03:04:33.258286+0000","last_became_active":"2023-10-06T03:04:29.242505+0000","last_became_peered":"2023-10-06T03:04:29.242505+0000","last_unstale":"2023-10-06T03:04:33.258286+0000","last_undegraded":"2023-10-06T03:04:33.258286+0000","last_fullsized":"2023-10-06T03:04:33.258286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:00.194415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279673+0000","last_change":"2023-10-06T03:04:33.276215+0000","last_active":"2023-10-06T03:04:33.279673+0000","last_peered":"2023-10-06T03:04:33.279673+0000","last_clean":"2023-10-06T03:04:33.279673+0000","last_became_active":"2023-10-06T03:04:33.275880+0000","last_became_peered":"2023-10-06T03:04:33.275880+0000","last_unstale":"2023-10-06T03:04:33.279673+0000","last_undegraded":"2023-10-06T03:04:33.279673+0000","last_fullsized":"2023-10-06T03:04:33.279673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:47.940801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255769+0000","last_change":"2023-10-06T03:04:28.833476+0000","last_active":"2023-10-06T03:04:33.255769+0000","last_peered":"2023-10-06T03:04:33.255769+0000","last_clean":"2023-10-06T03:04:33.255769+0000","last_became_active":"2023-10-06T03:04:28.833134+0000","last_became_peered":"2023-10-06T03:04:28.833134+0000","last_unstale":"2023-10-06T03:04:33.255769+0000","last_undegraded":"2023-10-06T03:04:33.255769+0000","last_fullsized":"2023-10-06T03:04:33.255769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:01.349764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257596+0000","last_change":"2023-10-06T03:04:29.254675+0000","last_active":"2023-10-06T03:04:33.257596+0000","last_peered":"2023-10-06T03:04:33.257596+0000","last_clean":"2023-10-06T03:04:33.257596+0000","last_became_active":"2023-10-06T03:04:29.254440+0000","last_became_peered":"2023-10-06T03:04:29.254440+0000","last_unstale":"2023-10-06T03:04:33.257596+0000","last_undegraded":"2023-10-06T03:04:33.257596+0000","last_fullsized":"2023-10-06T03:04:33.257596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:06.710555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275628+0000","last_change":"2023-10-06T03:04:33.271611+0000","last_active":"2023-10-06T03:04:33.275628+0000","last_peered":"2023-10-06T03:04:33.275628+0000","last_clean":"2023-10-06T03:04:33.275628+0000","last_became_active":"2023-10-06T03:04:33.270809+0000","last_became_peered":"2023-10-06T03:04:33.270809+0000","last_unstale":"2023-10-06T03:04:33.275628+0000","last_undegraded":"2023-10-06T03:04:33.275628+0000","last_fullsized":"2023-10-06T03:04:33.275628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:38.040904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256889+0000","last_change":"2023-10-06T03:04:23.986472+0000","last_active":"2023-10-06T03:04:33.256889+0000","last_peered":"2023-10-06T03:04:33.256889+0000","last_clean":"2023-10-06T03:04:33.256889+0000","last_became_active":"2023-10-06T03:04:23.986228+0000","last_became_peered":"2023-10-06T03:04:23.986228+0000","last_unstale":"2023-10-06T03:04:33.256889+0000","last_undegraded":"2023-10-06T03:04:33.256889+0000","last_fullsized":"2023-10-06T03:04:33.256889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:08.739849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247658+0000","last_change":"2023-10-06T03:04:28.837603+0000","last_active":"2023-10-06T03:04:33.247658+0000","last_peered":"2023-10-06T03:04:33.247658+0000","last_clean":"2023-10-06T03:04:33.247658+0000","last_became_active":"2023-10-06T03:04:28.837333+0000","last_became_peered":"2023-10-06T03:04:28.837333+0000","last_unstale":"2023-10-06T03:04:33.247658+0000","last_undegraded":"2023-10-06T03:04:33.247658+0000","last_fullsized":"2023-10-06T03:04:33.247658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:38:43.549607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252660+0000","last_change":"2023-10-06T03:04:29.251886+0000","last_active":"2023-10-06T03:04:33.252660+0000","last_peered":"2023-10-06T03:04:33.252660+0000","last_clean":"2023-10-06T03:04:33.252660+0000","last_became_active":"2023-10-06T03:04:29.250608+0000","last_became_peered":"2023-10-06T03:04:29.250608+0000","last_unstale":"2023-10-06T03:04:33.252660+0000","last_undegraded":"2023-10-06T03:04:33.252660+0000","last_fullsized":"2023-10-06T03:04:33.252660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275480+0000","last_change":"2023-10-06T03:04:33.270876+0000","last_active":"2023-10-06T03:04:33.275480+0000","last_peered":"2023-10-06T03:04:33.275480+0000","last_clean":"2023-10-06T03:04:33.275480+0000","last_became_active":"2023-10-06T03:04:33.270440+0000","last_became_peered":"2023-10-06T03:04:33.270440+0000","last_unstale":"2023-10-06T03:04:33.275480+0000","last_undegraded":"2023-10-06T03:04:33.275480+0000","last_fullsized":"2023-10-06T03:04:33.275480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:09:43.778573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247810+0000","last_change":"2023-10-06T03:04:23.814917+0000","last_active":"2023-10-06T03:04:33.247810+0000","last_peered":"2023-10-06T03:04:33.247810+0000","last_clean":"2023-10-06T03:04:33.247810+0000","last_became_active":"2023-10-06T03:04:23.814601+0000","last_became_peered":"2023-10-06T03:04:23.814601+0000","last_unstale":"2023-10-06T03:04:33.247810+0000","last_undegraded":"2023-10-06T03:04:33.247810+0000","last_fullsized":"2023-10-06T03:04:33.247810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251996+0000","last_change":"2023-10-06T03:04:28.844008+0000","last_active":"2023-10-06T03:04:33.251996+0000","last_peered":"2023-10-06T03:04:33.251996+0000","last_clean":"2023-10-06T03:04:33.251996+0000","last_became_active":"2023-10-06T03:04:28.843570+0000","last_became_peered":"2023-10-06T03:04:28.843570+0000","last_unstale":"2023-10-06T03:04:33.251996+0000","last_undegraded":"2023-10-06T03:04:33.251996+0000","last_fullsized":"2023-10-06T03:04:33.251996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:47.468717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256810+0000","last_change":"2023-10-06T03:04:29.251986+0000","last_active":"2023-10-06T03:04:33.256810+0000","last_peered":"2023-10-06T03:04:33.256810+0000","last_clean":"2023-10-06T03:04:33.256810+0000","last_became_active":"2023-10-06T03:04:29.250140+0000","last_became_peered":"2023-10-06T03:04:29.250140+0000","last_unstale":"2023-10-06T03:04:33.256810+0000","last_undegraded":"2023-10-06T03:04:33.256810+0000","last_fullsized":"2023-10-06T03:04:33.256810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:14.635872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275237+0000","last_change":"2023-10-06T03:04:33.271548+0000","last_active":"2023-10-06T03:04:33.275237+0000","last_peered":"2023-10-06T03:04:33.275237+0000","last_clean":"2023-10-06T03:04:33.275237+0000","last_became_active":"2023-10-06T03:04:33.270795+0000","last_became_peered":"2023-10-06T03:04:33.270795+0000","last_unstale":"2023-10-06T03:04:33.275237+0000","last_undegraded":"2023-10-06T03:04:33.275237+0000","last_fullsized":"2023-10-06T03:04:33.275237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:04.163589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254358+0000","last_change":"2023-10-06T03:04:24.314547+0000","last_active":"2023-10-06T03:04:33.254358+0000","last_peered":"2023-10-06T03:04:33.254358+0000","last_clean":"2023-10-06T03:04:33.254358+0000","last_became_active":"2023-10-06T03:04:24.314278+0000","last_became_peered":"2023-10-06T03:04:24.314278+0000","last_unstale":"2023-10-06T03:04:33.254358+0000","last_undegraded":"2023-10-06T03:04:33.254358+0000","last_fullsized":"2023-10-06T03:04:33.254358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:25.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.258223+0000","last_change":"2023-10-06T03:04:28.830604+0000","last_active":"2023-10-06T03:04:33.258223+0000","last_peered":"2023-10-06T03:04:33.258223+0000","last_clean":"2023-10-06T03:04:33.258223+0000","last_became_active":"2023-10-06T03:04:28.828889+0000","last_became_peered":"2023-10-06T03:04:28.828889+0000","last_unstale":"2023-10-06T03:04:33.258223+0000","last_undegraded":"2023-10-06T03:04:33.258223+0000","last_fullsized":"2023-10-06T03:04:33.258223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:53.804099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257514+0000","last_change":"2023-10-06T03:04:29.250731+0000","last_active":"2023-10-06T03:04:33.257514+0000","last_peered":"2023-10-06T03:04:33.257514+0000","last_clean":"2023-10-06T03:04:33.257514+0000","last_became_active":"2023-10-06T03:04:29.250491+0000","last_became_peered":"2023-10-06T03:04:29.250491+0000","last_unstale":"2023-10-06T03:04:33.257514+0000","last_undegraded":"2023-10-06T03:04:33.257514+0000","last_fullsized":"2023-10-06T03:04:33.257514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:13.355371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.271453+0000","last_change":"2023-10-06T03:04:33.266989+0000","last_active":"2023-10-06T03:04:33.271453+0000","last_peered":"2023-10-06T03:04:33.271453+0000","last_clean":"2023-10-06T03:04:33.271453+0000","last_became_active":"2023-10-06T03:04:33.266416+0000","last_became_peered":"2023-10-06T03:04:33.266416+0000","last_unstale":"2023-10-06T03:04:33.271453+0000","last_undegraded":"2023-10-06T03:04:33.271453+0000","last_fullsized":"2023-10-06T03:04:33.271453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:45.049591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247892+0000","last_change":"2023-10-06T03:04:23.807972+0000","last_active":"2023-10-06T03:04:33.247892+0000","last_peered":"2023-10-06T03:04:33.247892+0000","last_clean":"2023-10-06T03:04:33.247892+0000","last_became_active":"2023-10-06T03:04:23.807723+0000","last_became_peered":"2023-10-06T03:04:23.807723+0000","last_unstale":"2023-10-06T03:04:33.247892+0000","last_undegraded":"2023-10-06T03:04:33.247892+0000","last_fullsized":"2023-10-06T03:04:33.247892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253358+0000","last_change":"2023-10-06T03:04:17.779925+0000","last_active":"2023-10-06T03:04:33.253358+0000","last_peered":"2023-10-06T03:04:33.253358+0000","last_clean":"2023-10-06T03:04:33.253358+0000","last_became_active":"2023-10-06T03:04:17.778997+0000","last_became_peered":"2023-10-06T03:04:17.778997+0000","last_unstale":"2023-10-06T03:04:33.253358+0000","last_undegraded":"2023-10-06T03:04:33.253358+0000","last_fullsized":"2023-10-06T03:04:33.253358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_clean_scrub_stamp":"2023-10-06T03:04:16.761610+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255740+0000","last_change":"2023-10-06T03:04:28.836276+0000","last_active":"2023-10-06T03:04:33.255740+0000","last_peered":"2023-10-06T03:04:33.255740+0000","last_clean":"2023-10-06T03:04:33.255740+0000","last_became_active":"2023-10-06T03:04:28.836005+0000","last_became_peered":"2023-10-06T03:04:28.836005+0000","last_unstale":"2023-10-06T03:04:33.255740+0000","last_undegraded":"2023-10-06T03:04:33.255740+0000","last_fullsized":"2023-10-06T03:04:33.255740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:47.468717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251891+0000","last_change":"2023-10-06T03:04:29.246019+0000","last_active":"2023-10-06T03:04:33.251891+0000","last_peered":"2023-10-06T03:04:33.251891+0000","last_clean":"2023-10-06T03:04:33.251891+0000","last_became_active":"2023-10-06T03:04:29.245727+0000","last_became_peered":"2023-10-06T03:04:29.245727+0000","last_unstale":"2023-10-06T03:04:33.251891+0000","last_undegraded":"2023-10-06T03:04:33.251891+0000","last_fullsized":"2023-10-06T03:04:33.251891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:06.976149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275851+0000","last_change":"2023-10-06T03:04:33.273528+0000","last_active":"2023-10-06T03:04:33.275851+0000","last_peered":"2023-10-06T03:04:33.275851+0000","last_clean":"2023-10-06T03:04:33.275851+0000","last_became_active":"2023-10-06T03:04:33.272634+0000","last_became_peered":"2023-10-06T03:04:33.272634+0000","last_unstale":"2023-10-06T03:04:33.275851+0000","last_undegraded":"2023-10-06T03:04:33.275851+0000","last_fullsized":"2023-10-06T03:04:33.275851+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:49.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253551+0000","last_change":"2023-10-06T03:04:23.814887+0000","last_active":"2023-10-06T03:04:33.253551+0000","last_peered":"2023-10-06T03:04:33.253551+0000","last_clean":"2023-10-06T03:04:33.253551+0000","last_became_active":"2023-10-06T03:04:23.814581+0000","last_became_peered":"2023-10-06T03:04:23.814581+0000","last_unstale":"2023-10-06T03:04:33.253551+0000","last_undegraded":"2023-10-06T03:04:33.253551+0000","last_fullsized":"2023-10-06T03:04:33.253551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252277+0000","last_change":"2023-10-06T03:04:28.840850+0000","last_active":"2023-10-06T03:04:33.252277+0000","last_peered":"2023-10-06T03:04:33.252277+0000","last_clean":"2023-10-06T03:04:33.252277+0000","last_became_active":"2023-10-06T03:04:28.840598+0000","last_became_peered":"2023-10-06T03:04:28.840598+0000","last_unstale":"2023-10-06T03:04:33.252277+0000","last_undegraded":"2023-10-06T03:04:33.252277+0000","last_fullsized":"2023-10-06T03:04:33.252277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:01.349764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260789+0000","last_change":"2023-10-06T03:04:29.245535+0000","last_active":"2023-10-06T03:04:33.260789+0000","last_peered":"2023-10-06T03:04:33.260789+0000","last_clean":"2023-10-06T03:04:33.260789+0000","last_became_active":"2023-10-06T03:04:29.245290+0000","last_became_peered":"2023-10-06T03:04:29.245290+0000","last_unstale":"2023-10-06T03:04:33.260789+0000","last_undegraded":"2023-10-06T03:04:33.260789+0000","last_fullsized":"2023-10-06T03:04:33.260789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:41.163677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274377+0000","last_change":"2023-10-06T03:04:33.270521+0000","last_active":"2023-10-06T03:04:33.274377+0000","last_peered":"2023-10-06T03:04:33.274377+0000","last_clean":"2023-10-06T03:04:33.274377+0000","last_became_active":"2023-10-06T03:04:33.270088+0000","last_became_peered":"2023-10-06T03:04:33.270088+0000","last_unstale":"2023-10-06T03:04:33.274377+0000","last_undegraded":"2023-10-06T03:04:33.274377+0000","last_fullsized":"2023-10-06T03:04:33.274377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:19.718704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254193+0000","last_change":"2023-10-06T03:04:23.986771+0000","last_active":"2023-10-06T03:04:33.254193+0000","last_peered":"2023-10-06T03:04:33.254193+0000","last_clean":"2023-10-06T03:04:33.254193+0000","last_became_active":"2023-10-06T03:04:23.986552+0000","last_became_peered":"2023-10-06T03:04:23.986552+0000","last_unstale":"2023-10-06T03:04:33.254193+0000","last_undegraded":"2023-10-06T03:04:33.254193+0000","last_fullsized":"2023-10-06T03:04:33.254193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257056+0000","last_change":"2023-10-06T03:04:28.829211+0000","last_active":"2023-10-06T03:04:33.257056+0000","last_peered":"2023-10-06T03:04:33.257056+0000","last_clean":"2023-10-06T03:04:33.257056+0000","last_became_active":"2023-10-06T03:04:28.828898+0000","last_became_peered":"2023-10-06T03:04:28.828898+0000","last_unstale":"2023-10-06T03:04:33.257056+0000","last_undegraded":"2023-10-06T03:04:33.257056+0000","last_fullsized":"2023-10-06T03:04:33.257056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:47.647784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260435+0000","last_change":"2023-10-06T03:04:29.251481+0000","last_active":"2023-10-06T03:04:33.260435+0000","last_peered":"2023-10-06T03:04:33.260435+0000","last_clean":"2023-10-06T03:04:33.260435+0000","last_became_active":"2023-10-06T03:04:29.251248+0000","last_became_peered":"2023-10-06T03:04:29.251248+0000","last_unstale":"2023-10-06T03:04:33.260435+0000","last_undegraded":"2023-10-06T03:04:33.260435+0000","last_fullsized":"2023-10-06T03:04:33.260435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:27.111880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279649+0000","last_change":"2023-10-06T03:04:33.275681+0000","last_active":"2023-10-06T03:04:33.279649+0000","last_peered":"2023-10-06T03:04:33.279649+0000","last_clean":"2023-10-06T03:04:33.279649+0000","last_became_active":"2023-10-06T03:04:33.275300+0000","last_became_peered":"2023-10-06T03:04:33.275300+0000","last_unstale":"2023-10-06T03:04:33.279649+0000","last_undegraded":"2023-10-06T03:04:33.279649+0000","last_fullsized":"2023-10-06T03:04:33.279649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:47.690080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257944+0000","last_change":"2023-10-06T03:04:28.837159+0000","last_active":"2023-10-06T03:04:33.257944+0000","last_peered":"2023-10-06T03:04:33.257944+0000","last_clean":"2023-10-06T03:04:33.257944+0000","last_became_active":"2023-10-06T03:04:28.836765+0000","last_became_peered":"2023-10-06T03:04:28.836765+0000","last_unstale":"2023-10-06T03:04:33.257944+0000","last_undegraded":"2023-10-06T03:04:33.257944+0000","last_fullsized":"2023-10-06T03:04:33.257944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:53.804099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256426+0000","last_change":"2023-10-06T03:04:23.813862+0000","last_active":"2023-10-06T03:04:33.256426+0000","last_peered":"2023-10-06T03:04:33.256426+0000","last_clean":"2023-10-06T03:04:33.256426+0000","last_became_active":"2023-10-06T03:04:23.813584+0000","last_became_peered":"2023-10-06T03:04:23.813584+0000","last_unstale":"2023-10-06T03:04:33.256426+0000","last_undegraded":"2023-10-06T03:04:33.256426+0000","last_fullsized":"2023-10-06T03:04:33.256426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255681+0000","last_change":"2023-10-06T03:04:29.245915+0000","last_active":"2023-10-06T03:04:33.255681+0000","last_peered":"2023-10-06T03:04:33.255681+0000","last_clean":"2023-10-06T03:04:33.255681+0000","last_became_active":"2023-10-06T03:04:29.245657+0000","last_became_peered":"2023-10-06T03:04:29.245657+0000","last_unstale":"2023-10-06T03:04:33.255681+0000","last_undegraded":"2023-10-06T03:04:33.255681+0000","last_fullsized":"2023-10-06T03:04:33.255681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274653+0000","last_change":"2023-10-06T03:04:33.269388+0000","last_active":"2023-10-06T03:04:33.274653+0000","last_peered":"2023-10-06T03:04:33.274653+0000","last_clean":"2023-10-06T03:04:33.274653+0000","last_became_active":"2023-10-06T03:04:33.268742+0000","last_became_peered":"2023-10-06T03:04:33.268742+0000","last_unstale":"2023-10-06T03:04:33.274653+0000","last_undegraded":"2023-10-06T03:04:33.274653+0000","last_fullsized":"2023-10-06T03:04:33.274653+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:18.722157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252616+0000","last_change":"2023-10-06T03:04:23.805874+0000","last_active":"2023-10-06T03:04:33.252616+0000","last_peered":"2023-10-06T03:04:33.252616+0000","last_clean":"2023-10-06T03:04:33.252616+0000","last_became_active":"2023-10-06T03:04:23.805551+0000","last_became_peered":"2023-10-06T03:04:23.805551+0000","last_unstale":"2023-10-06T03:04:33.252616+0000","last_undegraded":"2023-10-06T03:04:33.252616+0000","last_fullsized":"2023-10-06T03:04:33.252616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:21.250275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.916228+0000","last_change":"2023-10-06T03:04:28.838956+0000","last_active":"2023-10-06T03:04:33.916228+0000","last_peered":"2023-10-06T03:04:33.916228+0000","last_clean":"2023-10-06T03:04:33.916228+0000","last_became_active":"2023-10-06T03:04:28.838653+0000","last_became_peered":"2023-10-06T03:04:28.838653+0000","last_unstale":"2023-10-06T03:04:33.916228+0000","last_undegraded":"2023-10-06T03:04:33.916228+0000","last_fullsized":"2023-10-06T03:04:33.916228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:01.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260316+0000","last_change":"2023-10-06T03:04:29.250642+0000","last_active":"2023-10-06T03:04:33.260316+0000","last_peered":"2023-10-06T03:04:33.260316+0000","last_clean":"2023-10-06T03:04:33.260316+0000","last_became_active":"2023-10-06T03:04:29.250128+0000","last_became_peered":"2023-10-06T03:04:29.250128+0000","last_unstale":"2023-10-06T03:04:33.260316+0000","last_undegraded":"2023-10-06T03:04:33.260316+0000","last_fullsized":"2023-10-06T03:04:33.260316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:07.410542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279289+0000","last_change":"2023-10-06T03:04:33.277567+0000","last_active":"2023-10-06T03:04:33.279289+0000","last_peered":"2023-10-06T03:04:33.279289+0000","last_clean":"2023-10-06T03:04:33.279289+0000","last_became_active":"2023-10-06T03:04:33.277169+0000","last_became_peered":"2023-10-06T03:04:33.277169+0000","last_unstale":"2023-10-06T03:04:33.279289+0000","last_undegraded":"2023-10-06T03:04:33.279289+0000","last_fullsized":"2023-10-06T03:04:33.279289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:38.040904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260456+0000","last_change":"2023-10-06T03:04:28.840794+0000","last_active":"2023-10-06T03:04:33.260456+0000","last_peered":"2023-10-06T03:04:33.260456+0000","last_clean":"2023-10-06T03:04:33.260456+0000","last_became_active":"2023-10-06T03:04:28.840573+0000","last_became_peered":"2023-10-06T03:04:28.840573+0000","last_unstale":"2023-10-06T03:04:33.260456+0000","last_undegraded":"2023-10-06T03:04:33.260456+0000","last_fullsized":"2023-10-06T03:04:33.260456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:16.444923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256202+0000","last_change":"2023-10-06T03:04:29.248438+0000","last_active":"2023-10-06T03:04:33.256202+0000","last_peered":"2023-10-06T03:04:33.256202+0000","last_clean":"2023-10-06T03:04:33.256202+0000","last_became_active":"2023-10-06T03:04:29.248173+0000","last_became_peered":"2023-10-06T03:04:29.248173+0000","last_unstale":"2023-10-06T03:04:33.256202+0000","last_undegraded":"2023-10-06T03:04:33.256202+0000","last_fullsized":"2023-10-06T03:04:33.256202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:38:44.554979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274467+0000","last_change":"2023-10-06T03:04:33.270323+0000","last_active":"2023-10-06T03:04:33.274467+0000","last_peered":"2023-10-06T03:04:33.274467+0000","last_clean":"2023-10-06T03:04:33.274467+0000","last_became_active":"2023-10-06T03:04:33.269918+0000","last_became_peered":"2023-10-06T03:04:33.269918+0000","last_unstale":"2023-10-06T03:04:33.274467+0000","last_undegraded":"2023-10-06T03:04:33.274467+0000","last_fullsized":"2023-10-06T03:04:33.274467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:29.020898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247754+0000","last_change":"2023-10-06T03:04:28.838880+0000","last_active":"2023-10-06T03:04:33.247754+0000","last_peered":"2023-10-06T03:04:33.247754+0000","last_clean":"2023-10-06T03:04:33.247754+0000","last_became_active":"2023-10-06T03:04:28.838586+0000","last_became_peered":"2023-10-06T03:04:28.838586+0000","last_unstale":"2023-10-06T03:04:33.247754+0000","last_undegraded":"2023-10-06T03:04:33.247754+0000","last_fullsized":"2023-10-06T03:04:33.247754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:22.072997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252124+0000","last_change":"2023-10-06T03:04:29.243720+0000","last_active":"2023-10-06T03:04:33.252124+0000","last_peered":"2023-10-06T03:04:33.252124+0000","last_clean":"2023-10-06T03:04:33.252124+0000","last_became_active":"2023-10-06T03:04:29.243445+0000","last_became_peered":"2023-10-06T03:04:29.243445+0000","last_unstale":"2023-10-06T03:04:33.252124+0000","last_undegraded":"2023-10-06T03:04:33.252124+0000","last_fullsized":"2023-10-06T03:04:33.252124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:22.258796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.272233+0000","last_change":"2023-10-06T03:04:33.267993+0000","last_active":"2023-10-06T03:04:33.272233+0000","last_peered":"2023-10-06T03:04:33.272233+0000","last_clean":"2023-10-06T03:04:33.272233+0000","last_became_active":"2023-10-06T03:04:33.267548+0000","last_became_peered":"2023-10-06T03:04:33.267548+0000","last_unstale":"2023-10-06T03:04:33.272233+0000","last_undegraded":"2023-10-06T03:04:33.272233+0000","last_fullsized":"2023-10-06T03:04:33.272233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:07.483381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247563+0000","last_change":"2023-10-06T03:04:28.839397+0000","last_active":"2023-10-06T03:04:33.247563+0000","last_peered":"2023-10-06T03:04:33.247563+0000","last_clean":"2023-10-06T03:04:33.247563+0000","last_became_active":"2023-10-06T03:04:28.839121+0000","last_became_peered":"2023-10-06T03:04:28.839121+0000","last_unstale":"2023-10-06T03:04:33.247563+0000","last_undegraded":"2023-10-06T03:04:33.247563+0000","last_fullsized":"2023-10-06T03:04:33.247563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:19.451116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251017+0000","last_change":"2023-10-06T03:04:29.241780+0000","last_active":"2023-10-06T03:04:33.251017+0000","last_peered":"2023-10-06T03:04:33.251017+0000","last_clean":"2023-10-06T03:04:33.251017+0000","last_became_active":"2023-10-06T03:04:29.241462+0000","last_became_peered":"2023-10-06T03:04:29.241462+0000","last_unstale":"2023-10-06T03:04:33.251017+0000","last_undegraded":"2023-10-06T03:04:33.251017+0000","last_fullsized":"2023-10-06T03:04:33.251017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.270793+0000","last_change":"2023-10-06T03:04:33.266666+0000","last_active":"2023-10-06T03:04:33.270793+0000","last_peered":"2023-10-06T03:04:33.270793+0000","last_clean":"2023-10-06T03:04:33.270793+0000","last_became_active":"2023-10-06T03:04:33.266284+0000","last_became_peered":"2023-10-06T03:04:33.266284+0000","last_unstale":"2023-10-06T03:04:33.270793+0000","last_undegraded":"2023-10-06T03:04:33.270793+0000","last_fullsized":"2023-10-06T03:04:33.270793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:17.775172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256370+0000","last_change":"2023-10-06T03:04:28.833313+0000","last_active":"2023-10-06T03:04:33.256370+0000","last_peered":"2023-10-06T03:04:33.256370+0000","last_clean":"2023-10-06T03:04:33.256370+0000","last_became_active":"2023-10-06T03:04:28.832982+0000","last_became_peered":"2023-10-06T03:04:28.832982+0000","last_unstale":"2023-10-06T03:04:33.256370+0000","last_undegraded":"2023-10-06T03:04:33.256370+0000","last_fullsized":"2023-10-06T03:04:33.256370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:04.476704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255857+0000","last_change":"2023-10-06T03:04:29.237739+0000","last_active":"2023-10-06T03:04:33.255857+0000","last_peered":"2023-10-06T03:04:33.255857+0000","last_clean":"2023-10-06T03:04:33.255857+0000","last_became_active":"2023-10-06T03:04:29.237497+0000","last_became_peered":"2023-10-06T03:04:29.237497+0000","last_unstale":"2023-10-06T03:04:33.255857+0000","last_undegraded":"2023-10-06T03:04:33.255857+0000","last_fullsized":"2023-10-06T03:04:33.255857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:27.111880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279027+0000","last_change":"2023-10-06T03:04:33.269307+0000","last_active":"2023-10-06T03:04:33.279027+0000","last_peered":"2023-10-06T03:04:33.279027+0000","last_clean":"2023-10-06T03:04:33.279027+0000","last_became_active":"2023-10-06T03:04:33.268876+0000","last_became_peered":"2023-10-06T03:04:33.268876+0000","last_unstale":"2023-10-06T03:04:33.279027+0000","last_undegraded":"2023-10-06T03:04:33.279027+0000","last_fullsized":"2023-10-06T03:04:33.279027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:53.801187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260493+0000","last_change":"2023-10-06T03:04:28.839985+0000","last_active":"2023-10-06T03:04:33.260493+0000","last_peered":"2023-10-06T03:04:33.260493+0000","last_clean":"2023-10-06T03:04:33.260493+0000","last_became_active":"2023-10-06T03:04:28.839831+0000","last_became_peered":"2023-10-06T03:04:28.839831+0000","last_unstale":"2023-10-06T03:04:33.260493+0000","last_undegraded":"2023-10-06T03:04:33.260493+0000","last_fullsized":"2023-10-06T03:04:33.260493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:04.476704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251017+0000","last_change":"2023-10-06T03:04:29.242972+0000","last_active":"2023-10-06T03:04:33.251017+0000","last_peered":"2023-10-06T03:04:33.251017+0000","last_clean":"2023-10-06T03:04:33.251017+0000","last_became_active":"2023-10-06T03:04:29.242692+0000","last_became_peered":"2023-10-06T03:04:29.242692+0000","last_unstale":"2023-10-06T03:04:33.251017+0000","last_undegraded":"2023-10-06T03:04:33.251017+0000","last_fullsized":"2023-10-06T03:04:33.251017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:22.493291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251832+0000","last_change":"2023-10-06T03:04:29.239473+0000","last_active":"2023-10-06T03:04:33.251832+0000","last_peered":"2023-10-06T03:04:33.251832+0000","last_clean":"2023-10-06T03:04:33.251832+0000","last_became_active":"2023-10-06T03:04:29.239195+0000","last_became_peered":"2023-10-06T03:04:29.239195+0000","last_unstale":"2023-10-06T03:04:33.251832+0000","last_undegraded":"2023-10-06T03:04:33.251832+0000","last_fullsized":"2023-10-06T03:04:33.251832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:38:44.554979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255913+0000","last_change":"2023-10-06T03:04:29.248060+0000","last_active":"2023-10-06T03:04:33.255913+0000","last_peered":"2023-10-06T03:04:33.255913+0000","last_clean":"2023-10-06T03:04:33.255913+0000","last_became_active":"2023-10-06T03:04:29.247710+0000","last_became_peered":"2023-10-06T03:04:29.247710+0000","last_unstale":"2023-10-06T03:04:33.255913+0000","last_undegraded":"2023-10-06T03:04:33.255913+0000","last_fullsized":"2023-10-06T03:04:33.255913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:41.163677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251328+0000","last_change":"2023-10-06T03:04:29.242391+0000","last_active":"2023-10-06T03:04:33.251328+0000","last_peered":"2023-10-06T03:04:33.251328+0000","last_clean":"2023-10-06T03:04:33.251328+0000","last_became_active":"2023-10-06T03:04:29.241939+0000","last_became_peered":"2023-10-06T03:04:29.241939+0000","last_unstale":"2023-10-06T03:04:33.251328+0000","last_undegraded":"2023-10-06T03:04:33.251328+0000","last_fullsized":"2023-10-06T03:04:33.251328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:22:15.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256253+0000","last_change":"2023-10-06T03:04:29.244909+0000","last_active":"2023-10-06T03:04:33.256253+0000","last_peered":"2023-10-06T03:04:33.256253+0000","last_clean":"2023-10-06T03:04:33.256253+0000","last_became_active":"2023-10-06T03:04:29.244666+0000","last_became_peered":"2023-10-06T03:04:29.244666+0000","last_unstale":"2023-10-06T03:04:33.256253+0000","last_undegraded":"2023-10-06T03:04:33.256253+0000","last_fullsized":"2023-10-06T03:04:33.256253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:16.298020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256973+0000","last_change":"2023-10-06T03:04:29.252885+0000","last_active":"2023-10-06T03:04:33.256973+0000","last_peered":"2023-10-06T03:04:33.256973+0000","last_clean":"2023-10-06T03:04:33.256973+0000","last_became_active":"2023-10-06T03:04:29.252697+0000","last_became_peered":"2023-10-06T03:04:29.252697+0000","last_unstale":"2023-10-06T03:04:33.256973+0000","last_undegraded":"2023-10-06T03:04:33.256973+0000","last_fullsized":"2023-10-06T03:04:33.256973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":713872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8860000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9510000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1429999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.903}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.8220000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8929999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":709484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":119663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.649}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.679}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":123344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":299008,"data_stored":120197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:04:47.851 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:04:48.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.999+0000 7f3ceb0ab700 1 Processor -- start 2023-10-06T03:04:48.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:47.999+0000 7f3ceb0ab700 1 -- start start 2023-10-06T03:04:48.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.000+0000 7f3ceb0ab700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ce406afd0 0x7f3ce4164200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.000+0000 7f3ceb0ab700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce4069110 con 0x7f3ce41590d0 2023-10-06T03:04:48.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.000+0000 7f3ceb0ab700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce4067c70 con 0x7f3ce40ac670 2023-10-06T03:04:48.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.000+0000 7f3ceb0ab700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce40c77e0 con 0x7f3ce406afd0 2023-10-06T03:04:48.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.000+0000 7f3ce8e47700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3ce41590d0 0x7f3ce406a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53232/0 (socket says 172.21.15.125:53232) 2023-10-06T03:04:48.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.000+0000 7f3ce8e47700 1 -- 172.21.15.125:0/2885532182 learned_addr learned my addr 172.21.15.125:0/2885532182 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:48.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce9648700 1 --2- 172.21.15.125:0/2885532182 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ce406afd0 0x7f3ce4164200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce37fe700 1 -- 172.21.15.125:0/2885532182 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518858736 0 0) 0x7f3ce4069110 con 0x7f3ce41590d0 2023-10-06T03:04:48.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce37fe700 1 -- 172.21.15.125:0/2885532182 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cd4003570 con 0x7f3ce41590d0 2023-10-06T03:04:48.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce37fe700 1 -- 172.21.15.125:0/2885532182 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 396816546 0 0) 0x7f3cd4003570 con 0x7f3ce41590d0 2023-10-06T03:04:48.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce37fe700 1 -- 172.21.15.125:0/2885532182 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ce406afd0 msgr2=0x7f3ce4164200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:48.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce37fe700 1 --2- 172.21.15.125:0/2885532182 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ce406afd0 0x7f3ce4164200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce37fe700 1 -- 172.21.15.125:0/2885532182 >> v1:172.21.15.130:6789/0 conn(0x7f3ce40ac670 legacy=0x7f3ce40c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce37fe700 1 -- 172.21.15.125:0/2885532182 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce40c7ac0 con 0x7f3ce41590d0 2023-10-06T03:04:48.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce37fe700 1 -- 172.21.15.125:0/2885532182 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f3cd8001470 con 0x7f3ce41590d0 2023-10-06T03:04:48.005 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce37fe700 1 -- 172.21.15.125:0/2885532182 >> v1:172.21.15.125:6789/0 conn(0x7f3ce41590d0 legacy=0x7f3ce406a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce37fe700 1 --2- 172.21.15.125:0/2885532182 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ce406afd0 0x7f3cd4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce37fe700 1 --2- 172.21.15.125:0/2885532182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cd4003fd0 0x7f3cd4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce37fe700 1 --2- 172.21.15.125:0/2885532182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cd4004d50 0x7f3cd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce37fe700 1 -- 172.21.15.125:0/2885532182 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce40c77e0 con 0x7f3cd4004d50 2023-10-06T03:04:48.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce37fe700 1 -- 172.21.15.125:0/2885532182 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd400bb40 con 0x7f3cd4003fd0 2023-10-06T03:04:48.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce37fe700 1 -- 172.21.15.125:0/2885532182 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd400bd00 con 0x7f3ce406afd0 2023-10-06T03:04:48.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce9648700 1 --2- 172.21.15.125:0/2885532182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cd4004d50 0x7f3cd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce8e47700 1 --2- 172.21.15.125:0/2885532182 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ce406afd0 0x7f3cd4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce3fff700 1 --2- 172.21.15.125:0/2885532182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cd4003fd0 0x7f3cd4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce9648700 1 -- 172.21.15.125:0/2885532182 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ce406afd0 msgr2=0x7f3cd4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:48.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce9648700 1 --2- 172.21.15.125:0/2885532182 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ce406afd0 0x7f3cd4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce9648700 1 -- 172.21.15.125:0/2885532182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cd4003fd0 msgr2=0x7f3cd4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:48.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce9648700 1 --2- 172.21.15.125:0/2885532182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cd4003fd0 0x7f3cd4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce9648700 1 -- 172.21.15.125:0/2885532182 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd4003570 con 0x7f3cd4004d50 2023-10-06T03:04:48.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.001+0000 7f3ce9648700 1 --2- 172.21.15.125:0/2885532182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cd4004d50 0x7f3cd40051c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00e210 tx=0x7f3cdc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5467bbe67b24a14e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:48.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.002+0000 7f3ce37fe700 1 -- 172.21.15.125:0/2885532182 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00eac0 con 0x7f3cd4004d50 2023-10-06T03:04:48.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.002+0000 7f3ce37fe700 1 -- 172.21.15.125:0/2885532182 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cdc00f040 con 0x7f3cd4004d50 2023-10-06T03:04:48.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.002+0000 7f3ce37fe700 1 -- 172.21.15.125:0/2885532182 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cdc00ee70 con 0x7f3cd4004d50 2023-10-06T03:04:48.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.002+0000 7f3ceb0ab700 1 -- 172.21.15.125:0/2885532182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cd4004d50 msgr2=0x7f3cd40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.002+0000 7f3ceb0ab700 1 --2- 172.21.15.125:0/2885532182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cd4004d50 0x7f3cd40051c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc00e210 tx=0x7f3cdc00b040 comp rx=0 tx=0).stop 2023-10-06T03:04:48.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.002+0000 7f3ce9648700 1 -- 172.21.15.125:0/2885532182 reap_dead start 2023-10-06T03:04:48.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.002+0000 7f3ceb0ab700 1 -- 172.21.15.125:0/2885532182 shutdown_connections 2023-10-06T03:04:48.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.002+0000 7f3ceb0ab700 1 -- 172.21.15.125:0/2885532182 >> 172.21.15.125:0/2885532182 conn(0x7f3ce40cc5a0 msgr2=0x7f3ce40cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:48.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.002+0000 7f3ceb0ab700 1 -- 172.21.15.125:0/2885532182 shutdown_connections 2023-10-06T03:04:48.008 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.002+0000 7f3ceb0ab700 1 -- 172.21.15.125:0/2885532182 wait complete. 2023-10-06T03:04:48.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.003+0000 7f3ceb0ab700 1 Processor -- start 2023-10-06T03:04:48.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.003+0000 7f3ceb0ab700 1 -- start start 2023-10-06T03:04:48.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.004+0000 7f3ceb0ab700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ce41559b0 0x7f3ce40b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.004+0000 7f3ceb0ab700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ce4155d80 0x7f3ce40b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.004+0000 7f3ceb0ab700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ce40aaa00 0x7f3ce40aaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.004+0000 7f3ceb0ab700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce40ab3e0 con 0x7f3ce41559b0 2023-10-06T03:04:48.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.004+0000 7f3ceb0ab700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce40af6a0 con 0x7f3ce4155d80 2023-10-06T03:04:48.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.004+0000 7f3ceb0ab700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce40b1230 con 0x7f3ce40aaa00 2023-10-06T03:04:48.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.004+0000 7f3ce8e47700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ce41559b0 0x7f3ce40b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.004+0000 7f3ce8e47700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ce41559b0 0x7f3ce40b0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40472/0 (socket says 172.21.15.125:40472) 2023-10-06T03:04:48.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.004+0000 7f3ce8e47700 1 -- 172.21.15.125:0/3854754633 learned_addr learned my addr 172.21.15.125:0/3854754633 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:48.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.004+0000 7f3ce3fff700 1 --2- 172.21.15.125:0/3854754633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ce4155d80 0x7f3ce40b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.004+0000 7f3ce9648700 1 --2- 172.21.15.125:0/3854754633 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ce40aaa00 0x7f3ce40aaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.005+0000 7f3ce8e47700 1 -- 172.21.15.125:0/3854754633 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ce40aaa00 msgr2=0x7f3ce40aaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.005+0000 7f3ce8e47700 1 --2- 172.21.15.125:0/3854754633 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ce40aaa00 0x7f3ce40aaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.005+0000 7f3ce8e47700 1 -- 172.21.15.125:0/3854754633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ce4155d80 msgr2=0x7f3ce40b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.005+0000 7f3ce8e47700 1 --2- 172.21.15.125:0/3854754633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ce4155d80 0x7f3ce40b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.005+0000 7f3ce8e47700 1 -- 172.21.15.125:0/3854754633 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce40b1510 con 0x7f3ce41559b0 2023-10-06T03:04:48.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.005+0000 7f3ce8e47700 1 --2- 172.21.15.125:0/3854754633 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ce41559b0 0x7f3ce40b0670 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80073c0 tx=0x7f3cd8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:48.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.005+0000 7f3ce0ff9700 1 -- 172.21.15.125:0/3854754633 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8018030 con 0x7f3ce41559b0 2023-10-06T03:04:48.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.005+0000 7f3ce0ff9700 1 -- 172.21.15.125:0/3854754633 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd800f870 con 0x7f3ce41559b0 2023-10-06T03:04:48.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.005+0000 7f3ceb0ab700 1 -- 172.21.15.125:0/3854754633 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce40b17f0 con 0x7f3ce41559b0 2023-10-06T03:04:48.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.005+0000 7f3ce0ff9700 1 -- 172.21.15.125:0/3854754633 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd800fc10 con 0x7f3ce41559b0 2023-10-06T03:04:48.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.005+0000 7f3ceb0ab700 1 -- 172.21.15.125:0/3854754633 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce40b1db0 con 0x7f3ce41559b0 2023-10-06T03:04:48.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.006+0000 7f3ceb0ab700 1 -- 172.21.15.125:0/3854754633 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce40b1fd0 con 0x7f3ce41559b0 2023-10-06T03:04:48.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.006+0000 7f3ce0ff9700 1 -- 172.21.15.125:0/3854754633 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3cd801b070 con 0x7f3ce41559b0 2023-10-06T03:04:48.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.007+0000 7f3ce0ff9700 1 --2- 172.21.15.125:0/3854754633 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3cc8066f30 0x7f3cc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.007+0000 7f3ce0ff9700 1 -- 172.21.15.125:0/3854754633 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3cd8019070 con 0x7f3ce41559b0 2023-10-06T03:04:48.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.007+0000 7f3ce3fff700 1 --2- 172.21.15.125:0/3854754633 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3cc8066f30 0x7f3cc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.007+0000 7f3ce3fff700 1 --2- 172.21.15.125:0/3854754633 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3cc8066f30 0x7f3cc80693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4159a20 tx=0x7f3cd0007d10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:48.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.011+0000 7f3ce0ff9700 1 -- 172.21.15.125:0/3854754633 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3cd80517d0 con 0x7f3ce41559b0 2023-10-06T03:04:48.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.190+0000 7f3ceb0ab700 1 -- 172.21.15.125:0/3854754633 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ce4066510 con 0x7f3cc8066f30 2023-10-06T03:04:48.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.199+0000 7f3ce0ff9700 1 -- 172.21.15.125:0/3854754633 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367326 (secure 0 0 0) 0x7f3ce4066510 con 0x7f3cc8066f30 2023-10-06T03:04:48.204 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:48.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.203+0000 7f3ceb0ab700 1 -- 172.21.15.125:0/3854754633 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3cc8066f30 msgr2=0x7f3cc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.203+0000 7f3ceb0ab700 1 --2- 172.21.15.125:0/3854754633 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3cc8066f30 0x7f3cc80693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4159a20 tx=0x7f3cd0007d10 comp rx=0 tx=0).stop 2023-10-06T03:04:48.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.203+0000 7f3ceb0ab700 1 -- 172.21.15.125:0/3854754633 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ce41559b0 msgr2=0x7f3ce40b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.203+0000 7f3ceb0ab700 1 --2- 172.21.15.125:0/3854754633 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ce41559b0 0x7f3ce40b0670 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80073c0 tx=0x7f3cd8001e70 comp rx=0 tx=0).stop 2023-10-06T03:04:48.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.203+0000 7f3ceb0ab700 1 -- 172.21.15.125:0/3854754633 shutdown_connections 2023-10-06T03:04:48.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.203+0000 7f3ceb0ab700 1 --2- 172.21.15.125:0/3854754633 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3cc8066f30 0x7f3cc80693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.203+0000 7f3ceb0ab700 1 --2- 172.21.15.125:0/3854754633 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3ce40aaa00 0x7f3ce40aaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.203+0000 7f3ceb0ab700 1 --2- 172.21.15.125:0/3854754633 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3ce41559b0 0x7f3ce40b0670 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.203+0000 7f3ceb0ab700 1 --2- 172.21.15.125:0/3854754633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3ce4155d80 0x7f3ce40b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.203+0000 7f3ceb0ab700 1 -- 172.21.15.125:0/3854754633 >> 172.21.15.125:0/3854754633 conn(0x7f3ce40cc5a0 msgr2=0x7f3ce4156a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:48.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.203+0000 7f3ceb0ab700 1 -- 172.21.15.125:0/3854754633 shutdown_connections 2023-10-06T03:04:48.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.203+0000 7f3ceb0ab700 1 -- 172.21.15.125:0/3854754633 wait complete. 2023-10-06T03:04:48.208 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-06T03:04:48.216 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-10-06T03:04:47.811097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594853,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381796,"kb_used_data":3492,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592924,"statfs":{"total":773094113280,"available":770655154176,"internally_reserved":0,"allocated":3575808,"data_stored":2145279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2179,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003176"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257885+0000","last_change":"2023-10-06T03:04:29.236716+0000","last_active":"2023-10-06T03:04:33.257885+0000","last_peered":"2023-10-06T03:04:33.257885+0000","last_clean":"2023-10-06T03:04:33.257885+0000","last_became_active":"2023-10-06T03:04:29.236437+0000","last_became_peered":"2023-10-06T03:04:29.236437+0000","last_unstale":"2023-10-06T03:04:33.257885+0000","last_undegraded":"2023-10-06T03:04:33.257885+0000","last_fullsized":"2023-10-06T03:04:33.257885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:20.456488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.248189+0000","last_change":"2023-10-06T03:04:29.250536+0000","last_active":"2023-10-06T03:04:33.248189+0000","last_peered":"2023-10-06T03:04:33.248189+0000","last_clean":"2023-10-06T03:04:33.248189+0000","last_became_active":"2023-10-06T03:04:29.249872+0000","last_became_peered":"2023-10-06T03:04:29.249872+0000","last_unstale":"2023-10-06T03:04:33.248189+0000","last_undegraded":"2023-10-06T03:04:33.248189+0000","last_fullsized":"2023-10-06T03:04:33.248189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:06.710555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251359+0000","last_change":"2023-10-06T03:04:29.244837+0000","last_active":"2023-10-06T03:04:33.251359+0000","last_peered":"2023-10-06T03:04:33.251359+0000","last_clean":"2023-10-06T03:04:33.251359+0000","last_became_active":"2023-10-06T03:04:29.244485+0000","last_became_peered":"2023-10-06T03:04:29.244485+0000","last_unstale":"2023-10-06T03:04:33.251359+0000","last_undegraded":"2023-10-06T03:04:33.251359+0000","last_fullsized":"2023-10-06T03:04:33.251359+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:22.025761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251807+0000","last_change":"2023-10-06T03:04:29.244101+0000","last_active":"2023-10-06T03:04:33.251807+0000","last_peered":"2023-10-06T03:04:33.251807+0000","last_clean":"2023-10-06T03:04:33.251807+0000","last_became_active":"2023-10-06T03:04:29.243769+0000","last_became_peered":"2023-10-06T03:04:29.243769+0000","last_unstale":"2023-10-06T03:04:33.251807+0000","last_undegraded":"2023-10-06T03:04:33.251807+0000","last_fullsized":"2023-10-06T03:04:33.251807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:03.973528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260210+0000","last_change":"2023-10-06T03:04:29.245074+0000","last_active":"2023-10-06T03:04:33.260210+0000","last_peered":"2023-10-06T03:04:33.260210+0000","last_clean":"2023-10-06T03:04:33.260210+0000","last_became_active":"2023-10-06T03:04:29.244794+0000","last_became_peered":"2023-10-06T03:04:29.244794+0000","last_unstale":"2023-10-06T03:04:33.260210+0000","last_undegraded":"2023-10-06T03:04:33.260210+0000","last_fullsized":"2023-10-06T03:04:33.260210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:14.635872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251200+0000","last_change":"2023-10-06T03:04:29.248647+0000","last_active":"2023-10-06T03:04:33.251200+0000","last_peered":"2023-10-06T03:04:33.251200+0000","last_clean":"2023-10-06T03:04:33.251200+0000","last_became_active":"2023-10-06T03:04:29.248380+0000","last_became_peered":"2023-10-06T03:04:29.248380+0000","last_unstale":"2023-10-06T03:04:33.251200+0000","last_undegraded":"2023-10-06T03:04:33.251200+0000","last_fullsized":"2023-10-06T03:04:33.251200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:21:03.691892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255155+0000","last_change":"2023-10-06T03:04:29.249718+0000","last_active":"2023-10-06T03:04:33.255155+0000","last_peered":"2023-10-06T03:04:33.255155+0000","last_clean":"2023-10-06T03:04:33.255155+0000","last_became_active":"2023-10-06T03:04:29.249402+0000","last_became_peered":"2023-10-06T03:04:29.249402+0000","last_unstale":"2023-10-06T03:04:33.255155+0000","last_undegraded":"2023-10-06T03:04:33.255155+0000","last_fullsized":"2023-10-06T03:04:33.255155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247799+0000","last_change":"2023-10-06T03:04:29.252781+0000","last_active":"2023-10-06T03:04:33.247799+0000","last_peered":"2023-10-06T03:04:33.247799+0000","last_clean":"2023-10-06T03:04:33.247799+0000","last_became_active":"2023-10-06T03:04:29.252492+0000","last_became_peered":"2023-10-06T03:04:29.252492+0000","last_unstale":"2023-10-06T03:04:33.247799+0000","last_undegraded":"2023-10-06T03:04:33.247799+0000","last_fullsized":"2023-10-06T03:04:33.247799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:27.111880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260274+0000","last_change":"2023-10-06T03:04:29.248896+0000","last_active":"2023-10-06T03:04:33.260274+0000","last_peered":"2023-10-06T03:04:33.260274+0000","last_clean":"2023-10-06T03:04:33.260274+0000","last_became_active":"2023-10-06T03:04:29.248629+0000","last_became_peered":"2023-10-06T03:04:29.248629+0000","last_unstale":"2023-10-06T03:04:33.260274+0000","last_undegraded":"2023-10-06T03:04:33.260274+0000","last_fullsized":"2023-10-06T03:04:33.260274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:07.410542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.248372+0000","last_change":"2023-10-06T03:04:29.249187+0000","last_active":"2023-10-06T03:04:33.248372+0000","last_peered":"2023-10-06T03:04:33.248372+0000","last_clean":"2023-10-06T03:04:33.248372+0000","last_became_active":"2023-10-06T03:04:29.248914+0000","last_became_peered":"2023-10-06T03:04:29.248914+0000","last_unstale":"2023-10-06T03:04:33.248372+0000","last_undegraded":"2023-10-06T03:04:33.248372+0000","last_fullsized":"2023-10-06T03:04:33.248372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:07.410542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251508+0000","last_change":"2023-10-06T03:04:29.254043+0000","last_active":"2023-10-06T03:04:33.251508+0000","last_peered":"2023-10-06T03:04:33.251508+0000","last_clean":"2023-10-06T03:04:33.251508+0000","last_became_active":"2023-10-06T03:04:29.253749+0000","last_became_peered":"2023-10-06T03:04:29.253749+0000","last_unstale":"2023-10-06T03:04:33.251508+0000","last_undegraded":"2023-10-06T03:04:33.251508+0000","last_fullsized":"2023-10-06T03:04:33.251508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:56.032368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256021+0000","last_change":"2023-10-06T03:04:29.248689+0000","last_active":"2023-10-06T03:04:33.256021+0000","last_peered":"2023-10-06T03:04:33.256021+0000","last_clean":"2023-10-06T03:04:33.256021+0000","last_became_active":"2023-10-06T03:04:29.248400+0000","last_became_peered":"2023-10-06T03:04:29.248400+0000","last_unstale":"2023-10-06T03:04:33.256021+0000","last_undegraded":"2023-10-06T03:04:33.256021+0000","last_fullsized":"2023-10-06T03:04:33.256021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:23.078369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252308+0000","last_change":"2023-10-06T03:04:29.238874+0000","last_active":"2023-10-06T03:04:33.252308+0000","last_peered":"2023-10-06T03:04:33.252308+0000","last_clean":"2023-10-06T03:04:33.252308+0000","last_became_active":"2023-10-06T03:04:29.238616+0000","last_became_peered":"2023-10-06T03:04:29.238616+0000","last_unstale":"2023-10-06T03:04:33.252308+0000","last_undegraded":"2023-10-06T03:04:33.252308+0000","last_fullsized":"2023-10-06T03:04:33.252308+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:05.482076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247717+0000","last_change":"2023-10-06T03:04:29.248968+0000","last_active":"2023-10-06T03:04:33.247717+0000","last_peered":"2023-10-06T03:04:33.247717+0000","last_clean":"2023-10-06T03:04:33.247717+0000","last_became_active":"2023-10-06T03:04:29.248709+0000","last_became_peered":"2023-10-06T03:04:29.248709+0000","last_unstale":"2023-10-06T03:04:33.247717+0000","last_undegraded":"2023-10-06T03:04:33.247717+0000","last_fullsized":"2023-10-06T03:04:33.247717+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:41.163677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254258+0000","last_change":"2023-10-06T03:04:29.253102+0000","last_active":"2023-10-06T03:04:33.254258+0000","last_peered":"2023-10-06T03:04:33.254258+0000","last_clean":"2023-10-06T03:04:33.254258+0000","last_became_active":"2023-10-06T03:04:29.252836+0000","last_became_peered":"2023-10-06T03:04:29.252836+0000","last_unstale":"2023-10-06T03:04:33.254258+0000","last_undegraded":"2023-10-06T03:04:33.254258+0000","last_fullsized":"2023-10-06T03:04:33.254258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251098+0000","last_change":"2023-10-06T03:04:29.244988+0000","last_active":"2023-10-06T03:04:33.251098+0000","last_peered":"2023-10-06T03:04:33.251098+0000","last_clean":"2023-10-06T03:04:33.251098+0000","last_became_active":"2023-10-06T03:04:29.244457+0000","last_became_peered":"2023-10-06T03:04:29.244457+0000","last_unstale":"2023-10-06T03:04:33.251098+0000","last_undegraded":"2023-10-06T03:04:33.251098+0000","last_fullsized":"2023-10-06T03:04:33.251098+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:20.580002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260392+0000","last_change":"2023-10-06T03:04:29.242343+0000","last_active":"2023-10-06T03:04:33.260392+0000","last_peered":"2023-10-06T03:04:33.260392+0000","last_clean":"2023-10-06T03:04:33.260392+0000","last_became_active":"2023-10-06T03:04:29.242032+0000","last_became_peered":"2023-10-06T03:04:29.242032+0000","last_unstale":"2023-10-06T03:04:33.260392+0000","last_undegraded":"2023-10-06T03:04:33.260392+0000","last_fullsized":"2023-10-06T03:04:33.260392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.258197+0000","last_change":"2023-10-06T03:04:29.246372+0000","last_active":"2023-10-06T03:04:33.258197+0000","last_peered":"2023-10-06T03:04:33.258197+0000","last_clean":"2023-10-06T03:04:33.258197+0000","last_became_active":"2023-10-06T03:04:29.246058+0000","last_became_peered":"2023-10-06T03:04:29.246058+0000","last_unstale":"2023-10-06T03:04:33.258197+0000","last_undegraded":"2023-10-06T03:04:33.258197+0000","last_fullsized":"2023-10-06T03:04:33.258197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253617+0000","last_change":"2023-10-06T03:04:29.242029+0000","last_active":"2023-10-06T03:04:33.253617+0000","last_peered":"2023-10-06T03:04:33.253617+0000","last_clean":"2023-10-06T03:04:33.253617+0000","last_became_active":"2023-10-06T03:04:29.241785+0000","last_became_peered":"2023-10-06T03:04:29.241785+0000","last_unstale":"2023-10-06T03:04:33.253617+0000","last_undegraded":"2023-10-06T03:04:33.253617+0000","last_fullsized":"2023-10-06T03:04:33.253617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:48.653156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253130+0000","last_change":"2023-10-06T03:04:29.246603+0000","last_active":"2023-10-06T03:04:33.253130+0000","last_peered":"2023-10-06T03:04:33.253130+0000","last_clean":"2023-10-06T03:04:33.253130+0000","last_became_active":"2023-10-06T03:04:29.246405+0000","last_became_peered":"2023-10-06T03:04:29.246405+0000","last_unstale":"2023-10-06T03:04:33.253130+0000","last_undegraded":"2023-10-06T03:04:33.253130+0000","last_fullsized":"2023-10-06T03:04:33.253130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:41.436589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254147+0000","last_change":"2023-10-06T03:04:29.250839+0000","last_active":"2023-10-06T03:04:33.254147+0000","last_peered":"2023-10-06T03:04:33.254147+0000","last_clean":"2023-10-06T03:04:33.254147+0000","last_became_active":"2023-10-06T03:04:29.250600+0000","last_became_peered":"2023-10-06T03:04:29.250600+0000","last_unstale":"2023-10-06T03:04:33.254147+0000","last_undegraded":"2023-10-06T03:04:33.254147+0000","last_fullsized":"2023-10-06T03:04:33.254147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:27.111880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252975+0000","last_change":"2023-10-06T03:04:29.247916+0000","last_active":"2023-10-06T03:04:33.252975+0000","last_peered":"2023-10-06T03:04:33.252975+0000","last_clean":"2023-10-06T03:04:33.252975+0000","last_became_active":"2023-10-06T03:04:29.247638+0000","last_became_peered":"2023-10-06T03:04:29.247638+0000","last_unstale":"2023-10-06T03:04:33.252975+0000","last_undegraded":"2023-10-06T03:04:33.252975+0000","last_fullsized":"2023-10-06T03:04:33.252975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:06.710555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255737+0000","last_change":"2023-10-06T03:04:29.244948+0000","last_active":"2023-10-06T03:04:33.255737+0000","last_peered":"2023-10-06T03:04:33.255737+0000","last_clean":"2023-10-06T03:04:33.255737+0000","last_became_active":"2023-10-06T03:04:29.244458+0000","last_became_peered":"2023-10-06T03:04:29.244458+0000","last_unstale":"2023-10-06T03:04:33.255737+0000","last_undegraded":"2023-10-06T03:04:33.255737+0000","last_fullsized":"2023-10-06T03:04:33.255737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:07.410542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253458+0000","last_change":"2023-10-06T03:04:29.246013+0000","last_active":"2023-10-06T03:04:33.253458+0000","last_peered":"2023-10-06T03:04:33.253458+0000","last_clean":"2023-10-06T03:04:33.253458+0000","last_became_active":"2023-10-06T03:04:29.245107+0000","last_became_peered":"2023-10-06T03:04:29.245107+0000","last_unstale":"2023-10-06T03:04:33.253458+0000","last_undegraded":"2023-10-06T03:04:33.253458+0000","last_fullsized":"2023-10-06T03:04:33.253458+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257429+0000","last_change":"2023-10-06T03:04:29.249697+0000","last_active":"2023-10-06T03:04:33.257429+0000","last_peered":"2023-10-06T03:04:33.257429+0000","last_clean":"2023-10-06T03:04:33.257429+0000","last_became_active":"2023-10-06T03:04:29.249523+0000","last_became_peered":"2023-10-06T03:04:29.249523+0000","last_unstale":"2023-10-06T03:04:33.257429+0000","last_undegraded":"2023-10-06T03:04:33.257429+0000","last_fullsized":"2023-10-06T03:04:33.257429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:22.258796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256711+0000","last_change":"2023-10-06T03:04:29.249776+0000","last_active":"2023-10-06T03:04:33.256711+0000","last_peered":"2023-10-06T03:04:33.256711+0000","last_clean":"2023-10-06T03:04:33.256711+0000","last_became_active":"2023-10-06T03:04:29.249512+0000","last_became_peered":"2023-10-06T03:04:29.249512+0000","last_unstale":"2023-10-06T03:04:33.256711+0000","last_undegraded":"2023-10-06T03:04:33.256711+0000","last_fullsized":"2023-10-06T03:04:33.256711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:03.973528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.248523+0000","last_change":"2023-10-06T03:04:29.253464+0000","last_active":"2023-10-06T03:04:33.248523+0000","last_peered":"2023-10-06T03:04:33.248523+0000","last_clean":"2023-10-06T03:04:33.248523+0000","last_became_active":"2023-10-06T03:04:29.253186+0000","last_became_peered":"2023-10-06T03:04:29.253186+0000","last_unstale":"2023-10-06T03:04:33.248523+0000","last_undegraded":"2023-10-06T03:04:33.248523+0000","last_fullsized":"2023-10-06T03:04:33.248523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.277035+0000","last_change":"2023-10-06T03:04:33.272809+0000","last_active":"2023-10-06T03:04:33.277035+0000","last_peered":"2023-10-06T03:04:33.277035+0000","last_clean":"2023-10-06T03:04:33.277035+0000","last_became_active":"2023-10-06T03:04:33.272457+0000","last_became_peered":"2023-10-06T03:04:33.272457+0000","last_unstale":"2023-10-06T03:04:33.277035+0000","last_undegraded":"2023-10-06T03:04:33.277035+0000","last_fullsized":"2023-10-06T03:04:33.277035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:57:00.208098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251101+0000","last_change":"2023-10-06T03:04:28.838285+0000","last_active":"2023-10-06T03:04:33.251101+0000","last_peered":"2023-10-06T03:04:33.251101+0000","last_clean":"2023-10-06T03:04:33.251101+0000","last_became_active":"2023-10-06T03:04:28.837675+0000","last_became_peered":"2023-10-06T03:04:28.837675+0000","last_unstale":"2023-10-06T03:04:33.251101+0000","last_undegraded":"2023-10-06T03:04:33.251101+0000","last_fullsized":"2023-10-06T03:04:33.251101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:01.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256585+0000","last_change":"2023-10-06T03:04:29.251007+0000","last_active":"2023-10-06T03:04:33.256585+0000","last_peered":"2023-10-06T03:04:33.256585+0000","last_clean":"2023-10-06T03:04:33.256585+0000","last_became_active":"2023-10-06T03:04:29.250760+0000","last_became_peered":"2023-10-06T03:04:29.250760+0000","last_unstale":"2023-10-06T03:04:33.256585+0000","last_undegraded":"2023-10-06T03:04:33.256585+0000","last_fullsized":"2023-10-06T03:04:33.256585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:14.635872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274464+0000","last_change":"2023-10-06T03:04:33.270233+0000","last_active":"2023-10-06T03:04:33.274464+0000","last_peered":"2023-10-06T03:04:33.274464+0000","last_clean":"2023-10-06T03:04:33.274464+0000","last_became_active":"2023-10-06T03:04:33.269917+0000","last_became_peered":"2023-10-06T03:04:33.269917+0000","last_unstale":"2023-10-06T03:04:33.274464+0000","last_undegraded":"2023-10-06T03:04:33.274464+0000","last_fullsized":"2023-10-06T03:04:33.274464+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:25.913975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254184+0000","last_change":"2023-10-06T03:04:28.831735+0000","last_active":"2023-10-06T03:04:33.254184+0000","last_peered":"2023-10-06T03:04:33.254184+0000","last_clean":"2023-10-06T03:04:33.254184+0000","last_became_active":"2023-10-06T03:04:28.831448+0000","last_became_peered":"2023-10-06T03:04:28.831448+0000","last_unstale":"2023-10-06T03:04:33.254184+0000","last_undegraded":"2023-10-06T03:04:33.254184+0000","last_fullsized":"2023-10-06T03:04:33.254184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:16.444923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260988+0000","last_change":"2023-10-06T03:04:29.244005+0000","last_active":"2023-10-06T03:04:33.260988+0000","last_peered":"2023-10-06T03:04:33.260988+0000","last_clean":"2023-10-06T03:04:33.260988+0000","last_became_active":"2023-10-06T03:04:29.243597+0000","last_became_peered":"2023-10-06T03:04:29.243597+0000","last_unstale":"2023-10-06T03:04:33.260988+0000","last_undegraded":"2023-10-06T03:04:33.260988+0000","last_fullsized":"2023-10-06T03:04:33.260988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279041+0000","last_change":"2023-10-06T03:04:33.275920+0000","last_active":"2023-10-06T03:04:33.279041+0000","last_peered":"2023-10-06T03:04:33.279041+0000","last_clean":"2023-10-06T03:04:33.279041+0000","last_became_active":"2023-10-06T03:04:33.275198+0000","last_became_peered":"2023-10-06T03:04:33.275198+0000","last_unstale":"2023-10-06T03:04:33.279041+0000","last_undegraded":"2023-10-06T03:04:33.279041+0000","last_fullsized":"2023-10-06T03:04:33.279041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:53.801187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255924+0000","last_change":"2023-10-06T03:04:28.839035+0000","last_active":"2023-10-06T03:04:33.255924+0000","last_peered":"2023-10-06T03:04:33.255924+0000","last_clean":"2023-10-06T03:04:33.255924+0000","last_became_active":"2023-10-06T03:04:28.838799+0000","last_became_peered":"2023-10-06T03:04:28.838799+0000","last_unstale":"2023-10-06T03:04:33.255924+0000","last_undegraded":"2023-10-06T03:04:33.255924+0000","last_fullsized":"2023-10-06T03:04:33.255924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:16.444923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252657+0000","last_change":"2023-10-06T03:04:29.250582+0000","last_active":"2023-10-06T03:04:33.252657+0000","last_peered":"2023-10-06T03:04:33.252657+0000","last_clean":"2023-10-06T03:04:33.252657+0000","last_became_active":"2023-10-06T03:04:29.250300+0000","last_became_peered":"2023-10-06T03:04:29.250300+0000","last_unstale":"2023-10-06T03:04:33.252657+0000","last_undegraded":"2023-10-06T03:04:33.252657+0000","last_fullsized":"2023-10-06T03:04:33.252657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:20.456488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.273611+0000","last_change":"2023-10-06T03:04:33.268665+0000","last_active":"2023-10-06T03:04:33.273611+0000","last_peered":"2023-10-06T03:04:33.273611+0000","last_clean":"2023-10-06T03:04:33.273611+0000","last_became_active":"2023-10-06T03:04:33.268265+0000","last_became_peered":"2023-10-06T03:04:33.268265+0000","last_unstale":"2023-10-06T03:04:33.273611+0000","last_undegraded":"2023-10-06T03:04:33.273611+0000","last_fullsized":"2023-10-06T03:04:33.273611+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:44.857274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260397+0000","last_change":"2023-10-06T03:04:28.840063+0000","last_active":"2023-10-06T03:04:33.260397+0000","last_peered":"2023-10-06T03:04:33.260397+0000","last_clean":"2023-10-06T03:04:33.260397+0000","last_became_active":"2023-10-06T03:04:28.839810+0000","last_became_peered":"2023-10-06T03:04:28.839810+0000","last_unstale":"2023-10-06T03:04:33.260397+0000","last_undegraded":"2023-10-06T03:04:33.260397+0000","last_fullsized":"2023-10-06T03:04:33.260397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:47.647784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255847+0000","last_change":"2023-10-06T03:04:29.246067+0000","last_active":"2023-10-06T03:04:33.255847+0000","last_peered":"2023-10-06T03:04:33.255847+0000","last_clean":"2023-10-06T03:04:33.255847+0000","last_became_active":"2023-10-06T03:04:29.245691+0000","last_became_peered":"2023-10-06T03:04:29.245691+0000","last_unstale":"2023-10-06T03:04:33.255847+0000","last_undegraded":"2023-10-06T03:04:33.255847+0000","last_fullsized":"2023-10-06T03:04:33.255847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274621+0000","last_change":"2023-10-06T03:04:33.271930+0000","last_active":"2023-10-06T03:04:33.274621+0000","last_peered":"2023-10-06T03:04:33.274621+0000","last_clean":"2023-10-06T03:04:33.274621+0000","last_became_active":"2023-10-06T03:04:33.271546+0000","last_became_peered":"2023-10-06T03:04:33.271546+0000","last_unstale":"2023-10-06T03:04:33.274621+0000","last_undegraded":"2023-10-06T03:04:33.274621+0000","last_fullsized":"2023-10-06T03:04:33.274621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:53.801187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.248282+0000","last_change":"2023-10-06T03:04:28.844581+0000","last_active":"2023-10-06T03:04:33.248282+0000","last_peered":"2023-10-06T03:04:33.248282+0000","last_clean":"2023-10-06T03:04:33.248282+0000","last_became_active":"2023-10-06T03:04:28.844305+0000","last_became_peered":"2023-10-06T03:04:28.844305+0000","last_unstale":"2023-10-06T03:04:33.248282+0000","last_undegraded":"2023-10-06T03:04:33.248282+0000","last_fullsized":"2023-10-06T03:04:33.248282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:02.968156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255764+0000","last_change":"2023-10-06T03:04:29.250970+0000","last_active":"2023-10-06T03:04:33.255764+0000","last_peered":"2023-10-06T03:04:33.255764+0000","last_clean":"2023-10-06T03:04:33.255764+0000","last_became_active":"2023-10-06T03:04:29.250699+0000","last_became_peered":"2023-10-06T03:04:29.250699+0000","last_unstale":"2023-10-06T03:04:33.255764+0000","last_undegraded":"2023-10-06T03:04:33.255764+0000","last_fullsized":"2023-10-06T03:04:33.255764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:00.194415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274257+0000","last_change":"2023-10-06T03:04:33.266174+0000","last_active":"2023-10-06T03:04:33.274257+0000","last_peered":"2023-10-06T03:04:33.274257+0000","last_clean":"2023-10-06T03:04:33.274257+0000","last_became_active":"2023-10-06T03:04:33.265684+0000","last_became_peered":"2023-10-06T03:04:33.265684+0000","last_unstale":"2023-10-06T03:04:33.274257+0000","last_undegraded":"2023-10-06T03:04:33.274257+0000","last_fullsized":"2023-10-06T03:04:33.274257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:25.279420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254696+0000","last_change":"2023-10-06T03:04:28.841750+0000","last_active":"2023-10-06T03:04:33.254696+0000","last_peered":"2023-10-06T03:04:33.254696+0000","last_clean":"2023-10-06T03:04:33.254696+0000","last_became_active":"2023-10-06T03:04:28.841494+0000","last_became_peered":"2023-10-06T03:04:28.841494+0000","last_unstale":"2023-10-06T03:04:33.254696+0000","last_undegraded":"2023-10-06T03:04:33.254696+0000","last_fullsized":"2023-10-06T03:04:33.254696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:56:37.754382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252743+0000","last_change":"2023-10-06T03:04:29.252516+0000","last_active":"2023-10-06T03:04:33.252743+0000","last_peered":"2023-10-06T03:04:33.252743+0000","last_clean":"2023-10-06T03:04:33.252743+0000","last_became_active":"2023-10-06T03:04:29.252229+0000","last_became_peered":"2023-10-06T03:04:29.252229+0000","last_unstale":"2023-10-06T03:04:33.252743+0000","last_undegraded":"2023-10-06T03:04:33.252743+0000","last_fullsized":"2023-10-06T03:04:33.252743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:41.163677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.273192+0000","last_change":"2023-10-06T03:04:33.270221+0000","last_active":"2023-10-06T03:04:33.273192+0000","last_peered":"2023-10-06T03:04:33.273192+0000","last_clean":"2023-10-06T03:04:33.273192+0000","last_became_active":"2023-10-06T03:04:33.269852+0000","last_became_peered":"2023-10-06T03:04:33.269852+0000","last_unstale":"2023-10-06T03:04:33.273192+0000","last_undegraded":"2023-10-06T03:04:33.273192+0000","last_fullsized":"2023-10-06T03:04:33.273192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:29.020898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'9","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T03:04:39.092973+0000","last_change":"2023-10-06T03:04:28.838015+0000","last_active":"2023-10-06T03:04:39.092973+0000","last_peered":"2023-10-06T03:04:39.092973+0000","last_clean":"2023-10-06T03:04:39.092973+0000","last_became_active":"2023-10-06T03:04:28.837321+0000","last_became_peered":"2023-10-06T03:04:28.837321+0000","last_unstale":"2023-10-06T03:04:39.092973+0000","last_undegraded":"2023-10-06T03:04:39.092973+0000","last_fullsized":"2023-10-06T03:04:39.092973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:16.444923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3715,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251923+0000","last_change":"2023-10-06T03:04:29.245423+0000","last_active":"2023-10-06T03:04:33.251923+0000","last_peered":"2023-10-06T03:04:33.251923+0000","last_clean":"2023-10-06T03:04:33.251923+0000","last_became_active":"2023-10-06T03:04:29.245125+0000","last_became_peered":"2023-10-06T03:04:29.245125+0000","last_unstale":"2023-10-06T03:04:33.251923+0000","last_undegraded":"2023-10-06T03:04:33.251923+0000","last_fullsized":"2023-10-06T03:04:33.251923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:16.298020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.272326+0000","last_change":"2023-10-06T03:04:33.269331+0000","last_active":"2023-10-06T03:04:33.272326+0000","last_peered":"2023-10-06T03:04:33.272326+0000","last_clean":"2023-10-06T03:04:33.272326+0000","last_became_active":"2023-10-06T03:04:33.268947+0000","last_became_peered":"2023-10-06T03:04:33.268947+0000","last_unstale":"2023-10-06T03:04:33.272326+0000","last_undegraded":"2023-10-06T03:04:33.272326+0000","last_fullsized":"2023-10-06T03:04:33.272326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:18.722157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254189+0000","last_change":"2023-10-06T03:04:28.844574+0000","last_active":"2023-10-06T03:04:33.254189+0000","last_peered":"2023-10-06T03:04:33.254189+0000","last_clean":"2023-10-06T03:04:33.254189+0000","last_became_active":"2023-10-06T03:04:28.844264+0000","last_became_peered":"2023-10-06T03:04:28.844264+0000","last_unstale":"2023-10-06T03:04:33.254189+0000","last_undegraded":"2023-10-06T03:04:33.254189+0000","last_fullsized":"2023-10-06T03:04:33.254189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:05.970777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256525+0000","last_change":"2023-10-06T03:04:29.247698+0000","last_active":"2023-10-06T03:04:33.256525+0000","last_peered":"2023-10-06T03:04:33.256525+0000","last_clean":"2023-10-06T03:04:33.256525+0000","last_became_active":"2023-10-06T03:04:29.247464+0000","last_became_peered":"2023-10-06T03:04:29.247464+0000","last_unstale":"2023-10-06T03:04:33.256525+0000","last_undegraded":"2023-10-06T03:04:33.256525+0000","last_fullsized":"2023-10-06T03:04:33.256525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:13.355371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.273888+0000","last_change":"2023-10-06T03:04:33.266947+0000","last_active":"2023-10-06T03:04:33.273888+0000","last_peered":"2023-10-06T03:04:33.273888+0000","last_clean":"2023-10-06T03:04:33.273888+0000","last_became_active":"2023-10-06T03:04:33.266543+0000","last_became_peered":"2023-10-06T03:04:33.266543+0000","last_unstale":"2023-10-06T03:04:33.273888+0000","last_undegraded":"2023-10-06T03:04:33.273888+0000","last_fullsized":"2023-10-06T03:04:33.273888+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:29.020898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252534+0000","last_change":"2023-10-06T03:04:28.838464+0000","last_active":"2023-10-06T03:04:33.252534+0000","last_peered":"2023-10-06T03:04:33.252534+0000","last_clean":"2023-10-06T03:04:33.252534+0000","last_became_active":"2023-10-06T03:04:28.838008+0000","last_became_peered":"2023-10-06T03:04:28.838008+0000","last_unstale":"2023-10-06T03:04:33.252534+0000","last_undegraded":"2023-10-06T03:04:33.252534+0000","last_fullsized":"2023-10-06T03:04:33.252534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:53.804099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247750+0000","last_change":"2023-10-06T03:04:29.252750+0000","last_active":"2023-10-06T03:04:33.247750+0000","last_peered":"2023-10-06T03:04:33.247750+0000","last_clean":"2023-10-06T03:04:33.247750+0000","last_became_active":"2023-10-06T03:04:29.252421+0000","last_became_peered":"2023-10-06T03:04:29.252421+0000","last_unstale":"2023-10-06T03:04:33.247750+0000","last_undegraded":"2023-10-06T03:04:33.247750+0000","last_fullsized":"2023-10-06T03:04:33.247750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274637+0000","last_change":"2023-10-06T03:04:33.267286+0000","last_active":"2023-10-06T03:04:33.274637+0000","last_peered":"2023-10-06T03:04:33.274637+0000","last_clean":"2023-10-06T03:04:33.274637+0000","last_became_active":"2023-10-06T03:04:33.266886+0000","last_became_peered":"2023-10-06T03:04:33.266886+0000","last_unstale":"2023-10-06T03:04:33.274637+0000","last_undegraded":"2023-10-06T03:04:33.274637+0000","last_fullsized":"2023-10-06T03:04:33.274637+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:49.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254264+0000","last_change":"2023-10-06T03:04:28.841825+0000","last_active":"2023-10-06T03:04:33.254264+0000","last_peered":"2023-10-06T03:04:33.254264+0000","last_clean":"2023-10-06T03:04:33.254264+0000","last_became_active":"2023-10-06T03:04:28.841550+0000","last_became_peered":"2023-10-06T03:04:28.841550+0000","last_unstale":"2023-10-06T03:04:33.254264+0000","last_undegraded":"2023-10-06T03:04:33.254264+0000","last_fullsized":"2023-10-06T03:04:33.254264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:22.072997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260999+0000","last_change":"2023-10-06T03:04:29.243824+0000","last_active":"2023-10-06T03:04:33.260999+0000","last_peered":"2023-10-06T03:04:33.260999+0000","last_clean":"2023-10-06T03:04:33.260999+0000","last_became_active":"2023-10-06T03:04:29.243249+0000","last_became_peered":"2023-10-06T03:04:29.243249+0000","last_unstale":"2023-10-06T03:04:33.260999+0000","last_undegraded":"2023-10-06T03:04:33.260999+0000","last_fullsized":"2023-10-06T03:04:33.260999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:16.298020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.272146+0000","last_change":"2023-10-06T03:04:33.268277+0000","last_active":"2023-10-06T03:04:33.272146+0000","last_peered":"2023-10-06T03:04:33.272146+0000","last_clean":"2023-10-06T03:04:33.272146+0000","last_became_active":"2023-10-06T03:04:33.267827+0000","last_became_peered":"2023-10-06T03:04:33.267827+0000","last_unstale":"2023-10-06T03:04:33.272146+0000","last_undegraded":"2023-10-06T03:04:33.272146+0000","last_fullsized":"2023-10-06T03:04:33.272146+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:03.744883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251717+0000","last_change":"2023-10-06T03:04:28.843010+0000","last_active":"2023-10-06T03:04:33.251717+0000","last_peered":"2023-10-06T03:04:33.251717+0000","last_clean":"2023-10-06T03:04:33.251717+0000","last_became_active":"2023-10-06T03:04:28.842743+0000","last_became_peered":"2023-10-06T03:04:28.842743+0000","last_unstale":"2023-10-06T03:04:33.251717+0000","last_undegraded":"2023-10-06T03:04:33.251717+0000","last_fullsized":"2023-10-06T03:04:33.251717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:01.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257848+0000","last_change":"2023-10-06T03:04:29.246248+0000","last_active":"2023-10-06T03:04:33.257848+0000","last_peered":"2023-10-06T03:04:33.257848+0000","last_clean":"2023-10-06T03:04:33.257848+0000","last_became_active":"2023-10-06T03:04:29.245660+0000","last_became_peered":"2023-10-06T03:04:29.245660+0000","last_unstale":"2023-10-06T03:04:33.257848+0000","last_undegraded":"2023-10-06T03:04:33.257848+0000","last_fullsized":"2023-10-06T03:04:33.257848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274535+0000","last_change":"2023-10-06T03:04:33.270753+0000","last_active":"2023-10-06T03:04:33.274535+0000","last_peered":"2023-10-06T03:04:33.274535+0000","last_clean":"2023-10-06T03:04:33.274535+0000","last_became_active":"2023-10-06T03:04:33.270285+0000","last_became_peered":"2023-10-06T03:04:33.270285+0000","last_unstale":"2023-10-06T03:04:33.274535+0000","last_undegraded":"2023-10-06T03:04:33.274535+0000","last_fullsized":"2023-10-06T03:04:33.274535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:38.040904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256306+0000","last_change":"2023-10-06T03:04:28.841768+0000","last_active":"2023-10-06T03:04:33.256306+0000","last_peered":"2023-10-06T03:04:33.256306+0000","last_clean":"2023-10-06T03:04:33.256306+0000","last_became_active":"2023-10-06T03:04:28.841466+0000","last_became_peered":"2023-10-06T03:04:28.841466+0000","last_unstale":"2023-10-06T03:04:33.256306+0000","last_undegraded":"2023-10-06T03:04:33.256306+0000","last_fullsized":"2023-10-06T03:04:33.256306+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:18.790700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247445+0000","last_change":"2023-10-06T03:04:29.254847+0000","last_active":"2023-10-06T03:04:33.247445+0000","last_peered":"2023-10-06T03:04:33.247445+0000","last_clean":"2023-10-06T03:04:33.247445+0000","last_became_active":"2023-10-06T03:04:29.254566+0000","last_became_peered":"2023-10-06T03:04:29.254566+0000","last_unstale":"2023-10-06T03:04:33.247445+0000","last_undegraded":"2023-10-06T03:04:33.247445+0000","last_fullsized":"2023-10-06T03:04:33.247445+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279105+0000","last_change":"2023-10-06T03:04:33.273474+0000","last_active":"2023-10-06T03:04:33.279105+0000","last_peered":"2023-10-06T03:04:33.279105+0000","last_clean":"2023-10-06T03:04:33.279105+0000","last_became_active":"2023-10-06T03:04:33.272844+0000","last_became_peered":"2023-10-06T03:04:33.272844+0000","last_unstale":"2023-10-06T03:04:33.279105+0000","last_undegraded":"2023-10-06T03:04:33.279105+0000","last_fullsized":"2023-10-06T03:04:33.279105+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:22:18.478319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253676+0000","last_change":"2023-10-06T03:04:28.844454+0000","last_active":"2023-10-06T03:04:33.253676+0000","last_peered":"2023-10-06T03:04:33.253676+0000","last_clean":"2023-10-06T03:04:33.253676+0000","last_became_active":"2023-10-06T03:04:28.844159+0000","last_became_peered":"2023-10-06T03:04:28.844159+0000","last_unstale":"2023-10-06T03:04:33.253676+0000","last_undegraded":"2023-10-06T03:04:33.253676+0000","last_fullsized":"2023-10-06T03:04:33.253676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:02.968156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260414+0000","last_change":"2023-10-06T03:04:29.247815+0000","last_active":"2023-10-06T03:04:33.260414+0000","last_peered":"2023-10-06T03:04:33.260414+0000","last_clean":"2023-10-06T03:04:33.260414+0000","last_became_active":"2023-10-06T03:04:29.247468+0000","last_became_peered":"2023-10-06T03:04:29.247468+0000","last_unstale":"2023-10-06T03:04:33.260414+0000","last_undegraded":"2023-10-06T03:04:33.260414+0000","last_fullsized":"2023-10-06T03:04:33.260414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:00.742905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.281495+0000","last_change":"2023-10-06T03:04:33.274004+0000","last_active":"2023-10-06T03:04:33.281495+0000","last_peered":"2023-10-06T03:04:33.281495+0000","last_clean":"2023-10-06T03:04:33.281495+0000","last_became_active":"2023-10-06T03:04:33.273505+0000","last_became_peered":"2023-10-06T03:04:33.273505+0000","last_unstale":"2023-10-06T03:04:33.281495+0000","last_undegraded":"2023-10-06T03:04:33.281495+0000","last_fullsized":"2023-10-06T03:04:33.281495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:35:59.453052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254602+0000","last_change":"2023-10-06T03:04:28.844541+0000","last_active":"2023-10-06T03:04:33.254602+0000","last_peered":"2023-10-06T03:04:33.254602+0000","last_clean":"2023-10-06T03:04:33.254602+0000","last_became_active":"2023-10-06T03:04:28.844287+0000","last_became_peered":"2023-10-06T03:04:28.844287+0000","last_unstale":"2023-10-06T03:04:33.254602+0000","last_undegraded":"2023-10-06T03:04:33.254602+0000","last_fullsized":"2023-10-06T03:04:33.254602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:28:56.517421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251704+0000","last_change":"2023-10-06T03:04:29.247387+0000","last_active":"2023-10-06T03:04:33.251704+0000","last_peered":"2023-10-06T03:04:33.251704+0000","last_clean":"2023-10-06T03:04:33.251704+0000","last_became_active":"2023-10-06T03:04:29.247094+0000","last_became_peered":"2023-10-06T03:04:29.247094+0000","last_unstale":"2023-10-06T03:04:33.251704+0000","last_undegraded":"2023-10-06T03:04:33.251704+0000","last_fullsized":"2023-10-06T03:04:33.251704+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:23.078369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275074+0000","last_change":"2023-10-06T03:04:33.268719+0000","last_active":"2023-10-06T03:04:33.275074+0000","last_peered":"2023-10-06T03:04:33.275074+0000","last_clean":"2023-10-06T03:04:33.275074+0000","last_became_active":"2023-10-06T03:04:33.268369+0000","last_became_peered":"2023-10-06T03:04:33.268369+0000","last_unstale":"2023-10-06T03:04:33.275074+0000","last_undegraded":"2023-10-06T03:04:33.275074+0000","last_fullsized":"2023-10-06T03:04:33.275074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:39.388410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247659+0000","last_change":"2023-10-06T03:04:28.836622+0000","last_active":"2023-10-06T03:04:33.247659+0000","last_peered":"2023-10-06T03:04:33.247659+0000","last_clean":"2023-10-06T03:04:33.247659+0000","last_became_active":"2023-10-06T03:04:28.836361+0000","last_became_peered":"2023-10-06T03:04:28.836361+0000","last_unstale":"2023-10-06T03:04:33.247659+0000","last_undegraded":"2023-10-06T03:04:33.247659+0000","last_fullsized":"2023-10-06T03:04:33.247659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:53.804099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260554+0000","last_change":"2023-10-06T03:04:29.246365+0000","last_active":"2023-10-06T03:04:33.260554+0000","last_peered":"2023-10-06T03:04:33.260554+0000","last_clean":"2023-10-06T03:04:33.260554+0000","last_became_active":"2023-10-06T03:04:29.246129+0000","last_became_peered":"2023-10-06T03:04:29.246129+0000","last_unstale":"2023-10-06T03:04:33.260554+0000","last_undegraded":"2023-10-06T03:04:33.260554+0000","last_fullsized":"2023-10-06T03:04:33.260554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.273557+0000","last_change":"2023-10-06T03:04:33.263768+0000","last_active":"2023-10-06T03:04:33.273557+0000","last_peered":"2023-10-06T03:04:33.273557+0000","last_clean":"2023-10-06T03:04:33.273557+0000","last_became_active":"2023-10-06T03:04:33.263379+0000","last_became_peered":"2023-10-06T03:04:33.263379+0000","last_unstale":"2023-10-06T03:04:33.273557+0000","last_undegraded":"2023-10-06T03:04:33.273557+0000","last_fullsized":"2023-10-06T03:04:33.273557+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:03.615099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256254+0000","last_change":"2023-10-06T03:04:28.842173+0000","last_active":"2023-10-06T03:04:33.256254+0000","last_peered":"2023-10-06T03:04:33.256254+0000","last_clean":"2023-10-06T03:04:33.256254+0000","last_became_active":"2023-10-06T03:04:28.841904+0000","last_became_peered":"2023-10-06T03:04:28.841904+0000","last_unstale":"2023-10-06T03:04:33.256254+0000","last_undegraded":"2023-10-06T03:04:33.256254+0000","last_fullsized":"2023-10-06T03:04:33.256254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:47.647784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252916+0000","last_change":"2023-10-06T03:04:29.248275+0000","last_active":"2023-10-06T03:04:33.252916+0000","last_peered":"2023-10-06T03:04:33.252916+0000","last_clean":"2023-10-06T03:04:33.252916+0000","last_became_active":"2023-10-06T03:04:29.247441+0000","last_became_peered":"2023-10-06T03:04:29.247441+0000","last_unstale":"2023-10-06T03:04:33.252916+0000","last_undegraded":"2023-10-06T03:04:33.252916+0000","last_fullsized":"2023-10-06T03:04:33.252916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:00:41.084853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279289+0000","last_change":"2023-10-06T03:04:33.277569+0000","last_active":"2023-10-06T03:04:33.279289+0000","last_peered":"2023-10-06T03:04:33.279289+0000","last_clean":"2023-10-06T03:04:33.279289+0000","last_became_active":"2023-10-06T03:04:33.277036+0000","last_became_peered":"2023-10-06T03:04:33.277036+0000","last_unstale":"2023-10-06T03:04:33.279289+0000","last_undegraded":"2023-10-06T03:04:33.279289+0000","last_fullsized":"2023-10-06T03:04:33.279289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:16.342856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252435+0000","last_change":"2023-10-06T03:04:28.839083+0000","last_active":"2023-10-06T03:04:33.252435+0000","last_peered":"2023-10-06T03:04:33.252435+0000","last_clean":"2023-10-06T03:04:33.252435+0000","last_became_active":"2023-10-06T03:04:28.838794+0000","last_became_peered":"2023-10-06T03:04:28.838794+0000","last_unstale":"2023-10-06T03:04:33.252435+0000","last_undegraded":"2023-10-06T03:04:33.252435+0000","last_fullsized":"2023-10-06T03:04:33.252435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:18:08.701124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251200+0000","last_change":"2023-10-06T03:04:29.245977+0000","last_active":"2023-10-06T03:04:33.251200+0000","last_peered":"2023-10-06T03:04:33.251200+0000","last_clean":"2023-10-06T03:04:33.251200+0000","last_became_active":"2023-10-06T03:04:29.245626+0000","last_became_peered":"2023-10-06T03:04:29.245626+0000","last_unstale":"2023-10-06T03:04:33.251200+0000","last_undegraded":"2023-10-06T03:04:33.251200+0000","last_fullsized":"2023-10-06T03:04:33.251200+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275700+0000","last_change":"2023-10-06T03:04:33.273132+0000","last_active":"2023-10-06T03:04:33.275700+0000","last_peered":"2023-10-06T03:04:33.275700+0000","last_clean":"2023-10-06T03:04:33.275700+0000","last_became_active":"2023-10-06T03:04:33.270004+0000","last_became_peered":"2023-10-06T03:04:33.270004+0000","last_unstale":"2023-10-06T03:04:33.275700+0000","last_undegraded":"2023-10-06T03:04:33.275700+0000","last_fullsized":"2023-10-06T03:04:33.275700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:29.588904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.262618+0000","last_change":"2023-10-06T03:04:28.834924+0000","last_active":"2023-10-06T03:04:33.262618+0000","last_peered":"2023-10-06T03:04:33.262618+0000","last_clean":"2023-10-06T03:04:33.262618+0000","last_became_active":"2023-10-06T03:04:28.833593+0000","last_became_peered":"2023-10-06T03:04:28.833593+0000","last_unstale":"2023-10-06T03:04:33.262618+0000","last_undegraded":"2023-10-06T03:04:33.262618+0000","last_fullsized":"2023-10-06T03:04:33.262618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:01.349764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.258286+0000","last_change":"2023-10-06T03:04:29.242813+0000","last_active":"2023-10-06T03:04:33.258286+0000","last_peered":"2023-10-06T03:04:33.258286+0000","last_clean":"2023-10-06T03:04:33.258286+0000","last_became_active":"2023-10-06T03:04:29.242505+0000","last_became_peered":"2023-10-06T03:04:29.242505+0000","last_unstale":"2023-10-06T03:04:33.258286+0000","last_undegraded":"2023-10-06T03:04:33.258286+0000","last_fullsized":"2023-10-06T03:04:33.258286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:47:00.194415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279673+0000","last_change":"2023-10-06T03:04:33.276215+0000","last_active":"2023-10-06T03:04:33.279673+0000","last_peered":"2023-10-06T03:04:33.279673+0000","last_clean":"2023-10-06T03:04:33.279673+0000","last_became_active":"2023-10-06T03:04:33.275880+0000","last_became_peered":"2023-10-06T03:04:33.275880+0000","last_unstale":"2023-10-06T03:04:33.279673+0000","last_undegraded":"2023-10-06T03:04:33.279673+0000","last_fullsized":"2023-10-06T03:04:33.279673+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:15:47.940801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255769+0000","last_change":"2023-10-06T03:04:28.833476+0000","last_active":"2023-10-06T03:04:33.255769+0000","last_peered":"2023-10-06T03:04:33.255769+0000","last_clean":"2023-10-06T03:04:33.255769+0000","last_became_active":"2023-10-06T03:04:28.833134+0000","last_became_peered":"2023-10-06T03:04:28.833134+0000","last_unstale":"2023-10-06T03:04:33.255769+0000","last_undegraded":"2023-10-06T03:04:33.255769+0000","last_fullsized":"2023-10-06T03:04:33.255769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:01.349764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257596+0000","last_change":"2023-10-06T03:04:29.254675+0000","last_active":"2023-10-06T03:04:33.257596+0000","last_peered":"2023-10-06T03:04:33.257596+0000","last_clean":"2023-10-06T03:04:33.257596+0000","last_became_active":"2023-10-06T03:04:29.254440+0000","last_became_peered":"2023-10-06T03:04:29.254440+0000","last_unstale":"2023-10-06T03:04:33.257596+0000","last_undegraded":"2023-10-06T03:04:33.257596+0000","last_fullsized":"2023-10-06T03:04:33.257596+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:13:06.710555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275628+0000","last_change":"2023-10-06T03:04:33.271611+0000","last_active":"2023-10-06T03:04:33.275628+0000","last_peered":"2023-10-06T03:04:33.275628+0000","last_clean":"2023-10-06T03:04:33.275628+0000","last_became_active":"2023-10-06T03:04:33.270809+0000","last_became_peered":"2023-10-06T03:04:33.270809+0000","last_unstale":"2023-10-06T03:04:33.275628+0000","last_undegraded":"2023-10-06T03:04:33.275628+0000","last_fullsized":"2023-10-06T03:04:33.275628+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:38.040904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256889+0000","last_change":"2023-10-06T03:04:23.986472+0000","last_active":"2023-10-06T03:04:33.256889+0000","last_peered":"2023-10-06T03:04:33.256889+0000","last_clean":"2023-10-06T03:04:33.256889+0000","last_became_active":"2023-10-06T03:04:23.986228+0000","last_became_peered":"2023-10-06T03:04:23.986228+0000","last_unstale":"2023-10-06T03:04:33.256889+0000","last_undegraded":"2023-10-06T03:04:33.256889+0000","last_fullsized":"2023-10-06T03:04:33.256889+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:08.739849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247658+0000","last_change":"2023-10-06T03:04:28.837603+0000","last_active":"2023-10-06T03:04:33.247658+0000","last_peered":"2023-10-06T03:04:33.247658+0000","last_clean":"2023-10-06T03:04:33.247658+0000","last_became_active":"2023-10-06T03:04:28.837333+0000","last_became_peered":"2023-10-06T03:04:28.837333+0000","last_unstale":"2023-10-06T03:04:33.247658+0000","last_undegraded":"2023-10-06T03:04:33.247658+0000","last_fullsized":"2023-10-06T03:04:33.247658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:38:43.549607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252660+0000","last_change":"2023-10-06T03:04:29.251886+0000","last_active":"2023-10-06T03:04:33.252660+0000","last_peered":"2023-10-06T03:04:33.252660+0000","last_clean":"2023-10-06T03:04:33.252660+0000","last_became_active":"2023-10-06T03:04:29.250608+0000","last_became_peered":"2023-10-06T03:04:29.250608+0000","last_unstale":"2023-10-06T03:04:33.252660+0000","last_undegraded":"2023-10-06T03:04:33.252660+0000","last_fullsized":"2023-10-06T03:04:33.252660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:20.717425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275480+0000","last_change":"2023-10-06T03:04:33.270876+0000","last_active":"2023-10-06T03:04:33.275480+0000","last_peered":"2023-10-06T03:04:33.275480+0000","last_clean":"2023-10-06T03:04:33.275480+0000","last_became_active":"2023-10-06T03:04:33.270440+0000","last_became_peered":"2023-10-06T03:04:33.270440+0000","last_unstale":"2023-10-06T03:04:33.275480+0000","last_undegraded":"2023-10-06T03:04:33.275480+0000","last_fullsized":"2023-10-06T03:04:33.275480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:09:43.778573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247810+0000","last_change":"2023-10-06T03:04:23.814917+0000","last_active":"2023-10-06T03:04:33.247810+0000","last_peered":"2023-10-06T03:04:33.247810+0000","last_clean":"2023-10-06T03:04:33.247810+0000","last_became_active":"2023-10-06T03:04:23.814601+0000","last_became_peered":"2023-10-06T03:04:23.814601+0000","last_unstale":"2023-10-06T03:04:33.247810+0000","last_undegraded":"2023-10-06T03:04:33.247810+0000","last_fullsized":"2023-10-06T03:04:33.247810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251996+0000","last_change":"2023-10-06T03:04:28.844008+0000","last_active":"2023-10-06T03:04:33.251996+0000","last_peered":"2023-10-06T03:04:33.251996+0000","last_clean":"2023-10-06T03:04:33.251996+0000","last_became_active":"2023-10-06T03:04:28.843570+0000","last_became_peered":"2023-10-06T03:04:28.843570+0000","last_unstale":"2023-10-06T03:04:33.251996+0000","last_undegraded":"2023-10-06T03:04:33.251996+0000","last_fullsized":"2023-10-06T03:04:33.251996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:47.468717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256810+0000","last_change":"2023-10-06T03:04:29.251986+0000","last_active":"2023-10-06T03:04:33.256810+0000","last_peered":"2023-10-06T03:04:33.256810+0000","last_clean":"2023-10-06T03:04:33.256810+0000","last_became_active":"2023-10-06T03:04:29.250140+0000","last_became_peered":"2023-10-06T03:04:29.250140+0000","last_unstale":"2023-10-06T03:04:33.256810+0000","last_undegraded":"2023-10-06T03:04:33.256810+0000","last_fullsized":"2023-10-06T03:04:33.256810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:14.635872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275237+0000","last_change":"2023-10-06T03:04:33.271548+0000","last_active":"2023-10-06T03:04:33.275237+0000","last_peered":"2023-10-06T03:04:33.275237+0000","last_clean":"2023-10-06T03:04:33.275237+0000","last_became_active":"2023-10-06T03:04:33.270795+0000","last_became_peered":"2023-10-06T03:04:33.270795+0000","last_unstale":"2023-10-06T03:04:33.275237+0000","last_undegraded":"2023-10-06T03:04:33.275237+0000","last_fullsized":"2023-10-06T03:04:33.275237+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:32:04.163589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254358+0000","last_change":"2023-10-06T03:04:24.314547+0000","last_active":"2023-10-06T03:04:33.254358+0000","last_peered":"2023-10-06T03:04:33.254358+0000","last_clean":"2023-10-06T03:04:33.254358+0000","last_became_active":"2023-10-06T03:04:24.314278+0000","last_became_peered":"2023-10-06T03:04:24.314278+0000","last_unstale":"2023-10-06T03:04:33.254358+0000","last_undegraded":"2023-10-06T03:04:33.254358+0000","last_fullsized":"2023-10-06T03:04:33.254358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:25.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.258223+0000","last_change":"2023-10-06T03:04:28.830604+0000","last_active":"2023-10-06T03:04:33.258223+0000","last_peered":"2023-10-06T03:04:33.258223+0000","last_clean":"2023-10-06T03:04:33.258223+0000","last_became_active":"2023-10-06T03:04:28.828889+0000","last_became_peered":"2023-10-06T03:04:28.828889+0000","last_unstale":"2023-10-06T03:04:33.258223+0000","last_undegraded":"2023-10-06T03:04:33.258223+0000","last_fullsized":"2023-10-06T03:04:33.258223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:53.804099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257514+0000","last_change":"2023-10-06T03:04:29.250731+0000","last_active":"2023-10-06T03:04:33.257514+0000","last_peered":"2023-10-06T03:04:33.257514+0000","last_clean":"2023-10-06T03:04:33.257514+0000","last_became_active":"2023-10-06T03:04:29.250491+0000","last_became_peered":"2023-10-06T03:04:29.250491+0000","last_unstale":"2023-10-06T03:04:33.257514+0000","last_undegraded":"2023-10-06T03:04:33.257514+0000","last_fullsized":"2023-10-06T03:04:33.257514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:57:13.355371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.271453+0000","last_change":"2023-10-06T03:04:33.266989+0000","last_active":"2023-10-06T03:04:33.271453+0000","last_peered":"2023-10-06T03:04:33.271453+0000","last_clean":"2023-10-06T03:04:33.271453+0000","last_became_active":"2023-10-06T03:04:33.266416+0000","last_became_peered":"2023-10-06T03:04:33.266416+0000","last_unstale":"2023-10-06T03:04:33.271453+0000","last_undegraded":"2023-10-06T03:04:33.271453+0000","last_fullsized":"2023-10-06T03:04:33.271453+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:39:45.049591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247892+0000","last_change":"2023-10-06T03:04:23.807972+0000","last_active":"2023-10-06T03:04:33.247892+0000","last_peered":"2023-10-06T03:04:33.247892+0000","last_clean":"2023-10-06T03:04:33.247892+0000","last_became_active":"2023-10-06T03:04:23.807723+0000","last_became_peered":"2023-10-06T03:04:23.807723+0000","last_unstale":"2023-10-06T03:04:33.247892+0000","last_undegraded":"2023-10-06T03:04:33.247892+0000","last_fullsized":"2023-10-06T03:04:33.247892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253358+0000","last_change":"2023-10-06T03:04:17.779925+0000","last_active":"2023-10-06T03:04:33.253358+0000","last_peered":"2023-10-06T03:04:33.253358+0000","last_clean":"2023-10-06T03:04:33.253358+0000","last_became_active":"2023-10-06T03:04:17.778997+0000","last_became_peered":"2023-10-06T03:04:17.778997+0000","last_unstale":"2023-10-06T03:04:33.253358+0000","last_undegraded":"2023-10-06T03:04:33.253358+0000","last_fullsized":"2023-10-06T03:04:33.253358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_clean_scrub_stamp":"2023-10-06T03:04:16.761610+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255740+0000","last_change":"2023-10-06T03:04:28.836276+0000","last_active":"2023-10-06T03:04:33.255740+0000","last_peered":"2023-10-06T03:04:33.255740+0000","last_clean":"2023-10-06T03:04:33.255740+0000","last_became_active":"2023-10-06T03:04:28.836005+0000","last_became_peered":"2023-10-06T03:04:28.836005+0000","last_unstale":"2023-10-06T03:04:33.255740+0000","last_undegraded":"2023-10-06T03:04:33.255740+0000","last_fullsized":"2023-10-06T03:04:33.255740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:35:47.468717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251891+0000","last_change":"2023-10-06T03:04:29.246019+0000","last_active":"2023-10-06T03:04:33.251891+0000","last_peered":"2023-10-06T03:04:33.251891+0000","last_clean":"2023-10-06T03:04:33.251891+0000","last_became_active":"2023-10-06T03:04:29.245727+0000","last_became_peered":"2023-10-06T03:04:29.245727+0000","last_unstale":"2023-10-06T03:04:33.251891+0000","last_undegraded":"2023-10-06T03:04:33.251891+0000","last_fullsized":"2023-10-06T03:04:33.251891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:23:06.976149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.275851+0000","last_change":"2023-10-06T03:04:33.273528+0000","last_active":"2023-10-06T03:04:33.275851+0000","last_peered":"2023-10-06T03:04:33.275851+0000","last_clean":"2023-10-06T03:04:33.275851+0000","last_became_active":"2023-10-06T03:04:33.272634+0000","last_became_peered":"2023-10-06T03:04:33.272634+0000","last_unstale":"2023-10-06T03:04:33.275851+0000","last_undegraded":"2023-10-06T03:04:33.275851+0000","last_fullsized":"2023-10-06T03:04:33.275851+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:49.564698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.253551+0000","last_change":"2023-10-06T03:04:23.814887+0000","last_active":"2023-10-06T03:04:33.253551+0000","last_peered":"2023-10-06T03:04:33.253551+0000","last_clean":"2023-10-06T03:04:33.253551+0000","last_became_active":"2023-10-06T03:04:23.814581+0000","last_became_peered":"2023-10-06T03:04:23.814581+0000","last_unstale":"2023-10-06T03:04:33.253551+0000","last_undegraded":"2023-10-06T03:04:33.253551+0000","last_fullsized":"2023-10-06T03:04:33.253551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252277+0000","last_change":"2023-10-06T03:04:28.840850+0000","last_active":"2023-10-06T03:04:33.252277+0000","last_peered":"2023-10-06T03:04:33.252277+0000","last_clean":"2023-10-06T03:04:33.252277+0000","last_became_active":"2023-10-06T03:04:28.840598+0000","last_became_peered":"2023-10-06T03:04:28.840598+0000","last_unstale":"2023-10-06T03:04:33.252277+0000","last_undegraded":"2023-10-06T03:04:33.252277+0000","last_fullsized":"2023-10-06T03:04:33.252277+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:30:01.349764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260789+0000","last_change":"2023-10-06T03:04:29.245535+0000","last_active":"2023-10-06T03:04:33.260789+0000","last_peered":"2023-10-06T03:04:33.260789+0000","last_clean":"2023-10-06T03:04:33.260789+0000","last_became_active":"2023-10-06T03:04:29.245290+0000","last_became_peered":"2023-10-06T03:04:29.245290+0000","last_unstale":"2023-10-06T03:04:33.260789+0000","last_undegraded":"2023-10-06T03:04:33.260789+0000","last_fullsized":"2023-10-06T03:04:33.260789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:41.163677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274377+0000","last_change":"2023-10-06T03:04:33.270521+0000","last_active":"2023-10-06T03:04:33.274377+0000","last_peered":"2023-10-06T03:04:33.274377+0000","last_clean":"2023-10-06T03:04:33.274377+0000","last_became_active":"2023-10-06T03:04:33.270088+0000","last_became_peered":"2023-10-06T03:04:33.270088+0000","last_unstale":"2023-10-06T03:04:33.274377+0000","last_undegraded":"2023-10-06T03:04:33.274377+0000","last_fullsized":"2023-10-06T03:04:33.274377+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:19.718704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.254193+0000","last_change":"2023-10-06T03:04:23.986771+0000","last_active":"2023-10-06T03:04:33.254193+0000","last_peered":"2023-10-06T03:04:33.254193+0000","last_clean":"2023-10-06T03:04:33.254193+0000","last_became_active":"2023-10-06T03:04:23.986552+0000","last_became_peered":"2023-10-06T03:04:23.986552+0000","last_unstale":"2023-10-06T03:04:33.254193+0000","last_undegraded":"2023-10-06T03:04:33.254193+0000","last_fullsized":"2023-10-06T03:04:33.254193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257056+0000","last_change":"2023-10-06T03:04:28.829211+0000","last_active":"2023-10-06T03:04:33.257056+0000","last_peered":"2023-10-06T03:04:33.257056+0000","last_clean":"2023-10-06T03:04:33.257056+0000","last_became_active":"2023-10-06T03:04:28.828898+0000","last_became_peered":"2023-10-06T03:04:28.828898+0000","last_unstale":"2023-10-06T03:04:33.257056+0000","last_undegraded":"2023-10-06T03:04:33.257056+0000","last_fullsized":"2023-10-06T03:04:33.257056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:47.647784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260435+0000","last_change":"2023-10-06T03:04:29.251481+0000","last_active":"2023-10-06T03:04:33.260435+0000","last_peered":"2023-10-06T03:04:33.260435+0000","last_clean":"2023-10-06T03:04:33.260435+0000","last_became_active":"2023-10-06T03:04:29.251248+0000","last_became_peered":"2023-10-06T03:04:29.251248+0000","last_unstale":"2023-10-06T03:04:33.260435+0000","last_undegraded":"2023-10-06T03:04:33.260435+0000","last_fullsized":"2023-10-06T03:04:33.260435+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:27.111880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279649+0000","last_change":"2023-10-06T03:04:33.275681+0000","last_active":"2023-10-06T03:04:33.279649+0000","last_peered":"2023-10-06T03:04:33.279649+0000","last_clean":"2023-10-06T03:04:33.279649+0000","last_became_active":"2023-10-06T03:04:33.275300+0000","last_became_peered":"2023-10-06T03:04:33.275300+0000","last_unstale":"2023-10-06T03:04:33.279649+0000","last_undegraded":"2023-10-06T03:04:33.279649+0000","last_fullsized":"2023-10-06T03:04:33.279649+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:01:47.690080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.257944+0000","last_change":"2023-10-06T03:04:28.837159+0000","last_active":"2023-10-06T03:04:33.257944+0000","last_peered":"2023-10-06T03:04:33.257944+0000","last_clean":"2023-10-06T03:04:33.257944+0000","last_became_active":"2023-10-06T03:04:28.836765+0000","last_became_peered":"2023-10-06T03:04:28.836765+0000","last_unstale":"2023-10-06T03:04:33.257944+0000","last_undegraded":"2023-10-06T03:04:33.257944+0000","last_fullsized":"2023-10-06T03:04:33.257944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:53.804099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256426+0000","last_change":"2023-10-06T03:04:23.813862+0000","last_active":"2023-10-06T03:04:33.256426+0000","last_peered":"2023-10-06T03:04:33.256426+0000","last_clean":"2023-10-06T03:04:33.256426+0000","last_became_active":"2023-10-06T03:04:23.813584+0000","last_became_peered":"2023-10-06T03:04:23.813584+0000","last_unstale":"2023-10-06T03:04:33.256426+0000","last_undegraded":"2023-10-06T03:04:33.256426+0000","last_fullsized":"2023-10-06T03:04:33.256426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255681+0000","last_change":"2023-10-06T03:04:29.245915+0000","last_active":"2023-10-06T03:04:33.255681+0000","last_peered":"2023-10-06T03:04:33.255681+0000","last_clean":"2023-10-06T03:04:33.255681+0000","last_became_active":"2023-10-06T03:04:29.245657+0000","last_became_peered":"2023-10-06T03:04:29.245657+0000","last_unstale":"2023-10-06T03:04:33.255681+0000","last_undegraded":"2023-10-06T03:04:33.255681+0000","last_fullsized":"2023-10-06T03:04:33.255681+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:35.967726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274653+0000","last_change":"2023-10-06T03:04:33.269388+0000","last_active":"2023-10-06T03:04:33.274653+0000","last_peered":"2023-10-06T03:04:33.274653+0000","last_clean":"2023-10-06T03:04:33.274653+0000","last_became_active":"2023-10-06T03:04:33.268742+0000","last_became_peered":"2023-10-06T03:04:33.268742+0000","last_unstale":"2023-10-06T03:04:33.274653+0000","last_undegraded":"2023-10-06T03:04:33.274653+0000","last_fullsized":"2023-10-06T03:04:33.274653+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:18.722157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252616+0000","last_change":"2023-10-06T03:04:23.805874+0000","last_active":"2023-10-06T03:04:33.252616+0000","last_peered":"2023-10-06T03:04:33.252616+0000","last_clean":"2023-10-06T03:04:33.252616+0000","last_became_active":"2023-10-06T03:04:23.805551+0000","last_became_peered":"2023-10-06T03:04:23.805551+0000","last_unstale":"2023-10-06T03:04:33.252616+0000","last_undegraded":"2023-10-06T03:04:33.252616+0000","last_fullsized":"2023-10-06T03:04:33.252616+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:21.250275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.916228+0000","last_change":"2023-10-06T03:04:28.838956+0000","last_active":"2023-10-06T03:04:33.916228+0000","last_peered":"2023-10-06T03:04:33.916228+0000","last_clean":"2023-10-06T03:04:33.916228+0000","last_became_active":"2023-10-06T03:04:28.838653+0000","last_became_peered":"2023-10-06T03:04:28.838653+0000","last_unstale":"2023-10-06T03:04:33.916228+0000","last_undegraded":"2023-10-06T03:04:33.916228+0000","last_fullsized":"2023-10-06T03:04:33.916228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:32:01.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260316+0000","last_change":"2023-10-06T03:04:29.250642+0000","last_active":"2023-10-06T03:04:33.260316+0000","last_peered":"2023-10-06T03:04:33.260316+0000","last_clean":"2023-10-06T03:04:33.260316+0000","last_became_active":"2023-10-06T03:04:29.250128+0000","last_became_peered":"2023-10-06T03:04:29.250128+0000","last_unstale":"2023-10-06T03:04:33.260316+0000","last_undegraded":"2023-10-06T03:04:33.260316+0000","last_fullsized":"2023-10-06T03:04:33.260316+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:20:07.410542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279289+0000","last_change":"2023-10-06T03:04:33.277567+0000","last_active":"2023-10-06T03:04:33.279289+0000","last_peered":"2023-10-06T03:04:33.279289+0000","last_clean":"2023-10-06T03:04:33.279289+0000","last_became_active":"2023-10-06T03:04:33.277169+0000","last_became_peered":"2023-10-06T03:04:33.277169+0000","last_unstale":"2023-10-06T03:04:33.279289+0000","last_undegraded":"2023-10-06T03:04:33.279289+0000","last_fullsized":"2023-10-06T03:04:33.279289+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:27:38.040904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260456+0000","last_change":"2023-10-06T03:04:28.840794+0000","last_active":"2023-10-06T03:04:33.260456+0000","last_peered":"2023-10-06T03:04:33.260456+0000","last_clean":"2023-10-06T03:04:33.260456+0000","last_became_active":"2023-10-06T03:04:28.840573+0000","last_became_peered":"2023-10-06T03:04:28.840573+0000","last_unstale":"2023-10-06T03:04:33.260456+0000","last_undegraded":"2023-10-06T03:04:33.260456+0000","last_fullsized":"2023-10-06T03:04:33.260456+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:03:16.444923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256202+0000","last_change":"2023-10-06T03:04:29.248438+0000","last_active":"2023-10-06T03:04:33.256202+0000","last_peered":"2023-10-06T03:04:33.256202+0000","last_clean":"2023-10-06T03:04:33.256202+0000","last_became_active":"2023-10-06T03:04:29.248173+0000","last_became_peered":"2023-10-06T03:04:29.248173+0000","last_unstale":"2023-10-06T03:04:33.256202+0000","last_undegraded":"2023-10-06T03:04:33.256202+0000","last_fullsized":"2023-10-06T03:04:33.256202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:38:44.554979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.274467+0000","last_change":"2023-10-06T03:04:33.270323+0000","last_active":"2023-10-06T03:04:33.274467+0000","last_peered":"2023-10-06T03:04:33.274467+0000","last_clean":"2023-10-06T03:04:33.274467+0000","last_became_active":"2023-10-06T03:04:33.269918+0000","last_became_peered":"2023-10-06T03:04:33.269918+0000","last_unstale":"2023-10-06T03:04:33.274467+0000","last_undegraded":"2023-10-06T03:04:33.274467+0000","last_fullsized":"2023-10-06T03:04:33.274467+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:39:29.020898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247754+0000","last_change":"2023-10-06T03:04:28.838880+0000","last_active":"2023-10-06T03:04:33.247754+0000","last_peered":"2023-10-06T03:04:33.247754+0000","last_clean":"2023-10-06T03:04:33.247754+0000","last_became_active":"2023-10-06T03:04:28.838586+0000","last_became_peered":"2023-10-06T03:04:28.838586+0000","last_unstale":"2023-10-06T03:04:33.247754+0000","last_undegraded":"2023-10-06T03:04:33.247754+0000","last_fullsized":"2023-10-06T03:04:33.247754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:22:22.072997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.252124+0000","last_change":"2023-10-06T03:04:29.243720+0000","last_active":"2023-10-06T03:04:33.252124+0000","last_peered":"2023-10-06T03:04:33.252124+0000","last_clean":"2023-10-06T03:04:33.252124+0000","last_became_active":"2023-10-06T03:04:29.243445+0000","last_became_peered":"2023-10-06T03:04:29.243445+0000","last_unstale":"2023-10-06T03:04:33.252124+0000","last_undegraded":"2023-10-06T03:04:33.252124+0000","last_fullsized":"2023-10-06T03:04:33.252124+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:22.258796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.272233+0000","last_change":"2023-10-06T03:04:33.267993+0000","last_active":"2023-10-06T03:04:33.272233+0000","last_peered":"2023-10-06T03:04:33.272233+0000","last_clean":"2023-10-06T03:04:33.272233+0000","last_became_active":"2023-10-06T03:04:33.267548+0000","last_became_peered":"2023-10-06T03:04:33.267548+0000","last_unstale":"2023-10-06T03:04:33.272233+0000","last_undegraded":"2023-10-06T03:04:33.272233+0000","last_fullsized":"2023-10-06T03:04:33.272233+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:41:07.483381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.247563+0000","last_change":"2023-10-06T03:04:28.839397+0000","last_active":"2023-10-06T03:04:33.247563+0000","last_peered":"2023-10-06T03:04:33.247563+0000","last_clean":"2023-10-06T03:04:33.247563+0000","last_became_active":"2023-10-06T03:04:28.839121+0000","last_became_peered":"2023-10-06T03:04:28.839121+0000","last_unstale":"2023-10-06T03:04:33.247563+0000","last_undegraded":"2023-10-06T03:04:33.247563+0000","last_fullsized":"2023-10-06T03:04:33.247563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:30:19.451116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251017+0000","last_change":"2023-10-06T03:04:29.241780+0000","last_active":"2023-10-06T03:04:33.251017+0000","last_peered":"2023-10-06T03:04:33.251017+0000","last_clean":"2023-10-06T03:04:33.251017+0000","last_became_active":"2023-10-06T03:04:29.241462+0000","last_became_peered":"2023-10-06T03:04:29.241462+0000","last_unstale":"2023-10-06T03:04:33.251017+0000","last_undegraded":"2023-10-06T03:04:33.251017+0000","last_fullsized":"2023-10-06T03:04:33.251017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.270793+0000","last_change":"2023-10-06T03:04:33.266666+0000","last_active":"2023-10-06T03:04:33.270793+0000","last_peered":"2023-10-06T03:04:33.270793+0000","last_clean":"2023-10-06T03:04:33.270793+0000","last_became_active":"2023-10-06T03:04:33.266284+0000","last_became_peered":"2023-10-06T03:04:33.266284+0000","last_unstale":"2023-10-06T03:04:33.270793+0000","last_undegraded":"2023-10-06T03:04:33.270793+0000","last_fullsized":"2023-10-06T03:04:33.270793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:08:17.775172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256370+0000","last_change":"2023-10-06T03:04:28.833313+0000","last_active":"2023-10-06T03:04:33.256370+0000","last_peered":"2023-10-06T03:04:33.256370+0000","last_clean":"2023-10-06T03:04:33.256370+0000","last_became_active":"2023-10-06T03:04:28.832982+0000","last_became_peered":"2023-10-06T03:04:28.832982+0000","last_unstale":"2023-10-06T03:04:33.256370+0000","last_undegraded":"2023-10-06T03:04:33.256370+0000","last_fullsized":"2023-10-06T03:04:33.256370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:04.476704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255857+0000","last_change":"2023-10-06T03:04:29.237739+0000","last_active":"2023-10-06T03:04:33.255857+0000","last_peered":"2023-10-06T03:04:33.255857+0000","last_clean":"2023-10-06T03:04:33.255857+0000","last_became_active":"2023-10-06T03:04:29.237497+0000","last_became_peered":"2023-10-06T03:04:29.237497+0000","last_unstale":"2023-10-06T03:04:33.255857+0000","last_undegraded":"2023-10-06T03:04:33.255857+0000","last_fullsized":"2023-10-06T03:04:33.255857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:27.111880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.279027+0000","last_change":"2023-10-06T03:04:33.269307+0000","last_active":"2023-10-06T03:04:33.279027+0000","last_peered":"2023-10-06T03:04:33.279027+0000","last_clean":"2023-10-06T03:04:33.279027+0000","last_became_active":"2023-10-06T03:04:33.268876+0000","last_became_peered":"2023-10-06T03:04:33.268876+0000","last_unstale":"2023-10-06T03:04:33.279027+0000","last_undegraded":"2023-10-06T03:04:33.279027+0000","last_fullsized":"2023-10-06T03:04:33.279027+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:32.236742+0000","last_clean_scrub_stamp":"2023-10-06T03:04:32.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:53.801187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.260493+0000","last_change":"2023-10-06T03:04:28.839985+0000","last_active":"2023-10-06T03:04:33.260493+0000","last_peered":"2023-10-06T03:04:33.260493+0000","last_clean":"2023-10-06T03:04:33.260493+0000","last_became_active":"2023-10-06T03:04:28.839831+0000","last_became_peered":"2023-10-06T03:04:28.839831+0000","last_unstale":"2023-10-06T03:04:33.260493+0000","last_undegraded":"2023-10-06T03:04:33.260493+0000","last_fullsized":"2023-10-06T03:04:33.260493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:27.810686+0000","last_clean_scrub_stamp":"2023-10-06T03:04:27.810686+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:53:04.476704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251017+0000","last_change":"2023-10-06T03:04:29.242972+0000","last_active":"2023-10-06T03:04:33.251017+0000","last_peered":"2023-10-06T03:04:33.251017+0000","last_clean":"2023-10-06T03:04:33.251017+0000","last_became_active":"2023-10-06T03:04:29.242692+0000","last_became_peered":"2023-10-06T03:04:29.242692+0000","last_unstale":"2023-10-06T03:04:33.251017+0000","last_undegraded":"2023-10-06T03:04:33.251017+0000","last_fullsized":"2023-10-06T03:04:33.251017+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:22.493291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251832+0000","last_change":"2023-10-06T03:04:29.239473+0000","last_active":"2023-10-06T03:04:33.251832+0000","last_peered":"2023-10-06T03:04:33.251832+0000","last_clean":"2023-10-06T03:04:33.251832+0000","last_became_active":"2023-10-06T03:04:29.239195+0000","last_became_peered":"2023-10-06T03:04:29.239195+0000","last_unstale":"2023-10-06T03:04:33.251832+0000","last_undegraded":"2023-10-06T03:04:33.251832+0000","last_fullsized":"2023-10-06T03:04:33.251832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:38:44.554979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.255913+0000","last_change":"2023-10-06T03:04:29.248060+0000","last_active":"2023-10-06T03:04:33.255913+0000","last_peered":"2023-10-06T03:04:33.255913+0000","last_clean":"2023-10-06T03:04:33.255913+0000","last_became_active":"2023-10-06T03:04:29.247710+0000","last_became_peered":"2023-10-06T03:04:29.247710+0000","last_unstale":"2023-10-06T03:04:33.255913+0000","last_undegraded":"2023-10-06T03:04:33.255913+0000","last_fullsized":"2023-10-06T03:04:33.255913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:50:41.163677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.251328+0000","last_change":"2023-10-06T03:04:29.242391+0000","last_active":"2023-10-06T03:04:33.251328+0000","last_peered":"2023-10-06T03:04:33.251328+0000","last_clean":"2023-10-06T03:04:33.251328+0000","last_became_active":"2023-10-06T03:04:29.241939+0000","last_became_peered":"2023-10-06T03:04:29.241939+0000","last_unstale":"2023-10-06T03:04:33.251328+0000","last_undegraded":"2023-10-06T03:04:33.251328+0000","last_fullsized":"2023-10-06T03:04:33.251328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:22:15.057635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256253+0000","last_change":"2023-10-06T03:04:29.244909+0000","last_active":"2023-10-06T03:04:33.256253+0000","last_peered":"2023-10-06T03:04:33.256253+0000","last_clean":"2023-10-06T03:04:33.256253+0000","last_became_active":"2023-10-06T03:04:29.244666+0000","last_became_peered":"2023-10-06T03:04:29.244666+0000","last_unstale":"2023-10-06T03:04:33.256253+0000","last_undegraded":"2023-10-06T03:04:33.256253+0000","last_fullsized":"2023-10-06T03:04:33.256253+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:16.298020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-06T03:04:33.256973+0000","last_change":"2023-10-06T03:04:29.252885+0000","last_active":"2023-10-06T03:04:33.256973+0000","last_peered":"2023-10-06T03:04:33.256973+0000","last_clean":"2023-10-06T03:04:33.256973+0000","last_became_active":"2023-10-06T03:04:29.252697+0000","last_became_peered":"2023-10-06T03:04:29.252697+0000","last_unstale":"2023-10-06T03:04:33.256973+0000","last_undegraded":"2023-10-06T03:04:33.256973+0000","last_fullsized":"2023-10-06T03:04:33.256973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:28.816058+0000","last_clean_scrub_stamp":"2023-10-06T03:04:28.816058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:39:09.273458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4485,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":713872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8860000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9510000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1429999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.903}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.8220000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8929999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":709484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297572,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074268,"statfs":{"total":96636764160,"available":96332050432,"internally_reserved":0,"allocated":290816,"data_stored":119573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074264,"statfs":{"total":96636764160,"available":96332046336,"internally_reserved":0,"allocated":294912,"data_stored":119663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.649}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.679}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":123344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297580,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074260,"statfs":{"total":96636764160,"available":96332042240,"internally_reserved":0,"allocated":299008,"data_stored":120197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:04:48.223 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T03:04:48.223 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T03:04:48.223 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T03:04:48.223 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T03:04:48.374 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.372+0000 7f8ff4e62700 1 Processor -- start 2023-10-06T03:04:48.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.372+0000 7f8ff4e62700 1 -- start start 2023-10-06T03:04:48.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.373+0000 7f8ff4e62700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f8ff00ac670 0x7f8ff0158c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.373+0000 7f8ff4e62700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff0069110 con 0x7f8ff00c7250 2023-10-06T03:04:48.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.373+0000 7f8ff4e62700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff0067c70 con 0x7f8ff006ab10 2023-10-06T03:04:48.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.373+0000 7f8ff4e62700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff00c7800 con 0x7f8ff00ac670 2023-10-06T03:04:48.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.373+0000 7f8feed9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f8ff00c7250 0x7f8ff0159190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53246/0 (socket says 172.21.15.125:53246) 2023-10-06T03:04:48.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.373+0000 7f8feed9d700 1 -- 172.21.15.125:0/619617849 learned_addr learned my addr 172.21.15.125:0/619617849 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fed59a700 1 -- 172.21.15.125:0/619617849 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136605608 0 0) 0x7f8ff0069110 con 0x7f8ff00c7250 2023-10-06T03:04:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fed59a700 1 -- 172.21.15.125:0/619617849 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fd8003570 con 0x7f8ff00c7250 2023-10-06T03:04:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fedd9b700 1 --2- 172.21.15.125:0/619617849 >> v2:172.21.15.130:3300/0 conn(0x7f8ff00ac670 0x7f8ff0158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fed59a700 1 -- 172.21.15.125:0/619617849 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1896840715 0 0) 0x7f8fd8003570 con 0x7f8ff00c7250 2023-10-06T03:04:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fed59a700 1 -- 172.21.15.125:0/619617849 >> v2:172.21.15.130:3300/0 conn(0x7f8ff00ac670 msgr2=0x7f8ff0158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fed59a700 1 --2- 172.21.15.125:0/619617849 >> v2:172.21.15.130:3300/0 conn(0x7f8ff00ac670 0x7f8ff0158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fed59a700 1 -- 172.21.15.125:0/619617849 >> v1:172.21.15.130:6789/0 conn(0x7f8ff006ab10 legacy=0x7f8ff00c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fed59a700 1 -- 172.21.15.125:0/619617849 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff00c7ae0 con 0x7f8ff00c7250 2023-10-06T03:04:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fed59a700 1 -- 172.21.15.125:0/619617849 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f8fe80017f0 con 0x7f8ff00c7250 2023-10-06T03:04:48.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fed59a700 1 -- 172.21.15.125:0/619617849 >> v1:172.21.15.125:6789/0 conn(0x7f8ff00c7250 legacy=0x7f8ff0159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fed59a700 1 --2- 172.21.15.125:0/619617849 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8fd8003a60 0x7f8fd8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fed59a700 1 --2- 172.21.15.125:0/619617849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fd8004810 0x7f8fd8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fed59a700 1 --2- 172.21.15.125:0/619617849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd80051c0 0x7f8fd800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fed59a700 1 -- 172.21.15.125:0/619617849 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff00c7800 con 0x7f8fd8004810 2023-10-06T03:04:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fed59a700 1 -- 172.21.15.125:0/619617849 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd800c0d0 con 0x7f8fd80051c0 2023-10-06T03:04:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fed59a700 1 -- 172.21.15.125:0/619617849 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd800c290 con 0x7f8fd8003a60 2023-10-06T03:04:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fedd9b700 1 --2- 172.21.15.125:0/619617849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fd8004810 0x7f8fd8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8feed9d700 1 --2- 172.21.15.125:0/619617849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd80051c0 0x7f8fd800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fee59c700 1 --2- 172.21.15.125:0/619617849 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8fd8003a60 0x7f8fd8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fedd9b700 1 -- 172.21.15.125:0/619617849 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8fd8003a60 msgr2=0x7f8fd8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fedd9b700 1 --2- 172.21.15.125:0/619617849 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8fd8003a60 0x7f8fd8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fedd9b700 1 -- 172.21.15.125:0/619617849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd80051c0 msgr2=0x7f8fd800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fedd9b700 1 --2- 172.21.15.125:0/619617849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd80051c0 0x7f8fd800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8feed9d700 1 -- 172.21.15.125:0/619617849 reap_dead start 2023-10-06T03:04:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.374+0000 7f8fedd9b700 1 -- 172.21.15.125:0/619617849 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd8003570 con 0x7f8fd8004810 2023-10-06T03:04:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.375+0000 7f8fedd9b700 1 --2- 172.21.15.125:0/619617849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fd8004810 0x7f8fd8004c80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009c00 tx=0x7f8fe00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9485d7e56c2d3cbb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.375+0000 7f8fed59a700 1 -- 172.21.15.125:0/619617849 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe000e710 con 0x7f8fd8004810 2023-10-06T03:04:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.375+0000 7f8fed59a700 1 -- 172.21.15.125:0/619617849 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe000e870 con 0x7f8fd8004810 2023-10-06T03:04:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.375+0000 7f8fed59a700 1 -- 172.21.15.125:0/619617849 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe000ec30 con 0x7f8fd8004810 2023-10-06T03:04:48.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.375+0000 7f8ff4e62700 1 -- 172.21.15.125:0/619617849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fd8004810 msgr2=0x7f8fd8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.375+0000 7f8ff4e62700 1 --2- 172.21.15.125:0/619617849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fd8004810 0x7f8fd8004c80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009c00 tx=0x7f8fe00091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.375+0000 7f8ff4e62700 1 -- 172.21.15.125:0/619617849 shutdown_connections 2023-10-06T03:04:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.375+0000 7f8ff4e62700 1 --2- 172.21.15.125:0/619617849 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8fd8004810 0x7f8fd8004c80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.375+0000 7f8ff4e62700 1 -- 172.21.15.125:0/619617849 >> 172.21.15.125:0/619617849 conn(0x7f8ff00cc5a0 msgr2=0x7f8ff00cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.375+0000 7f8ff4e62700 1 -- 172.21.15.125:0/619617849 shutdown_connections 2023-10-06T03:04:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.375+0000 7f8ff4e62700 1 -- 172.21.15.125:0/619617849 wait complete. 2023-10-06T03:04:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.376+0000 7f8ff4e62700 1 Processor -- start 2023-10-06T03:04:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.377+0000 7f8ff4e62700 1 -- start start 2023-10-06T03:04:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.377+0000 7f8ff4e62700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd8004810 0x7f8ff0154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.377+0000 7f8ff4e62700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ff00ab0d0 0x7f8ff00cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.377+0000 7f8ff4e62700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff00ab540 0x7f8ff00cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.377+0000 7f8ff4e62700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff015be60 con 0x7f8ff00ab540 2023-10-06T03:04:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.377+0000 7f8ff4e62700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff015c140 con 0x7f8fd8004810 2023-10-06T03:04:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.377+0000 7f8ff4e62700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff015c420 con 0x7f8ff00ab0d0 2023-10-06T03:04:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.377+0000 7f8feed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff00ab540 0x7f8ff00cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.377+0000 7f8feed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff00ab540 0x7f8ff00cb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40496/0 (socket says 172.21.15.125:40496) 2023-10-06T03:04:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.377+0000 7f8feed9d700 1 -- 172.21.15.125:0/1036051068 learned_addr learned my addr 172.21.15.125:0/1036051068 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.377+0000 7f8fee59c700 1 --2- 172.21.15.125:0/1036051068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd8004810 0x7f8ff0154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.377+0000 7f8fedd9b700 1 --2- 172.21.15.125:0/1036051068 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ff00ab0d0 0x7f8ff00cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.378+0000 7f8feed9d700 1 -- 172.21.15.125:0/1036051068 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ff00ab0d0 msgr2=0x7f8ff00cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.378+0000 7f8feed9d700 1 --2- 172.21.15.125:0/1036051068 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ff00ab0d0 0x7f8ff00cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.378+0000 7f8feed9d700 1 -- 172.21.15.125:0/1036051068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd8004810 msgr2=0x7f8ff0154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.378+0000 7f8feed9d700 1 --2- 172.21.15.125:0/1036051068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd8004810 0x7f8ff0154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.378+0000 7f8feed9d700 1 -- 172.21.15.125:0/1036051068 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff015c700 con 0x7f8ff00ab540 2023-10-06T03:04:48.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.378+0000 7f8feed9d700 1 --2- 172.21.15.125:0/1036051068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff00ab540 0x7f8ff00cb790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8ff015df90 tx=0x7f8fe80021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:48.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.378+0000 7f8fde7fc700 1 -- 172.21.15.125:0/1036051068 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe800ae10 con 0x7f8ff00ab540 2023-10-06T03:04:48.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.378+0000 7f8fde7fc700 1 -- 172.21.15.125:0/1036051068 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe80133f0 con 0x7f8ff00ab540 2023-10-06T03:04:48.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.378+0000 7f8ff4e62700 1 -- 172.21.15.125:0/1036051068 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff01553b0 con 0x7f8ff00ab540 2023-10-06T03:04:48.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.378+0000 7f8fde7fc700 1 -- 172.21.15.125:0/1036051068 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8013790 con 0x7f8ff00ab540 2023-10-06T03:04:48.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.378+0000 7f8ff4e62700 1 -- 172.21.15.125:0/1036051068 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff00b0320 con 0x7f8ff00ab540 2023-10-06T03:04:48.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.379+0000 7f8ff4e62700 1 -- 172.21.15.125:0/1036051068 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff015c8f0 con 0x7f8ff00ab540 2023-10-06T03:04:48.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.379+0000 7f8fde7fc700 1 -- 172.21.15.125:0/1036051068 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8fe8013bc0 con 0x7f8ff00ab540 2023-10-06T03:04:48.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.380+0000 7f8fde7fc700 1 --2- 172.21.15.125:0/1036051068 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f8fd0066f30 0x7f8fd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.380+0000 7f8fde7fc700 1 -- 172.21.15.125:0/1036051068 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f8fe8085170 con 0x7f8ff00ab540 2023-10-06T03:04:48.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.380+0000 7f8fee59c700 1 --2- 172.21.15.125:0/1036051068 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f8fd0066f30 0x7f8fd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.380+0000 7f8fee59c700 1 --2- 172.21.15.125:0/1036051068 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f8fd0066f30 0x7f8fd00693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4000c00 tx=0x7f8fe4007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:48.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.384+0000 7f8fde7fc700 1 -- 172.21.15.125:0/1036051068 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8fe8052050 con 0x7f8ff00ab540 2023-10-06T03:04:48.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.605+0000 7f8ff4e62700 1 -- 172.21.15.125:0/1036051068 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8ff0066510 con 0x7f8ff00ab540 2023-10-06T03:04:48.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.606+0000 7f8fde7fc700 1 -- 172.21.15.125:0/1036051068 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8fe8055670 con 0x7f8ff00ab540 2023-10-06T03:04:48.607 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:48.608 INFO:teuthology.orchestra.run.smithi125.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T03:04:48.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.608+0000 7f8ff4e62700 1 -- 172.21.15.125:0/1036051068 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f8fd0066f30 msgr2=0x7f8fd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.608+0000 7f8ff4e62700 1 --2- 172.21.15.125:0/1036051068 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f8fd0066f30 0x7f8fd00693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4000c00 tx=0x7f8fe4007d30 comp rx=0 tx=0).stop 2023-10-06T03:04:48.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.608+0000 7f8ff4e62700 1 -- 172.21.15.125:0/1036051068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff00ab540 msgr2=0x7f8ff00cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.608+0000 7f8ff4e62700 1 --2- 172.21.15.125:0/1036051068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff00ab540 0x7f8ff00cb790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f8ff015df90 tx=0x7f8fe80021d0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.608+0000 7f8ff4e62700 1 -- 172.21.15.125:0/1036051068 shutdown_connections 2023-10-06T03:04:48.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.608+0000 7f8ff4e62700 1 --2- 172.21.15.125:0/1036051068 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f8fd0066f30 0x7f8fd00693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.608+0000 7f8ff4e62700 1 --2- 172.21.15.125:0/1036051068 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f8ff00ab540 0x7f8ff00cb790 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.608+0000 7f8ff4e62700 1 --2- 172.21.15.125:0/1036051068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8fd8004810 0x7f8ff0154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.608+0000 7f8ff4e62700 1 --2- 172.21.15.125:0/1036051068 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f8ff00ab0d0 0x7f8ff00cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.608+0000 7f8ff4e62700 1 -- 172.21.15.125:0/1036051068 >> 172.21.15.125:0/1036051068 conn(0x7f8ff00cc5a0 msgr2=0x7f8ff006e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:48.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.608+0000 7f8ff4e62700 1 -- 172.21.15.125:0/1036051068 shutdown_connections 2023-10-06T03:04:48.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.608+0000 7f8ff4e62700 1 -- 172.21.15.125:0/1036051068 wait complete. 2023-10-06T03:04:48.621 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T03:04:48.621 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:04:48.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.737+0000 7f24b74ed700 1 Processor -- start 2023-10-06T03:04:48.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.738+0000 7f24b74ed700 1 -- start start 2023-10-06T03:04:48.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.738+0000 7f24b74ed700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f24b01590d0 0x7f24b006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.738+0000 7f24b74ed700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24b00ac670 0x7f24b006ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.738+0000 7f24b74ed700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24b0067c70 con 0x7f24b01594a0 2023-10-06T03:04:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.738+0000 7f24b74ed700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24b0069110 con 0x7f24b01590d0 2023-10-06T03:04:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.738+0000 7f24b74ed700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b00c77e0 con 0x7f24b00ac670 2023-10-06T03:04:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.739+0000 7f24b5289700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f24b01590d0 0x7f24b006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.739+0000 7f24b5289700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f24b01590d0 0x7f24b006a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40508/0 (socket says 172.21.15.125:40508) 2023-10-06T03:04:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.739+0000 7f24b5289700 1 -- 172.21.15.125:0/4265597130 learned_addr learned my addr 172.21.15.125:0/4265597130 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.739+0000 7f24b4a88700 1 --2- 172.21.15.125:0/4265597130 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24b00ac670 0x7f24b006ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.739+0000 7f24b5289700 1 -- 172.21.15.125:0/4265597130 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24b00ac670 msgr2=0x7f24b006ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.739+0000 7f24b5289700 1 --2- 172.21.15.125:0/4265597130 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24b00ac670 0x7f24b006ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.739+0000 7f24b5289700 1 -- 172.21.15.125:0/4265597130 >> v1:172.21.15.130:6789/0 conn(0x7f24b01594a0 legacy=0x7f24b00c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.739+0000 7f24b5289700 1 -- 172.21.15.125:0/4265597130 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b00c7ac0 con 0x7f24b01590d0 2023-10-06T03:04:48.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.739+0000 7f24b5289700 1 --2- 172.21.15.125:0/4265597130 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24b01590d0 0x7f24b006a8c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f24a00099b0 tx=0x7f24a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3aed00444fd23f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:48.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.739+0000 7f24a7fff700 1 -- 172.21.15.125:0/4265597130 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a0009ea0 con 0x7f24b01590d0 2023-10-06T03:04:48.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.739+0000 7f24a7fff700 1 -- 172.21.15.125:0/4265597130 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a000b860 con 0x7f24b01590d0 2023-10-06T03:04:48.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.739+0000 7f24a7fff700 1 -- 172.21.15.125:0/4265597130 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a000bc00 con 0x7f24b01590d0 2023-10-06T03:04:48.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.740+0000 7f24b74ed700 1 -- 172.21.15.125:0/4265597130 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24b01590d0 msgr2=0x7f24b006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.740+0000 7f24b74ed700 1 --2- 172.21.15.125:0/4265597130 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24b01590d0 0x7f24b006a8c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f24a00099b0 tx=0x7f24a0009250 comp rx=0 tx=0).stop 2023-10-06T03:04:48.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.740+0000 7f24b74ed700 1 -- 172.21.15.125:0/4265597130 shutdown_connections 2023-10-06T03:04:48.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.740+0000 7f24b74ed700 1 --2- 172.21.15.125:0/4265597130 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24b01590d0 0x7f24b006a8c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.740+0000 7f24b74ed700 1 --2- 172.21.15.125:0/4265597130 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24b00ac670 0x7f24b006ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.740+0000 7f24b74ed700 1 -- 172.21.15.125:0/4265597130 >> 172.21.15.125:0/4265597130 conn(0x7f24b00cc5a0 msgr2=0x7f24b00cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:48.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.740+0000 7f24b74ed700 1 -- 172.21.15.125:0/4265597130 shutdown_connections 2023-10-06T03:04:48.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.740+0000 7f24b74ed700 1 -- 172.21.15.125:0/4265597130 wait complete. 2023-10-06T03:04:48.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.741+0000 7f24b74ed700 1 Processor -- start 2023-10-06T03:04:48.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.741+0000 7f24b74ed700 1 -- start start 2023-10-06T03:04:48.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.742+0000 7f24b74ed700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24b00ac670 0x7f24b00c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.742+0000 7f24b74ed700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24b01590d0 0x7f24b01515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.742+0000 7f24b74ed700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24b01594a0 0x7f24b0151b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.742+0000 7f24b74ed700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b00b2260 con 0x7f24b01590d0 2023-10-06T03:04:48.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.742+0000 7f24b74ed700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b00af350 con 0x7f24b00ac670 2023-10-06T03:04:48.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.742+0000 7f24b74ed700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24b00b01b0 con 0x7f24b01594a0 2023-10-06T03:04:48.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.742+0000 7f24b4a88700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24b01590d0 0x7f24b01515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.742+0000 7f24b4a88700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24b01590d0 0x7f24b01515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40524/0 (socket says 172.21.15.125:40524) 2023-10-06T03:04:48.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.742+0000 7f24b4a88700 1 -- 172.21.15.125:0/1552666028 learned_addr learned my addr 172.21.15.125:0/1552666028 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:48.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.742+0000 7f24b5a8a700 1 --2- 172.21.15.125:0/1552666028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24b01594a0 0x7f24b0151b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.742+0000 7f24b4a88700 1 -- 172.21.15.125:0/1552666028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24b01594a0 msgr2=0x7f24b0151b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.742+0000 7f24b5289700 1 --2- 172.21.15.125:0/1552666028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24b00ac670 0x7f24b00c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.742+0000 7f24b4a88700 1 --2- 172.21.15.125:0/1552666028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24b01594a0 0x7f24b0151b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.742+0000 7f24b4a88700 1 -- 172.21.15.125:0/1552666028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24b00ac670 msgr2=0x7f24b00c25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.742+0000 7f24b4a88700 1 --2- 172.21.15.125:0/1552666028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24b00ac670 0x7f24b00c25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.742+0000 7f24b4a88700 1 -- 172.21.15.125:0/1552666028 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a00094f0 con 0x7f24b01590d0 2023-10-06T03:04:48.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.742+0000 7f24b5289700 1 --2- 172.21.15.125:0/1552666028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24b00ac670 0x7f24b00c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:04:48.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.742+0000 7f24b4a88700 1 --2- 172.21.15.125:0/1552666028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24b01590d0 0x7f24b01515f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00ecb0 tx=0x7f24ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:48.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.742+0000 7f24a57fa700 1 -- 172.21.15.125:0/1552666028 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac00c9d0 con 0x7f24b01590d0 2023-10-06T03:04:48.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.743+0000 7f24a57fa700 1 -- 172.21.15.125:0/1552666028 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ac00cb30 con 0x7f24b01590d0 2023-10-06T03:04:48.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.743+0000 7f24a57fa700 1 -- 172.21.15.125:0/1552666028 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac00ced0 con 0x7f24b01590d0 2023-10-06T03:04:48.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.743+0000 7f24b74ed700 1 -- 172.21.15.125:0/1552666028 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b00af5a0 con 0x7f24b01590d0 2023-10-06T03:04:48.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.743+0000 7f24b74ed700 1 -- 172.21.15.125:0/1552666028 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b00afbe0 con 0x7f24b01590d0 2023-10-06T03:04:48.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.743+0000 7f24b74ed700 1 -- 172.21.15.125:0/1552666028 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24b0066510 con 0x7f24b01590d0 2023-10-06T03:04:48.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.744+0000 7f24a57fa700 1 -- 172.21.15.125:0/1552666028 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f24ac013680 con 0x7f24b01590d0 2023-10-06T03:04:48.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.744+0000 7f24a57fa700 1 --2- 172.21.15.125:0/1552666028 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2494066f30 0x7f24940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:48.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.744+0000 7f24a57fa700 1 -- 172.21.15.125:0/1552666028 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f24ac084d40 con 0x7f24b01590d0 2023-10-06T03:04:48.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.744+0000 7f24b5289700 1 --2- 172.21.15.125:0/1552666028 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2494066f30 0x7f24940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:48.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.745+0000 7f24b5289700 1 --2- 172.21.15.125:0/1552666028 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2494066f30 0x7f24940693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f24a00099b0 tx=0x7f24a0017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:48.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.749+0000 7f24a57fa700 1 -- 172.21.15.125:0/1552666028 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24ac051b60 con 0x7f24b01590d0 2023-10-06T03:04:48.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.932+0000 7f24b74ed700 1 -- 172.21.15.125:0/1552666028 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24b00b02f0 con 0x7f24b01590d0 2023-10-06T03:04:48.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.933+0000 7f24a57fa700 1 -- 172.21.15.125:0/1552666028 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18851 (secure 0 0 0) 0x7f24ac055180 con 0x7f24b01590d0 2023-10-06T03:04:48.956 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:48.956 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:33.645139+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:04:26.828121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:04:28.179225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:04:31.256394+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:04:48.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.935+0000 7f24b74ed700 1 -- 172.21.15.125:0/1552666028 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2494066f30 msgr2=0x7f24940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.935+0000 7f24b74ed700 1 --2- 172.21.15.125:0/1552666028 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2494066f30 0x7f24940693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f24a00099b0 tx=0x7f24a0017000 comp rx=0 tx=0).stop 2023-10-06T03:04:48.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.935+0000 7f24b74ed700 1 -- 172.21.15.125:0/1552666028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24b01590d0 msgr2=0x7f24b01515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:48.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.935+0000 7f24b74ed700 1 --2- 172.21.15.125:0/1552666028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24b01590d0 0x7f24b01515f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00ecb0 tx=0x7f24ac0091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.935+0000 7f24b74ed700 1 -- 172.21.15.125:0/1552666028 shutdown_connections 2023-10-06T03:04:48.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.935+0000 7f24b74ed700 1 --2- 172.21.15.125:0/1552666028 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2494066f30 0x7f24940693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.935+0000 7f24b74ed700 1 --2- 172.21.15.125:0/1552666028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f24b01594a0 0x7f24b0151b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.935+0000 7f24b74ed700 1 --2- 172.21.15.125:0/1552666028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24b00ac670 0x7f24b00c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.935+0000 7f24b74ed700 1 --2- 172.21.15.125:0/1552666028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f24b01590d0 0x7f24b01515f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:48.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.935+0000 7f24b74ed700 1 -- 172.21.15.125:0/1552666028 >> 172.21.15.125:0/1552666028 conn(0x7f24b00cc5a0 msgr2=0x7f24b01576f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:48.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.935+0000 7f24b74ed700 1 -- 172.21.15.125:0/1552666028 shutdown_connections 2023-10-06T03:04:48.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:48.935+0000 7f24b74ed700 1 -- 172.21.15.125:0/1552666028 wait complete. 2023-10-06T03:04:48.959 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:04:15.845430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:04:22.729795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:04:26.828121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:04:28.179225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:04:31.256394+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:04:48.959 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:04:49.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.078+0000 7f704684d700 1 Processor -- start 2023-10-06T03:04:49.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.078+0000 7f704684d700 1 -- start start 2023-10-06T03:04:49.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.079+0000 7f704684d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70400ad450 0x7f7040157670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:49.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.079+0000 7f704684d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f704006e120 0x7f7040157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:49.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.079+0000 7f704684d700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70400cbb90 con 0x7f70400ad080 2023-10-06T03:04:49.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.079+0000 7f704684d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7040158420 con 0x7f704006e120 2023-10-06T03:04:49.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.079+0000 7f704684d700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70400cbde0 con 0x7f70400ad450 2023-10-06T03:04:49.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.079+0000 7f7044dea700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f704006e120 0x7f7040157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:49.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.079+0000 7f7044dea700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f704006e120 0x7f7040157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40530/0 (socket says 172.21.15.125:40530) 2023-10-06T03:04:49.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.079+0000 7f7044dea700 1 -- 172.21.15.125:0/1561672881 learned_addr learned my addr 172.21.15.125:0/1561672881 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:49.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.079+0000 7f703f7fe700 1 --2- 172.21.15.125:0/1561672881 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70400ad450 0x7f7040157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:49.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.079+0000 7f7044dea700 1 -- 172.21.15.125:0/1561672881 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70400ad450 msgr2=0x7f7040157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:49.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.079+0000 7f7044dea700 1 --2- 172.21.15.125:0/1561672881 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70400ad450 0x7f7040157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.079+0000 7f7044dea700 1 -- 172.21.15.125:0/1561672881 >> v1:172.21.15.130:6789/0 conn(0x7f70400ad080 legacy=0x7f704006da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:49.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.079+0000 7f7044dea700 1 -- 172.21.15.125:0/1561672881 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70400cc0c0 con 0x7f704006e120 2023-10-06T03:04:49.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.079+0000 7f7044dea700 1 --2- 172.21.15.125:0/1561672881 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f704006e120 0x7f7040157bb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7038009f20 tx=0x7f7038009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d019b7a8d06df7cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:49.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.079+0000 7f703effd700 1 -- 172.21.15.125:0/1561672881 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703800e070 con 0x7f704006e120 2023-10-06T03:04:49.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.080+0000 7f703effd700 1 -- 172.21.15.125:0/1561672881 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703800b9d0 con 0x7f704006e120 2023-10-06T03:04:49.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.080+0000 7f703effd700 1 -- 172.21.15.125:0/1561672881 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70380092e0 con 0x7f704006e120 2023-10-06T03:04:49.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.080+0000 7f704684d700 1 -- 172.21.15.125:0/1561672881 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f704006e120 msgr2=0x7f7040157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:49.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.080+0000 7f704684d700 1 --2- 172.21.15.125:0/1561672881 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f704006e120 0x7f7040157bb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7038009f20 tx=0x7f7038009840 comp rx=0 tx=0).stop 2023-10-06T03:04:49.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.080+0000 7f704684d700 1 -- 172.21.15.125:0/1561672881 shutdown_connections 2023-10-06T03:04:49.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.080+0000 7f704684d700 1 --2- 172.21.15.125:0/1561672881 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f704006e120 0x7f7040157bb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.080+0000 7f704684d700 1 --2- 172.21.15.125:0/1561672881 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70400ad450 0x7f7040157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.080+0000 7f704684d700 1 -- 172.21.15.125:0/1561672881 >> 172.21.15.125:0/1561672881 conn(0x7f70400cea90 msgr2=0x7f704006c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:49.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.080+0000 7f704684d700 1 -- 172.21.15.125:0/1561672881 shutdown_connections 2023-10-06T03:04:49.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.080+0000 7f704684d700 1 -- 172.21.15.125:0/1561672881 wait complete. 2023-10-06T03:04:49.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.081+0000 7f704684d700 1 Processor -- start 2023-10-06T03:04:49.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.081+0000 7f704684d700 1 -- start start 2023-10-06T03:04:49.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.082+0000 7f704684d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f704006e120 0x7f70400aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:49.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.082+0000 7f704684d700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70400ad080 0x7f7040068d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:49.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.082+0000 7f704684d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70400ad450 0x7f7040069260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:49.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.082+0000 7f704684d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70400697a0 con 0x7f704006e120 2023-10-06T03:04:49.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.082+0000 7f704684d700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7040068720 con 0x7f70400ad080 2023-10-06T03:04:49.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.082+0000 7f704684d700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7040169fb0 con 0x7f70400ad450 2023-10-06T03:04:49.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.082+0000 7f703ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f704006e120 0x7f70400aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:49.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.082+0000 7f703ffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f704006e120 0x7f70400aee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40532/0 (socket says 172.21.15.125:40532) 2023-10-06T03:04:49.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.082+0000 7f703ffff700 1 -- 172.21.15.125:0/2313207017 learned_addr learned my addr 172.21.15.125:0/2313207017 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:49.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.082+0000 7f7044dea700 1 --2- 172.21.15.125:0/2313207017 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70400ad450 0x7f7040069260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:49.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.082+0000 7f703f7fe700 1 --2- 172.21.15.125:0/2313207017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70400ad080 0x7f7040068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:49.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.083+0000 7f703ffff700 1 -- 172.21.15.125:0/2313207017 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70400ad450 msgr2=0x7f7040069260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:49.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.083+0000 7f703ffff700 1 --2- 172.21.15.125:0/2313207017 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70400ad450 0x7f7040069260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.083+0000 7f703ffff700 1 -- 172.21.15.125:0/2313207017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70400ad080 msgr2=0x7f7040068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:49.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.083+0000 7f703ffff700 1 --2- 172.21.15.125:0/2313207017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70400ad080 0x7f7040068d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.083+0000 7f703ffff700 1 -- 172.21.15.125:0/2313207017 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7038009ae0 con 0x7f704006e120 2023-10-06T03:04:49.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.083+0000 7f7044dea700 1 --2- 172.21.15.125:0/2313207017 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70400ad450 0x7f7040069260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:49.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.083+0000 7f703ffff700 1 --2- 172.21.15.125:0/2313207017 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f704006e120 0x7f70400aee30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f703400c590 tx=0x7f703400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:49.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.083+0000 7f7027fff700 1 -- 172.21.15.125:0/2313207017 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034011590 con 0x7f704006e120 2023-10-06T03:04:49.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.083+0000 7f7027fff700 1 -- 172.21.15.125:0/2313207017 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70340116f0 con 0x7f704006e120 2023-10-06T03:04:49.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.083+0000 7f704684d700 1 -- 172.21.15.125:0/2313207017 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70400c7670 con 0x7f704006e120 2023-10-06T03:04:49.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.083+0000 7f7027fff700 1 -- 172.21.15.125:0/2313207017 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7034011ab0 con 0x7f704006e120 2023-10-06T03:04:49.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.083+0000 7f704684d700 1 -- 172.21.15.125:0/2313207017 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70401694f0 con 0x7f704006e120 2023-10-06T03:04:49.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.084+0000 7f704684d700 1 -- 172.21.15.125:0/2313207017 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7040169e20 con 0x7f704006e120 2023-10-06T03:04:49.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.084+0000 7f7027fff700 1 -- 172.21.15.125:0/2313207017 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f703401b3b0 con 0x7f704006e120 2023-10-06T03:04:49.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.085+0000 7f7027fff700 1 --2- 172.21.15.125:0/2313207017 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f702c066f30 0x7f702c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:49.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.085+0000 7f7027fff700 1 -- 172.21.15.125:0/2313207017 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7034083f10 con 0x7f704006e120 2023-10-06T03:04:49.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.085+0000 7f703f7fe700 1 --2- 172.21.15.125:0/2313207017 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f702c066f30 0x7f702c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:49.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.085+0000 7f703f7fe700 1 --2- 172.21.15.125:0/2313207017 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f702c066f30 0x7f702c0693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f70400c47f0 tx=0x7f7030008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:49.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.089+0000 7f7027fff700 1 -- 172.21.15.125:0/2313207017 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7034050d30 con 0x7f704006e120 2023-10-06T03:04:49.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.273+0000 7f704684d700 1 -- 172.21.15.125:0/2313207017 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7040066510 con 0x7f704006e120 2023-10-06T03:04:49.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.274+0000 7f7027fff700 1 -- 172.21.15.125:0/2313207017 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7034017070 con 0x7f704006e120 2023-10-06T03:04:49.275 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-06T03:04:49.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.276+0000 7f704684d700 1 -- 172.21.15.125:0/2313207017 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f702c066f30 msgr2=0x7f702c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:49.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.276+0000 7f704684d700 1 --2- 172.21.15.125:0/2313207017 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f702c066f30 0x7f702c0693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f70400c47f0 tx=0x7f7030008040 comp rx=0 tx=0).stop 2023-10-06T03:04:49.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.276+0000 7f704684d700 1 -- 172.21.15.125:0/2313207017 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f704006e120 msgr2=0x7f70400aee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:49.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.276+0000 7f704684d700 1 --2- 172.21.15.125:0/2313207017 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f704006e120 0x7f70400aee30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f703400c590 tx=0x7f703400c950 comp rx=0 tx=0).stop 2023-10-06T03:04:49.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.276+0000 7f704684d700 1 -- 172.21.15.125:0/2313207017 shutdown_connections 2023-10-06T03:04:49.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.276+0000 7f704684d700 1 --2- 172.21.15.125:0/2313207017 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f702c066f30 0x7f702c0693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.276+0000 7f704684d700 1 --2- 172.21.15.125:0/2313207017 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f70400ad450 0x7f7040069260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.276+0000 7f704684d700 1 --2- 172.21.15.125:0/2313207017 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f704006e120 0x7f70400aee30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.276+0000 7f704684d700 1 --2- 172.21.15.125:0/2313207017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70400ad080 0x7f7040068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.276+0000 7f704684d700 1 -- 172.21.15.125:0/2313207017 >> 172.21.15.125:0/2313207017 conn(0x7f70400cea90 msgr2=0x7f70401565d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:49.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.276+0000 7f704684d700 1 -- 172.21.15.125:0/2313207017 shutdown_connections 2023-10-06T03:04:49.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.276+0000 7f704684d700 1 -- 172.21.15.125:0/2313207017 wait complete. 2023-10-06T03:04:49.289 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:04:49.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.409+0000 7fad0c882700 1 Processor -- start 2023-10-06T03:04:49.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.409+0000 7fad0c882700 1 -- start start 2023-10-06T03:04:49.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.410+0000 7fad0c882700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad081591d0 0x7fad080b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:49.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.410+0000 7fad0c882700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad080cc7f0 0x7fad080ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:49.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.410+0000 7fad0c882700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad080cc360 con 0x7fad081595a0 2023-10-06T03:04:49.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.410+0000 7fad0c882700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad080cba70 con 0x7fad081591d0 2023-10-06T03:04:49.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.410+0000 7fad0c882700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad080b2740 con 0x7fad080cc7f0 2023-10-06T03:04:49.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.410+0000 7fad0659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad081591d0 0x7fad080b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:49.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.410+0000 7fad05d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fad081595a0 0x7fad080b2030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53254/0 (socket says 172.21.15.125:53254) 2023-10-06T03:04:49.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.410+0000 7fad05d9b700 1 -- 172.21.15.125:0/4052515915 learned_addr learned my addr 172.21.15.125:0/4052515915 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:49.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.410+0000 7fad0559a700 1 -- 172.21.15.125:0/4052515915 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769146970 0 0) 0x7fad080cc360 con 0x7fad081595a0 2023-10-06T03:04:49.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.410+0000 7fad0559a700 1 -- 172.21.15.125:0/4052515915 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facf0003570 con 0x7fad081595a0 2023-10-06T03:04:49.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.410+0000 7fad06d9d700 1 --2- 172.21.15.125:0/4052515915 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad080cc7f0 0x7fad080ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:49.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.411+0000 7fad0659c700 1 -- 172.21.15.125:0/4052515915 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad080cc7f0 msgr2=0x7fad080ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:49.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.411+0000 7fad0659c700 1 --2- 172.21.15.125:0/4052515915 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad080cc7f0 0x7fad080ccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.411+0000 7fad0659c700 1 -- 172.21.15.125:0/4052515915 >> v1:172.21.15.125:6789/0 conn(0x7fad081595a0 legacy=0x7fad080b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:49.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.411+0000 7fad0659c700 1 -- 172.21.15.125:0/4052515915 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad080cbd10 con 0x7fad081591d0 2023-10-06T03:04:49.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.411+0000 7fad0659c700 1 --2- 172.21.15.125:0/4052515915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad081591d0 0x7fad080b2f50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7facfc0098d0 tx=0x7facfc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af68bc384c9a12f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:49.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.411+0000 7fad0559a700 1 -- 172.21.15.125:0/4052515915 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc005c10 con 0x7fad081591d0 2023-10-06T03:04:49.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.411+0000 7fad0559a700 1 -- 172.21.15.125:0/4052515915 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc005d70 con 0x7fad081591d0 2023-10-06T03:04:49.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.411+0000 7fad0559a700 1 -- 172.21.15.125:0/4052515915 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc006280 con 0x7fad081591d0 2023-10-06T03:04:49.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.411+0000 7fad0c882700 1 -- 172.21.15.125:0/4052515915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad081591d0 msgr2=0x7fad080b2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:49.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.411+0000 7fad0c882700 1 --2- 172.21.15.125:0/4052515915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad081591d0 0x7fad080b2f50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7facfc0098d0 tx=0x7facfc009120 comp rx=0 tx=0).stop 2023-10-06T03:04:49.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.411+0000 7fad0c882700 1 -- 172.21.15.125:0/4052515915 shutdown_connections 2023-10-06T03:04:49.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.411+0000 7fad0c882700 1 --2- 172.21.15.125:0/4052515915 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad080cc7f0 0x7fad080ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.411+0000 7fad0c882700 1 --2- 172.21.15.125:0/4052515915 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad081591d0 0x7fad080b2f50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.411+0000 7fad0c882700 1 -- 172.21.15.125:0/4052515915 >> 172.21.15.125:0/4052515915 conn(0x7fad0806ed40 msgr2=0x7fad0806f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:49.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.411+0000 7fad0c882700 1 -- 172.21.15.125:0/4052515915 shutdown_connections 2023-10-06T03:04:49.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.411+0000 7fad0c882700 1 -- 172.21.15.125:0/4052515915 wait complete. 2023-10-06T03:04:49.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.412+0000 7fad0c882700 1 Processor -- start 2023-10-06T03:04:49.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.413+0000 7fad0c882700 1 -- start start 2023-10-06T03:04:49.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.413+0000 7fad0c882700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad080cc7f0 0x7fad08153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:49.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.413+0000 7fad0c882700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad081591d0 0x7fad08157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:49.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.413+0000 7fad0c882700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad081595a0 0x7fad080b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:49.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.413+0000 7fad0c882700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad08156ee0 con 0x7fad081595a0 2023-10-06T03:04:49.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.413+0000 7fad0c882700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad081571c0 con 0x7fad081591d0 2023-10-06T03:04:49.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.413+0000 7fad0c882700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad081574a0 con 0x7fad080cc7f0 2023-10-06T03:04:49.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.413+0000 7fad06d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad081595a0 0x7fad080b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:49.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.413+0000 7fad06d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad081595a0 0x7fad080b3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40564/0 (socket says 172.21.15.125:40564) 2023-10-06T03:04:49.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.413+0000 7fad06d9d700 1 -- 172.21.15.125:0/831632206 learned_addr learned my addr 172.21.15.125:0/831632206 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:49.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.413+0000 7fad05d9b700 1 --2- 172.21.15.125:0/831632206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad081591d0 0x7fad08157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:49.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.413+0000 7fad0659c700 1 --2- 172.21.15.125:0/831632206 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad080cc7f0 0x7fad08153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:49.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.414+0000 7fad06d9d700 1 -- 172.21.15.125:0/831632206 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad080cc7f0 msgr2=0x7fad08153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:49.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.414+0000 7fad06d9d700 1 --2- 172.21.15.125:0/831632206 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad080cc7f0 0x7fad08153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.414+0000 7fad06d9d700 1 -- 172.21.15.125:0/831632206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad081591d0 msgr2=0x7fad08157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.414+0000 7fad06d9d700 1 --2- 172.21.15.125:0/831632206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad081591d0 0x7fad08157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.414+0000 7fad06d9d700 1 -- 172.21.15.125:0/831632206 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc0093c0 con 0x7fad081595a0 2023-10-06T03:04:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.414+0000 7fad06d9d700 1 --2- 172.21.15.125:0/831632206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad081595a0 0x7fad080b3540 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fad0000ceb0 tx=0x7fad00007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.414+0000 7facf67fc700 1 -- 172.21.15.125:0/831632206 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0000ad90 con 0x7fad081595a0 2023-10-06T03:04:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.414+0000 7facf67fc700 1 -- 172.21.15.125:0/831632206 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad00016430 con 0x7fad081595a0 2023-10-06T03:04:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.414+0000 7facf67fc700 1 -- 172.21.15.125:0/831632206 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad000167d0 con 0x7fad081595a0 2023-10-06T03:04:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.414+0000 7fad0c882700 1 -- 172.21.15.125:0/831632206 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad08157780 con 0x7fad081595a0 2023-10-06T03:04:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.414+0000 7fad0c882700 1 -- 172.21.15.125:0/831632206 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad081581e0 con 0x7fad081595a0 2023-10-06T03:04:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.415+0000 7fad0c882700 1 -- 172.21.15.125:0/831632206 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad08157020 con 0x7fad081595a0 2023-10-06T03:04:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.415+0000 7facf67fc700 1 -- 172.21.15.125:0/831632206 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad00003020 con 0x7fad081595a0 2023-10-06T03:04:49.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.416+0000 7facf67fc700 1 --2- 172.21.15.125:0/831632206 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7face8066f30 0x7face80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:49.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.416+0000 7facf67fc700 1 -- 172.21.15.125:0/831632206 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fad00012070 con 0x7fad081595a0 2023-10-06T03:04:49.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.416+0000 7fad0659c700 1 --2- 172.21.15.125:0/831632206 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7face8066f30 0x7face80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:49.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.416+0000 7fad0659c700 1 --2- 172.21.15.125:0/831632206 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7face8066f30 0x7face80693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7facfc009160 tx=0x7facfc016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:49.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.420+0000 7facf67fc700 1 -- 172.21.15.125:0/831632206 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad08157020 con 0x7fad081595a0 2023-10-06T03:04:49.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.600+0000 7fad0c882700 1 -- 172.21.15.125:0/831632206 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fad08157020 con 0x7fad081595a0 2023-10-06T03:04:49.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.601+0000 7facf67fc700 1 -- 172.21.15.125:0/831632206 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fad08157020 con 0x7fad081595a0 2023-10-06T03:04:49.603 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-06T03:04:49.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.603+0000 7fad0c882700 1 -- 172.21.15.125:0/831632206 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7face8066f30 msgr2=0x7face80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:49.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.603+0000 7fad0c882700 1 --2- 172.21.15.125:0/831632206 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7face8066f30 0x7face80693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7facfc009160 tx=0x7facfc016000 comp rx=0 tx=0).stop 2023-10-06T03:04:49.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.603+0000 7fad0c882700 1 -- 172.21.15.125:0/831632206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad081595a0 msgr2=0x7fad080b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:49.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.603+0000 7fad0c882700 1 --2- 172.21.15.125:0/831632206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad081595a0 0x7fad080b3540 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fad0000ceb0 tx=0x7fad00007870 comp rx=0 tx=0).stop 2023-10-06T03:04:49.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.603+0000 7fad0c882700 1 -- 172.21.15.125:0/831632206 shutdown_connections 2023-10-06T03:04:49.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.603+0000 7fad0c882700 1 --2- 172.21.15.125:0/831632206 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7face8066f30 0x7face80693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.603+0000 7fad0c882700 1 --2- 172.21.15.125:0/831632206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad081595a0 0x7fad080b3540 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.603+0000 7fad0c882700 1 --2- 172.21.15.125:0/831632206 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad080cc7f0 0x7fad08153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.603+0000 7fad0c882700 1 --2- 172.21.15.125:0/831632206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad081591d0 0x7fad08157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.603+0000 7fad0c882700 1 -- 172.21.15.125:0/831632206 >> 172.21.15.125:0/831632206 conn(0x7fad0806ed40 msgr2=0x7fad08068cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:49.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.603+0000 7fad0c882700 1 -- 172.21.15.125:0/831632206 shutdown_connections 2023-10-06T03:04:49.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.603+0000 7fad0c882700 1 -- 172.21.15.125:0/831632206 wait complete. 2023-10-06T03:04:49.616 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:04:49.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.735+0000 7f1adfb11700 1 Processor -- start 2023-10-06T03:04:49.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.735+0000 7f1adfb11700 1 -- start start 2023-10-06T03:04:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.736+0000 7f1adfb11700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1ad8157300 0x7f1ad80b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.736+0000 7f1adfb11700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1ad81576d0 0x7f1ad80684c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.736+0000 7f1adfb11700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ad8068a00 0x7f1ad80a92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.736+0000 7f1adfb11700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad8068e60 con 0x7f1ad8157300 2023-10-06T03:04:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.736+0000 7f1adfb11700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad80aa760 con 0x7f1ad81576d0 2023-10-06T03:04:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.736+0000 7f1adfb11700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80aaa40 con 0x7f1ad8068a00 2023-10-06T03:04:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.736+0000 7f1add8ad700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1ad8157300 0x7f1ad80b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.736+0000 7f1add8ad700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1ad8157300 0x7f1ad80b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40570/0 (socket says 172.21.15.125:40570) 2023-10-06T03:04:49.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.736+0000 7f1add8ad700 1 -- 172.21.15.125:0/4174263254 learned_addr learned my addr 172.21.15.125:0/4174263254 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:49.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.736+0000 7f1ade0ae700 1 --2- 172.21.15.125:0/4174263254 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ad8068a00 0x7f1ad80a92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:49.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.736+0000 7f1add0ac700 1 --2- 172.21.15.125:0/4174263254 >> v2:172.21.15.130:3300/0 conn(0x7f1ad81576d0 0x7f1ad80684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:49.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.736+0000 7f1add8ad700 1 -- 172.21.15.125:0/4174263254 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ad8068a00 msgr2=0x7f1ad80a92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:49.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.736+0000 7f1add8ad700 1 --2- 172.21.15.125:0/4174263254 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ad8068a00 0x7f1ad80a92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.736+0000 7f1add8ad700 1 -- 172.21.15.125:0/4174263254 >> v2:172.21.15.130:3300/0 conn(0x7f1ad81576d0 msgr2=0x7f1ad80684c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:49.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.736+0000 7f1add8ad700 1 --2- 172.21.15.125:0/4174263254 >> v2:172.21.15.130:3300/0 conn(0x7f1ad81576d0 0x7f1ad80684c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.736+0000 7f1add8ad700 1 -- 172.21.15.125:0/4174263254 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad80aad20 con 0x7f1ad8157300 2023-10-06T03:04:49.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.736+0000 7f1add8ad700 1 --2- 172.21.15.125:0/4174263254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ad8157300 0x7f1ad80b0240 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80b0780 tx=0x7f1ad4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c456e757b983ffad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:49.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.737+0000 7f1adc8ab700 1 -- 172.21.15.125:0/4174263254 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4005c10 con 0x7f1ad8157300 2023-10-06T03:04:49.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.737+0000 7f1adc8ab700 1 -- 172.21.15.125:0/4174263254 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad4005d70 con 0x7f1ad8157300 2023-10-06T03:04:49.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.737+0000 7f1adc8ab700 1 -- 172.21.15.125:0/4174263254 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad400b880 con 0x7f1ad8157300 2023-10-06T03:04:49.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.737+0000 7f1adfb11700 1 -- 172.21.15.125:0/4174263254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ad8157300 msgr2=0x7f1ad80b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:49.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.737+0000 7f1adfb11700 1 --2- 172.21.15.125:0/4174263254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ad8157300 0x7f1ad80b0240 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80b0780 tx=0x7f1ad4009220 comp rx=0 tx=0).stop 2023-10-06T03:04:49.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.737+0000 7f1adfb11700 1 -- 172.21.15.125:0/4174263254 shutdown_connections 2023-10-06T03:04:49.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.737+0000 7f1adfb11700 1 --2- 172.21.15.125:0/4174263254 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ad8068a00 0x7f1ad80a92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.737+0000 7f1adfb11700 1 --2- 172.21.15.125:0/4174263254 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ad8157300 0x7f1ad80b0240 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.737+0000 7f1adfb11700 1 --2- 172.21.15.125:0/4174263254 >> v2:172.21.15.130:3300/0 conn(0x7f1ad81576d0 0x7f1ad80684c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.737+0000 7f1adfb11700 1 -- 172.21.15.125:0/4174263254 >> 172.21.15.125:0/4174263254 conn(0x7f1ad80af730 msgr2=0x7f1ad80afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:49.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.737+0000 7f1adfb11700 1 -- 172.21.15.125:0/4174263254 shutdown_connections 2023-10-06T03:04:49.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.737+0000 7f1adfb11700 1 -- 172.21.15.125:0/4174263254 wait complete. 2023-10-06T03:04:49.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.739+0000 7f1adfb11700 1 Processor -- start 2023-10-06T03:04:49.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.739+0000 7f1adfb11700 1 -- start start 2023-10-06T03:04:49.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1adfb11700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ad8068a00 0x7f1ad8098070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:49.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1adfb11700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ad8157300 0x7f1ad80c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:49.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1adfb11700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ad81576d0 0x7f1ad816aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:49.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1adfb11700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80c7190 con 0x7f1ad8068a00 2023-10-06T03:04:49.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1adfb11700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8099e40 con 0x7f1ad8157300 2023-10-06T03:04:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1adfb11700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad809a120 con 0x7f1ad81576d0 2023-10-06T03:04:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1add8ad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ad8068a00 0x7f1ad8098070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1add8ad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ad8068a00 0x7f1ad8098070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40574/0 (socket says 172.21.15.125:40574) 2023-10-06T03:04:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1add8ad700 1 -- 172.21.15.125:0/3648020369 learned_addr learned my addr 172.21.15.125:0/3648020369 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1ade0ae700 1 --2- 172.21.15.125:0/3648020369 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ad81576d0 0x7f1ad816aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1add0ac700 1 --2- 172.21.15.125:0/3648020369 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ad8157300 0x7f1ad80c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1add8ad700 1 -- 172.21.15.125:0/3648020369 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ad81576d0 msgr2=0x7f1ad816aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1add8ad700 1 --2- 172.21.15.125:0/3648020369 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ad81576d0 0x7f1ad816aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1add8ad700 1 -- 172.21.15.125:0/3648020369 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ad8157300 msgr2=0x7f1ad80c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1add8ad700 1 --2- 172.21.15.125:0/3648020369 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ad8157300 0x7f1ad80c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1add8ad700 1 -- 172.21.15.125:0/3648020369 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4009480 con 0x7f1ad8068a00 2023-10-06T03:04:49.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1add8ad700 1 --2- 172.21.15.125:0/3648020369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ad8068a00 0x7f1ad8098070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400b3c0 tx=0x7f1ad4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:49.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1acdffb700 1 -- 172.21.15.125:0/3648020369 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4011740 con 0x7f1ad8068a00 2023-10-06T03:04:49.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1acdffb700 1 -- 172.21.15.125:0/3648020369 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad4020070 con 0x7f1ad8068a00 2023-10-06T03:04:49.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1acdffb700 1 -- 172.21.15.125:0/3648020369 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4011ad0 con 0x7f1ad8068a00 2023-10-06T03:04:49.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.740+0000 7f1adfb11700 1 -- 172.21.15.125:0/3648020369 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad80c6e20 con 0x7f1ad8068a00 2023-10-06T03:04:49.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.741+0000 7f1adfb11700 1 -- 172.21.15.125:0/3648020369 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad80c9500 con 0x7f1ad8068a00 2023-10-06T03:04:49.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.741+0000 7f1adfb11700 1 -- 172.21.15.125:0/3648020369 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad80c6c80 con 0x7f1ad8068a00 2023-10-06T03:04:49.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.742+0000 7f1acdffb700 1 -- 172.21.15.125:0/3648020369 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ad4022030 con 0x7f1ad8068a00 2023-10-06T03:04:49.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.742+0000 7f1acdffb700 1 --2- 172.21.15.125:0/3648020369 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1abc066f30 0x7f1abc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:49.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.742+0000 7f1acdffb700 1 -- 172.21.15.125:0/3648020369 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1ad40863f0 con 0x7f1ad8068a00 2023-10-06T03:04:49.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.742+0000 7f1add0ac700 1 --2- 172.21.15.125:0/3648020369 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1abc066f30 0x7f1abc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:49.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.743+0000 7f1add0ac700 1 --2- 172.21.15.125:0/3648020369 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1abc066f30 0x7f1abc0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8156540 tx=0x7f1ac8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:49.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.747+0000 7f1acdffb700 1 -- 172.21.15.125:0/3648020369 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ad80c6c80 con 0x7f1ad8068a00 2023-10-06T03:04:49.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.929+0000 7f1adfb11700 1 -- 172.21.15.125:0/3648020369 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1ad80c6c80 con 0x7f1ad8068a00 2023-10-06T03:04:49.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.929+0000 7f1acdffb700 1 -- 172.21.15.125:0/3648020369 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ad80c6c80 con 0x7f1ad8068a00 2023-10-06T03:04:49.931 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-06T03:04:49.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.931+0000 7f1adfb11700 1 -- 172.21.15.125:0/3648020369 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1abc066f30 msgr2=0x7f1abc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:49.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.931+0000 7f1adfb11700 1 --2- 172.21.15.125:0/3648020369 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1abc066f30 0x7f1abc0693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8156540 tx=0x7f1ac8008040 comp rx=0 tx=0).stop 2023-10-06T03:04:49.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.931+0000 7f1adfb11700 1 -- 172.21.15.125:0/3648020369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ad8068a00 msgr2=0x7f1ad8098070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:49.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.931+0000 7f1adfb11700 1 --2- 172.21.15.125:0/3648020369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ad8068a00 0x7f1ad8098070 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400b3c0 tx=0x7f1ad4016000 comp rx=0 tx=0).stop 2023-10-06T03:04:49.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.931+0000 7f1adfb11700 1 -- 172.21.15.125:0/3648020369 shutdown_connections 2023-10-06T03:04:49.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.931+0000 7f1adfb11700 1 --2- 172.21.15.125:0/3648020369 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1abc066f30 0x7f1abc0693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.931+0000 7f1adfb11700 1 --2- 172.21.15.125:0/3648020369 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ad81576d0 0x7f1ad816aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.931+0000 7f1adfb11700 1 --2- 172.21.15.125:0/3648020369 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ad8068a00 0x7f1ad8098070 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.931+0000 7f1adfb11700 1 --2- 172.21.15.125:0/3648020369 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ad8157300 0x7f1ad80c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:49.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.931+0000 7f1adfb11700 1 -- 172.21.15.125:0/3648020369 >> 172.21.15.125:0/3648020369 conn(0x7f1ad80af730 msgr2=0x7f1ad806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:49.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.931+0000 7f1adfb11700 1 -- 172.21.15.125:0/3648020369 shutdown_connections 2023-10-06T03:04:49.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:49.931+0000 7f1adfb11700 1 -- 172.21.15.125:0/3648020369 wait complete. 2023-10-06T03:04:49.944 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:04:50.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.063+0000 7fe7910bd700 1 Processor -- start 2023-10-06T03:04:50.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.063+0000 7fe7910bd700 1 -- start start 2023-10-06T03:04:50.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.064+0000 7fe7910bd700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe78c15cb00 0x7fe78c0b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:50.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.064+0000 7fe7910bd700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe78c067610 0x7fe78c068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:50.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.064+0000 7fe7910bd700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78c0ca670 con 0x7fe78c15ced0 2023-10-06T03:04:50.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.064+0000 7fe7910bd700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78c068320 con 0x7fe78c067610 2023-10-06T03:04:50.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.064+0000 7fe7910bd700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c067a80 con 0x7fe78c15cb00 2023-10-06T03:04:50.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.065+0000 7fe78a59c700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe78c067610 0x7fe78c068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:50.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.065+0000 7fe78ad9d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe78c15cb00 0x7fe78c0b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:50.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.065+0000 7fe78b59e700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe78c15ced0 0x7fe78c0c90e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:52454/0 (socket says 172.21.15.125:52454) 2023-10-06T03:04:50.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.065+0000 7fe78ad9d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe78c15cb00 0x7fe78c0b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:59160/0 (socket says 172.21.15.125:59160) 2023-10-06T03:04:50.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.065+0000 7fe78b59e700 1 -- 172.21.15.125:0/2986155933 learned_addr learned my addr 172.21.15.125:0/2986155933 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:50.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.065+0000 7fe789d9b700 1 -- 172.21.15.125:0/2986155933 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4075086766 0 0) 0x7fe78c0ca670 con 0x7fe78c15ced0 2023-10-06T03:04:50.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.065+0000 7fe789d9b700 1 -- 172.21.15.125:0/2986155933 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe774003570 con 0x7fe78c15ced0 2023-10-06T03:04:50.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.065+0000 7fe78ad9d700 1 -- 172.21.15.125:0/2986155933 >> v2:172.21.15.130:3300/0 conn(0x7fe78c067610 msgr2=0x7fe78c068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:50.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.065+0000 7fe78ad9d700 1 --2- 172.21.15.125:0/2986155933 >> v2:172.21.15.130:3300/0 conn(0x7fe78c067610 0x7fe78c068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.065+0000 7fe78ad9d700 1 -- 172.21.15.125:0/2986155933 >> v1:172.21.15.130:6789/0 conn(0x7fe78c15ced0 legacy=0x7fe78c0c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:50.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.065+0000 7fe78ad9d700 1 -- 172.21.15.125:0/2986155933 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c067d60 con 0x7fe78c15cb00 2023-10-06T03:04:50.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.065+0000 7fe78ad9d700 1 --2- 172.21.15.125:0/2986155933 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe78c15cb00 0x7fe78c0b0240 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe7800098d0 tx=0x7fe780009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcbc184e4ed30792 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:50.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.065+0000 7fe789d9b700 1 -- 172.21.15.125:0/2986155933 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe780005c10 con 0x7fe78c15cb00 2023-10-06T03:04:50.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.065+0000 7fe789d9b700 1 -- 172.21.15.125:0/2986155933 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe780005d70 con 0x7fe78c15cb00 2023-10-06T03:04:50.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.066+0000 7fe789d9b700 1 -- 172.21.15.125:0/2986155933 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe780006260 con 0x7fe78c15cb00 2023-10-06T03:04:50.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.066+0000 7fe7910bd700 1 -- 172.21.15.125:0/2986155933 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe78c15cb00 msgr2=0x7fe78c0b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:50.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.066+0000 7fe7910bd700 1 --2- 172.21.15.125:0/2986155933 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe78c15cb00 0x7fe78c0b0240 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe7800098d0 tx=0x7fe780009120 comp rx=0 tx=0).stop 2023-10-06T03:04:50.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.066+0000 7fe7910bd700 1 -- 172.21.15.125:0/2986155933 shutdown_connections 2023-10-06T03:04:50.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.066+0000 7fe7910bd700 1 --2- 172.21.15.125:0/2986155933 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe78c15cb00 0x7fe78c0b0240 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.066+0000 7fe7910bd700 1 --2- 172.21.15.125:0/2986155933 >> v2:172.21.15.130:3300/0 conn(0x7fe78c067610 0x7fe78c068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.066+0000 7fe7910bd700 1 -- 172.21.15.125:0/2986155933 >> 172.21.15.125:0/2986155933 conn(0x7fe78c0af730 msgr2=0x7fe78c0afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:50.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.066+0000 7fe7910bd700 1 -- 172.21.15.125:0/2986155933 shutdown_connections 2023-10-06T03:04:50.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.066+0000 7fe7910bd700 1 -- 172.21.15.125:0/2986155933 wait complete. 2023-10-06T03:04:50.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.067+0000 7fe7910bd700 1 Processor -- start 2023-10-06T03:04:50.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.067+0000 7fe7910bd700 1 -- start start 2023-10-06T03:04:50.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.068+0000 7fe7910bd700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe78c067610 0x7fe78c0c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:50.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.068+0000 7fe7910bd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe78c15cb00 0x7fe78c06ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:50.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.068+0000 7fe7910bd700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe78c15ced0 0x7fe78c06b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:50.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.068+0000 7fe7910bd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c0c6760 con 0x7fe78c15cb00 2023-10-06T03:04:50.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.068+0000 7fe7910bd700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c14ff00 con 0x7fe78c15ced0 2023-10-06T03:04:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.068+0000 7fe7910bd700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c0c61a0 con 0x7fe78c067610 2023-10-06T03:04:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.068+0000 7fe78a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe78c15cb00 0x7fe78c06ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.068+0000 7fe78a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe78c15cb00 0x7fe78c06ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40576/0 (socket says 172.21.15.125:40576) 2023-10-06T03:04:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.068+0000 7fe78a59c700 1 -- 172.21.15.125:0/1716914119 learned_addr learned my addr 172.21.15.125:0/1716914119 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.068+0000 7fe78b59e700 1 --2- 172.21.15.125:0/1716914119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe78c15ced0 0x7fe78c06b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.068+0000 7fe78ad9d700 1 --2- 172.21.15.125:0/1716914119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe78c067610 0x7fe78c0c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.068+0000 7fe78a59c700 1 -- 172.21.15.125:0/1716914119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe78c067610 msgr2=0x7fe78c0c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.068+0000 7fe78a59c700 1 --2- 172.21.15.125:0/1716914119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe78c067610 0x7fe78c0c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.068+0000 7fe78a59c700 1 -- 172.21.15.125:0/1716914119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe78c15ced0 msgr2=0x7fe78c06b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:50.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.068+0000 7fe78a59c700 1 --2- 172.21.15.125:0/1716914119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe78c15ced0 0x7fe78c06b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.068+0000 7fe78a59c700 1 -- 172.21.15.125:0/1716914119 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7800093c0 con 0x7fe78c15cb00 2023-10-06T03:04:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.069+0000 7fe78a59c700 1 --2- 172.21.15.125:0/1716914119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe78c15cb00 0x7fe78c06ad30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe77c00e900 tx=0x7fe77c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.069+0000 7fe772ffd700 1 -- 172.21.15.125:0/1716914119 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c013680 con 0x7fe78c15cb00 2023-10-06T03:04:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.069+0000 7fe772ffd700 1 -- 172.21.15.125:0/1716914119 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c0137e0 con 0x7fe78c15cb00 2023-10-06T03:04:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.069+0000 7fe7910bd700 1 -- 172.21.15.125:0/1716914119 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe78c0c6480 con 0x7fe78c15cb00 2023-10-06T03:04:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.069+0000 7fe772ffd700 1 -- 172.21.15.125:0/1716914119 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c013ba0 con 0x7fe78c15cb00 2023-10-06T03:04:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.069+0000 7fe7910bd700 1 -- 172.21.15.125:0/1716914119 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78c0c5470 con 0x7fe78c15cb00 2023-10-06T03:04:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.070+0000 7fe7910bd700 1 -- 172.21.15.125:0/1716914119 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78c150040 con 0x7fe78c15cb00 2023-10-06T03:04:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.070+0000 7fe772ffd700 1 -- 172.21.15.125:0/1716914119 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe77c01c450 con 0x7fe78c15cb00 2023-10-06T03:04:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.070+0000 7fe772ffd700 1 --2- 172.21.15.125:0/1716914119 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe778066f30 0x7fe7780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:50.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.071+0000 7fe772ffd700 1 -- 172.21.15.125:0/1716914119 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fe77c084ac0 con 0x7fe78c15cb00 2023-10-06T03:04:50.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.071+0000 7fe78ad9d700 1 --2- 172.21.15.125:0/1716914119 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe778066f30 0x7fe7780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:50.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.071+0000 7fe78ad9d700 1 --2- 172.21.15.125:0/1716914119 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe778066f30 0x7fe7780693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe78c0ccca0 tx=0x7fe780016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:50.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.075+0000 7fe772ffd700 1 -- 172.21.15.125:0/1716914119 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe78c150040 con 0x7fe78c15cb00 2023-10-06T03:04:50.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.255+0000 7fe7910bd700 1 -- 172.21.15.125:0/1716914119 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe78c150040 con 0x7fe78c15cb00 2023-10-06T03:04:50.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.255+0000 7fe772ffd700 1 -- 172.21.15.125:0/1716914119 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe78c150040 con 0x7fe78c15cb00 2023-10-06T03:04:50.257 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-06T03:04:50.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.257+0000 7fe7910bd700 1 -- 172.21.15.125:0/1716914119 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe778066f30 msgr2=0x7fe7780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:50.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.257+0000 7fe7910bd700 1 --2- 172.21.15.125:0/1716914119 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe778066f30 0x7fe7780693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe78c0ccca0 tx=0x7fe780016000 comp rx=0 tx=0).stop 2023-10-06T03:04:50.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.257+0000 7fe7910bd700 1 -- 172.21.15.125:0/1716914119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe78c15cb00 msgr2=0x7fe78c06ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:50.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.257+0000 7fe7910bd700 1 --2- 172.21.15.125:0/1716914119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe78c15cb00 0x7fe78c06ad30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe77c00e900 tx=0x7fe77c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.257+0000 7fe7910bd700 1 -- 172.21.15.125:0/1716914119 shutdown_connections 2023-10-06T03:04:50.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.257+0000 7fe7910bd700 1 --2- 172.21.15.125:0/1716914119 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe778066f30 0x7fe7780693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.257+0000 7fe7910bd700 1 --2- 172.21.15.125:0/1716914119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe78c15ced0 0x7fe78c06b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.257+0000 7fe7910bd700 1 --2- 172.21.15.125:0/1716914119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe78c067610 0x7fe78c0c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.257+0000 7fe7910bd700 1 --2- 172.21.15.125:0/1716914119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe78c15cb00 0x7fe78c06ad30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.257+0000 7fe7910bd700 1 -- 172.21.15.125:0/1716914119 >> 172.21.15.125:0/1716914119 conn(0x7fe78c0af730 msgr2=0x7fe78c15b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:50.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.257+0000 7fe7910bd700 1 -- 172.21.15.125:0/1716914119 shutdown_connections 2023-10-06T03:04:50.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.257+0000 7fe7910bd700 1 -- 172.21.15.125:0/1716914119 wait complete. 2023-10-06T03:04:50.270 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:04:50.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.390+0000 7eff7a0d6700 1 Processor -- start 2023-10-06T03:04:50.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.390+0000 7eff7a0d6700 1 -- start start 2023-10-06T03:04:50.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.391+0000 7eff7a0d6700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff74067610 0x7eff740b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:50.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.391+0000 7eff7a0d6700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff74068ba0 0x7eff740cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:50.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.391+0000 7eff7a0d6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff740ca670 con 0x7eff7415cb00 2023-10-06T03:04:50.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.391+0000 7eff7a0d6700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff74068320 con 0x7eff74067610 2023-10-06T03:04:50.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.391+0000 7eff7a0d6700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff74067a80 con 0x7eff74068ba0 2023-10-06T03:04:50.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.391+0000 7eff737fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7eff7415cb00 0x7eff74068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53266/0 (socket says 172.21.15.125:53266) 2023-10-06T03:04:50.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.391+0000 7eff737fe700 1 -- 172.21.15.125:0/423609096 learned_addr learned my addr 172.21.15.125:0/423609096 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:50.398 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.392+0000 7eff73fff700 1 --2- 172.21.15.125:0/423609096 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff74068ba0 0x7eff740cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:50.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.392+0000 7eff72ffd700 1 --2- 172.21.15.125:0/423609096 >> v2:172.21.15.130:3300/0 conn(0x7eff74067610 0x7eff740b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:50.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.392+0000 7eff727fc700 1 -- 172.21.15.125:0/423609096 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558936670 0 0) 0x7eff740ca670 con 0x7eff7415cb00 2023-10-06T03:04:50.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.392+0000 7eff727fc700 1 -- 172.21.15.125:0/423609096 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff5c003570 con 0x7eff7415cb00 2023-10-06T03:04:50.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.392+0000 7eff727fc700 1 -- 172.21.15.125:0/423609096 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1516479188 0 0) 0x7eff5c003570 con 0x7eff7415cb00 2023-10-06T03:04:50.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.392+0000 7eff73fff700 1 -- 172.21.15.125:0/423609096 >> v2:172.21.15.130:3300/0 conn(0x7eff74067610 msgr2=0x7eff740b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:50.399 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.392+0000 7eff73fff700 1 --2- 172.21.15.125:0/423609096 >> v2:172.21.15.130:3300/0 conn(0x7eff74067610 0x7eff740b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.392+0000 7eff73fff700 1 -- 172.21.15.125:0/423609096 >> v1:172.21.15.125:6789/0 conn(0x7eff7415cb00 legacy=0x7eff74068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:50.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.392+0000 7eff73fff700 1 -- 172.21.15.125:0/423609096 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff74067d60 con 0x7eff74068ba0 2023-10-06T03:04:50.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.392+0000 7eff72ffd700 1 --2- 172.21.15.125:0/423609096 >> v2:172.21.15.130:3300/0 conn(0x7eff74067610 0x7eff740b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:50.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.392+0000 7eff73fff700 1 --2- 172.21.15.125:0/423609096 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff74068ba0 0x7eff740cab00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0098e0 tx=0x7eff6c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dec5892e7a4fe7f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:50.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.392+0000 7eff727fc700 1 -- 172.21.15.125:0/423609096 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff64001970 con 0x7eff74068ba0 2023-10-06T03:04:50.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.392+0000 7eff727fc700 1 -- 172.21.15.125:0/423609096 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6c011420 con 0x7eff74068ba0 2023-10-06T03:04:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.392+0000 7eff727fc700 1 -- 172.21.15.125:0/423609096 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c0117c0 con 0x7eff74068ba0 2023-10-06T03:04:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.393+0000 7eff7a0d6700 1 -- 172.21.15.125:0/423609096 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff74068ba0 msgr2=0x7eff740cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.393+0000 7eff7a0d6700 1 --2- 172.21.15.125:0/423609096 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff74068ba0 0x7eff740cab00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff6c0098e0 tx=0x7eff6c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.393+0000 7eff7a0d6700 1 -- 172.21.15.125:0/423609096 shutdown_connections 2023-10-06T03:04:50.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.393+0000 7eff7a0d6700 1 --2- 172.21.15.125:0/423609096 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff74068ba0 0x7eff740cab00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.393+0000 7eff7a0d6700 1 --2- 172.21.15.125:0/423609096 >> v2:172.21.15.130:3300/0 conn(0x7eff74067610 0x7eff740b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.393+0000 7eff7a0d6700 1 -- 172.21.15.125:0/423609096 >> 172.21.15.125:0/423609096 conn(0x7eff740af730 msgr2=0x7eff740afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:50.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.393+0000 7eff7a0d6700 1 -- 172.21.15.125:0/423609096 shutdown_connections 2023-10-06T03:04:50.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.393+0000 7eff7a0d6700 1 -- 172.21.15.125:0/423609096 wait complete. 2023-10-06T03:04:50.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.394+0000 7eff7a0d6700 1 Processor -- start 2023-10-06T03:04:50.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.394+0000 7eff7a0d6700 1 -- start start 2023-10-06T03:04:50.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.395+0000 7eff7a0d6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff74067610 0x7eff7414dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:50.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.395+0000 7eff7a0d6700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff74068ba0 0x7eff740c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:50.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.395+0000 7eff7a0d6700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff7415cb00 0x7eff740cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:50.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.395+0000 7eff7a0d6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7416d880 con 0x7eff74067610 2023-10-06T03:04:50.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.395+0000 7eff7a0d6700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff740cbc00 con 0x7eff7415cb00 2023-10-06T03:04:50.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.395+0000 7eff7a0d6700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff740cd210 con 0x7eff74068ba0 2023-10-06T03:04:50.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.395+0000 7eff737fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff74067610 0x7eff7414dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:50.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.395+0000 7eff737fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff74067610 0x7eff7414dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40584/0 (socket says 172.21.15.125:40584) 2023-10-06T03:04:50.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.395+0000 7eff737fe700 1 -- 172.21.15.125:0/772761387 learned_addr learned my addr 172.21.15.125:0/772761387 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:50.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.395+0000 7eff72ffd700 1 --2- 172.21.15.125:0/772761387 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff74068ba0 0x7eff740c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:50.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.395+0000 7eff73fff700 1 --2- 172.21.15.125:0/772761387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff7415cb00 0x7eff740cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:50.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.395+0000 7eff737fe700 1 -- 172.21.15.125:0/772761387 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff74068ba0 msgr2=0x7eff740c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:50.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.395+0000 7eff737fe700 1 --2- 172.21.15.125:0/772761387 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff74068ba0 0x7eff740c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.395+0000 7eff737fe700 1 -- 172.21.15.125:0/772761387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff7415cb00 msgr2=0x7eff740cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:50.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.395+0000 7eff737fe700 1 --2- 172.21.15.125:0/772761387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff7415cb00 0x7eff740cc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.395+0000 7eff737fe700 1 -- 172.21.15.125:0/772761387 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff68009420 con 0x7eff74067610 2023-10-06T03:04:50.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.396+0000 7eff737fe700 1 --2- 172.21.15.125:0/772761387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff74067610 0x7eff7414dc30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7eff64007fd0 tx=0x7eff64001730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:50.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.396+0000 7eff5b7fe700 1 -- 172.21.15.125:0/772761387 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff64005e50 con 0x7eff74067610 2023-10-06T03:04:50.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.396+0000 7eff5b7fe700 1 -- 172.21.15.125:0/772761387 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6400a5d0 con 0x7eff74067610 2023-10-06T03:04:50.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.396+0000 7eff5b7fe700 1 -- 172.21.15.125:0/772761387 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6400a990 con 0x7eff74067610 2023-10-06T03:04:50.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.396+0000 7eff7a0d6700 1 -- 172.21.15.125:0/772761387 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6c009420 con 0x7eff74067610 2023-10-06T03:04:50.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.396+0000 7eff7a0d6700 1 -- 172.21.15.125:0/772761387 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7414e170 con 0x7eff74067610 2023-10-06T03:04:50.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.397+0000 7eff7a0d6700 1 -- 172.21.15.125:0/772761387 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff740cbee0 con 0x7eff74067610 2023-10-06T03:04:50.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.397+0000 7eff5b7fe700 1 -- 172.21.15.125:0/772761387 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff640070f0 con 0x7eff74067610 2023-10-06T03:04:50.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.397+0000 7eff5b7fe700 1 --2- 172.21.15.125:0/772761387 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7eff60066f30 0x7eff600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:50.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.398+0000 7eff5b7fe700 1 -- 172.21.15.125:0/772761387 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7eff640849b0 con 0x7eff74067610 2023-10-06T03:04:50.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.398+0000 7eff72ffd700 1 --2- 172.21.15.125:0/772761387 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7eff60066f30 0x7eff600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:50.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.398+0000 7eff72ffd700 1 --2- 172.21.15.125:0/772761387 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7eff60066f30 0x7eff600693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff741530d0 tx=0x7eff680091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:50.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.402+0000 7eff5b7fe700 1 -- 172.21.15.125:0/772761387 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff64051850 con 0x7eff74067610 2023-10-06T03:04:50.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.582+0000 7eff7a0d6700 1 -- 172.21.15.125:0/772761387 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7eff74066510 con 0x7eff74067610 2023-10-06T03:04:50.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.583+0000 7eff5b7fe700 1 -- 172.21.15.125:0/772761387 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7eff64054e70 con 0x7eff74067610 2023-10-06T03:04:50.585 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-06T03:04:50.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.585+0000 7eff7a0d6700 1 -- 172.21.15.125:0/772761387 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7eff60066f30 msgr2=0x7eff600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:50.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.585+0000 7eff7a0d6700 1 --2- 172.21.15.125:0/772761387 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7eff60066f30 0x7eff600693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff741530d0 tx=0x7eff680091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.585+0000 7eff7a0d6700 1 -- 172.21.15.125:0/772761387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff74067610 msgr2=0x7eff7414dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:50.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.585+0000 7eff7a0d6700 1 --2- 172.21.15.125:0/772761387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff74067610 0x7eff7414dc30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7eff64007fd0 tx=0x7eff64001730 comp rx=0 tx=0).stop 2023-10-06T03:04:50.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.585+0000 7eff7a0d6700 1 -- 172.21.15.125:0/772761387 shutdown_connections 2023-10-06T03:04:50.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.585+0000 7eff7a0d6700 1 --2- 172.21.15.125:0/772761387 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7eff60066f30 0x7eff600693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.585+0000 7eff7a0d6700 1 --2- 172.21.15.125:0/772761387 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff7415cb00 0x7eff740cc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.585+0000 7eff7a0d6700 1 --2- 172.21.15.125:0/772761387 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff74067610 0x7eff7414dc30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.585+0000 7eff7a0d6700 1 --2- 172.21.15.125:0/772761387 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff74068ba0 0x7eff740c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.585+0000 7eff7a0d6700 1 -- 172.21.15.125:0/772761387 >> 172.21.15.125:0/772761387 conn(0x7eff740af730 msgr2=0x7eff7406c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:50.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.585+0000 7eff7a0d6700 1 -- 172.21.15.125:0/772761387 shutdown_connections 2023-10-06T03:04:50.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.585+0000 7eff7a0d6700 1 -- 172.21.15.125:0/772761387 wait complete. 2023-10-06T03:04:50.598 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:04:50.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.714+0000 7f628449f700 1 Processor -- start 2023-10-06T03:04:50.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.714+0000 7f628449f700 1 -- start start 2023-10-06T03:04:50.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.715+0000 7f628449f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f627c1592e0 0x7f627c0ace80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:50.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.715+0000 7f628449f700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f627c0ad3c0 0x7f627c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:50.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.715+0000 7f628449f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627c068290 con 0x7f627c155670 2023-10-06T03:04:50.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.715+0000 7f628449f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627c06f780 con 0x7f627c1592e0 2023-10-06T03:04:50.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.715+0000 7f628449f700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627c159930 con 0x7f627c0ad3c0 2023-10-06T03:04:50.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.715+0000 7f6281a3a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f627c1592e0 0x7f627c0ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:50.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.715+0000 7f628223b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f627c155670 0x7f627c06f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53282/0 (socket says 172.21.15.125:53282) 2023-10-06T03:04:50.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.716+0000 7f628223b700 1 -- 172.21.15.125:0/3194004940 learned_addr learned my addr 172.21.15.125:0/3194004940 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:50.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.716+0000 7f6282a3c700 1 --2- 172.21.15.125:0/3194004940 >> v2:172.21.15.130:3300/0 conn(0x7f627c0ad3c0 0x7f627c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:50.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.716+0000 7f6281a3a700 1 -- 172.21.15.125:0/3194004940 >> v2:172.21.15.130:3300/0 conn(0x7f627c0ad3c0 msgr2=0x7f627c06a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:50.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.716+0000 7f6281a3a700 1 --2- 172.21.15.125:0/3194004940 >> v2:172.21.15.130:3300/0 conn(0x7f627c0ad3c0 0x7f627c06a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.716+0000 7f6281a3a700 1 -- 172.21.15.125:0/3194004940 >> v1:172.21.15.125:6789/0 conn(0x7f627c155670 legacy=0x7f627c06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:50.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.716+0000 7f6281a3a700 1 -- 172.21.15.125:0/3194004940 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c159c10 con 0x7f627c1592e0 2023-10-06T03:04:50.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.716+0000 7f6281239700 1 -- 172.21.15.125:0/3194004940 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3902805287 0 0) 0x7f627c068290 con 0x7f627c155670 2023-10-06T03:04:50.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.716+0000 7f6281a3a700 1 --2- 172.21.15.125:0/3194004940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f627c1592e0 0x7f627c0ace80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f627c067b10 tx=0x7f62780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f474c846ec420669 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:50.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.716+0000 7f6281239700 1 -- 172.21.15.125:0/3194004940 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627800b6b0 con 0x7f627c1592e0 2023-10-06T03:04:50.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.716+0000 7f6281239700 1 -- 172.21.15.125:0/3194004940 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627800b810 con 0x7f627c1592e0 2023-10-06T03:04:50.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.716+0000 7f6281239700 1 -- 172.21.15.125:0/3194004940 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627800bbb0 con 0x7f627c1592e0 2023-10-06T03:04:50.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.717+0000 7f628449f700 1 -- 172.21.15.125:0/3194004940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f627c1592e0 msgr2=0x7f627c0ace80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:50.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.717+0000 7f628449f700 1 --2- 172.21.15.125:0/3194004940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f627c1592e0 0x7f627c0ace80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f627c067b10 tx=0x7f62780091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.717+0000 7f628449f700 1 -- 172.21.15.125:0/3194004940 shutdown_connections 2023-10-06T03:04:50.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.717+0000 7f628449f700 1 --2- 172.21.15.125:0/3194004940 >> v2:172.21.15.130:3300/0 conn(0x7f627c0ad3c0 0x7f627c06a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.717+0000 7f628449f700 1 --2- 172.21.15.125:0/3194004940 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f627c1592e0 0x7f627c0ace80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.717+0000 7f628449f700 1 -- 172.21.15.125:0/3194004940 >> 172.21.15.125:0/3194004940 conn(0x7f627c0cc5a0 msgr2=0x7f627c0cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:50.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.717+0000 7f628449f700 1 -- 172.21.15.125:0/3194004940 shutdown_connections 2023-10-06T03:04:50.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.717+0000 7f628449f700 1 -- 172.21.15.125:0/3194004940 wait complete. 2023-10-06T03:04:50.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.718+0000 7f628449f700 1 Processor -- start 2023-10-06T03:04:50.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.718+0000 7f628449f700 1 -- start start 2023-10-06T03:04:50.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.719+0000 7f628449f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f627c0ad3c0 0x7f627c150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:50.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.719+0000 7f628449f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f627c155670 0x7f627c0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:50.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.719+0000 7f628449f700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f627c1592e0 0x7f627c0bfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:50.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.719+0000 7f628449f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c0b0430 con 0x7f627c0ad3c0 2023-10-06T03:04:50.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.719+0000 7f628449f700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c0af820 con 0x7f627c1592e0 2023-10-06T03:04:50.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.719+0000 7f628449f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c0afb00 con 0x7f627c155670 2023-10-06T03:04:50.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.719+0000 7f628223b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f627c0ad3c0 0x7f627c150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:50.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.719+0000 7f628223b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f627c0ad3c0 0x7f627c150790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40592/0 (socket says 172.21.15.125:40592) 2023-10-06T03:04:50.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.719+0000 7f628223b700 1 -- 172.21.15.125:0/3252174587 learned_addr learned my addr 172.21.15.125:0/3252174587 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:50.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.719+0000 7f6282a3c700 1 --2- 172.21.15.125:0/3252174587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f627c1592e0 0x7f627c0bfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:50.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.719+0000 7f6281a3a700 1 --2- 172.21.15.125:0/3252174587 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f627c155670 0x7f627c0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.719+0000 7f628223b700 1 -- 172.21.15.125:0/3252174587 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f627c155670 msgr2=0x7f627c0b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.720+0000 7f628223b700 1 --2- 172.21.15.125:0/3252174587 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f627c155670 0x7f627c0b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.720+0000 7f628223b700 1 -- 172.21.15.125:0/3252174587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f627c1592e0 msgr2=0x7f627c0bfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.720+0000 7f628223b700 1 --2- 172.21.15.125:0/3252174587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f627c1592e0 0x7f627c0bfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.720+0000 7f628223b700 1 -- 172.21.15.125:0/3252174587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6278009420 con 0x7f627c0ad3c0 2023-10-06T03:04:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.720+0000 7f628223b700 1 --2- 172.21.15.125:0/3252174587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f627c0ad3c0 0x7f627c150790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f626c00c7e0 tx=0x7f626c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.720+0000 7f62727fc700 1 -- 172.21.15.125:0/3252174587 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c005b30 con 0x7f627c0ad3c0 2023-10-06T03:04:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.720+0000 7f62727fc700 1 -- 172.21.15.125:0/3252174587 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626c005c90 con 0x7f627c0ad3c0 2023-10-06T03:04:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.720+0000 7f62727fc700 1 -- 172.21.15.125:0/3252174587 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626c007300 con 0x7f627c0ad3c0 2023-10-06T03:04:50.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.720+0000 7f628449f700 1 -- 172.21.15.125:0/3252174587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627c0afde0 con 0x7f627c0ad3c0 2023-10-06T03:04:50.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.720+0000 7f628449f700 1 -- 172.21.15.125:0/3252174587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627c150cd0 con 0x7f627c0ad3c0 2023-10-06T03:04:50.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.721+0000 7f628449f700 1 -- 172.21.15.125:0/3252174587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627c0b0710 con 0x7f627c0ad3c0 2023-10-06T03:04:50.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.721+0000 7f62727fc700 1 -- 172.21.15.125:0/3252174587 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f626c01b3b0 con 0x7f627c0ad3c0 2023-10-06T03:04:50.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.722+0000 7f62727fc700 1 --2- 172.21.15.125:0/3252174587 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6260066f60 0x7f6260069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:50.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.722+0000 7f62727fc700 1 -- 172.21.15.125:0/3252174587 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f626c083e70 con 0x7f627c0ad3c0 2023-10-06T03:04:50.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.722+0000 7f6281a3a700 1 --2- 172.21.15.125:0/3252174587 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6260066f60 0x7f6260069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:50.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.722+0000 7f6281a3a700 1 --2- 172.21.15.125:0/3252174587 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6260066f60 0x7f6260069410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f62780091e0 tx=0x7f6278017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:50.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.726+0000 7f62727fc700 1 -- 172.21.15.125:0/3252174587 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f626c050c90 con 0x7f627c0ad3c0 2023-10-06T03:04:50.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.952+0000 7f628449f700 1 -- 172.21.15.125:0/3252174587 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f627c066510 con 0x7f627c0ad3c0 2023-10-06T03:04:50.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.952+0000 7f62727fc700 1 -- 172.21.15.125:0/3252174587 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f626c017020 con 0x7f627c0ad3c0 2023-10-06T03:04:50.954 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:50.954 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/1260071130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1260071130},{"type":"v1","addr":"172.21.15.130:6834","nonce":1260071130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/63925154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":63925154},{"type":"v1","addr":"172.21.15.125:6836","nonce":63925154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/1057811891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1057811891},{"type":"v1","addr":"172.21.15.125:6837","nonce":1057811891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:04:29.211664+0000","modified":"2023-10-06T03:04:42.275374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/4004582354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":4004582354},{"type":"v1","addr":"172.21.15.130:6835","nonce":4004582354}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:04:50.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.954+0000 7f628449f700 1 -- 172.21.15.125:0/3252174587 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6260066f60 msgr2=0x7f6260069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:50.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.954+0000 7f628449f700 1 --2- 172.21.15.125:0/3252174587 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6260066f60 0x7f6260069410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f62780091e0 tx=0x7f6278017000 comp rx=0 tx=0).stop 2023-10-06T03:04:50.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.954+0000 7f628449f700 1 -- 172.21.15.125:0/3252174587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f627c0ad3c0 msgr2=0x7f627c150790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:50.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.954+0000 7f628449f700 1 --2- 172.21.15.125:0/3252174587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f627c0ad3c0 0x7f627c150790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f626c00c7e0 tx=0x7f626c007df0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.954+0000 7f628449f700 1 -- 172.21.15.125:0/3252174587 shutdown_connections 2023-10-06T03:04:50.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.954+0000 7f628449f700 1 --2- 172.21.15.125:0/3252174587 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6260066f60 0x7f6260069410 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.954+0000 7f628449f700 1 --2- 172.21.15.125:0/3252174587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f627c1592e0 0x7f627c0bfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.954+0000 7f628449f700 1 --2- 172.21.15.125:0/3252174587 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f627c0ad3c0 0x7f627c150790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.954+0000 7f628449f700 1 --2- 172.21.15.125:0/3252174587 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f627c155670 0x7f627c0b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:50.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.954+0000 7f628449f700 1 -- 172.21.15.125:0/3252174587 >> 172.21.15.125:0/3252174587 conn(0x7f627c0cc5a0 msgr2=0x7f627c068720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:50.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.954+0000 7f628449f700 1 -- 172.21.15.125:0/3252174587 shutdown_connections 2023-10-06T03:04:50.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:50.954+0000 7f628449f700 1 -- 172.21.15.125:0/3252174587 wait complete. 2023-10-06T03:04:50.957 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 9 2023-10-06T03:04:50.967 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:04:51.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.082+0000 7f1dadf95700 1 Processor -- start 2023-10-06T03:04:51.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.083+0000 7f1dadf95700 1 -- start start 2023-10-06T03:04:51.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.083+0000 7f1dadf95700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1da806ab10 0x7f1da80c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.083+0000 7f1dadf95700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1da806aee0 0x7f1da8159360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.083+0000 7f1dadf95700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da8067c70 con 0x7f1da80ac670 2023-10-06T03:04:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.083+0000 7f1dadf95700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da8069110 con 0x7f1da806aee0 2023-10-06T03:04:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.083+0000 7f1dadf95700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80c7800 con 0x7f1da806ab10 2023-10-06T03:04:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.084+0000 7f1da77fe700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1da806ab10 0x7f1da80c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.084+0000 7f1da7fff700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1da806aee0 0x7f1da8159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.084+0000 7f1da77fe700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1da806ab10 0x7f1da80c6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:59198/0 (socket says 172.21.15.125:59198) 2023-10-06T03:04:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.084+0000 7f1da77fe700 1 -- 172.21.15.125:0/2355427810 learned_addr learned my addr 172.21.15.125:0/2355427810 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.084+0000 7f1da77fe700 1 -- 172.21.15.125:0/2355427810 >> v2:172.21.15.130:3300/0 conn(0x7f1da806aee0 msgr2=0x7f1da8159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.084+0000 7f1da77fe700 1 --2- 172.21.15.125:0/2355427810 >> v2:172.21.15.130:3300/0 conn(0x7f1da806aee0 0x7f1da8159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.084+0000 7f1da77fe700 1 -- 172.21.15.125:0/2355427810 >> v1:172.21.15.130:6789/0 conn(0x7f1da80ac670 legacy=0x7f1da8158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.084+0000 7f1da77fe700 1 -- 172.21.15.125:0/2355427810 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da80c7ae0 con 0x7f1da806ab10 2023-10-06T03:04:51.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.084+0000 7f1da77fe700 1 --2- 172.21.15.125:0/2355427810 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1da806ab10 0x7f1da80c6b40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1d980099b0 tx=0x7f1d98009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3111edeb5beefe35 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.084+0000 7f1da67fc700 1 -- 172.21.15.125:0/2355427810 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d98009ea0 con 0x7f1da806ab10 2023-10-06T03:04:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.084+0000 7f1da67fc700 1 -- 172.21.15.125:0/2355427810 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9800b860 con 0x7f1da806ab10 2023-10-06T03:04:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.085+0000 7f1da67fc700 1 -- 172.21.15.125:0/2355427810 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9800bc00 con 0x7f1da806ab10 2023-10-06T03:04:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.085+0000 7f1dadf95700 1 -- 172.21.15.125:0/2355427810 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1da806ab10 msgr2=0x7f1da80c6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.085+0000 7f1dadf95700 1 --2- 172.21.15.125:0/2355427810 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1da806ab10 0x7f1da80c6b40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1d980099b0 tx=0x7f1d98009250 comp rx=0 tx=0).stop 2023-10-06T03:04:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.085+0000 7f1dadf95700 1 -- 172.21.15.125:0/2355427810 shutdown_connections 2023-10-06T03:04:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.085+0000 7f1dadf95700 1 --2- 172.21.15.125:0/2355427810 >> v2:172.21.15.130:3300/0 conn(0x7f1da806aee0 0x7f1da8159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.085+0000 7f1dadf95700 1 --2- 172.21.15.125:0/2355427810 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1da806ab10 0x7f1da80c6b40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.085+0000 7f1dadf95700 1 -- 172.21.15.125:0/2355427810 >> 172.21.15.125:0/2355427810 conn(0x7f1da80cc5a0 msgr2=0x7f1da80cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.085+0000 7f1dadf95700 1 -- 172.21.15.125:0/2355427810 shutdown_connections 2023-10-06T03:04:51.088 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.085+0000 7f1dadf95700 1 -- 172.21.15.125:0/2355427810 wait complete. 2023-10-06T03:04:51.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.086+0000 7f1dadf95700 1 Processor -- start 2023-10-06T03:04:51.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.086+0000 7f1dadf95700 1 -- start start 2023-10-06T03:04:51.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.087+0000 7f1dadf95700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1da806ab10 0x7f1da80b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.087+0000 7f1dadf95700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1da806aee0 0x7f1da80aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.087+0000 7f1dadf95700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1da80ac670 0x7f1da80aabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.087+0000 7f1dadf95700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80c49e0 con 0x7f1da806aee0 2023-10-06T03:04:51.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.087+0000 7f1dadf95700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80b2160 con 0x7f1da806ab10 2023-10-06T03:04:51.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.087+0000 7f1dadf95700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80ab7f0 con 0x7f1da80ac670 2023-10-06T03:04:51.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.087+0000 7f1da6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1da806aee0 0x7f1da80aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.087+0000 7f1da6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1da806aee0 0x7f1da80aa6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40600/0 (socket says 172.21.15.125:40600) 2023-10-06T03:04:51.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.087+0000 7f1da6ffd700 1 -- 172.21.15.125:0/2559717499 learned_addr learned my addr 172.21.15.125:0/2559717499 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:51.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.087+0000 7f1da77fe700 1 --2- 172.21.15.125:0/2559717499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1da806ab10 0x7f1da80b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.087+0000 7f1da7fff700 1 --2- 172.21.15.125:0/2559717499 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1da80ac670 0x7f1da80aabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.088+0000 7f1da6ffd700 1 -- 172.21.15.125:0/2559717499 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1da80ac670 msgr2=0x7f1da80aabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.088+0000 7f1da6ffd700 1 --2- 172.21.15.125:0/2559717499 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1da80ac670 0x7f1da80aabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.088+0000 7f1da6ffd700 1 -- 172.21.15.125:0/2559717499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1da806ab10 msgr2=0x7f1da80b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.088+0000 7f1da6ffd700 1 --2- 172.21.15.125:0/2559717499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1da806ab10 0x7f1da80b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.088+0000 7f1da6ffd700 1 -- 172.21.15.125:0/2559717499 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d980094f0 con 0x7f1da806aee0 2023-10-06T03:04:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.088+0000 7f1da6ffd700 1 --2- 172.21.15.125:0/2559717499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1da806aee0 0x7f1da80aa6b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1d9000c4e0 tx=0x7f1d9000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.088+0000 7f1d9f7fe700 1 -- 172.21.15.125:0/2559717499 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90011590 con 0x7f1da806aee0 2023-10-06T03:04:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.088+0000 7f1d9f7fe700 1 -- 172.21.15.125:0/2559717499 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d90011710 con 0x7f1da806aee0 2023-10-06T03:04:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.088+0000 7f1d9f7fe700 1 -- 172.21.15.125:0/2559717499 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90011ad0 con 0x7f1da806aee0 2023-10-06T03:04:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.088+0000 7f1dadf95700 1 -- 172.21.15.125:0/2559717499 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da80c46b0 con 0x7f1da806aee0 2023-10-06T03:04:51.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.088+0000 7f1dadf95700 1 -- 172.21.15.125:0/2559717499 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da80ab510 con 0x7f1da806aee0 2023-10-06T03:04:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.089+0000 7f1dadf95700 1 -- 172.21.15.125:0/2559717499 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da8066510 con 0x7f1da806aee0 2023-10-06T03:04:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.089+0000 7f1d9f7fe700 1 -- 172.21.15.125:0/2559717499 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d9001b3b0 con 0x7f1da806aee0 2023-10-06T03:04:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.090+0000 7f1d9f7fe700 1 --2- 172.21.15.125:0/2559717499 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1d88066f30 0x7f1d880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.090+0000 7f1d9f7fe700 1 -- 172.21.15.125:0/2559717499 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1d90083d40 con 0x7f1da806aee0 2023-10-06T03:04:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.090+0000 7f1da77fe700 1 --2- 172.21.15.125:0/2559717499 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1d88066f30 0x7f1d880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.090+0000 7f1da77fe700 1 --2- 172.21.15.125:0/2559717499 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1d88066f30 0x7f1d880693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d980099b0 tx=0x7f1d98017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:51.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.094+0000 7f1d9f7fe700 1 -- 172.21.15.125:0/2559717499 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d90050b60 con 0x7f1da806aee0 2023-10-06T03:04:51.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.278+0000 7f1dadf95700 1 -- 172.21.15.125:0/2559717499 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1da80c4b20 con 0x7f1da806aee0 2023-10-06T03:04:51.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.279+0000 7f1d9f7fe700 1 -- 172.21.15.125:0/2559717499 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18851 (secure 0 0 0) 0x7f1d90017070 con 0x7f1da806aee0 2023-10-06T03:04:51.281 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:51.281 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:33.645139+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:04:26.828121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:04:28.179225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:04:31.256394+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:04:51.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.281+0000 7f1dadf95700 1 -- 172.21.15.125:0/2559717499 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1d88066f30 msgr2=0x7f1d880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:51.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.281+0000 7f1dadf95700 1 --2- 172.21.15.125:0/2559717499 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1d88066f30 0x7f1d880693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d980099b0 tx=0x7f1d98017000 comp rx=0 tx=0).stop 2023-10-06T03:04:51.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.281+0000 7f1dadf95700 1 -- 172.21.15.125:0/2559717499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1da806aee0 msgr2=0x7f1da80aa6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:51.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.281+0000 7f1dadf95700 1 --2- 172.21.15.125:0/2559717499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1da806aee0 0x7f1da80aa6b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1d9000c4e0 tx=0x7f1d9000c7f0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.281+0000 7f1dadf95700 1 -- 172.21.15.125:0/2559717499 shutdown_connections 2023-10-06T03:04:51.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.281+0000 7f1dadf95700 1 --2- 172.21.15.125:0/2559717499 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1d88066f30 0x7f1d880693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.281+0000 7f1dadf95700 1 --2- 172.21.15.125:0/2559717499 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1da80ac670 0x7f1da80aabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.281+0000 7f1dadf95700 1 --2- 172.21.15.125:0/2559717499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1da806ab10 0x7f1da80b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.281+0000 7f1dadf95700 1 --2- 172.21.15.125:0/2559717499 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1da806aee0 0x7f1da80aa6b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.281+0000 7f1dadf95700 1 -- 172.21.15.125:0/2559717499 >> 172.21.15.125:0/2559717499 conn(0x7f1da80cc5a0 msgr2=0x7f1da815d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:51.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.281+0000 7f1dadf95700 1 -- 172.21.15.125:0/2559717499 shutdown_connections 2023-10-06T03:04:51.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.281+0000 7f1dadf95700 1 -- 172.21.15.125:0/2559717499 wait complete. 2023-10-06T03:04:51.295 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:04:15.845430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:04:22.729795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:04:26.828121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:04:28.179225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:04:31.256394+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:04:51.295 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:04:51.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.414+0000 7ff0149e0700 1 Processor -- start 2023-10-06T03:04:51.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.414+0000 7ff0149e0700 1 -- start start 2023-10-06T03:04:51.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.415+0000 7ff0149e0700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0101574b0 0x7ff010067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.415+0000 7ff0149e0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff010067b50 con 0x7ff0100b0240 2023-10-06T03:04:51.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.415+0000 7ff0149e0700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0100c7f70 con 0x7ff0100c6eb0 2023-10-06T03:04:51.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.415+0000 7ff0149e0700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100c8210 con 0x7ff0101574b0 2023-10-06T03:04:51.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.415+0000 7ff00dd9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff0100b0240 0x7ff0100cb860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53284/0 (socket says 172.21.15.125:53284) 2023-10-06T03:04:51.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.415+0000 7ff00dd9b700 1 -- 172.21.15.125:0/4158372366 learned_addr learned my addr 172.21.15.125:0/4158372366 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:51.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.415+0000 7ff00d59a700 1 -- 172.21.15.125:0/4158372366 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335524890 0 0) 0x7ff010067b50 con 0x7ff0100b0240 2023-10-06T03:04:51.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.415+0000 7ff00e59c700 1 --2- 172.21.15.125:0/4158372366 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0101574b0 0x7ff010067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.415+0000 7ff00d59a700 1 -- 172.21.15.125:0/4158372366 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feff8003570 con 0x7ff0100b0240 2023-10-06T03:04:51.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00d59a700 1 -- 172.21.15.125:0/4158372366 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3130102996 0 0) 0x7feff8003570 con 0x7ff0100b0240 2023-10-06T03:04:51.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00d59a700 1 -- 172.21.15.125:0/4158372366 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0101574b0 msgr2=0x7ff010067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:51.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00d59a700 1 --2- 172.21.15.125:0/4158372366 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0101574b0 0x7ff010067610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00d59a700 1 -- 172.21.15.125:0/4158372366 >> v1:172.21.15.130:6789/0 conn(0x7ff0100c6eb0 legacy=0x7ff0100c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:51.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00d59a700 1 -- 172.21.15.125:0/4158372366 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0100c8b00 con 0x7ff0100b0240 2023-10-06T03:04:51.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00d59a700 1 -- 172.21.15.125:0/4158372366 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7ff000001470 con 0x7ff0100b0240 2023-10-06T03:04:51.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00d59a700 1 -- 172.21.15.125:0/4158372366 >> v1:172.21.15.125:6789/0 conn(0x7ff0100b0240 legacy=0x7ff0100cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:51.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00d59a700 1 --2- 172.21.15.125:0/4158372366 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0101574b0 0x7feff8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00d59a700 1 --2- 172.21.15.125:0/4158372366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feff8004010 0x7feff8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00d59a700 1 --2- 172.21.15.125:0/4158372366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feff8004d50 0x7feff80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00d59a700 1 -- 172.21.15.125:0/4158372366 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100c8210 con 0x7feff8004d50 2023-10-06T03:04:51.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00d59a700 1 -- 172.21.15.125:0/4158372366 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feff800bbf0 con 0x7feff8004010 2023-10-06T03:04:51.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00d59a700 1 -- 172.21.15.125:0/4158372366 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feff800bdb0 con 0x7ff0101574b0 2023-10-06T03:04:51.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00ed9d700 1 --2- 172.21.15.125:0/4158372366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feff8004d50 0x7feff80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00e59c700 1 --2- 172.21.15.125:0/4158372366 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0101574b0 0x7feff8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00dd9b700 1 --2- 172.21.15.125:0/4158372366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feff8004010 0x7feff8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00ed9d700 1 -- 172.21.15.125:0/4158372366 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0101574b0 msgr2=0x7feff8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:51.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00ed9d700 1 --2- 172.21.15.125:0/4158372366 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0101574b0 0x7feff8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00ed9d700 1 -- 172.21.15.125:0/4158372366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feff8004010 msgr2=0x7feff8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:51.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00ed9d700 1 --2- 172.21.15.125:0/4158372366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feff8004010 0x7feff8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00ed9d700 1 -- 172.21.15.125:0/4158372366 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff8003570 con 0x7feff8004d50 2023-10-06T03:04:51.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00ed9d700 1 --2- 172.21.15.125:0/4158372366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feff8004d50 0x7feff80051c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff008001f90 tx=0x7ff008001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684e289fa5630fd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:51.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00d59a700 1 -- 172.21.15.125:0/4158372366 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008001950 con 0x7feff8004d50 2023-10-06T03:04:51.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00d59a700 1 -- 172.21.15.125:0/4158372366 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00800c8b0 con 0x7feff8004d50 2023-10-06T03:04:51.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.416+0000 7ff00d59a700 1 -- 172.21.15.125:0/4158372366 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00800cc70 con 0x7feff8004d50 2023-10-06T03:04:51.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.417+0000 7ff0149e0700 1 -- 172.21.15.125:0/4158372366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feff8004d50 msgr2=0x7feff80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:51.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.417+0000 7ff0149e0700 1 --2- 172.21.15.125:0/4158372366 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7feff8004d50 0x7feff80051c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff008001f90 tx=0x7ff008001640 comp rx=0 tx=0).stop 2023-10-06T03:04:51.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.417+0000 7ff00ed9d700 1 -- 172.21.15.125:0/4158372366 reap_dead start 2023-10-06T03:04:51.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.417+0000 7ff0149e0700 1 -- 172.21.15.125:0/4158372366 shutdown_connections 2023-10-06T03:04:51.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.417+0000 7ff0149e0700 1 -- 172.21.15.125:0/4158372366 >> 172.21.15.125:0/4158372366 conn(0x7ff0100af730 msgr2=0x7ff0100afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:51.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.417+0000 7ff0149e0700 1 -- 172.21.15.125:0/4158372366 shutdown_connections 2023-10-06T03:04:51.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.417+0000 7ff0149e0700 1 -- 172.21.15.125:0/4158372366 wait complete. 2023-10-06T03:04:51.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.418+0000 7ff0149e0700 1 Processor -- start 2023-10-06T03:04:51.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.419+0000 7ff0149e0700 1 -- start start 2023-10-06T03:04:51.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.419+0000 7ff0149e0700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feff8004d50 0x7ff01015a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.419+0000 7ff0149e0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff010158e60 0x7ff010151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.419+0000 7ff0149e0700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0100c4190 0x7ff0100c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.419+0000 7ff0149e0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01015a8b0 con 0x7ff010158e60 2023-10-06T03:04:51.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.419+0000 7ff0149e0700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0101592d0 con 0x7feff8004d50 2023-10-06T03:04:51.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.419+0000 7ff0149e0700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0101595b0 con 0x7ff0100c4190 2023-10-06T03:04:51.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.420+0000 7ff00dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff010158e60 0x7ff010151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.420+0000 7ff00dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff010158e60 0x7ff010151f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40618/0 (socket says 172.21.15.125:40618) 2023-10-06T03:04:51.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.420+0000 7ff00dd9b700 1 -- 172.21.15.125:0/277273166 learned_addr learned my addr 172.21.15.125:0/277273166 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:51.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.420+0000 7ff00e59c700 1 --2- 172.21.15.125:0/277273166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feff8004d50 0x7ff01015a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.420+0000 7ff00ed9d700 1 --2- 172.21.15.125:0/277273166 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0100c4190 0x7ff0100c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.420+0000 7ff00dd9b700 1 -- 172.21.15.125:0/277273166 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0100c4190 msgr2=0x7ff0100c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:51.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.420+0000 7ff00dd9b700 1 --2- 172.21.15.125:0/277273166 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0100c4190 0x7ff0100c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.420+0000 7ff00dd9b700 1 -- 172.21.15.125:0/277273166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feff8004d50 msgr2=0x7ff01015a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:51.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.420+0000 7ff00dd9b700 1 --2- 172.21.15.125:0/277273166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feff8004d50 0x7ff01015a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.420+0000 7ff00dd9b700 1 -- 172.21.15.125:0/277273166 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff010159890 con 0x7ff010158e60 2023-10-06T03:04:51.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.420+0000 7ff00ed9d700 1 --2- 172.21.15.125:0/277273166 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0100c4190 0x7ff0100c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:04:51.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.420+0000 7ff00dd9b700 1 --2- 172.21.15.125:0/277273166 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff010158e60 0x7ff010151f80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff000007390 tx=0x7ff000001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:51.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.420+0000 7feffe7fc700 1 -- 172.21.15.125:0/277273166 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000018030 con 0x7ff010158e60 2023-10-06T03:04:51.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.420+0000 7feffe7fc700 1 -- 172.21.15.125:0/277273166 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff000004e00 con 0x7ff010158e60 2023-10-06T03:04:51.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.420+0000 7ff0149e0700 1 -- 172.21.15.125:0/277273166 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff010159b70 con 0x7ff010158e60 2023-10-06T03:04:51.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.420+0000 7feffe7fc700 1 -- 172.21.15.125:0/277273166 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00000fb40 con 0x7ff010158e60 2023-10-06T03:04:51.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.420+0000 7ff0149e0700 1 -- 172.21.15.125:0/277273166 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0101524c0 con 0x7ff010158e60 2023-10-06T03:04:51.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.421+0000 7ff0149e0700 1 -- 172.21.15.125:0/277273166 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff010066510 con 0x7ff010158e60 2023-10-06T03:04:51.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.421+0000 7feffe7fc700 1 -- 172.21.15.125:0/277273166 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff00001b070 con 0x7ff010158e60 2023-10-06T03:04:51.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.422+0000 7feffe7fc700 1 --2- 172.21.15.125:0/277273166 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7feff0066f00 0x7feff00693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.422+0000 7feffe7fc700 1 -- 172.21.15.125:0/277273166 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff000019070 con 0x7ff010158e60 2023-10-06T03:04:51.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.422+0000 7ff00e59c700 1 --2- 172.21.15.125:0/277273166 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7feff0066f00 0x7feff00693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.422+0000 7ff00e59c700 1 --2- 172.21.15.125:0/277273166 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7feff0066f00 0x7feff00693b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff004006ea0 tx=0x7ff004008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:51.428 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.426+0000 7feffe7fc700 1 -- 172.21.15.125:0/277273166 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff000051670 con 0x7ff010158e60 2023-10-06T03:04:51.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.605+0000 7ff0149e0700 1 -- 172.21.15.125:0/277273166 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff01015ca30 con 0x7ff010158e60 2023-10-06T03:04:51.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.605+0000 7feffe7fc700 1 -- 172.21.15.125:0/277273166 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff000054c90 con 0x7ff010158e60 2023-10-06T03:04:51.607 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-06T03:04:51.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.607+0000 7ff0149e0700 1 -- 172.21.15.125:0/277273166 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7feff0066f00 msgr2=0x7feff00693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:51.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.607+0000 7ff0149e0700 1 --2- 172.21.15.125:0/277273166 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7feff0066f00 0x7feff00693b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff004006ea0 tx=0x7ff004008040 comp rx=0 tx=0).stop 2023-10-06T03:04:51.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.607+0000 7ff0149e0700 1 -- 172.21.15.125:0/277273166 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff010158e60 msgr2=0x7ff010151f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:51.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.607+0000 7ff0149e0700 1 --2- 172.21.15.125:0/277273166 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff010158e60 0x7ff010151f80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff000007390 tx=0x7ff000001e50 comp rx=0 tx=0).stop 2023-10-06T03:04:51.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.607+0000 7ff0149e0700 1 -- 172.21.15.125:0/277273166 shutdown_connections 2023-10-06T03:04:51.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.607+0000 7ff0149e0700 1 --2- 172.21.15.125:0/277273166 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7feff0066f00 0x7feff00693b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.607+0000 7ff0149e0700 1 --2- 172.21.15.125:0/277273166 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff0100c4190 0x7ff0100c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.607+0000 7ff0149e0700 1 --2- 172.21.15.125:0/277273166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feff8004d50 0x7ff01015a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.607+0000 7ff0149e0700 1 --2- 172.21.15.125:0/277273166 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff010158e60 0x7ff010151f80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.607+0000 7ff0149e0700 1 -- 172.21.15.125:0/277273166 >> 172.21.15.125:0/277273166 conn(0x7ff0100af730 msgr2=0x7ff010153e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:51.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.608+0000 7ff0149e0700 1 -- 172.21.15.125:0/277273166 shutdown_connections 2023-10-06T03:04:51.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.608+0000 7ff0149e0700 1 -- 172.21.15.125:0/277273166 wait complete. 2023-10-06T03:04:51.621 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:04:51.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.739+0000 7f3b9eec7700 1 Processor -- start 2023-10-06T03:04:51.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.739+0000 7f3b9eec7700 1 -- start start 2023-10-06T03:04:51.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.740+0000 7f3b9eec7700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3b98067610 0x7f3b980b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.740+0000 7f3b9eec7700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b98068ba0 0x7f3b980cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.740+0000 7f3b9eec7700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b980ca670 con 0x7f3b9815cb00 2023-10-06T03:04:51.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.740+0000 7f3b9eec7700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b98068320 con 0x7f3b98067610 2023-10-06T03:04:51.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.740+0000 7f3b9eec7700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b98067a80 con 0x7f3b98068ba0 2023-10-06T03:04:51.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.740+0000 7f3b97fff700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3b98067610 0x7f3b980b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.740+0000 7f3b97fff700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3b98067610 0x7f3b980b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:50828/0 (socket says 172.21.15.125:50828) 2023-10-06T03:04:51.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.740+0000 7f3b97fff700 1 -- 172.21.15.125:0/272664158 learned_addr learned my addr 172.21.15.125:0/272664158 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:51.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.740+0000 7f3b9d464700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b98068ba0 0x7f3b980cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.740+0000 7f3b9cc63700 1 --1- 172.21.15.125:0/272664158 >> v1:172.21.15.130:6789/0 conn(0x7f3b9815cb00 0x7f3b98068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:52484/0 (socket says 172.21.15.125:52484) 2023-10-06T03:04:51.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.740+0000 7f3b97fff700 1 -- 172.21.15.125:0/272664158 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b98068ba0 msgr2=0x7f3b980cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:51.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.740+0000 7f3b97fff700 1 --2- 172.21.15.125:0/272664158 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b98068ba0 0x7f3b980cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.740+0000 7f3b97fff700 1 -- 172.21.15.125:0/272664158 >> v1:172.21.15.130:6789/0 conn(0x7f3b9815cb00 legacy=0x7f3b98068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:51.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.740+0000 7f3b97fff700 1 -- 172.21.15.125:0/272664158 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b98067d60 con 0x7f3b98067610 2023-10-06T03:04:51.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.740+0000 7f3b9d464700 1 --2- 172.21.15.125:0/272664158 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b98068ba0 0x7f3b980cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:51.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.741+0000 7f3b97fff700 1 --2- 172.21.15.125:0/272664158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b98067610 0x7f3b980b0240 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3b840099b0 tx=0x7f3b84009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fede9d8f9700621 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:51.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.741+0000 7f3b977fe700 1 -- 172.21.15.125:0/272664158 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84009ea0 con 0x7f3b98067610 2023-10-06T03:04:51.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.741+0000 7f3b977fe700 1 -- 172.21.15.125:0/272664158 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8400b860 con 0x7f3b98067610 2023-10-06T03:04:51.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.741+0000 7f3b977fe700 1 -- 172.21.15.125:0/272664158 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8400bc00 con 0x7f3b98067610 2023-10-06T03:04:51.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.741+0000 7f3b9eec7700 1 -- 172.21.15.125:0/272664158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b98067610 msgr2=0x7f3b980b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:51.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.741+0000 7f3b9eec7700 1 --2- 172.21.15.125:0/272664158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b98067610 0x7f3b980b0240 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3b840099b0 tx=0x7f3b84009250 comp rx=0 tx=0).stop 2023-10-06T03:04:51.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.741+0000 7f3b9eec7700 1 -- 172.21.15.125:0/272664158 shutdown_connections 2023-10-06T03:04:51.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.741+0000 7f3b9eec7700 1 --2- 172.21.15.125:0/272664158 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b98068ba0 0x7f3b980cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.741+0000 7f3b9eec7700 1 --2- 172.21.15.125:0/272664158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b98067610 0x7f3b980b0240 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.741+0000 7f3b9eec7700 1 -- 172.21.15.125:0/272664158 >> 172.21.15.125:0/272664158 conn(0x7f3b980af730 msgr2=0x7f3b980afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:51.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.741+0000 7f3b9eec7700 1 -- 172.21.15.125:0/272664158 shutdown_connections 2023-10-06T03:04:51.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.741+0000 7f3b9eec7700 1 -- 172.21.15.125:0/272664158 wait complete. 2023-10-06T03:04:51.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.742+0000 7f3b9eec7700 1 Processor -- start 2023-10-06T03:04:51.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.743+0000 7f3b9eec7700 1 -- start start 2023-10-06T03:04:51.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.743+0000 7f3b9eec7700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b98067610 0x7f3b980c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.743+0000 7f3b9eec7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b98068ba0 0x7f3b980c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.743+0000 7f3b9eec7700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b9815cb00 0x7f3b98169fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.743+0000 7f3b9eec7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b98097f20 con 0x7f3b98068ba0 2023-10-06T03:04:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.743+0000 7f3b9eec7700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b98097a90 con 0x7f3b98067610 2023-10-06T03:04:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.743+0000 7f3b9eec7700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b98096e80 con 0x7f3b9815cb00 2023-10-06T03:04:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.744+0000 7f3b97fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b98068ba0 0x7f3b980c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.744+0000 7f3b97fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b98068ba0 0x7f3b980c5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40620/0 (socket says 172.21.15.125:40620) 2023-10-06T03:04:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.744+0000 7f3b97fff700 1 -- 172.21.15.125:0/812077255 learned_addr learned my addr 172.21.15.125:0/812077255 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.744+0000 7f3b9d464700 1 --2- 172.21.15.125:0/812077255 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b9815cb00 0x7f3b98169fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.744+0000 7f3b9cc63700 1 --2- 172.21.15.125:0/812077255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b98067610 0x7f3b980c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.744+0000 7f3b97fff700 1 -- 172.21.15.125:0/812077255 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b9815cb00 msgr2=0x7f3b98169fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.744+0000 7f3b97fff700 1 --2- 172.21.15.125:0/812077255 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b9815cb00 0x7f3b98169fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.744+0000 7f3b97fff700 1 -- 172.21.15.125:0/812077255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b98067610 msgr2=0x7f3b980c5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.744+0000 7f3b97fff700 1 --2- 172.21.15.125:0/812077255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b98067610 0x7f3b980c5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.744+0000 7f3b97fff700 1 -- 172.21.15.125:0/812077255 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b90009a20 con 0x7f3b98068ba0 2023-10-06T03:04:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.744+0000 7f3b97fff700 1 --2- 172.21.15.125:0/812077255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b98068ba0 0x7f3b980c5fb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b9806dbf0 tx=0x7f3b84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.744+0000 7f3b94ff9700 1 -- 172.21.15.125:0/812077255 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8400bbe0 con 0x7f3b98068ba0 2023-10-06T03:04:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.744+0000 7f3b94ff9700 1 -- 172.21.15.125:0/812077255 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b84011420 con 0x7f3b98068ba0 2023-10-06T03:04:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.744+0000 7f3b94ff9700 1 -- 172.21.15.125:0/812077255 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b840117c0 con 0x7f3b98068ba0 2023-10-06T03:04:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.744+0000 7f3b9eec7700 1 -- 172.21.15.125:0/812077255 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b840094f0 con 0x7f3b98068ba0 2023-10-06T03:04:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.744+0000 7f3b9eec7700 1 -- 172.21.15.125:0/812077255 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b98097440 con 0x7f3b98068ba0 2023-10-06T03:04:51.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.745+0000 7f3b9eec7700 1 -- 172.21.15.125:0/812077255 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b98097c00 con 0x7f3b98068ba0 2023-10-06T03:04:51.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.746+0000 7f3b94ff9700 1 -- 172.21.15.125:0/812077255 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b84011bb0 con 0x7f3b98068ba0 2023-10-06T03:04:51.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.746+0000 7f3b94ff9700 1 --2- 172.21.15.125:0/812077255 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3b7c066f30 0x7f3b7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:51.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.746+0000 7f3b94ff9700 1 -- 172.21.15.125:0/812077255 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3b84086170 con 0x7f3b98068ba0 2023-10-06T03:04:51.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.746+0000 7f3b9cc63700 1 --2- 172.21.15.125:0/812077255 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3b7c066f30 0x7f3b7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:51.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.746+0000 7f3b9cc63700 1 --2- 172.21.15.125:0/812077255 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3b7c066f30 0x7f3b7c0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c007fd0 tx=0x7f3b8c007f00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:51.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.750+0000 7f3b94ff9700 1 -- 172.21.15.125:0/812077255 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b84053050 con 0x7f3b98068ba0 2023-10-06T03:04:51.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.930+0000 7f3b9eec7700 1 -- 172.21.15.125:0/812077255 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3b98066510 con 0x7f3b98068ba0 2023-10-06T03:04:51.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.930+0000 7f3b94ff9700 1 -- 172.21.15.125:0/812077255 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3b84011e60 con 0x7f3b98068ba0 2023-10-06T03:04:51.932 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-06T03:04:51.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.932+0000 7f3b9eec7700 1 -- 172.21.15.125:0/812077255 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3b7c066f30 msgr2=0x7f3b7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:51.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.932+0000 7f3b9eec7700 1 --2- 172.21.15.125:0/812077255 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3b7c066f30 0x7f3b7c0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c007fd0 tx=0x7f3b8c007f00 comp rx=0 tx=0).stop 2023-10-06T03:04:51.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.932+0000 7f3b9eec7700 1 -- 172.21.15.125:0/812077255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b98068ba0 msgr2=0x7f3b980c5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:51.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.932+0000 7f3b9eec7700 1 --2- 172.21.15.125:0/812077255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b98068ba0 0x7f3b980c5fb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b9806dbf0 tx=0x7f3b84017000 comp rx=0 tx=0).stop 2023-10-06T03:04:51.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.932+0000 7f3b9eec7700 1 -- 172.21.15.125:0/812077255 shutdown_connections 2023-10-06T03:04:51.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.932+0000 7f3b9eec7700 1 --2- 172.21.15.125:0/812077255 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3b7c066f30 0x7f3b7c0693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.932+0000 7f3b9eec7700 1 --2- 172.21.15.125:0/812077255 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3b9815cb00 0x7f3b98169fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.932+0000 7f3b9eec7700 1 --2- 172.21.15.125:0/812077255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3b98067610 0x7f3b980c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.932+0000 7f3b9eec7700 1 --2- 172.21.15.125:0/812077255 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3b98068ba0 0x7f3b980c5fb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:51.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.932+0000 7f3b9eec7700 1 -- 172.21.15.125:0/812077255 >> 172.21.15.125:0/812077255 conn(0x7f3b980af730 msgr2=0x7f3b9806b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:51.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.932+0000 7f3b9eec7700 1 -- 172.21.15.125:0/812077255 shutdown_connections 2023-10-06T03:04:51.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:51.932+0000 7f3b9eec7700 1 -- 172.21.15.125:0/812077255 wait complete. 2023-10-06T03:04:51.945 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:04:52.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.064+0000 7fb501b7f700 1 Processor -- start 2023-10-06T03:04:52.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.064+0000 7fb501b7f700 1 -- start start 2023-10-06T03:04:52.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.065+0000 7fb501b7f700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb4fc1574b0 0x7fb4fc067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:52.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.065+0000 7fb501b7f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb4fc0b0240 0x7fb4fc0cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:52.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.065+0000 7fb501b7f700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4fc067b50 con 0x7fb4fc0c6eb0 2023-10-06T03:04:52.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.065+0000 7fb501b7f700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4fc0c7f70 con 0x7fb4fc1574b0 2023-10-06T03:04:52.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.065+0000 7fb501b7f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc0c8210 con 0x7fb4fc0b0240 2023-10-06T03:04:52.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.065+0000 7fb4fb7fe700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb4fc1574b0 0x7fb4fc067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:52.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.065+0000 7fb4fbfff700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fb4fc0c6eb0 0x7fb4fc0c95e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:52488/0 (socket says 172.21.15.125:52488) 2023-10-06T03:04:52.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.065+0000 7fb4faffd700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb4fc0b0240 0x7fb4fc0cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:52.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.065+0000 7fb4fb7fe700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb4fc1574b0 0x7fb4fc067610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:50838/0 (socket says 172.21.15.125:50838) 2023-10-06T03:04:52.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.065+0000 7fb4fbfff700 1 -- 172.21.15.125:0/4279292070 learned_addr learned my addr 172.21.15.125:0/4279292070 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:52.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.065+0000 7fb4fa7fc700 1 -- 172.21.15.125:0/4279292070 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113694648 0 0) 0x7fb4fc067b50 con 0x7fb4fc0c6eb0 2023-10-06T03:04:52.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.065+0000 7fb4fa7fc700 1 -- 172.21.15.125:0/4279292070 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4e8003570 con 0x7fb4fc0c6eb0 2023-10-06T03:04:52.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.065+0000 7fb4fb7fe700 1 -- 172.21.15.125:0/4279292070 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb4fc0b0240 msgr2=0x7fb4fc0cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:52.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.065+0000 7fb4fb7fe700 1 --2- 172.21.15.125:0/4279292070 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb4fc0b0240 0x7fb4fc0cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.065+0000 7fb4fb7fe700 1 -- 172.21.15.125:0/4279292070 >> v1:172.21.15.130:6789/0 conn(0x7fb4fc0c6eb0 legacy=0x7fb4fc0c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:52.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.065+0000 7fb4fb7fe700 1 -- 172.21.15.125:0/4279292070 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc0c8b00 con 0x7fb4fc1574b0 2023-10-06T03:04:52.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.065+0000 7fb4faffd700 1 --2- 172.21.15.125:0/4279292070 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb4fc0b0240 0x7fb4fc0cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:04:52.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.066+0000 7fb4fb7fe700 1 --2- 172.21.15.125:0/4279292070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4fc1574b0 0x7fb4fc067610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40098d0 tx=0x7fb4e4009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c483bccbb7b40f63 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:52.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.066+0000 7fb4fa7fc700 1 -- 172.21.15.125:0/4279292070 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4005c10 con 0x7fb4fc1574b0 2023-10-06T03:04:52.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.066+0000 7fb4fa7fc700 1 -- 172.21.15.125:0/4279292070 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e4005d70 con 0x7fb4fc1574b0 2023-10-06T03:04:52.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.066+0000 7fb4fa7fc700 1 -- 172.21.15.125:0/4279292070 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4006260 con 0x7fb4fc1574b0 2023-10-06T03:04:52.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.066+0000 7fb501b7f700 1 -- 172.21.15.125:0/4279292070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4fc1574b0 msgr2=0x7fb4fc067610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:52.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.066+0000 7fb501b7f700 1 --2- 172.21.15.125:0/4279292070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4fc1574b0 0x7fb4fc067610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40098d0 tx=0x7fb4e4009120 comp rx=0 tx=0).stop 2023-10-06T03:04:52.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.066+0000 7fb501b7f700 1 -- 172.21.15.125:0/4279292070 shutdown_connections 2023-10-06T03:04:52.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.066+0000 7fb501b7f700 1 --2- 172.21.15.125:0/4279292070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4fc1574b0 0x7fb4fc067610 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.066+0000 7fb501b7f700 1 --2- 172.21.15.125:0/4279292070 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb4fc0b0240 0x7fb4fc0cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.066+0000 7fb501b7f700 1 -- 172.21.15.125:0/4279292070 >> 172.21.15.125:0/4279292070 conn(0x7fb4fc0af730 msgr2=0x7fb4fc0afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:52.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.066+0000 7fb501b7f700 1 -- 172.21.15.125:0/4279292070 shutdown_connections 2023-10-06T03:04:52.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.066+0000 7fb501b7f700 1 -- 172.21.15.125:0/4279292070 wait complete. 2023-10-06T03:04:52.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.068+0000 7fb501b7f700 1 Processor -- start 2023-10-06T03:04:52.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.068+0000 7fb501b7f700 1 -- start start 2023-10-06T03:04:52.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.068+0000 7fb501b7f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb4fc0b0240 0x7fb4fc0c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:52.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.068+0000 7fb501b7f700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4fc0c6eb0 0x7fb4fc1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:52.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.068+0000 7fb501b7f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4fc1574b0 0x7fb4fc0c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:52.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.069+0000 7fb501b7f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc15bab0 con 0x7fb4fc1574b0 2023-10-06T03:04:52.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.069+0000 7fb501b7f700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc0c5090 con 0x7fb4fc0c6eb0 2023-10-06T03:04:52.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.069+0000 7fb501b7f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4fc15b180 con 0x7fb4fc0b0240 2023-10-06T03:04:52.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.069+0000 7fb4fbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4fc1574b0 0x7fb4fc0c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:52.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.069+0000 7fb4fbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4fc1574b0 0x7fb4fc0c5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40626/0 (socket says 172.21.15.125:40626) 2023-10-06T03:04:52.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.069+0000 7fb4fbfff700 1 -- 172.21.15.125:0/2639934995 learned_addr learned my addr 172.21.15.125:0/2639934995 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:52.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.069+0000 7fb4fb7fe700 1 --2- 172.21.15.125:0/2639934995 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb4fc0b0240 0x7fb4fc0c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:52.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.069+0000 7fb4faffd700 1 --2- 172.21.15.125:0/2639934995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4fc0c6eb0 0x7fb4fc1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:52.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.069+0000 7fb4fbfff700 1 -- 172.21.15.125:0/2639934995 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb4fc0b0240 msgr2=0x7fb4fc0c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:52.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.069+0000 7fb4fbfff700 1 --2- 172.21.15.125:0/2639934995 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb4fc0b0240 0x7fb4fc0c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.069+0000 7fb4fbfff700 1 -- 172.21.15.125:0/2639934995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4fc0c6eb0 msgr2=0x7fb4fc1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:52.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.069+0000 7fb4fbfff700 1 --2- 172.21.15.125:0/2639934995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4fc0c6eb0 0x7fb4fc1589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.069+0000 7fb4fbfff700 1 -- 172.21.15.125:0/2639934995 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec009420 con 0x7fb4fc1574b0 2023-10-06T03:04:52.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.069+0000 7fb4fbfff700 1 --2- 172.21.15.125:0/2639934995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4fc1574b0 0x7fb4fc0c5d00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4001460 tx=0x7fb4f4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:52.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.069+0000 7fb4f37fe700 1 -- 172.21.15.125:0/2639934995 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f400a890 con 0x7fb4fc1574b0 2023-10-06T03:04:52.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.069+0000 7fb4f37fe700 1 -- 172.21.15.125:0/2639934995 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f400a9f0 con 0x7fb4fc1574b0 2023-10-06T03:04:52.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.069+0000 7fb501b7f700 1 -- 172.21.15.125:0/2639934995 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e40093c0 con 0x7fb4fc1574b0 2023-10-06T03:04:52.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.069+0000 7fb4f37fe700 1 -- 172.21.15.125:0/2639934995 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f400ad70 con 0x7fb4fc1574b0 2023-10-06T03:04:52.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.069+0000 7fb501b7f700 1 -- 172.21.15.125:0/2639934995 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4fc15b740 con 0x7fb4fc1574b0 2023-10-06T03:04:52.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.070+0000 7fb501b7f700 1 -- 172.21.15.125:0/2639934995 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4fc067820 con 0x7fb4fc1574b0 2023-10-06T03:04:52.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.071+0000 7fb4f37fe700 1 -- 172.21.15.125:0/2639934995 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb4f4007300 con 0x7fb4fc1574b0 2023-10-06T03:04:52.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.071+0000 7fb4f37fe700 1 --2- 172.21.15.125:0/2639934995 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb4dc066f30 0x7fb4dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:52.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.071+0000 7fb4f37fe700 1 -- 172.21.15.125:0/2639934995 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fb4f4084e30 con 0x7fb4fc1574b0 2023-10-06T03:04:52.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.071+0000 7fb4fb7fe700 1 --2- 172.21.15.125:0/2639934995 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb4dc066f30 0x7fb4dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:52.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.071+0000 7fb4fb7fe700 1 --2- 172.21.15.125:0/2639934995 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb4dc066f30 0x7fb4dc0693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009160 tx=0x7fb4e4016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:52.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.075+0000 7fb4f37fe700 1 -- 172.21.15.125:0/2639934995 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4f4051bc0 con 0x7fb4fc1574b0 2023-10-06T03:04:52.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.257+0000 7fb501b7f700 1 -- 172.21.15.125:0/2639934995 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4fc066510 con 0x7fb4fc1574b0 2023-10-06T03:04:52.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.257+0000 7fb4f37fe700 1 -- 172.21.15.125:0/2639934995 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb4f40551e0 con 0x7fb4fc1574b0 2023-10-06T03:04:52.259 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-06T03:04:52.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.259+0000 7fb501b7f700 1 -- 172.21.15.125:0/2639934995 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb4dc066f30 msgr2=0x7fb4dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:52.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.259+0000 7fb501b7f700 1 --2- 172.21.15.125:0/2639934995 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb4dc066f30 0x7fb4dc0693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009160 tx=0x7fb4e4016000 comp rx=0 tx=0).stop 2023-10-06T03:04:52.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.259+0000 7fb501b7f700 1 -- 172.21.15.125:0/2639934995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4fc1574b0 msgr2=0x7fb4fc0c5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:52.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.259+0000 7fb501b7f700 1 --2- 172.21.15.125:0/2639934995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4fc1574b0 0x7fb4fc0c5d00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4001460 tx=0x7fb4f4001ae0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.259+0000 7fb501b7f700 1 -- 172.21.15.125:0/2639934995 shutdown_connections 2023-10-06T03:04:52.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.259+0000 7fb501b7f700 1 --2- 172.21.15.125:0/2639934995 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb4dc066f30 0x7fb4dc0693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.259+0000 7fb501b7f700 1 --2- 172.21.15.125:0/2639934995 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb4fc1574b0 0x7fb4fc0c5d00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.259+0000 7fb501b7f700 1 --2- 172.21.15.125:0/2639934995 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb4fc0b0240 0x7fb4fc0c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.259+0000 7fb501b7f700 1 --2- 172.21.15.125:0/2639934995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4fc0c6eb0 0x7fb4fc1589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.259+0000 7fb501b7f700 1 -- 172.21.15.125:0/2639934995 >> 172.21.15.125:0/2639934995 conn(0x7fb4fc0af730 msgr2=0x7fb4fc0afb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:52.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.259+0000 7fb501b7f700 1 -- 172.21.15.125:0/2639934995 shutdown_connections 2023-10-06T03:04:52.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.259+0000 7fb501b7f700 1 -- 172.21.15.125:0/2639934995 wait complete. 2023-10-06T03:04:52.272 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:04:52.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.391+0000 7f2f4d7c5700 1 Processor -- start 2023-10-06T03:04:52.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.391+0000 7f2f4d7c5700 1 -- start start 2023-10-06T03:04:52.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.392+0000 7f2f4d7c5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2f480aa2f0 0x7f2f480b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:52.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.392+0000 7f2f4d7c5700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f48068bd0 0x7f2f481576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:52.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.392+0000 7f2f4d7c5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f480aa760 con 0x7f2f48157300 2023-10-06T03:04:52.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.392+0000 7f2f4d7c5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f480aaa40 con 0x7f2f480aa2f0 2023-10-06T03:04:52.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.392+0000 7f2f4d7c5700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480aad20 con 0x7f2f48068bd0 2023-10-06T03:04:52.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.392+0000 7f2f46ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2f48157300 0x7f2f480684c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53300/0 (socket says 172.21.15.125:53300) 2023-10-06T03:04:52.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.392+0000 7f2f467fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2f480aa2f0 0x7f2f480b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:52.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.392+0000 7f2f46ffd700 1 -- 172.21.15.125:0/2937296592 learned_addr learned my addr 172.21.15.125:0/2937296592 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:52.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.393+0000 7f2f477fe700 1 --2- 172.21.15.125:0/2937296592 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f48068bd0 0x7f2f481576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:52.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.393+0000 7f2f467fc700 1 -- 172.21.15.125:0/2937296592 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f48068bd0 msgr2=0x7f2f481576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:52.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.393+0000 7f2f467fc700 1 --2- 172.21.15.125:0/2937296592 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f48068bd0 0x7f2f481576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.393+0000 7f2f467fc700 1 -- 172.21.15.125:0/2937296592 >> v1:172.21.15.125:6789/0 conn(0x7f2f48157300 legacy=0x7f2f480684c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:52.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.393+0000 7f2f45ffb700 1 -- 172.21.15.125:0/2937296592 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448790875 0 0) 0x7f2f480aa760 con 0x7f2f48157300 2023-10-06T03:04:52.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.393+0000 7f2f467fc700 1 -- 172.21.15.125:0/2937296592 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f480ab000 con 0x7f2f480aa2f0 2023-10-06T03:04:52.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.393+0000 7f2f467fc700 1 --2- 172.21.15.125:0/2937296592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f480aa2f0 0x7f2f480b0240 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2f380098e0 tx=0x7f2f380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914fb7bbcc12b0f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:52.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.393+0000 7f2f45ffb700 1 -- 172.21.15.125:0/2937296592 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3800b640 con 0x7f2f480aa2f0 2023-10-06T03:04:52.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.393+0000 7f2f45ffb700 1 -- 172.21.15.125:0/2937296592 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3800b7a0 con 0x7f2f480aa2f0 2023-10-06T03:04:52.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.393+0000 7f2f45ffb700 1 -- 172.21.15.125:0/2937296592 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3800bb40 con 0x7f2f480aa2f0 2023-10-06T03:04:52.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.394+0000 7f2f4d7c5700 1 -- 172.21.15.125:0/2937296592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f480aa2f0 msgr2=0x7f2f480b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:52.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.394+0000 7f2f4d7c5700 1 --2- 172.21.15.125:0/2937296592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f480aa2f0 0x7f2f480b0240 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2f380098e0 tx=0x7f2f380091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.394+0000 7f2f4d7c5700 1 -- 172.21.15.125:0/2937296592 shutdown_connections 2023-10-06T03:04:52.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.394+0000 7f2f4d7c5700 1 --2- 172.21.15.125:0/2937296592 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f48068bd0 0x7f2f481576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.394+0000 7f2f4d7c5700 1 --2- 172.21.15.125:0/2937296592 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f480aa2f0 0x7f2f480b0240 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.394+0000 7f2f4d7c5700 1 -- 172.21.15.125:0/2937296592 >> 172.21.15.125:0/2937296592 conn(0x7f2f480af730 msgr2=0x7f2f480afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:52.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.394+0000 7f2f4d7c5700 1 -- 172.21.15.125:0/2937296592 shutdown_connections 2023-10-06T03:04:52.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.394+0000 7f2f4d7c5700 1 -- 172.21.15.125:0/2937296592 wait complete. 2023-10-06T03:04:52.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.395+0000 7f2f4d7c5700 1 Processor -- start 2023-10-06T03:04:52.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.395+0000 7f2f4d7c5700 1 -- start start 2023-10-06T03:04:52.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f4d7c5700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f48068bd0 0x7f2f480aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:52.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f4d7c5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f480aa2f0 0x7f2f480c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:52.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f4d7c5700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f48157300 0x7f2f4815c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:52.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f4d7c5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4815ca30 con 0x7f2f480aa2f0 2023-10-06T03:04:52.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f4d7c5700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480c1a30 con 0x7f2f48157300 2023-10-06T03:04:52.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f4d7c5700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f480c1ff0 con 0x7f2f48068bd0 2023-10-06T03:04:52.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f467fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f480aa2f0 0x7f2f480c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:52.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f467fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f480aa2f0 0x7f2f480c7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40650/0 (socket says 172.21.15.125:40650) 2023-10-06T03:04:52.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f467fc700 1 -- 172.21.15.125:0/270677820 learned_addr learned my addr 172.21.15.125:0/270677820 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:52.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f46ffd700 1 --2- 172.21.15.125:0/270677820 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f48068bd0 0x7f2f480aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:52.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f477fe700 1 --2- 172.21.15.125:0/270677820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f48157300 0x7f2f4815c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:52.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f467fc700 1 -- 172.21.15.125:0/270677820 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f48068bd0 msgr2=0x7f2f480aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:52.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f467fc700 1 --2- 172.21.15.125:0/270677820 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f48068bd0 0x7f2f480aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f467fc700 1 -- 172.21.15.125:0/270677820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f48157300 msgr2=0x7f2f4815c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:52.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f467fc700 1 --2- 172.21.15.125:0/270677820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f48157300 0x7f2f4815c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f467fc700 1 -- 172.21.15.125:0/270677820 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f38009420 con 0x7f2f480aa2f0 2023-10-06T03:04:52.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f467fc700 1 --2- 172.21.15.125:0/270677820 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f480aa2f0 0x7f2f480c7c50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2f38013000 tx=0x7f2f38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:52.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f3effd700 1 -- 172.21.15.125:0/270677820 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3800bb20 con 0x7f2f480aa2f0 2023-10-06T03:04:52.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f3effd700 1 -- 172.21.15.125:0/270677820 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f38000c90 con 0x7f2f480aa2f0 2023-10-06T03:04:52.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f4d7c5700 1 -- 172.21.15.125:0/270677820 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4815cc40 con 0x7f2f480aa2f0 2023-10-06T03:04:52.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f3effd700 1 -- 172.21.15.125:0/270677820 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f38011650 con 0x7f2f480aa2f0 2023-10-06T03:04:52.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.396+0000 7f2f4d7c5700 1 -- 172.21.15.125:0/270677820 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f480c1c80 con 0x7f2f480aa2f0 2023-10-06T03:04:52.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.397+0000 7f2f4d7c5700 1 -- 172.21.15.125:0/270677820 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4815d160 con 0x7f2f480aa2f0 2023-10-06T03:04:52.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.398+0000 7f2f3effd700 1 -- 172.21.15.125:0/270677820 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f38011a00 con 0x7f2f480aa2f0 2023-10-06T03:04:52.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.398+0000 7f2f3effd700 1 --2- 172.21.15.125:0/270677820 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2f28066f30 0x7f2f280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:52.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.398+0000 7f2f3effd700 1 -- 172.21.15.125:0/270677820 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2f38085f50 con 0x7f2f480aa2f0 2023-10-06T03:04:52.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.398+0000 7f2f46ffd700 1 --2- 172.21.15.125:0/270677820 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2f28066f30 0x7f2f280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:52.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.399+0000 7f2f46ffd700 1 --2- 172.21.15.125:0/270677820 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2f28066f30 0x7f2f280693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2f300029c0 tx=0x7f2f30009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:52.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.402+0000 7f2f3effd700 1 -- 172.21.15.125:0/270677820 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f38052df0 con 0x7f2f480aa2f0 2023-10-06T03:04:52.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.582+0000 7f2f4d7c5700 1 -- 172.21.15.125:0/270677820 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f480c2160 con 0x7f2f480aa2f0 2023-10-06T03:04:52.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.582+0000 7f2f3effd700 1 -- 172.21.15.125:0/270677820 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2f380150a0 con 0x7f2f480aa2f0 2023-10-06T03:04:52.584 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-06T03:04:52.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.584+0000 7f2f4d7c5700 1 -- 172.21.15.125:0/270677820 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2f28066f30 msgr2=0x7f2f280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:52.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.584+0000 7f2f4d7c5700 1 --2- 172.21.15.125:0/270677820 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2f28066f30 0x7f2f280693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2f300029c0 tx=0x7f2f30009040 comp rx=0 tx=0).stop 2023-10-06T03:04:52.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.584+0000 7f2f4d7c5700 1 -- 172.21.15.125:0/270677820 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f480aa2f0 msgr2=0x7f2f480c7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:52.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.584+0000 7f2f4d7c5700 1 --2- 172.21.15.125:0/270677820 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f480aa2f0 0x7f2f480c7c50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2f38013000 tx=0x7f2f38017000 comp rx=0 tx=0).stop 2023-10-06T03:04:52.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.584+0000 7f2f4d7c5700 1 -- 172.21.15.125:0/270677820 shutdown_connections 2023-10-06T03:04:52.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.584+0000 7f2f4d7c5700 1 --2- 172.21.15.125:0/270677820 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2f28066f30 0x7f2f280693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.584+0000 7f2f4d7c5700 1 --2- 172.21.15.125:0/270677820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2f48157300 0x7f2f4815c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.584+0000 7f2f4d7c5700 1 --2- 172.21.15.125:0/270677820 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2f48068bd0 0x7f2f480aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.584+0000 7f2f4d7c5700 1 --2- 172.21.15.125:0/270677820 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2f480aa2f0 0x7f2f480c7c50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.584+0000 7f2f4d7c5700 1 -- 172.21.15.125:0/270677820 >> 172.21.15.125:0/270677820 conn(0x7f2f480af730 msgr2=0x7f2f4806aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:52.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.584+0000 7f2f4d7c5700 1 -- 172.21.15.125:0/270677820 shutdown_connections 2023-10-06T03:04:52.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.584+0000 7f2f4d7c5700 1 -- 172.21.15.125:0/270677820 wait complete. 2023-10-06T03:04:52.597 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:04:52.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.716+0000 7f9a55648700 1 Processor -- start 2023-10-06T03:04:52.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.716+0000 7f9a55648700 1 -- start start 2023-10-06T03:04:52.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.717+0000 7f9a55648700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9a50157300 0x7f9a500b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:52.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.717+0000 7f9a55648700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9a501576d0 0x7f9a500684c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:52.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.717+0000 7f9a55648700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a50068e20 con 0x7f9a50068a00 2023-10-06T03:04:52.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.717+0000 7f9a55648700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a500aa760 con 0x7f9a501576d0 2023-10-06T03:04:52.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.717+0000 7f9a55648700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a500aaa40 con 0x7f9a50157300 2023-10-06T03:04:52.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.717+0000 7f9a4e7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9a501576d0 0x7f9a500684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:52.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.717+0000 7f9a4e7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9a501576d0 0x7f9a500684c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40666/0 (socket says 172.21.15.125:40666) 2023-10-06T03:04:52.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.717+0000 7f9a4e7fc700 1 -- 172.21.15.125:0/1730201702 learned_addr learned my addr 172.21.15.125:0/1730201702 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:52.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.718+0000 7f9a4effd700 1 --2- 172.21.15.125:0/1730201702 >> v2:172.21.15.130:3300/0 conn(0x7f9a50157300 0x7f9a500b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:52.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.718+0000 7f9a4e7fc700 1 -- 172.21.15.125:0/1730201702 >> v2:172.21.15.130:3300/0 conn(0x7f9a50157300 msgr2=0x7f9a500b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:52.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.718+0000 7f9a4e7fc700 1 --2- 172.21.15.125:0/1730201702 >> v2:172.21.15.130:3300/0 conn(0x7f9a50157300 0x7f9a500b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.718+0000 7f9a4e7fc700 1 -- 172.21.15.125:0/1730201702 >> v1:172.21.15.130:6789/0 conn(0x7f9a50068a00 legacy=0x7f9a500a92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:52.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.718+0000 7f9a4e7fc700 1 -- 172.21.15.125:0/1730201702 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a500aad20 con 0x7f9a501576d0 2023-10-06T03:04:52.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.718+0000 7f9a4e7fc700 1 --2- 172.21.15.125:0/1730201702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a501576d0 0x7f9a500684c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9a5006fdf0 tx=0x7f9a40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae26aa9620a5e62 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:52.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.718+0000 7f9a4dffb700 1 -- 172.21.15.125:0/1730201702 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4000b860 con 0x7f9a501576d0 2023-10-06T03:04:52.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.718+0000 7f9a4dffb700 1 -- 172.21.15.125:0/1730201702 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4000b9c0 con 0x7f9a501576d0 2023-10-06T03:04:52.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.718+0000 7f9a4dffb700 1 -- 172.21.15.125:0/1730201702 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4000bd60 con 0x7f9a501576d0 2023-10-06T03:04:52.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.719+0000 7f9a55648700 1 -- 172.21.15.125:0/1730201702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a501576d0 msgr2=0x7f9a500684c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:52.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.719+0000 7f9a55648700 1 --2- 172.21.15.125:0/1730201702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a501576d0 0x7f9a500684c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9a5006fdf0 tx=0x7f9a40009250 comp rx=0 tx=0).stop 2023-10-06T03:04:52.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.719+0000 7f9a55648700 1 -- 172.21.15.125:0/1730201702 shutdown_connections 2023-10-06T03:04:52.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.719+0000 7f9a55648700 1 --2- 172.21.15.125:0/1730201702 >> v2:172.21.15.130:3300/0 conn(0x7f9a50157300 0x7f9a500b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.719+0000 7f9a55648700 1 --2- 172.21.15.125:0/1730201702 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a501576d0 0x7f9a500684c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.719+0000 7f9a55648700 1 -- 172.21.15.125:0/1730201702 >> 172.21.15.125:0/1730201702 conn(0x7f9a500af730 msgr2=0x7f9a500afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:52.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.719+0000 7f9a55648700 1 -- 172.21.15.125:0/1730201702 shutdown_connections 2023-10-06T03:04:52.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.719+0000 7f9a55648700 1 -- 172.21.15.125:0/1730201702 wait complete. 2023-10-06T03:04:52.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.720+0000 7f9a55648700 1 Processor -- start 2023-10-06T03:04:52.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.720+0000 7f9a55648700 1 -- start start 2023-10-06T03:04:52.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a55648700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a50068a00 0x7f9a5014eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:52.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a55648700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a50157300 0x7f9a5014d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:52.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a55648700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a501576d0 0x7f9a500a92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:52.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a55648700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5014ffd0 con 0x7f9a50068a00 2023-10-06T03:04:52.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a55648700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5014f3c0 con 0x7f9a501576d0 2023-10-06T03:04:52.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a55648700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5014f6a0 con 0x7f9a50157300 2023-10-06T03:04:52.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a4effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a50068a00 0x7f9a5014eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:52.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a4effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a50068a00 0x7f9a5014eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40670/0 (socket says 172.21.15.125:40670) 2023-10-06T03:04:52.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a4effd700 1 -- 172.21.15.125:0/2652762713 learned_addr learned my addr 172.21.15.125:0/2652762713 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:52.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a4e7fc700 1 --2- 172.21.15.125:0/2652762713 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a50157300 0x7f9a5014d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:52.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a4f7fe700 1 --2- 172.21.15.125:0/2652762713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a501576d0 0x7f9a500a92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:52.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a4effd700 1 -- 172.21.15.125:0/2652762713 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a50157300 msgr2=0x7f9a5014d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:52.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a4effd700 1 --2- 172.21.15.125:0/2652762713 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a50157300 0x7f9a5014d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a4effd700 1 -- 172.21.15.125:0/2652762713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a501576d0 msgr2=0x7f9a500a92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:52.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a4effd700 1 --2- 172.21.15.125:0/2652762713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a501576d0 0x7f9a500a92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a4effd700 1 -- 172.21.15.125:0/2652762713 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a400094f0 con 0x7f9a50068a00 2023-10-06T03:04:52.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a4effd700 1 --2- 172.21.15.125:0/2652762713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a50068a00 0x7f9a5014eb70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9a4400d810 tx=0x7f9a44008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:52.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a36ffd700 1 -- 172.21.15.125:0/2652762713 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a440125f0 con 0x7f9a50068a00 2023-10-06T03:04:52.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a36ffd700 1 -- 172.21.15.125:0/2652762713 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a44012750 con 0x7f9a50068a00 2023-10-06T03:04:52.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a55648700 1 -- 172.21.15.125:0/2652762713 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a5014f980 con 0x7f9a50068a00 2023-10-06T03:04:52.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a36ffd700 1 -- 172.21.15.125:0/2652762713 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a44012b10 con 0x7f9a50068a00 2023-10-06T03:04:52.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.721+0000 7f9a55648700 1 -- 172.21.15.125:0/2652762713 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a5014f0b0 con 0x7f9a50068a00 2023-10-06T03:04:52.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.722+0000 7f9a55648700 1 -- 172.21.15.125:0/2652762713 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a500aa4d0 con 0x7f9a50068a00 2023-10-06T03:04:52.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.723+0000 7f9a36ffd700 1 -- 172.21.15.125:0/2652762713 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a4401e460 con 0x7f9a50068a00 2023-10-06T03:04:52.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.723+0000 7f9a36ffd700 1 --2- 172.21.15.125:0/2652762713 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9a3c066f30 0x7f9a3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:52.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.723+0000 7f9a36ffd700 1 -- 172.21.15.125:0/2652762713 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9a44084f40 con 0x7f9a50068a00 2023-10-06T03:04:52.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.723+0000 7f9a4e7fc700 1 --2- 172.21.15.125:0/2652762713 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9a3c066f30 0x7f9a3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:52.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.723+0000 7f9a4e7fc700 1 --2- 172.21.15.125:0/2652762713 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9a3c066f30 0x7f9a3c0693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9a5006fdf0 tx=0x7f9a40017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:52.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.727+0000 7f9a36ffd700 1 -- 172.21.15.125:0/2652762713 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a44051d60 con 0x7f9a50068a00 2023-10-06T03:04:52.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.910+0000 7f9a55648700 1 -- 172.21.15.125:0/2652762713 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9a50066510 con 0x7f9a50068a00 2023-10-06T03:04:52.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.911+0000 7f9a36ffd700 1 -- 172.21.15.125:0/2652762713 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9a44055380 con 0x7f9a50068a00 2023-10-06T03:04:52.912 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-06T03:04:52.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.912+0000 7f9a55648700 1 -- 172.21.15.125:0/2652762713 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9a3c066f30 msgr2=0x7f9a3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:52.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.912+0000 7f9a55648700 1 --2- 172.21.15.125:0/2652762713 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9a3c066f30 0x7f9a3c0693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9a5006fdf0 tx=0x7f9a40017000 comp rx=0 tx=0).stop 2023-10-06T03:04:52.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.912+0000 7f9a55648700 1 -- 172.21.15.125:0/2652762713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a50068a00 msgr2=0x7f9a5014eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:52.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.912+0000 7f9a55648700 1 --2- 172.21.15.125:0/2652762713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a50068a00 0x7f9a5014eb70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9a4400d810 tx=0x7f9a44008040 comp rx=0 tx=0).stop 2023-10-06T03:04:52.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.912+0000 7f9a55648700 1 -- 172.21.15.125:0/2652762713 shutdown_connections 2023-10-06T03:04:52.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.913+0000 7f9a55648700 1 --2- 172.21.15.125:0/2652762713 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9a3c066f30 0x7f9a3c0693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.913+0000 7f9a55648700 1 --2- 172.21.15.125:0/2652762713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a501576d0 0x7f9a500a92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.913+0000 7f9a55648700 1 --2- 172.21.15.125:0/2652762713 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9a50068a00 0x7f9a5014eb70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.913+0000 7f9a55648700 1 --2- 172.21.15.125:0/2652762713 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a50157300 0x7f9a5014d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:52.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.913+0000 7f9a55648700 1 -- 172.21.15.125:0/2652762713 >> 172.21.15.125:0/2652762713 conn(0x7f9a500af730 msgr2=0x7f9a500ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:52.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.913+0000 7f9a55648700 1 -- 172.21.15.125:0/2652762713 shutdown_connections 2023-10-06T03:04:52.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:52.913+0000 7f9a55648700 1 -- 172.21.15.125:0/2652762713 wait complete. 2023-10-06T03:04:52.926 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:04:53.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.041+0000 7f59756b8700 1 Processor -- start 2023-10-06T03:04:53.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.041+0000 7f59756b8700 1 -- start start 2023-10-06T03:04:53.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.042+0000 7f59756b8700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f59701592e0 0x7f59700ace80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.042+0000 7f59756b8700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59700ad3c0 0x7f597006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.042+0000 7f59756b8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5970068290 con 0x7f5970155670 2023-10-06T03:04:53.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f59756b8700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597006f780 con 0x7f59701592e0 2023-10-06T03:04:53.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f59756b8700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5970159930 con 0x7f59700ad3c0 2023-10-06T03:04:53.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596effd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5970155670 0x7f597006f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53314/0 (socket says 172.21.15.125:53314) 2023-10-06T03:04:53.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596effd700 1 -- 172.21.15.125:0/818283545 learned_addr learned my addr 172.21.15.125:0/818283545 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:53.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596f7fe700 1 --2- 172.21.15.125:0/818283545 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59700ad3c0 0x7f597006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596e7fc700 1 --2- 172.21.15.125:0/818283545 >> v2:172.21.15.130:3300/0 conn(0x7f59701592e0 0x7f59700ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596dffb700 1 -- 172.21.15.125:0/818283545 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016411368 0 0) 0x7f5970068290 con 0x7f5970155670 2023-10-06T03:04:53.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596dffb700 1 -- 172.21.15.125:0/818283545 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f595c003570 con 0x7f5970155670 2023-10-06T03:04:53.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596dffb700 1 -- 172.21.15.125:0/818283545 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2584972326 0 0) 0x7f595c003570 con 0x7f5970155670 2023-10-06T03:04:53.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596dffb700 1 -- 172.21.15.125:0/818283545 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59700ad3c0 msgr2=0x7f597006a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:53.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596dffb700 1 --2- 172.21.15.125:0/818283545 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59700ad3c0 0x7f597006a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596dffb700 1 -- 172.21.15.125:0/818283545 >> v2:172.21.15.130:3300/0 conn(0x7f59701592e0 msgr2=0x7f59700ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:53.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596dffb700 1 --2- 172.21.15.125:0/818283545 >> v2:172.21.15.130:3300/0 conn(0x7f59701592e0 0x7f59700ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596dffb700 1 -- 172.21.15.125:0/818283545 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5970159c10 con 0x7f5970155670 2023-10-06T03:04:53.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596dffb700 1 -- 172.21.15.125:0/818283545 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f59680017f0 con 0x7f5970155670 2023-10-06T03:04:53.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596dffb700 1 -- 172.21.15.125:0/818283545 >> v1:172.21.15.125:6789/0 conn(0x7f5970155670 legacy=0x7f597006f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:53.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596dffb700 1 --2- 172.21.15.125:0/818283545 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59700ad3c0 0x7f595c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596dffb700 1 --2- 172.21.15.125:0/818283545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f595c003fe0 0x7f595c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596dffb700 1 --2- 172.21.15.125:0/818283545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f595c004d50 0x7f595c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596dffb700 1 -- 172.21.15.125:0/818283545 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5970159930 con 0x7f595c004d50 2023-10-06T03:04:53.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596dffb700 1 -- 172.21.15.125:0/818283545 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c00ba60 con 0x7f595c003fe0 2023-10-06T03:04:53.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596dffb700 1 -- 172.21.15.125:0/818283545 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595c00bbd0 con 0x7f59700ad3c0 2023-10-06T03:04:53.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596f7fe700 1 --2- 172.21.15.125:0/818283545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f595c004d50 0x7f595c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596e7fc700 1 --2- 172.21.15.125:0/818283545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f595c003fe0 0x7f595c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.043+0000 7f596effd700 1 --2- 172.21.15.125:0/818283545 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59700ad3c0 0x7f595c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.044+0000 7f596f7fe700 1 -- 172.21.15.125:0/818283545 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59700ad3c0 msgr2=0x7f595c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:53.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.044+0000 7f596f7fe700 1 --2- 172.21.15.125:0/818283545 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59700ad3c0 0x7f595c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.044+0000 7f596f7fe700 1 -- 172.21.15.125:0/818283545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f595c003fe0 msgr2=0x7f595c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:53.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.044+0000 7f596f7fe700 1 --2- 172.21.15.125:0/818283545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f595c003fe0 0x7f595c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.044+0000 7f596f7fe700 1 -- 172.21.15.125:0/818283545 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c003570 con 0x7f595c004d50 2023-10-06T03:04:53.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.044+0000 7f596f7fe700 1 --2- 172.21.15.125:0/818283545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f595c004d50 0x7f595c0051c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5960009c00 tx=0x7f59600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367564c2507f62e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:53.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.044+0000 7f596dffb700 1 -- 172.21.15.125:0/818283545 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596000e6b0 con 0x7f595c004d50 2023-10-06T03:04:53.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.044+0000 7f596dffb700 1 -- 172.21.15.125:0/818283545 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596000e810 con 0x7f595c004d50 2023-10-06T03:04:53.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.044+0000 7f596dffb700 1 -- 172.21.15.125:0/818283545 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596000ebd0 con 0x7f595c004d50 2023-10-06T03:04:53.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.044+0000 7f59756b8700 1 -- 172.21.15.125:0/818283545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f595c004d50 msgr2=0x7f595c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:53.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.044+0000 7f59756b8700 1 --2- 172.21.15.125:0/818283545 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f595c004d50 0x7f595c0051c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5960009c00 tx=0x7f59600091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.044+0000 7f596f7fe700 1 -- 172.21.15.125:0/818283545 reap_dead start 2023-10-06T03:04:53.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.044+0000 7f59756b8700 1 -- 172.21.15.125:0/818283545 shutdown_connections 2023-10-06T03:04:53.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.044+0000 7f59756b8700 1 -- 172.21.15.125:0/818283545 >> 172.21.15.125:0/818283545 conn(0x7f59700cc5a0 msgr2=0x7f59700cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:53.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.044+0000 7f59756b8700 1 -- 172.21.15.125:0/818283545 shutdown_connections 2023-10-06T03:04:53.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.045+0000 7f59756b8700 1 -- 172.21.15.125:0/818283545 wait complete. 2023-10-06T03:04:53.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.046+0000 7f59756b8700 1 Processor -- start 2023-10-06T03:04:53.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.046+0000 7f59756b8700 1 -- start start 2023-10-06T03:04:53.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.046+0000 7f59756b8700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f595c004d50 0x7f5970169e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.046+0000 7f59756b8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59700c3190 0x7f59700ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f59756b8700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59700ca0d0 0x7f59700ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f59756b8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59700caa80 con 0x7f59700c3190 2023-10-06T03:04:53.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f59756b8700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59700aaca0 con 0x7f595c004d50 2023-10-06T03:04:53.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f59756b8700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597016a360 con 0x7f59700ca0d0 2023-10-06T03:04:53.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f596e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59700c3190 0x7f59700ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f596e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59700c3190 0x7f59700ab130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40700/0 (socket says 172.21.15.125:40700) 2023-10-06T03:04:53.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f596e7fc700 1 -- 172.21.15.125:0/2481220501 learned_addr learned my addr 172.21.15.125:0/2481220501 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:53.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f596f7fe700 1 --2- 172.21.15.125:0/2481220501 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59700ca0d0 0x7f59700ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f596effd700 1 --2- 172.21.15.125:0/2481220501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f595c004d50 0x7f5970169e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f596e7fc700 1 -- 172.21.15.125:0/2481220501 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59700ca0d0 msgr2=0x7f59700ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:53.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f596e7fc700 1 --2- 172.21.15.125:0/2481220501 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59700ca0d0 0x7f59700ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f596e7fc700 1 -- 172.21.15.125:0/2481220501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f595c004d50 msgr2=0x7f5970169e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:53.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f596e7fc700 1 --2- 172.21.15.125:0/2481220501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f595c004d50 0x7f5970169e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f596e7fc700 1 -- 172.21.15.125:0/2481220501 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59700a8c90 con 0x7f59700c3190 2023-10-06T03:04:53.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f596e7fc700 1 --2- 172.21.15.125:0/2481220501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59700c3190 0x7f59700ab130 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5958006ac0 tx=0x7f59580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:53.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f5966ffd700 1 -- 172.21.15.125:0/2481220501 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5958011ec0 con 0x7f59700c3190 2023-10-06T03:04:53.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f5966ffd700 1 -- 172.21.15.125:0/2481220501 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595800f940 con 0x7f59700c3190 2023-10-06T03:04:53.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f5966ffd700 1 -- 172.21.15.125:0/2481220501 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595800fcc0 con 0x7f59700c3190 2023-10-06T03:04:53.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f59756b8700 1 -- 172.21.15.125:0/2481220501 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59700aa650 con 0x7f59700c3190 2023-10-06T03:04:53.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.047+0000 7f59756b8700 1 -- 172.21.15.125:0/2481220501 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59700ab670 con 0x7f59700c3190 2023-10-06T03:04:53.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.048+0000 7f59756b8700 1 -- 172.21.15.125:0/2481220501 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59700aa4b0 con 0x7f59700c3190 2023-10-06T03:04:53.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.049+0000 7f5966ffd700 1 -- 172.21.15.125:0/2481220501 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5958014650 con 0x7f59700c3190 2023-10-06T03:04:53.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.049+0000 7f5966ffd700 1 --2- 172.21.15.125:0/2481220501 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5950066f30 0x7f59500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.049+0000 7f596effd700 1 --2- 172.21.15.125:0/2481220501 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5950066f30 0x7f59500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.049+0000 7f5966ffd700 1 -- 172.21.15.125:0/2481220501 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f5958018030 con 0x7f59700c3190 2023-10-06T03:04:53.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.049+0000 7f596effd700 1 --2- 172.21.15.125:0/2481220501 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5950066f30 0x7f59500693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f59700c5a70 tx=0x7f5968002210 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:53.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.053+0000 7f5966ffd700 1 -- 172.21.15.125:0/2481220501 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59700aa4b0 con 0x7f59700c3190 2023-10-06T03:04:53.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.279+0000 7f59756b8700 1 -- 172.21.15.125:0/2481220501 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59700aa4b0 con 0x7f59700c3190 2023-10-06T03:04:53.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.279+0000 7f5966ffd700 1 -- 172.21.15.125:0/2481220501 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f59700aa4b0 con 0x7f59700c3190 2023-10-06T03:04:53.281 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:53.281 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/1260071130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1260071130},{"type":"v1","addr":"172.21.15.130:6834","nonce":1260071130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/63925154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":63925154},{"type":"v1","addr":"172.21.15.125:6836","nonce":63925154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/1057811891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1057811891},{"type":"v1","addr":"172.21.15.125:6837","nonce":1057811891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:04:29.211664+0000","modified":"2023-10-06T03:04:42.275374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/4004582354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":4004582354},{"type":"v1","addr":"172.21.15.130:6835","nonce":4004582354}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:04:53.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.281+0000 7f59756b8700 1 -- 172.21.15.125:0/2481220501 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5950066f30 msgr2=0x7f59500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:53.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.281+0000 7f59756b8700 1 --2- 172.21.15.125:0/2481220501 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5950066f30 0x7f59500693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f59700c5a70 tx=0x7f5968002210 comp rx=0 tx=0).stop 2023-10-06T03:04:53.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.281+0000 7f59756b8700 1 -- 172.21.15.125:0/2481220501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59700c3190 msgr2=0x7f59700ab130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:53.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.281+0000 7f59756b8700 1 --2- 172.21.15.125:0/2481220501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59700c3190 0x7f59700ab130 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5958006ac0 tx=0x7f59580091a0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.281+0000 7f59756b8700 1 -- 172.21.15.125:0/2481220501 shutdown_connections 2023-10-06T03:04:53.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.281+0000 7f59756b8700 1 --2- 172.21.15.125:0/2481220501 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5950066f30 0x7f59500693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.281+0000 7f59756b8700 1 --2- 172.21.15.125:0/2481220501 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59700ca0d0 0x7f59700ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.281+0000 7f59756b8700 1 --2- 172.21.15.125:0/2481220501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f595c004d50 0x7f5970169e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.281+0000 7f59756b8700 1 --2- 172.21.15.125:0/2481220501 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f59700c3190 0x7f59700ab130 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.281+0000 7f59756b8700 1 -- 172.21.15.125:0/2481220501 >> 172.21.15.125:0/2481220501 conn(0x7f59700cc5a0 msgr2=0x7f59700c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:53.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.282+0000 7f59756b8700 1 -- 172.21.15.125:0/2481220501 shutdown_connections 2023-10-06T03:04:53.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.282+0000 7f59756b8700 1 -- 172.21.15.125:0/2481220501 wait complete. 2023-10-06T03:04:53.284 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 9 2023-10-06T03:04:53.295 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:04:53.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.411+0000 7f11c2caa700 1 Processor -- start 2023-10-06T03:04:53.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.411+0000 7f11c2caa700 1 -- start start 2023-10-06T03:04:53.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.412+0000 7f11c2caa700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f11bc0af5d0 0x7f11bc0c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.412+0000 7f11c2caa700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11bc0c9f70 0x7f11bc0677c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.412+0000 7f11c2caa700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11bc0c90e0 con 0x7f11bc0af200 2023-10-06T03:04:53.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.412+0000 7f11c2caa700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11bc159700 con 0x7f11bc0c9f70 2023-10-06T03:04:53.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.412+0000 7f11c2caa700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11bc0c84d0 con 0x7f11bc0af5d0 2023-10-06T03:04:53.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.412+0000 7f11c1247700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11bc0c9f70 0x7f11bc0677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.412+0000 7f11c1247700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11bc0c9f70 0x7f11bc0677c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40704/0 (socket says 172.21.15.125:40704) 2023-10-06T03:04:53.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.412+0000 7f11c1247700 1 -- 172.21.15.125:0/2860026591 learned_addr learned my addr 172.21.15.125:0/2860026591 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:53.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.412+0000 7f11bbfff700 1 --2- 172.21.15.125:0/2860026591 >> v2:172.21.15.130:3300/0 conn(0x7f11bc0af5d0 0x7f11bc0c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.412+0000 7f11c1247700 1 -- 172.21.15.125:0/2860026591 >> v2:172.21.15.130:3300/0 conn(0x7f11bc0af5d0 msgr2=0x7f11bc0c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:53.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.412+0000 7f11c1247700 1 --2- 172.21.15.125:0/2860026591 >> v2:172.21.15.130:3300/0 conn(0x7f11bc0af5d0 0x7f11bc0c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.412+0000 7f11c1247700 1 -- 172.21.15.125:0/2860026591 >> v1:172.21.15.130:6789/0 conn(0x7f11bc0af200 legacy=0x7f11bc0c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:53.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.412+0000 7f11c1247700 1 -- 172.21.15.125:0/2860026591 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc0c87b0 con 0x7f11bc0c9f70 2023-10-06T03:04:53.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.413+0000 7f11c1247700 1 --2- 172.21.15.125:0/2860026591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11bc0c9f70 0x7f11bc0677c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0099b0 tx=0x7f11ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20df0db8247fc434 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:53.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.413+0000 7f11bb7fe700 1 -- 172.21.15.125:0/2860026591 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac00b820 con 0x7f11bc0c9f70 2023-10-06T03:04:53.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.413+0000 7f11bb7fe700 1 -- 172.21.15.125:0/2860026591 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac00b980 con 0x7f11bc0c9f70 2023-10-06T03:04:53.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.413+0000 7f11bb7fe700 1 -- 172.21.15.125:0/2860026591 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac00bd20 con 0x7f11bc0c9f70 2023-10-06T03:04:53.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.413+0000 7f11c2caa700 1 -- 172.21.15.125:0/2860026591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11bc0c9f70 msgr2=0x7f11bc0677c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:53.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.413+0000 7f11c2caa700 1 --2- 172.21.15.125:0/2860026591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11bc0c9f70 0x7f11bc0677c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0099b0 tx=0x7f11ac009250 comp rx=0 tx=0).stop 2023-10-06T03:04:53.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.413+0000 7f11c2caa700 1 -- 172.21.15.125:0/2860026591 shutdown_connections 2023-10-06T03:04:53.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.413+0000 7f11c2caa700 1 --2- 172.21.15.125:0/2860026591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11bc0c9f70 0x7f11bc0677c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.413+0000 7f11c2caa700 1 --2- 172.21.15.125:0/2860026591 >> v2:172.21.15.130:3300/0 conn(0x7f11bc0af5d0 0x7f11bc0c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.413+0000 7f11c2caa700 1 -- 172.21.15.125:0/2860026591 >> 172.21.15.125:0/2860026591 conn(0x7f11bc06b1a0 msgr2=0x7f11bc06b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:53.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.413+0000 7f11c2caa700 1 -- 172.21.15.125:0/2860026591 shutdown_connections 2023-10-06T03:04:53.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.413+0000 7f11c2caa700 1 -- 172.21.15.125:0/2860026591 wait complete. 2023-10-06T03:04:53.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.415+0000 7f11c2caa700 1 Processor -- start 2023-10-06T03:04:53.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.415+0000 7f11c2caa700 1 -- start start 2023-10-06T03:04:53.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11c2caa700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11bc0af200 0x7f11bc15a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11c2caa700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11bc0af5d0 0x7f11bc13f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11c2caa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11bc0c9f70 0x7f11bc1578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11c2caa700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc0afc00 con 0x7f11bc0c9f70 2023-10-06T03:04:53.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11c2caa700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc0b0a60 con 0x7f11bc0af5d0 2023-10-06T03:04:53.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11c2caa700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11bc15acb0 con 0x7f11bc0af200 2023-10-06T03:04:53.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11c1247700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11bc0c9f70 0x7f11bc1578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11c1247700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11bc0c9f70 0x7f11bc1578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40714/0 (socket says 172.21.15.125:40714) 2023-10-06T03:04:53.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11c1247700 1 -- 172.21.15.125:0/2722379791 learned_addr learned my addr 172.21.15.125:0/2722379791 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:53.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11bbfff700 1 --2- 172.21.15.125:0/2722379791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11bc0af5d0 0x7f11bc13f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11c0a46700 1 --2- 172.21.15.125:0/2722379791 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11bc0af200 0x7f11bc15a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11c1247700 1 -- 172.21.15.125:0/2722379791 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11bc0af200 msgr2=0x7f11bc15a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:53.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11c1247700 1 --2- 172.21.15.125:0/2722379791 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11bc0af200 0x7f11bc15a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11c1247700 1 -- 172.21.15.125:0/2722379791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11bc0af5d0 msgr2=0x7f11bc13f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:53.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11c1247700 1 --2- 172.21.15.125:0/2722379791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11bc0af5d0 0x7f11bc13f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11c1247700 1 -- 172.21.15.125:0/2722379791 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ac0094f0 con 0x7f11bc0c9f70 2023-10-06T03:04:53.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11c1247700 1 --2- 172.21.15.125:0/2722379791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11bc0c9f70 0x7f11bc1578f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f11bc06a4e0 tx=0x7f11ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:53.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11b8ff9700 1 -- 172.21.15.125:0/2722379791 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac011e30 con 0x7f11bc0c9f70 2023-10-06T03:04:53.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11b8ff9700 1 -- 172.21.15.125:0/2722379791 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ac01a630 con 0x7f11bc0c9f70 2023-10-06T03:04:53.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11b8ff9700 1 -- 172.21.15.125:0/2722379791 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ac01a9f0 con 0x7f11bc0c9f70 2023-10-06T03:04:53.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11c2caa700 1 -- 172.21.15.125:0/2722379791 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11bc0afe50 con 0x7f11bc0c9f70 2023-10-06T03:04:53.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.416+0000 7f11c2caa700 1 -- 172.21.15.125:0/2722379791 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11bc0b0410 con 0x7f11bc0c9f70 2023-10-06T03:04:53.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.417+0000 7f11c2caa700 1 -- 172.21.15.125:0/2722379791 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11bc16c3e0 con 0x7f11bc0c9f70 2023-10-06T03:04:53.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.418+0000 7f11b8ff9700 1 -- 172.21.15.125:0/2722379791 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f11ac02d440 con 0x7f11bc0c9f70 2023-10-06T03:04:53.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.418+0000 7f11b8ff9700 1 --2- 172.21.15.125:0/2722379791 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f119c066f30 0x7f119c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.418+0000 7f11b8ff9700 1 -- 172.21.15.125:0/2722379791 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f11ac086470 con 0x7f11bc0c9f70 2023-10-06T03:04:53.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.418+0000 7f11c0a46700 1 --2- 172.21.15.125:0/2722379791 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f119c066f30 0x7f119c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.419+0000 7f11c0a46700 1 --2- 172.21.15.125:0/2722379791 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f119c066f30 0x7f119c0693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f11b4007fd0 tx=0x7f11b4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:53.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.422+0000 7f11b8ff9700 1 -- 172.21.15.125:0/2722379791 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11bc16c3e0 con 0x7f11bc0c9f70 2023-10-06T03:04:53.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.606+0000 7f11c2caa700 1 -- 172.21.15.125:0/2722379791 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11bc16c3e0 con 0x7f11bc0c9f70 2023-10-06T03:04:53.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.607+0000 7f11b8ff9700 1 -- 172.21.15.125:0/2722379791 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18851 (secure 0 0 0) 0x7f11bc16c3e0 con 0x7f11bc0c9f70 2023-10-06T03:04:53.609 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:53.609 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:33.645139+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:04:26.828121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:04:28.179225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:04:31.256394+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:04:53.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.609+0000 7f11c2caa700 1 -- 172.21.15.125:0/2722379791 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f119c066f30 msgr2=0x7f119c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:53.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.609+0000 7f11c2caa700 1 --2- 172.21.15.125:0/2722379791 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f119c066f30 0x7f119c0693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f11b4007fd0 tx=0x7f11b4009040 comp rx=0 tx=0).stop 2023-10-06T03:04:53.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.609+0000 7f11c2caa700 1 -- 172.21.15.125:0/2722379791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11bc0c9f70 msgr2=0x7f11bc1578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:53.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.609+0000 7f11c2caa700 1 --2- 172.21.15.125:0/2722379791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11bc0c9f70 0x7f11bc1578f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f11bc06a4e0 tx=0x7f11ac017000 comp rx=0 tx=0).stop 2023-10-06T03:04:53.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.609+0000 7f11c2caa700 1 -- 172.21.15.125:0/2722379791 shutdown_connections 2023-10-06T03:04:53.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.609+0000 7f11c2caa700 1 --2- 172.21.15.125:0/2722379791 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f119c066f30 0x7f119c0693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.609+0000 7f11c2caa700 1 --2- 172.21.15.125:0/2722379791 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11bc0c9f70 0x7f11bc1578f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.609+0000 7f11c2caa700 1 --2- 172.21.15.125:0/2722379791 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11bc0af200 0x7f11bc15a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.609+0000 7f11c2caa700 1 --2- 172.21.15.125:0/2722379791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11bc0af5d0 0x7f11bc13f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.609+0000 7f11c2caa700 1 -- 172.21.15.125:0/2722379791 >> 172.21.15.125:0/2722379791 conn(0x7f11bc06b1a0 msgr2=0x7f11bc0c9840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:53.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.609+0000 7f11c2caa700 1 -- 172.21.15.125:0/2722379791 shutdown_connections 2023-10-06T03:04:53.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.609+0000 7f11c2caa700 1 -- 172.21.15.125:0/2722379791 wait complete. 2023-10-06T03:04:53.623 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:04:53.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.739+0000 7f59b5dd7700 1 Processor -- start 2023-10-06T03:04:53.741 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.739+0000 7f59b5dd7700 1 -- start start 2023-10-06T03:04:53.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.740+0000 7f59b5dd7700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f59b00cc8f0 0x7f59b0069300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.740+0000 7f59b5dd7700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59b00caa40 0x7f59b0067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.740+0000 7f59b5dd7700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b0067fb0 con 0x7f59b0067b50 2023-10-06T03:04:53.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.740+0000 7f59b5dd7700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b00caeb0 con 0x7f59b00cc8f0 2023-10-06T03:04:53.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.740+0000 7f59b5dd7700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00cccc0 con 0x7f59b00caa40 2023-10-06T03:04:53.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.740+0000 7f59affff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f59b0067b50 0x7f59b0159d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53326/0 (socket says 172.21.15.125:53326) 2023-10-06T03:04:53.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.740+0000 7f59affff700 1 -- 172.21.15.125:0/234849146 learned_addr learned my addr 172.21.15.125:0/234849146 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:53.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59aeffd700 1 --2- 172.21.15.125:0/234849146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59b00caa40 0x7f59b0067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59af7fe700 1 --2- 172.21.15.125:0/234849146 >> v2:172.21.15.130:3300/0 conn(0x7f59b00cc8f0 0x7f59b0069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59ae7fc700 1 -- 172.21.15.125:0/234849146 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2218961632 0 0) 0x7f59a8001490 con 0x7f59b0067b50 2023-10-06T03:04:53.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59ae7fc700 1 -- 172.21.15.125:0/234849146 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5998003570 con 0x7f59b0067b50 2023-10-06T03:04:53.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59ae7fc700 1 -- 172.21.15.125:0/234849146 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2038561342 0 0) 0x7f5998003570 con 0x7f59b0067b50 2023-10-06T03:04:53.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59ae7fc700 1 -- 172.21.15.125:0/234849146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59b00caa40 msgr2=0x7f59b0067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:53.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59ae7fc700 1 --2- 172.21.15.125:0/234849146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59b00caa40 0x7f59b0067610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59ae7fc700 1 -- 172.21.15.125:0/234849146 >> v2:172.21.15.130:3300/0 conn(0x7f59b00cc8f0 msgr2=0x7f59b0069300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:53.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59ae7fc700 1 --2- 172.21.15.125:0/234849146 >> v2:172.21.15.130:3300/0 conn(0x7f59b00cc8f0 0x7f59b0069300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59ae7fc700 1 -- 172.21.15.125:0/234849146 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b01585c0 con 0x7f59b0067b50 2023-10-06T03:04:53.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59ae7fc700 1 -- 172.21.15.125:0/234849146 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f59a8001980 con 0x7f59b0067b50 2023-10-06T03:04:53.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59ae7fc700 1 -- 172.21.15.125:0/234849146 >> v1:172.21.15.125:6789/0 conn(0x7f59b0067b50 legacy=0x7f59b0159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:53.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59ae7fc700 1 --2- 172.21.15.125:0/234849146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5998003a60 0x7f5998003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59ae7fc700 1 --2- 172.21.15.125:0/234849146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5998004810 0x7f5998004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59ae7fc700 1 --2- 172.21.15.125:0/234849146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59b00caa40 0x7f59980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59ae7fc700 1 -- 172.21.15.125:0/234849146 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00caeb0 con 0x7f5998003a60 2023-10-06T03:04:53.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59ae7fc700 1 -- 172.21.15.125:0/234849146 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00cccc0 con 0x7f5998004810 2023-10-06T03:04:53.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59ae7fc700 1 -- 172.21.15.125:0/234849146 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599800ba90 con 0x7f59b00caa40 2023-10-06T03:04:53.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59af7fe700 1 --2- 172.21.15.125:0/234849146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5998003a60 0x7f5998003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59affff700 1 --2- 172.21.15.125:0/234849146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59b00caa40 0x7f59980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59aeffd700 1 --2- 172.21.15.125:0/234849146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5998004810 0x7f5998004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59af7fe700 1 -- 172.21.15.125:0/234849146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59b00caa40 msgr2=0x7f59980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:53.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59af7fe700 1 --2- 172.21.15.125:0/234849146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59b00caa40 0x7f59980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59af7fe700 1 -- 172.21.15.125:0/234849146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5998004810 msgr2=0x7f5998004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:53.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59af7fe700 1 --2- 172.21.15.125:0/234849146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5998004810 0x7f5998004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59af7fe700 1 -- 172.21.15.125:0/234849146 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5998003570 con 0x7f5998003a60 2023-10-06T03:04:53.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59affff700 1 --2- 172.21.15.125:0/234849146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59b00caa40 0x7f59980051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:53.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59aeffd700 1 --2- 172.21.15.125:0/234849146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5998004810 0x7f5998004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:53.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.741+0000 7f59af7fe700 1 --2- 172.21.15.125:0/234849146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5998003a60 0x7f5998003e70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f59a4009bf0 tx=0x7f59a4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadc41817933a4eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:53.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.742+0000 7f59ae7fc700 1 -- 172.21.15.125:0/234849146 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a4005a00 con 0x7f5998003a60 2023-10-06T03:04:53.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.742+0000 7f59ae7fc700 1 -- 172.21.15.125:0/234849146 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a4005b60 con 0x7f5998003a60 2023-10-06T03:04:53.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.742+0000 7f59ae7fc700 1 -- 172.21.15.125:0/234849146 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a400e6b0 con 0x7f5998003a60 2023-10-06T03:04:53.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.742+0000 7f59b5dd7700 1 -- 172.21.15.125:0/234849146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5998003a60 msgr2=0x7f5998003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:53.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.742+0000 7f59b5dd7700 1 --2- 172.21.15.125:0/234849146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5998003a60 0x7f5998003e70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f59a4009bf0 tx=0x7f59a4009120 comp rx=0 tx=0).stop 2023-10-06T03:04:53.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.742+0000 7f59affff700 1 -- 172.21.15.125:0/234849146 reap_dead start 2023-10-06T03:04:53.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.742+0000 7f59b5dd7700 1 -- 172.21.15.125:0/234849146 shutdown_connections 2023-10-06T03:04:53.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.742+0000 7f59b5dd7700 1 -- 172.21.15.125:0/234849146 >> 172.21.15.125:0/234849146 conn(0x7f59b0068f00 msgr2=0x7f59b00cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:53.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.742+0000 7f59b5dd7700 1 -- 172.21.15.125:0/234849146 shutdown_connections 2023-10-06T03:04:53.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.742+0000 7f59b5dd7700 1 -- 172.21.15.125:0/234849146 wait complete. 2023-10-06T03:04:53.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.743+0000 7f59b5dd7700 1 Processor -- start 2023-10-06T03:04:53.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.743+0000 7f59b5dd7700 1 -- start start 2023-10-06T03:04:53.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.744+0000 7f59b5dd7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5998003a60 0x7f59b00ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.744+0000 7f59b5dd7700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59b00aed00 0x7f59b015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.744+0000 7f59b5dd7700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59b015bba0 0x7f59b015c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.744+0000 7f59b5dd7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00c1c10 con 0x7f5998003a60 2023-10-06T03:04:53.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.744+0000 7f59b5dd7700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00c2440 con 0x7f59b015bba0 2023-10-06T03:04:53.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.744+0000 7f59b5dd7700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b0144540 con 0x7f59b00aed00 2023-10-06T03:04:53.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.744+0000 7f59af7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5998003a60 0x7f59b00ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.744+0000 7f59af7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5998003a60 0x7f59b00ae7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40730/0 (socket says 172.21.15.125:40730) 2023-10-06T03:04:53.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.744+0000 7f59af7fe700 1 -- 172.21.15.125:0/2355631649 learned_addr learned my addr 172.21.15.125:0/2355631649 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:53.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.744+0000 7f59aeffd700 1 --2- 172.21.15.125:0/2355631649 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59b00aed00 0x7f59b015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.744+0000 7f59affff700 1 --2- 172.21.15.125:0/2355631649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59b015bba0 0x7f59b015c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.744+0000 7f59af7fe700 1 -- 172.21.15.125:0/2355631649 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59b00aed00 msgr2=0x7f59b015b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:53.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.744+0000 7f59af7fe700 1 --2- 172.21.15.125:0/2355631649 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59b00aed00 0x7f59b015b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.744+0000 7f59af7fe700 1 -- 172.21.15.125:0/2355631649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59b015bba0 msgr2=0x7f59b015c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:53.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.744+0000 7f59af7fe700 1 --2- 172.21.15.125:0/2355631649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59b015bba0 0x7f59b015c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.744+0000 7f59af7fe700 1 -- 172.21.15.125:0/2355631649 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b00af4f0 con 0x7f5998003a60 2023-10-06T03:04:53.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.744+0000 7f59aeffd700 1 --2- 172.21.15.125:0/2355631649 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59b00aed00 0x7f59b015b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:04:53.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.744+0000 7f59affff700 1 --2- 172.21.15.125:0/2355631649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59b015bba0 0x7f59b015c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:04:53.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.745+0000 7f59af7fe700 1 --2- 172.21.15.125:0/2355631649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5998003a60 0x7f59b00ae7c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f59a400e4b0 tx=0x7f59a4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:53.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.745+0000 7f59977fe700 1 -- 172.21.15.125:0/2355631649 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a4006240 con 0x7f5998003a60 2023-10-06T03:04:53.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.745+0000 7f59977fe700 1 -- 172.21.15.125:0/2355631649 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a40063a0 con 0x7f5998003a60 2023-10-06T03:04:53.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.745+0000 7f59b5dd7700 1 -- 172.21.15.125:0/2355631649 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b00c1df0 con 0x7f5998003a60 2023-10-06T03:04:53.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.745+0000 7f59977fe700 1 -- 172.21.15.125:0/2355631649 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a4006760 con 0x7f5998003a60 2023-10-06T03:04:53.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.745+0000 7f59b5dd7700 1 -- 172.21.15.125:0/2355631649 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b00af170 con 0x7f5998003a60 2023-10-06T03:04:53.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.746+0000 7f59b5dd7700 1 -- 172.21.15.125:0/2355631649 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b00c1c10 con 0x7f5998003a60 2023-10-06T03:04:53.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.746+0000 7f59977fe700 1 -- 172.21.15.125:0/2355631649 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59a4013680 con 0x7f5998003a60 2023-10-06T03:04:53.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.746+0000 7f59977fe700 1 --2- 172.21.15.125:0/2355631649 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f599c066f30 0x7f599c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:53.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.747+0000 7f59977fe700 1 -- 172.21.15.125:0/2355631649 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f59a4086160 con 0x7f5998003a60 2023-10-06T03:04:53.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.747+0000 7f59aeffd700 1 --2- 172.21.15.125:0/2355631649 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f599c066f30 0x7f599c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:53.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.747+0000 7f59aeffd700 1 --2- 172.21.15.125:0/2355631649 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f599c066f30 0x7f599c0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f59a0006f00 tx=0x7f59a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:53.755 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.751+0000 7f59977fe700 1 -- 172.21.15.125:0/2355631649 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59a4052f80 con 0x7f5998003a60 2023-10-06T03:04:53.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.974+0000 7f59b5dd7700 1 -- 172.21.15.125:0/2355631649 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59b0066510 con 0x7f5998003a60 2023-10-06T03:04:53.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.975+0000 7f59977fe700 1 -- 172.21.15.125:0/2355631649 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f59a40565a0 con 0x7f5998003a60 2023-10-06T03:04:53.976 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:04:53.976 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/1260071130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1260071130},{"type":"v1","addr":"172.21.15.130:6834","nonce":1260071130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/63925154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":63925154},{"type":"v1","addr":"172.21.15.125:6836","nonce":63925154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/1057811891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1057811891},{"type":"v1","addr":"172.21.15.125:6837","nonce":1057811891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:04:29.211664+0000","modified":"2023-10-06T03:04:42.275374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/4004582354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":4004582354},{"type":"v1","addr":"172.21.15.130:6835","nonce":4004582354}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:04:53.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.977+0000 7f59b5dd7700 1 -- 172.21.15.125:0/2355631649 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f599c066f30 msgr2=0x7f599c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:53.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.977+0000 7f59b5dd7700 1 --2- 172.21.15.125:0/2355631649 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f599c066f30 0x7f599c0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f59a0006f00 tx=0x7f59a0008040 comp rx=0 tx=0).stop 2023-10-06T03:04:53.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.977+0000 7f59b5dd7700 1 -- 172.21.15.125:0/2355631649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5998003a60 msgr2=0x7f59b00ae7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:53.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.977+0000 7f59b5dd7700 1 --2- 172.21.15.125:0/2355631649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5998003a60 0x7f59b00ae7c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f59a400e4b0 tx=0x7f59a4019000 comp rx=0 tx=0).stop 2023-10-06T03:04:53.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.977+0000 7f59b5dd7700 1 -- 172.21.15.125:0/2355631649 shutdown_connections 2023-10-06T03:04:53.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.977+0000 7f59b5dd7700 1 --2- 172.21.15.125:0/2355631649 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f599c066f30 0x7f599c0693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.977+0000 7f59b5dd7700 1 --2- 172.21.15.125:0/2355631649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f59b015bba0 0x7f59b015c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.977+0000 7f59b5dd7700 1 --2- 172.21.15.125:0/2355631649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5998003a60 0x7f59b00ae7c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.977+0000 7f59b5dd7700 1 --2- 172.21.15.125:0/2355631649 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f59b00aed00 0x7f59b015b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:53.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.977+0000 7f59b5dd7700 1 -- 172.21.15.125:0/2355631649 >> 172.21.15.125:0/2355631649 conn(0x7f59b0068f00 msgr2=0x7f59b00b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:53.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.977+0000 7f59b5dd7700 1 -- 172.21.15.125:0/2355631649 shutdown_connections 2023-10-06T03:04:53.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:53.977+0000 7f59b5dd7700 1 -- 172.21.15.125:0/2355631649 wait complete. 2023-10-06T03:04:53.980 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 9 2023-10-06T03:04:54.393 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:04:29.211664+0000', 'modified': '2023-10-06T03:04:42.275374+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4269}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4269': {'gid': 4269, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.130:6835/4004582354', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6833', 'nonce': 4004582354}, {'type': 'v1', 'addr': '172.21.15.130:6835', 'nonce': 4004582354}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:04:54.393 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:04:54.393 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T03:04:54.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.512+0000 7fa677c96700 1 Processor -- start 2023-10-06T03:04:54.513 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.512+0000 7fa677c96700 1 -- start start 2023-10-06T03:04:54.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.513+0000 7fa677c96700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa670140c50 0x7fa6700cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.513+0000 7fa677c96700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa6700c9fb0 0x7fa6700caba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.513+0000 7fa677c96700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa670158570 con 0x7fa6700cc9b0 2023-10-06T03:04:54.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.513+0000 7fa677c96700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa670157770 con 0x7fa670140c50 2023-10-06T03:04:54.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.513+0000 7fa677c96700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa670158920 con 0x7fa6700c9fb0 2023-10-06T03:04:54.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.513+0000 7fa675a32700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa670140c50 0x7fa6700cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.513+0000 7fa675231700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa6700cc9b0 0x7fa6700c98a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:53340/0 (socket says 172.21.15.125:53340) 2023-10-06T03:04:54.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.513+0000 7fa675231700 1 -- 172.21.15.125:0/3328063097 learned_addr learned my addr 172.21.15.125:0/3328063097 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:54.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.513+0000 7fa675a32700 1 -- 172.21.15.125:0/3328063097 >> v2:172.21.15.130:3300/0 conn(0x7fa6700c9fb0 msgr2=0x7fa6700caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:54.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.513+0000 7fa676233700 1 --2- 172.21.15.125:0/3328063097 >> v2:172.21.15.130:3300/0 conn(0x7fa6700c9fb0 0x7fa6700caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.513+0000 7fa675a32700 1 --2- 172.21.15.125:0/3328063097 >> v2:172.21.15.130:3300/0 conn(0x7fa6700c9fb0 0x7fa6700caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.513+0000 7fa674a30700 1 -- 172.21.15.125:0/3328063097 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360374244 0 0) 0x7fa670158570 con 0x7fa6700cc9b0 2023-10-06T03:04:54.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.513+0000 7fa675a32700 1 -- 172.21.15.125:0/3328063097 >> v1:172.21.15.125:6789/0 conn(0x7fa6700cc9b0 legacy=0x7fa6700c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:54.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.513+0000 7fa675a32700 1 -- 172.21.15.125:0/3328063097 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa670157960 con 0x7fa670140c50 2023-10-06T03:04:54.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.513+0000 7fa676233700 1 --2- 172.21.15.125:0/3328063097 >> v2:172.21.15.130:3300/0 conn(0x7fa6700c9fb0 0x7fa6700caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:04:54.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.513+0000 7fa675a32700 1 --2- 172.21.15.125:0/3328063097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa670140c50 0x7fa6700cc470 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa67006e000 tx=0x7fa66c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31370835634e78 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:54.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.514+0000 7fa674a30700 1 -- 172.21.15.125:0/3328063097 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c005c10 con 0x7fa670140c50 2023-10-06T03:04:54.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.514+0000 7fa674a30700 1 -- 172.21.15.125:0/3328063097 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c005d70 con 0x7fa670140c50 2023-10-06T03:04:54.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.514+0000 7fa674a30700 1 -- 172.21.15.125:0/3328063097 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c006260 con 0x7fa670140c50 2023-10-06T03:04:54.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.514+0000 7fa677c96700 1 -- 172.21.15.125:0/3328063097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa670140c50 msgr2=0x7fa6700cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:54.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.514+0000 7fa677c96700 1 --2- 172.21.15.125:0/3328063097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa670140c50 0x7fa6700cc470 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa67006e000 tx=0x7fa66c009120 comp rx=0 tx=0).stop 2023-10-06T03:04:54.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.514+0000 7fa677c96700 1 -- 172.21.15.125:0/3328063097 shutdown_connections 2023-10-06T03:04:54.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.514+0000 7fa677c96700 1 --2- 172.21.15.125:0/3328063097 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa670140c50 0x7fa6700cc470 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.514+0000 7fa677c96700 1 --2- 172.21.15.125:0/3328063097 >> v2:172.21.15.130:3300/0 conn(0x7fa6700c9fb0 0x7fa6700caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.514+0000 7fa677c96700 1 -- 172.21.15.125:0/3328063097 >> 172.21.15.125:0/3328063097 conn(0x7fa670096120 msgr2=0x7fa670068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:54.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.514+0000 7fa677c96700 1 -- 172.21.15.125:0/3328063097 shutdown_connections 2023-10-06T03:04:54.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.514+0000 7fa677c96700 1 -- 172.21.15.125:0/3328063097 wait complete. 2023-10-06T03:04:54.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.515+0000 7fa677c96700 1 Processor -- start 2023-10-06T03:04:54.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.515+0000 7fa677c96700 1 -- start start 2023-10-06T03:04:54.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.516+0000 7fa677c96700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa6700c9fb0 0x7fa670155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.516+0000 7fa677c96700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6700cc9b0 0x7fa6700b2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.516+0000 7fa677c96700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa670140c50 0x7fa6700c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.516+0000 7fa677c96700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6700b2d70 con 0x7fa6700cc9b0 2023-10-06T03:04:54.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.516+0000 7fa677c96700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67013e0c0 con 0x7fa670140c50 2023-10-06T03:04:54.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.516+0000 7fa677c96700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6700b2ad0 con 0x7fa6700c9fb0 2023-10-06T03:04:54.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.516+0000 7fa675231700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6700cc9b0 0x7fa6700b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.516+0000 7fa675231700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6700cc9b0 0x7fa6700b2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40752/0 (socket says 172.21.15.125:40752) 2023-10-06T03:04:54.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.516+0000 7fa675231700 1 -- 172.21.15.125:0/869404182 learned_addr learned my addr 172.21.15.125:0/869404182 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:54.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.516+0000 7fa675a32700 1 --2- 172.21.15.125:0/869404182 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa6700c9fb0 0x7fa670155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.516+0000 7fa676233700 1 --2- 172.21.15.125:0/869404182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa670140c50 0x7fa6700c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.516+0000 7fa675231700 1 -- 172.21.15.125:0/869404182 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa6700c9fb0 msgr2=0x7fa670155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:54.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.516+0000 7fa675231700 1 --2- 172.21.15.125:0/869404182 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa6700c9fb0 0x7fa670155ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.516+0000 7fa675231700 1 -- 172.21.15.125:0/869404182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa670140c50 msgr2=0x7fa6700c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:54.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.516+0000 7fa675231700 1 --2- 172.21.15.125:0/869404182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa670140c50 0x7fa6700c3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.516+0000 7fa675231700 1 -- 172.21.15.125:0/869404182 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c0093c0 con 0x7fa6700cc9b0 2023-10-06T03:04:54.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.516+0000 7fa676233700 1 --2- 172.21.15.125:0/869404182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa670140c50 0x7fa6700c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:04:54.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.517+0000 7fa675231700 1 --2- 172.21.15.125:0/869404182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6700cc9b0 0x7fa6700b2590 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa66000c810 tx=0x7fa660007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:54.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.517+0000 7fa665ffb700 1 -- 172.21.15.125:0/869404182 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa660005b30 con 0x7fa6700cc9b0 2023-10-06T03:04:54.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.517+0000 7fa665ffb700 1 -- 172.21.15.125:0/869404182 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa660005c90 con 0x7fa6700cc9b0 2023-10-06T03:04:54.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.517+0000 7fa677c96700 1 -- 172.21.15.125:0/869404182 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67013c1a0 con 0x7fa6700cc9b0 2023-10-06T03:04:54.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.517+0000 7fa665ffb700 1 -- 172.21.15.125:0/869404182 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa660007300 con 0x7fa6700cc9b0 2023-10-06T03:04:54.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.517+0000 7fa677c96700 1 -- 172.21.15.125:0/869404182 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67013c760 con 0x7fa6700cc9b0 2023-10-06T03:04:54.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.519+0000 7fa665ffb700 1 -- 172.21.15.125:0/869404182 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa66001b400 con 0x7fa6700cc9b0 2023-10-06T03:04:54.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.519+0000 7fa665ffb700 1 --2- 172.21.15.125:0/869404182 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa654066f30 0x7fa6540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.519+0000 7fa665ffb700 1 -- 172.21.15.125:0/869404182 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa660084500 con 0x7fa6700cc9b0 2023-10-06T03:04:54.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.519+0000 7fa675a32700 1 --2- 172.21.15.125:0/869404182 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa654066f30 0x7fa6540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.519+0000 7fa675a32700 1 --2- 172.21.15.125:0/869404182 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa654066f30 0x7fa6540693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009160 tx=0x7fa66c016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:54.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.521+0000 7fa680faab80 1 Processor -- start 2023-10-06T03:04:54.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.521+0000 7fa680faab80 1 -- start start 2023-10-06T03:04:54.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.521+0000 7fa680faab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66ee21790 0x55f66edf95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.521+0000 7fa680faab80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66ee43370 0x55f66edf9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.521+0000 7fa680faab80 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66edfa020 0x55f66ee3f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.521+0000 7fa680faab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66ed12310 con 0x55f66ee21790 2023-10-06T03:04:54.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.521+0000 7fa680faab80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66ed4f130 con 0x55f66ee43370 2023-10-06T03:04:54.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.521+0000 7fa680faab80 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f66ed4caf0 con 0x55f66edfa020 2023-10-06T03:04:54.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.522+0000 7fa675a32700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66ee21790 0x55f66edf95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.522+0000 7fa675a32700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66ee21790 0x55f66edf95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40768/0 (socket says 172.21.15.125:40768) 2023-10-06T03:04:54.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.522+0000 7fa675a32700 1 -- 172.21.15.125:0/1228943932 learned_addr learned my addr 172.21.15.125:0/1228943932 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:54.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.522+0000 7fa675231700 1 --2- 172.21.15.125:0/1228943932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66ee43370 0x55f66edf9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.522+0000 7fa676233700 1 --2- 172.21.15.125:0/1228943932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66edfa020 0x55f66ee3f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.522+0000 7fa675a32700 1 -- 172.21.15.125:0/1228943932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66edfa020 msgr2=0x55f66ee3f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:54.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.522+0000 7fa675a32700 1 --2- 172.21.15.125:0/1228943932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66edfa020 0x55f66ee3f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.522+0000 7fa675a32700 1 -- 172.21.15.125:0/1228943932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66ee43370 msgr2=0x55f66edf9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:54.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.522+0000 7fa675a32700 1 --2- 172.21.15.125:0/1228943932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66ee43370 0x55f66edf9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.522+0000 7fa675a32700 1 -- 172.21.15.125:0/1228943932 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f66eb4e790 con 0x55f66ee21790 2023-10-06T03:04:54.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.522+0000 7fa675a32700 1 --2- 172.21.15.125:0/1228943932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66ee21790 0x55f66edf95a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00b0e0 tx=0x7fa66c022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea2ea6cc10da5d51 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:54.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.522+0000 7fa65affd700 1 -- 172.21.15.125:0/1228943932 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c022070 con 0x55f66ee21790 2023-10-06T03:04:54.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.522+0000 7fa65affd700 1 -- 172.21.15.125:0/1228943932 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c00b930 con 0x55f66ee21790 2023-10-06T03:04:54.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.522+0000 7fa65affd700 1 -- 172.21.15.125:0/1228943932 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c00baa0 con 0x55f66ee21790 2023-10-06T03:04:54.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.523+0000 7fa680faab80 1 -- 172.21.15.125:0/1228943932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66ee21790 msgr2=0x55f66edf95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:54.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.523+0000 7fa680faab80 1 --2- 172.21.15.125:0/1228943932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66ee21790 0x55f66edf95a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00b0e0 tx=0x7fa66c022000 comp rx=0 tx=0).stop 2023-10-06T03:04:54.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.523+0000 7fa680faab80 1 -- 172.21.15.125:0/1228943932 shutdown_connections 2023-10-06T03:04:54.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.523+0000 7fa680faab80 1 --2- 172.21.15.125:0/1228943932 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66edfa020 0x55f66ee3f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.523+0000 7fa680faab80 1 --2- 172.21.15.125:0/1228943932 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66ee21790 0x55f66edf95a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.523+0000 7fa680faab80 1 --2- 172.21.15.125:0/1228943932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66ee43370 0x55f66edf9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.523+0000 7fa680faab80 1 -- 172.21.15.125:0/1228943932 >> 172.21.15.125:0/1228943932 conn(0x55f66ee42890 msgr2=0x55f66ee42c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:54.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.523+0000 7fa680faab80 1 -- 172.21.15.125:0/1228943932 shutdown_connections 2023-10-06T03:04:54.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.523+0000 7fa680faab80 1 -- 172.21.15.125:0/1228943932 wait complete. 2023-10-06T03:04:54.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.523+0000 7fa680faab80 1 -- start start 2023-10-06T03:04:54.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.523+0000 7fa680faab80 1 Processor -- start 2023-10-06T03:04:54.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.524+0000 7fa680faab80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66edfa020 0x55f66ee1fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.524+0000 7fa680faab80 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66ee21790 0x55f66ee40790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.524+0000 7fa680faab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66ee43370 0x55f66ee40cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.524+0000 7fa680faab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66ed488e0 con 0x55f66ee43370 2023-10-06T03:04:54.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.524+0000 7fa680faab80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66ecf4980 con 0x55f66edfa020 2023-10-06T03:04:54.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.524+0000 7fa680faab80 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f66ecf4620 con 0x55f66ee21790 2023-10-06T03:04:54.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.524+0000 7fa680faab80 10 client.0 _ll_register_callbacks cb 0x55f66eb57a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:04:54.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.524+0000 7fa676233700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66ee43370 0x55f66ee40cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa676233700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66ee43370 0x55f66ee40cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40780/0 (socket says 172.21.15.125:40780) 2023-10-06T03:04:54.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa676233700 1 -- 172.21.15.125:0/2405217117 learned_addr learned my addr 172.21.15.125:0/2405217117 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:54.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa675a32700 1 --2- 172.21.15.125:0/2405217117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66edfa020 0x55f66ee1fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa675231700 1 --2- 172.21.15.125:0/2405217117 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66ee21790 0x55f66ee40790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa676233700 1 -- 172.21.15.125:0/2405217117 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66ee21790 msgr2=0x55f66ee40790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:54.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa676233700 1 --2- 172.21.15.125:0/2405217117 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66ee21790 0x55f66ee40790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa676233700 1 -- 172.21.15.125:0/2405217117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66edfa020 msgr2=0x55f66ee1fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:54.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa676233700 1 --2- 172.21.15.125:0/2405217117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66edfa020 0x55f66ee1fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa676233700 1 -- 172.21.15.125:0/2405217117 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa670157960 con 0x55f66ee43370 2023-10-06T03:04:54.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa676233700 1 --2- 172.21.15.125:0/2405217117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66ee43370 0x55f66ee40cd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa66800dd90 tx=0x7fa668007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dcf78df68d40165 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:54.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa64ffff700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-06T03:04:54.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa64ffff700 1 -- 172.21.15.125:0/2405217117 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa668012070 con 0x55f66ee43370 2023-10-06T03:04:54.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa64ffff700 1 -- 172.21.15.125:0/2405217117 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa66800be00 con 0x55f66ee43370 2023-10-06T03:04:54.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa680faab80 1 -- 172.21.15.125:0/2405217117 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f66edece50 con 0x55f66ee43370 2023-10-06T03:04:54.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa64ffff700 1 -- 172.21.15.125:0/2405217117 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa668007dd0 con 0x55f66ee43370 2023-10-06T03:04:54.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa680faab80 10 client.4725 fetch_fsmap learned FSMap version 9 2023-10-06T03:04:54.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa680faab80 1 -- 172.21.15.125:0/2405217117 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55f66ec3b0a0 con 0x55f66ee43370 2023-10-06T03:04:54.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa64ffff700 1 -- 172.21.15.125:0/2405217117 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f66edece50 con 0x55f66ee43370 2023-10-06T03:04:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa64ffff700 1 -- 172.21.15.125:0/2405217117 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fa668016600 con 0x55f66ee43370 2023-10-06T03:04:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa680faab80 10 client.4725 fetch_fsmap finished waiting for FSMap version 9 2023-10-06T03:04:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa680faab80 10 client.4725 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:04:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa680faab80 20 client.4725 populate_metadata read hostname 'smithi125' 2023-10-06T03:04:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.525+0000 7fa680faab80 1 --2- 172.21.15.125:0/2405217117 >> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] conn(0x55f66ee20800 0x55f66ee26900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.526+0000 7fa680faab80 4 client.4725 mds_command: new command op to 4269 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:04:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.526+0000 7fa680faab80 1 -- 172.21.15.125:0/2405217117 --> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f66edc9c20 con 0x55f66ee20800 2023-10-06T03:04:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.526+0000 7fa675a32700 1 --2- 172.21.15.125:0/2405217117 >> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] conn(0x55f66ee20800 0x55f66ee26900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.526+0000 7fa64ffff700 10 client.4725 ms_handle_connect on v2:172.21.15.130:6833/4004582354 2023-10-06T03:04:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.526+0000 7fa675a32700 1 --2- 172.21.15.125:0/2405217117 >> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] conn(0x55f66ee20800 0x55f66ee26900 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74b0799c093fbb08 server_cookie=b14c8646e8d7e894 in_seq=0 out_seq=0 2023-10-06T03:04:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.527+0000 7fa64ffff700 1 -- 172.21.15.125:0/2405217117 <== mds.0 v2:172.21.15.130:6833/4004582354 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f66edc9c20 con 0x55f66ee20800 2023-10-06T03:04:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.527+0000 7fa64ffff700 10 client.4725 handle_command_reply: tid=0 2023-10-06T03:04:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.527+0000 7fa680faab80 1 client.4725 shutdown 2023-10-06T03:04:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.527+0000 7fa680faab80 1 -- 172.21.15.125:0/2405217117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66ee43370 msgr2=0x55f66ee40cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.527+0000 7fa680faab80 1 --2- 172.21.15.125:0/2405217117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66ee43370 0x55f66ee40cd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa66800dd90 tx=0x7fa668007c70 comp rx=0 tx=0).stop 2023-10-06T03:04:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.527+0000 7fa680faab80 1 -- 172.21.15.125:0/2405217117 shutdown_connections 2023-10-06T03:04:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.527+0000 7fa680faab80 1 --2- 172.21.15.125:0/2405217117 >> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] conn(0x55f66ee20800 0x55f66ee26900 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.527+0000 7fa680faab80 1 --2- 172.21.15.125:0/2405217117 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66ee43370 0x55f66ee40cd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.527+0000 7fa680faab80 1 --2- 172.21.15.125:0/2405217117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66edfa020 0x55f66ee1fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.527+0000 7fa64ffff700 0 client.4725 ms_handle_reset on v2:172.21.15.130:6833/4004582354 2023-10-06T03:04:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.527+0000 7fa680faab80 1 --2- 172.21.15.125:0/2405217117 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66ee21790 0x55f66ee40790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.527+0000 7fa680faab80 1 -- 172.21.15.125:0/2405217117 >> 172.21.15.125:0/2405217117 conn(0x55f66ee42890 msgr2=0x55f66edfa500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:54.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.527+0000 7fa680faab80 1 -- 172.21.15.125:0/2405217117 shutdown_connections 2023-10-06T03:04:54.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.527+0000 7fa680faab80 1 -- 172.21.15.125:0/2405217117 wait complete. 2023-10-06T03:04:54.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.527+0000 7fa680faab80 20 client.4725 trim_cache size 0 max 16384 2023-10-06T03:04:54.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.544+0000 7fa680faab80 1 Processor -- start 2023-10-06T03:04:54.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.544+0000 7fa680faab80 1 -- start start 2023-10-06T03:04:54.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.544+0000 7fa680faab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66edfa020 0x55f66edf3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.544+0000 7fa680faab80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66ee21790 0x55f66ee524d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.544+0000 7fa680faab80 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66ee43370 0x55f66ee41840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.544+0000 7fa680faab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66ebe01e0 con 0x55f66edfa020 2023-10-06T03:04:54.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.544+0000 7fa680faab80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66edee1f0 con 0x55f66ee21790 2023-10-06T03:04:54.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.544+0000 7fa680faab80 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f66ee19770 con 0x55f66ee43370 2023-10-06T03:04:54.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.545+0000 7fa675a32700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66edfa020 0x55f66edf3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.545+0000 7fa675a32700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66edfa020 0x55f66edf3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40790/0 (socket says 172.21.15.125:40790) 2023-10-06T03:04:54.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.545+0000 7fa675a32700 1 -- 172.21.15.125:0/704665385 learned_addr learned my addr 172.21.15.125:0/704665385 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:54.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.545+0000 7fa676233700 1 --2- 172.21.15.125:0/704665385 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66ee43370 0x55f66ee41840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.545+0000 7fa675231700 1 --2- 172.21.15.125:0/704665385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66ee21790 0x55f66ee524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.545+0000 7fa675a32700 1 -- 172.21.15.125:0/704665385 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66ee43370 msgr2=0x55f66ee41840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:54.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.545+0000 7fa675a32700 1 --2- 172.21.15.125:0/704665385 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66ee43370 0x55f66ee41840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.545+0000 7fa675a32700 1 -- 172.21.15.125:0/704665385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66ee21790 msgr2=0x55f66ee524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:54.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.545+0000 7fa675a32700 1 --2- 172.21.15.125:0/704665385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66ee21790 0x55f66ee524d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.545+0000 7fa675a32700 1 -- 172.21.15.125:0/704665385 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f66ed173c0 con 0x55f66edfa020 2023-10-06T03:04:54.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.545+0000 7fa675a32700 1 --2- 172.21.15.125:0/704665385 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66edfa020 0x55f66edf3fe0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa66c02b000 tx=0x7fa66c03c250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df16a5bf13605d2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:54.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.545+0000 7fa65b7fe700 1 -- 172.21.15.125:0/704665385 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c022040 con 0x55f66edfa020 2023-10-06T03:04:54.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.545+0000 7fa65b7fe700 1 -- 172.21.15.125:0/704665385 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c00baa0 con 0x55f66edfa020 2023-10-06T03:04:54.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.545+0000 7fa65b7fe700 1 -- 172.21.15.125:0/704665385 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c00be50 con 0x55f66edfa020 2023-10-06T03:04:54.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.546+0000 7fa680faab80 1 -- 172.21.15.125:0/704665385 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66edfa020 msgr2=0x55f66edf3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:54.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.546+0000 7fa680faab80 1 --2- 172.21.15.125:0/704665385 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66edfa020 0x55f66edf3fe0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa66c02b000 tx=0x7fa66c03c250 comp rx=0 tx=0).stop 2023-10-06T03:04:54.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.546+0000 7fa680faab80 1 -- 172.21.15.125:0/704665385 shutdown_connections 2023-10-06T03:04:54.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.546+0000 7fa680faab80 1 --2- 172.21.15.125:0/704665385 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66ee43370 0x55f66ee41840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.546+0000 7fa680faab80 1 --2- 172.21.15.125:0/704665385 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66edfa020 0x55f66edf3fe0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.546+0000 7fa680faab80 1 --2- 172.21.15.125:0/704665385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66ee21790 0x55f66ee524d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.546+0000 7fa680faab80 1 -- 172.21.15.125:0/704665385 >> 172.21.15.125:0/704665385 conn(0x55f66ee42890 msgr2=0x55f66ee42c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:54.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.546+0000 7fa680faab80 1 -- 172.21.15.125:0/704665385 shutdown_connections 2023-10-06T03:04:54.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.546+0000 7fa680faab80 1 -- 172.21.15.125:0/704665385 wait complete. 2023-10-06T03:04:54.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.546+0000 7fa680faab80 1 -- start start 2023-10-06T03:04:54.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.546+0000 7fa680faab80 1 Processor -- start 2023-10-06T03:04:54.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.547+0000 7fa680faab80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66edfa020 0x55f66ee41c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.547+0000 7fa680faab80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66ee21790 0x55f66edfa500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.547+0000 7fa680faab80 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66ee43370 0x55f66eeabf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.547+0000 7fa680faab80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66edee4d0 con 0x55f66edfa020 2023-10-06T03:04:54.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.547+0000 7fa680faab80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f66edf4440 con 0x55f66ee21790 2023-10-06T03:04:54.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.547+0000 7fa680faab80 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f66eea9cf0 con 0x55f66ee43370 2023-10-06T03:04:54.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.547+0000 7fa680faab80 10 client.0 _ll_register_callbacks cb 0x55f66eb57a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:04:54.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.547+0000 7fa675a32700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66edfa020 0x55f66ee41c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.547+0000 7fa675a32700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66edfa020 0x55f66ee41c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40806/0 (socket says 172.21.15.125:40806) 2023-10-06T03:04:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.547+0000 7fa675a32700 1 -- 172.21.15.125:0/3161448626 learned_addr learned my addr 172.21.15.125:0/3161448626 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.547+0000 7fa676233700 1 --2- 172.21.15.125:0/3161448626 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66ee43370 0x55f66eeabf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.547+0000 7fa675231700 1 --2- 172.21.15.125:0/3161448626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66ee21790 0x55f66edfa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa675a32700 1 -- 172.21.15.125:0/3161448626 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66ee43370 msgr2=0x55f66eeabf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa675a32700 1 --2- 172.21.15.125:0/3161448626 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66ee43370 0x55f66eeabf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa675a32700 1 -- 172.21.15.125:0/3161448626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66ee21790 msgr2=0x55f66edfa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa675a32700 1 --2- 172.21.15.125:0/3161448626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66ee21790 0x55f66edfa500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa675a32700 1 -- 172.21.15.125:0/3161448626 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f66eb4e790 con 0x55f66edfa020 2023-10-06T03:04:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa676233700 1 --2- 172.21.15.125:0/3161448626 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66ee43370 0x55f66eeabf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:04:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa675a32700 1 --2- 172.21.15.125:0/3161448626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66edfa020 0x55f66ee41c00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55f66ee207a0 tx=0x7fa66c037040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44ebd21498d4444 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa64ffff700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-06T03:04:54.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa64ffff700 1 -- 172.21.15.125:0/3161448626 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c022030 con 0x55f66edfa020 2023-10-06T03:04:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa64ffff700 1 -- 172.21.15.125:0/3161448626 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa66c034790 con 0x55f66edfa020 2023-10-06T03:04:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa680faab80 1 -- 172.21.15.125:0/3161448626 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa66c00b930 con 0x55f66edfa020 2023-10-06T03:04:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa64ffff700 1 -- 172.21.15.125:0/3161448626 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa66c034b60 con 0x55f66edfa020 2023-10-06T03:04:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa680faab80 10 client.4731 fetch_fsmap learned FSMap version 9 2023-10-06T03:04:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa680faab80 1 -- 172.21.15.125:0/3161448626 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55f66ebaf1d0 con 0x55f66edfa020 2023-10-06T03:04:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa64ffff700 1 -- 172.21.15.125:0/3161448626 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c00b930 con 0x55f66edfa020 2023-10-06T03:04:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa64ffff700 1 -- 172.21.15.125:0/3161448626 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 9) v1 ==== 3108+0+0 (secure 0 0 0) 0x7fa66c034cc0 con 0x55f66edfa020 2023-10-06T03:04:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa680faab80 10 client.4731 fetch_fsmap finished waiting for FSMap version 9 2023-10-06T03:04:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa680faab80 10 client.4731 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T03:04:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa680faab80 20 client.4731 populate_metadata read hostname 'smithi125' 2023-10-06T03:04:54.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa680faab80 1 --2- 172.21.15.125:0/3161448626 >> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] conn(0x55f66eeac8f0 0x55f66edee7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa680faab80 4 client.4731 mds_command: new command op to 4269 tid=0[{"prefix": "status"}] 2023-10-06T03:04:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa680faab80 1 -- 172.21.15.125:0/3161448626 --> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f66eceb8d0 con 0x55f66eeac8f0 2023-10-06T03:04:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.548+0000 7fa675231700 1 --2- 172.21.15.125:0/3161448626 >> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] conn(0x55f66eeac8f0 0x55f66edee7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.549+0000 7fa64ffff700 10 client.4731 ms_handle_connect on v2:172.21.15.130:6833/4004582354 2023-10-06T03:04:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.549+0000 7fa675231700 1 --2- 172.21.15.125:0/3161448626 >> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] conn(0x55f66eeac8f0 0x55f66edee7e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92be88d26b19a66a server_cookie=19ad091ef7afdbf3 in_seq=0 out_seq=0 2023-10-06T03:04:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.549+0000 7fa64ffff700 1 -- 172.21.15.125:0/3161448626 <== mds.0 v2:172.21.15.130:6833/4004582354 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55f66eceb8d0 con 0x55f66eeac8f0 2023-10-06T03:04:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.549+0000 7fa64ffff700 10 client.4731 handle_command_reply: tid=0 2023-10-06T03:04:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.549+0000 7fa680faab80 1 client.4731 shutdown 2023-10-06T03:04:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.549+0000 7fa680faab80 1 -- 172.21.15.125:0/3161448626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66edfa020 msgr2=0x55f66ee41c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.549+0000 7fa680faab80 1 --2- 172.21.15.125:0/3161448626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66edfa020 0x55f66ee41c00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x55f66ee207a0 tx=0x7fa66c037040 comp rx=0 tx=0).stop 2023-10-06T03:04:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.549+0000 7fa680faab80 1 -- 172.21.15.125:0/3161448626 shutdown_connections 2023-10-06T03:04:54.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.549+0000 7fa680faab80 1 --2- 172.21.15.125:0/3161448626 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f66ee43370 0x55f66eeabf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.549+0000 7fa680faab80 1 --2- 172.21.15.125:0/3161448626 >> [v2:172.21.15.130:6833/4004582354,v1:172.21.15.130:6835/4004582354] conn(0x55f66eeac8f0 0x55f66edee7e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.549+0000 7fa680faab80 1 --2- 172.21.15.125:0/3161448626 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f66edfa020 0x55f66ee41c00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.549+0000 7fa64ffff700 0 client.4731 ms_handle_reset on v2:172.21.15.130:6833/4004582354 2023-10-06T03:04:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.549+0000 7fa680faab80 1 --2- 172.21.15.125:0/3161448626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f66ee21790 0x55f66edfa500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.549+0000 7fa680faab80 1 -- 172.21.15.125:0/3161448626 >> 172.21.15.125:0/3161448626 conn(0x55f66ee42890 msgr2=0x55f66ee1b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.549+0000 7fa680faab80 1 -- 172.21.15.125:0/3161448626 shutdown_connections 2023-10-06T03:04:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.549+0000 7fa680faab80 1 -- 172.21.15.125:0/3161448626 wait complete. 2023-10-06T03:04:54.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.549+0000 7fa680faab80 20 client.4731 trim_cache size 0 max 16384 2023-10-06T03:04:54.558 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:04:54.559 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_fsid": "c8556660-0880-4430-a03a-c140780d46e7", 2023-10-06T03:04:54.559 INFO:teuthology.orchestra.run.smithi125.stdout: "whoami": 0, 2023-10-06T03:04:54.559 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 4269, 2023-10-06T03:04:54.559 INFO:teuthology.orchestra.run.smithi125.stdout: "want_state": "up:active", 2023-10-06T03:04:54.559 INFO:teuthology.orchestra.run.smithi125.stdout: "state": "up:active", 2023-10-06T03:04:54.559 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs", 2023-10-06T03:04:54.559 INFO:teuthology.orchestra.run.smithi125.stdout: "rank_uptime": 24.714189148999999, 2023-10-06T03:04:54.559 INFO:teuthology.orchestra.run.smithi125.stdout: "mdsmap_epoch": 9, 2023-10-06T03:04:54.559 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch": 27, 2023-10-06T03:04:54.559 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch_barrier": 27, 2023-10-06T03:04:54.559 INFO:teuthology.orchestra.run.smithi125.stdout: "uptime": 30.637642249999999 2023-10-06T03:04:54.560 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:04:54.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.550+0000 7fa677c96700 1 -- 172.21.15.125:0/869404182 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa654066f30 msgr2=0x7fa6540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:54.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.550+0000 7fa677c96700 1 --2- 172.21.15.125:0/869404182 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa654066f30 0x7fa6540693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009160 tx=0x7fa66c016000 comp rx=0 tx=0).stop 2023-10-06T03:04:54.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.550+0000 7fa677c96700 1 -- 172.21.15.125:0/869404182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6700cc9b0 msgr2=0x7fa6700b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:54.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.550+0000 7fa677c96700 1 --2- 172.21.15.125:0/869404182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6700cc9b0 0x7fa6700b2590 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa66000c810 tx=0x7fa660007df0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.550+0000 7fa677c96700 1 -- 172.21.15.125:0/869404182 shutdown_connections 2023-10-06T03:04:54.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.550+0000 7fa677c96700 1 --2- 172.21.15.125:0/869404182 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa654066f30 0x7fa6540693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.550+0000 7fa677c96700 1 --2- 172.21.15.125:0/869404182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa670140c50 0x7fa6700c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.550+0000 7fa677c96700 1 --2- 172.21.15.125:0/869404182 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa6700c9fb0 0x7fa670155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.550+0000 7fa677c96700 1 --2- 172.21.15.125:0/869404182 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa6700cc9b0 0x7fa6700b2590 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.550+0000 7fa677c96700 1 -- 172.21.15.125:0/869404182 >> 172.21.15.125:0/869404182 conn(0x7fa670096120 msgr2=0x7fa67006baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:54.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.550+0000 7fa677c96700 1 -- 172.21.15.125:0/869404182 shutdown_connections 2023-10-06T03:04:54.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.550+0000 7fa677c96700 1 -- 172.21.15.125:0/869404182 wait complete. 2023-10-06T03:04:54.563 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-06T03:04:54.575 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-06T03:04:54.576 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T03:04:54.576 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-06T03:04:54.576 INFO:tasks.ceph_fuse:client.2 config is {} 2023-10-06T03:04:54.576 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-06T03:04:54.576 INFO:tasks.ceph_fuse:client.3 config is {} 2023-10-06T03:04:54.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:54.576 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-10-06T03:04:54.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:54.600 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2023-10-06T03:04:54.675 INFO:teuthology.orchestra.run.smithi130.stderr:Cannot find device "ceph-brx" 2023-10-06T03:04:54.676 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:04:54.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:54.677 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-06T03:04:54.695 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-06T03:04:54.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:54.696 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-06T03:04:54.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:54.782 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link delete ceph-brx 2023-10-06T03:04:54.854 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-06T03:04:54.854 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:04:54.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.971+0000 7f713668d700 1 Processor -- start 2023-10-06T03:04:54.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.971+0000 7f713668d700 1 -- start start 2023-10-06T03:04:54.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.971+0000 7f713668d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f71300cbb50 0x7f71300a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.971+0000 7f713668d700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f71300cbf20 0x7f71300caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.971+0000 7f713668d700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71300cb3e0 con 0x7f71300caf80 2023-10-06T03:04:54.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.971+0000 7f713668d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71300c2910 con 0x7f71300cbb50 2023-10-06T03:04:54.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.971+0000 7f713668d700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71300c1d40 con 0x7f71300cbf20 2023-10-06T03:04:54.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.972+0000 7f712ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f71300cbb50 0x7f71300a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.972+0000 7f712ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f71300cbb50 0x7f71300a99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40810/0 (socket says 172.21.15.125:40810) 2023-10-06T03:04:54.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.972+0000 7f712ffff700 1 -- 172.21.15.125:0/2174536067 learned_addr learned my addr 172.21.15.125:0/2174536067 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:54.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.972+0000 7f712f7fe700 1 --2- 172.21.15.125:0/2174536067 >> v2:172.21.15.130:3300/0 conn(0x7f71300cbf20 0x7f71300caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.972+0000 7f712ffff700 1 -- 172.21.15.125:0/2174536067 >> v2:172.21.15.130:3300/0 conn(0x7f71300cbf20 msgr2=0x7f71300caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:54.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.972+0000 7f712ffff700 1 --2- 172.21.15.125:0/2174536067 >> v2:172.21.15.130:3300/0 conn(0x7f71300cbf20 0x7f71300caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.972+0000 7f712ffff700 1 -- 172.21.15.125:0/2174536067 >> v1:172.21.15.130:6789/0 conn(0x7f71300caf80 legacy=0x7f71300c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:54.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.972+0000 7f712ffff700 1 -- 172.21.15.125:0/2174536067 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71300c1fe0 con 0x7f71300cbb50 2023-10-06T03:04:54.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.972+0000 7f712ffff700 1 --2- 172.21.15.125:0/2174536067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71300cbb50 0x7f71300a99a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f713006e8f0 tx=0x7f7120009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c8a4cdd6562da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:54.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.972+0000 7f712effd700 1 -- 172.21.15.125:0/2174536067 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7120005c10 con 0x7f71300cbb50 2023-10-06T03:04:54.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.972+0000 7f712effd700 1 -- 172.21.15.125:0/2174536067 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7120005d70 con 0x7f71300cbb50 2023-10-06T03:04:54.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.972+0000 7f712effd700 1 -- 172.21.15.125:0/2174536067 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712000b880 con 0x7f71300cbb50 2023-10-06T03:04:54.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.973+0000 7f713668d700 1 -- 172.21.15.125:0/2174536067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71300cbb50 msgr2=0x7f71300a99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:54.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.973+0000 7f713668d700 1 --2- 172.21.15.125:0/2174536067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71300cbb50 0x7f71300a99a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f713006e8f0 tx=0x7f7120009220 comp rx=0 tx=0).stop 2023-10-06T03:04:54.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.973+0000 7f713668d700 1 -- 172.21.15.125:0/2174536067 shutdown_connections 2023-10-06T03:04:54.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.973+0000 7f713668d700 1 --2- 172.21.15.125:0/2174536067 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71300cbb50 0x7f71300a99a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.973+0000 7f713668d700 1 --2- 172.21.15.125:0/2174536067 >> v2:172.21.15.130:3300/0 conn(0x7f71300cbf20 0x7f71300caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.973+0000 7f713668d700 1 -- 172.21.15.125:0/2174536067 >> 172.21.15.125:0/2174536067 conn(0x7f7130068f00 msgr2=0x7f71300cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:54.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.973+0000 7f713668d700 1 -- 172.21.15.125:0/2174536067 shutdown_connections 2023-10-06T03:04:54.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.973+0000 7f713668d700 1 -- 172.21.15.125:0/2174536067 wait complete. 2023-10-06T03:04:54.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.974+0000 7f713668d700 1 Processor -- start 2023-10-06T03:04:54.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.974+0000 7f713668d700 1 -- start start 2023-10-06T03:04:54.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.975+0000 7f713668d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71300caf80 0x7f7130149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.975+0000 7f713668d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71300cbb50 0x7f713014a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.975+0000 7f713668d700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71300cbf20 0x7f713014f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.975+0000 7f713668d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713014dd20 con 0x7f71300cbb50 2023-10-06T03:04:54.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.975+0000 7f713668d700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713014ce70 con 0x7f71300cbf20 2023-10-06T03:04:54.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.975+0000 7f713668d700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713014d110 con 0x7f71300caf80 2023-10-06T03:04:54.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.975+0000 7f712f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71300cbb50 0x7f713014a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.975+0000 7f712f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71300cbb50 0x7f713014a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:40814/0 (socket says 172.21.15.125:40814) 2023-10-06T03:04:54.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.975+0000 7f712f7fe700 1 -- 172.21.15.125:0/2876217318 learned_addr learned my addr 172.21.15.125:0/2876217318 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:54.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.975+0000 7f7134c2a700 1 --2- 172.21.15.125:0/2876217318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71300cbf20 0x7f713014f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.975+0000 7f712f7fe700 1 -- 172.21.15.125:0/2876217318 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71300caf80 msgr2=0x7f7130149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:54.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.975+0000 7f712ffff700 1 --2- 172.21.15.125:0/2876217318 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71300caf80 0x7f7130149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.975+0000 7f712f7fe700 1 --2- 172.21.15.125:0/2876217318 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71300caf80 0x7f7130149730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.975+0000 7f712f7fe700 1 -- 172.21.15.125:0/2876217318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71300cbf20 msgr2=0x7f713014f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.975+0000 7f712f7fe700 1 --2- 172.21.15.125:0/2876217318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71300cbf20 0x7f713014f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.975+0000 7f712f7fe700 1 -- 172.21.15.125:0/2876217318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7120009480 con 0x7f71300cbb50 2023-10-06T03:04:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.975+0000 7f7134c2a700 1 --2- 172.21.15.125:0/2876217318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71300cbf20 0x7f713014f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:04:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.976+0000 7f712f7fe700 1 --2- 172.21.15.125:0/2876217318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71300cbb50 0x7f713014a690 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f712400d860 tx=0x7f7124008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.976+0000 7f7117fff700 1 -- 172.21.15.125:0/2876217318 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7124009610 con 0x7f71300cbb50 2023-10-06T03:04:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.976+0000 7f7117fff700 1 -- 172.21.15.125:0/2876217318 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7124009770 con 0x7f71300cbb50 2023-10-06T03:04:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.976+0000 7f7117fff700 1 -- 172.21.15.125:0/2876217318 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7124009b30 con 0x7f71300cbb50 2023-10-06T03:04:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.976+0000 7f713668d700 1 -- 172.21.15.125:0/2876217318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713014d3f0 con 0x7f71300cbb50 2023-10-06T03:04:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.976+0000 7f713668d700 1 -- 172.21.15.125:0/2876217318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713014d9b0 con 0x7f71300cbb50 2023-10-06T03:04:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.977+0000 7f713668d700 1 -- 172.21.15.125:0/2876217318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713014de90 con 0x7f71300cbb50 2023-10-06T03:04:54.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.977+0000 7f7117fff700 1 -- 172.21.15.125:0/2876217318 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f712401e460 con 0x7f71300cbb50 2023-10-06T03:04:54.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.977+0000 7f7117fff700 1 --2- 172.21.15.125:0/2876217318 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f711c066f30 0x7f711c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:54.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.978+0000 7f7117fff700 1 -- 172.21.15.125:0/2876217318 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7124084ff0 con 0x7f71300cbb50 2023-10-06T03:04:54.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.978+0000 7f712ffff700 1 --2- 172.21.15.125:0/2876217318 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f711c066f30 0x7f711c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:54.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.978+0000 7f712ffff700 1 --2- 172.21.15.125:0/2876217318 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f711c066f30 0x7f711c0693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f71300c6100 tx=0x7f7120016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:54.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:54.982+0000 7f7117fff700 1 -- 172.21.15.125:0/2876217318 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7124051e10 con 0x7f71300cbb50 2023-10-06T03:04:55.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:55.205+0000 7f713668d700 1 -- 172.21.15.125:0/2876217318 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7130066510 con 0x7f71300cbb50 2023-10-06T03:04:55.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:55.205+0000 7f7117fff700 1 -- 172.21.15.125:0/2876217318 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f7124055430 con 0x7f71300cbb50 2023-10-06T03:04:55.207 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T03:04:55.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:55.208+0000 7f713668d700 1 -- 172.21.15.125:0/2876217318 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f711c066f30 msgr2=0x7f711c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:55.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:55.208+0000 7f713668d700 1 --2- 172.21.15.125:0/2876217318 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f711c066f30 0x7f711c0693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f71300c6100 tx=0x7f7120016000 comp rx=0 tx=0).stop 2023-10-06T03:04:55.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:55.208+0000 7f713668d700 1 -- 172.21.15.125:0/2876217318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71300cbb50 msgr2=0x7f713014a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:55.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:55.208+0000 7f713668d700 1 --2- 172.21.15.125:0/2876217318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71300cbb50 0x7f713014a690 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f712400d860 tx=0x7f7124008040 comp rx=0 tx=0).stop 2023-10-06T03:04:55.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:55.208+0000 7f713668d700 1 -- 172.21.15.125:0/2876217318 shutdown_connections 2023-10-06T03:04:55.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:55.208+0000 7f713668d700 1 --2- 172.21.15.125:0/2876217318 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f711c066f30 0x7f711c0693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:55.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:55.208+0000 7f713668d700 1 --2- 172.21.15.125:0/2876217318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71300cbf20 0x7f713014f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:55.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:55.208+0000 7f713668d700 1 --2- 172.21.15.125:0/2876217318 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71300caf80 0x7f7130149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:55.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:55.208+0000 7f713668d700 1 --2- 172.21.15.125:0/2876217318 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71300cbb50 0x7f713014a690 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:55.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:55.208+0000 7f713668d700 1 -- 172.21.15.125:0/2876217318 >> 172.21.15.125:0/2876217318 conn(0x7f7130068f00 msgr2=0x7f71300af280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:55.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:55.208+0000 7f713668d700 1 -- 172.21.15.125:0/2876217318 shutdown_connections 2023-10-06T03:04:55.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:55.208+0000 7f713668d700 1 -- 172.21.15.125:0/2876217318 wait complete. 2023-10-06T03:04:55.221 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:04:55.221 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:04:55.221 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-10-06T03:04:55.221 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:04:55.221 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:04:55.221 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:04:55.221 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:04:55.221 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:04:55.221 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:04:55.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:55.222 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-10-06T03:04:55.240 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:04:55.240 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:04:55.240 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:04:55.240 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:55.240 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-10-06T03:04:55.240 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:55.240 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:04:55.240 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:04:55.240 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2023-10-06T03:04:55.241 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:04:55.241 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:04:55.241 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2023-10-06T03:04:55.241 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:04:55.241 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:04:55.241 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:04:55.241 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:04:55.241 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:04:55.241 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42506sec preferred_lft 42506sec 2023-10-06T03:04:55.241 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2023-10-06T03:04:55.241 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:55.242 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T03:04:55.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:55.242 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:04:55.242 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:04:55.242 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add name ceph-brx type bridge 2023-10-06T03:04:55.242 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip addr flush dev ceph-brx 2023-10-06T03:04:55.242 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set ceph-brx up 2023-10-06T03:04:55.242 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T03:04:55.242 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:04:55.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:55.356 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:04:55.383 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-10-06T03:04:55.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:55.385 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-10-06T03:04:55.445 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-10-06T03:04:55.445 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:04:55.445 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:04:55.445 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:04:55.445 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:04:55.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:55.446 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:04:55.446 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:04:55.446 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:04:55.447 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:04:55.447 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:04:55.447 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:04:55.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:55.551 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-06T03:04:55.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:55.569 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list-id 2023-10-06T03:04:55.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:55.627 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:04:55.627 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:04:55.627 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:04:55.627 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T03:04:55.628 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:04:55.721 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T03:04:55.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:55.721 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:04:55.722 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:04:55.722 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T03:04:55.722 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T03:04:55.722 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T03:04:55.722 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T03:04:55.722 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T03:04:55.722 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:04:55.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:55.909 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:04:55.909 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:04:55.909 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2023-10-06T03:04:55.909 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T03:04:55.909 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:04:56.007 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T03:04:56.007 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:04:56.008 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:04:56.025 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:04:56.025 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:04:56.025 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:04:56.083 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-06T03:04:56.150 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:04:56.151 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:04:56.217 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:04:56.218 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:04:56.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:04:56.219 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-06T03:04:56.277 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T03:04:56.277 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T03:04:56.319 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-06T03:04:56.345 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:04:56.345 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:04:56.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2023-10-06T03:04:56.401+0000 7f3931312540 -1 init, newargv = 0x55e048130d60 newargc=15 2023-10-06T03:04:56.403 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[130999]: starting ceph client 2023-10-06T03:04:56.407 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[130999]: starting fuse 2023-10-06T03:04:56.413 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:04:56.414 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:04:56.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:04:56.415 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-06T03:04:56.473 INFO:teuthology.orchestra.run.smithi125.stdout:46 2023-10-06T03:04:56.473 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T03:04:56.473 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:04:56.473 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2023-10-06T03:04:56.473 DEBUG:teuthology.orchestra.run.smithi125:> import re 2023-10-06T03:04:56.473 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-10-06T03:04:56.473 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2023-10-06T03:04:56.474 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:04:56.474 DEBUG:teuthology.orchestra.run.smithi125:> def _find_admin_socket(client_name): 2023-10-06T03:04:56.474 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T03:04:56.474 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2023-10-06T03:04:56.474 DEBUG:teuthology.orchestra.run.smithi125:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T03:04:56.474 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:04:56.474 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2023-10-06T03:04:56.474 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2023-10-06T03:04:56.474 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2023-10-06T03:04:56.474 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2023-10-06T03:04:56.474 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:04:56.474 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2023-10-06T03:04:56.475 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T03:04:56.475 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T03:04:56.475 DEBUG:teuthology.orchestra.run.smithi125:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T03:04:56.475 DEBUG:teuthology.orchestra.run.smithi125:> contents = proc_f.read() 2023-10-06T03:04:56.475 DEBUG:teuthology.orchestra.run.smithi125:> if mountpoint in contents: 2023-10-06T03:04:56.475 DEBUG:teuthology.orchestra.run.smithi125:> return f 2023-10-06T03:04:56.475 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T03:04:56.475 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:04:56.475 DEBUG:teuthology.orchestra.run.smithi125:> print(_find_admin_socket("client.0")) 2023-10-06T03:04:56.475 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-10-06T03:04:56.596 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.130999.asok 2023-10-06T03:04:56.778 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.130999.asok 2023-10-06T03:04:56.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:04:56.779 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.130999.asok status 2023-10-06T03:04:56.933 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:04:56.933 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2023-10-06T03:04:56.933 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T03:04:56.933 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T03:04:56.933 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2023-10-06T03:04:56.933 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2023-10-06T03:04:56.933 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T03:04:56.934 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "130999", 2023-10-06T03:04:56.934 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2023-10-06T03:04:56.934 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:04:56.934 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2023-10-06T03:04:56.934 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2023-10-06T03:04:56.934 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 4743, 2023-10-06T03:04:56.934 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2023-10-06T03:04:56.934 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2023-10-06T03:04:56.934 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2023-10-06T03:04:56.934 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 4743 2023-10-06T03:04:56.934 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:04:56.935 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-06T03:04:56.935 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-06T03:04:56.935 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:04:56.935 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 654336965 2023-10-06T03:04:56.935 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:04:56.935 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:04:56.935 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-06T03:04:56.935 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-06T03:04:56.935 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:04:56.935 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 654336965 2023-10-06T03:04:56.935 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:04:56.935 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.4743 192.168.0.1:0/654336965", 2023-10-06T03:04:56.936 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "192.168.0.1:0/654336965", 2023-10-06T03:04:56.936 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2023-10-06T03:04:56.936 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 9, 2023-10-06T03:04:56.936 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 27, 2023-10-06T03:04:56.936 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2023-10-06T03:04:56.936 INFO:teuthology.orchestra.run.smithi125.stdout: "blocklisted": false, 2023-10-06T03:04:56.936 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2023-10-06T03:04:56.936 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:04:56.943 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:04:57.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.058+0000 7f3c7c866700 1 Processor -- start 2023-10-06T03:04:57.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.058+0000 7f3c7c866700 1 -- start start 2023-10-06T03:04:57.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.059+0000 7f3c7c866700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3c7813f6a0 0x7f3c7813fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:57.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.059+0000 7f3c7c866700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3c7815a320 0x7f3c780cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:57.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.059+0000 7f3c7c866700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c780c74c0 con 0x7f3c7806bd10 2023-10-06T03:04:57.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.059+0000 7f3c7c866700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c780c7710 con 0x7f3c7815a320 2023-10-06T03:04:57.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.059+0000 7f3c7c866700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c780c79f0 con 0x7f3c7813f6a0 2023-10-06T03:04:57.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.059+0000 7f3c76d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3c7815a320 0x7f3c780cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:57.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.059+0000 7f3c75d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3c7806bd10 0x7f3c78159c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46560/0 (socket says 172.21.15.125:46560) 2023-10-06T03:04:57.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.059+0000 7f3c76d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3c7815a320 0x7f3c780cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51392/0 (socket says 172.21.15.125:51392) 2023-10-06T03:04:57.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.059+0000 7f3c75d9b700 1 -- 172.21.15.125:0/3867093250 learned_addr learned my addr 172.21.15.125:0/3867093250 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:04:57.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.059+0000 7f3c7659c700 1 --2- 172.21.15.125:0/3867093250 >> v2:172.21.15.130:3300/0 conn(0x7f3c7813f6a0 0x7f3c7813fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:57.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.060+0000 7f3c76d9d700 1 -- 172.21.15.125:0/3867093250 >> v2:172.21.15.130:3300/0 conn(0x7f3c7813f6a0 msgr2=0x7f3c7813fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:57.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.060+0000 7f3c76d9d700 1 --2- 172.21.15.125:0/3867093250 >> v2:172.21.15.130:3300/0 conn(0x7f3c7813f6a0 0x7f3c7813fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:57.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.060+0000 7f3c76d9d700 1 -- 172.21.15.125:0/3867093250 >> v1:172.21.15.125:6789/0 conn(0x7f3c7806bd10 legacy=0x7f3c78159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:57.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.060+0000 7f3c76d9d700 1 -- 172.21.15.125:0/3867093250 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c780c9b40 con 0x7f3c7815a320 2023-10-06T03:04:57.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.060+0000 7f3c7559a700 1 -- 172.21.15.125:0/3867093250 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 282280361 0 0) 0x7f3c780c74c0 con 0x7f3c7806bd10 2023-10-06T03:04:57.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.060+0000 7f3c76d9d700 1 --2- 172.21.15.125:0/3867093250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c7815a320 0x7f3c780cc870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3c7806a4d0 tx=0x7f3c70009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f40cb9d70ee3ecd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:57.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.060+0000 7f3c7559a700 1 -- 172.21.15.125:0/3867093250 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7000e070 con 0x7f3c7815a320 2023-10-06T03:04:57.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.060+0000 7f3c7559a700 1 -- 172.21.15.125:0/3867093250 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7000bc30 con 0x7f3c7815a320 2023-10-06T03:04:57.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.060+0000 7f3c7559a700 1 -- 172.21.15.125:0/3867093250 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c70012430 con 0x7f3c7815a320 2023-10-06T03:04:57.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.060+0000 7f3c7c866700 1 -- 172.21.15.125:0/3867093250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c7815a320 msgr2=0x7f3c780cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:57.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.060+0000 7f3c7c866700 1 --2- 172.21.15.125:0/3867093250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c7815a320 0x7f3c780cc870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3c7806a4d0 tx=0x7f3c70009780 comp rx=0 tx=0).stop 2023-10-06T03:04:57.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.060+0000 7f3c7c866700 1 -- 172.21.15.125:0/3867093250 shutdown_connections 2023-10-06T03:04:57.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.060+0000 7f3c7c866700 1 --2- 172.21.15.125:0/3867093250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c7815a320 0x7f3c780cc870 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:57.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.060+0000 7f3c7c866700 1 --2- 172.21.15.125:0/3867093250 >> v2:172.21.15.130:3300/0 conn(0x7f3c7813f6a0 0x7f3c7813fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:57.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.060+0000 7f3c7c866700 1 -- 172.21.15.125:0/3867093250 >> 172.21.15.125:0/3867093250 conn(0x7f3c7806b190 msgr2=0x7f3c7806b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:57.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.061+0000 7f3c7c866700 1 -- 172.21.15.125:0/3867093250 shutdown_connections 2023-10-06T03:04:57.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.061+0000 7f3c7c866700 1 -- 172.21.15.125:0/3867093250 wait complete. 2023-10-06T03:04:57.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.062+0000 7f3c7c866700 1 Processor -- start 2023-10-06T03:04:57.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.062+0000 7f3c7c866700 1 -- start start 2023-10-06T03:04:57.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.062+0000 7f3c7c866700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c7806bd10 0x7f3c780afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:57.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.062+0000 7f3c7c866700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c7813f6a0 0x7f3c78156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:57.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.062+0000 7f3c7c866700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c7815a320 0x7f3c780cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:57.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.062+0000 7f3c7c866700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78158600 con 0x7f3c7813f6a0 2023-10-06T03:04:57.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.062+0000 7f3c7c866700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78156b10 con 0x7f3c7815a320 2023-10-06T03:04:57.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.062+0000 7f3c7c866700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c780b0500 con 0x7f3c7806bd10 2023-10-06T03:04:57.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.062+0000 7f3c75d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c7813f6a0 0x7f3c78156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:57.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.062+0000 7f3c75d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c7813f6a0 0x7f3c78156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51406/0 (socket says 172.21.15.125:51406) 2023-10-06T03:04:57.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.062+0000 7f3c75d9b700 1 -- 172.21.15.125:0/3941171348 learned_addr learned my addr 172.21.15.125:0/3941171348 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:57.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.062+0000 7f3c7659c700 1 --2- 172.21.15.125:0/3941171348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c7806bd10 0x7f3c780afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:57.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.063+0000 7f3c76d9d700 1 --2- 172.21.15.125:0/3941171348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c7815a320 0x7f3c780cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:57.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.063+0000 7f3c75d9b700 1 -- 172.21.15.125:0/3941171348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c7806bd10 msgr2=0x7f3c780afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:57.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.063+0000 7f3c75d9b700 1 --2- 172.21.15.125:0/3941171348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c7806bd10 0x7f3c780afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:57.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.063+0000 7f3c75d9b700 1 -- 172.21.15.125:0/3941171348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c7815a320 msgr2=0x7f3c780cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:57.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.063+0000 7f3c75d9b700 1 --2- 172.21.15.125:0/3941171348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c7815a320 0x7f3c780cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:57.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.063+0000 7f3c75d9b700 1 -- 172.21.15.125:0/3941171348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c70009a20 con 0x7f3c7813f6a0 2023-10-06T03:04:57.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.063+0000 7f3c75d9b700 1 --2- 172.21.15.125:0/3941171348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c7813f6a0 0x7f3c78156fa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3c6800c5b0 tx=0x7f3c68001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:57.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.063+0000 7f3c6e7fc700 1 -- 172.21.15.125:0/3941171348 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c68005b30 con 0x7f3c7813f6a0 2023-10-06T03:04:57.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.063+0000 7f3c6e7fc700 1 -- 172.21.15.125:0/3941171348 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c68005c90 con 0x7f3c7813f6a0 2023-10-06T03:04:57.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.063+0000 7f3c6e7fc700 1 -- 172.21.15.125:0/3941171348 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c68007300 con 0x7f3c7813f6a0 2023-10-06T03:04:57.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.063+0000 7f3c7c866700 1 -- 172.21.15.125:0/3941171348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c780b07e0 con 0x7f3c7813f6a0 2023-10-06T03:04:57.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.063+0000 7f3c7c866700 1 -- 172.21.15.125:0/3941171348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c781567a0 con 0x7f3c7813f6a0 2023-10-06T03:04:57.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.064+0000 7f3c7c866700 1 -- 172.21.15.125:0/3941171348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c78156cc0 con 0x7f3c7813f6a0 2023-10-06T03:04:57.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.064+0000 7f3c6e7fc700 1 -- 172.21.15.125:0/3941171348 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c680076b0 con 0x7f3c7813f6a0 2023-10-06T03:04:57.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.065+0000 7f3c6e7fc700 1 --2- 172.21.15.125:0/3941171348 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3c58066f30 0x7f3c580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:57.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.065+0000 7f3c6e7fc700 1 -- 172.21.15.125:0/3941171348 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f3c68083e20 con 0x7f3c7813f6a0 2023-10-06T03:04:57.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.065+0000 7f3c7659c700 1 --2- 172.21.15.125:0/3941171348 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3c58066f30 0x7f3c580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:57.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.065+0000 7f3c7659c700 1 --2- 172.21.15.125:0/3941171348 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3c58066f30 0x7f3c580693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3c60006fd0 tx=0x7f3c60008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:57.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.069+0000 7f3c6e7fc700 1 -- 172.21.15.125:0/3941171348 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c78156cc0 con 0x7f3c7813f6a0 2023-10-06T03:04:57.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.297+0000 7f3c7c866700 1 -- 172.21.15.125:0/3941171348 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3c78156c80 con 0x7f3c7813f6a0 2023-10-06T03:04:57.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.297+0000 7f3c6e7fc700 1 -- 172.21.15.125:0/3941171348 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3c68017020 con 0x7f3c7813f6a0 2023-10-06T03:04:57.299 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T03:04:57.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.299+0000 7f3c7c866700 1 -- 172.21.15.125:0/3941171348 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3c58066f30 msgr2=0x7f3c580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:57.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.299+0000 7f3c7c866700 1 --2- 172.21.15.125:0/3941171348 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3c58066f30 0x7f3c580693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3c60006fd0 tx=0x7f3c60008040 comp rx=0 tx=0).stop 2023-10-06T03:04:57.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.299+0000 7f3c7c866700 1 -- 172.21.15.125:0/3941171348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c7813f6a0 msgr2=0x7f3c78156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:57.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.299+0000 7f3c7c866700 1 --2- 172.21.15.125:0/3941171348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c7813f6a0 0x7f3c78156fa0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3c6800c5b0 tx=0x7f3c68001070 comp rx=0 tx=0).stop 2023-10-06T03:04:57.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.299+0000 7f3c7c866700 1 -- 172.21.15.125:0/3941171348 shutdown_connections 2023-10-06T03:04:57.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.299+0000 7f3c7c866700 1 --2- 172.21.15.125:0/3941171348 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3c58066f30 0x7f3c580693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:57.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.299+0000 7f3c7c866700 1 --2- 172.21.15.125:0/3941171348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3c7815a320 0x7f3c780cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:57.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.299+0000 7f3c7c866700 1 --2- 172.21.15.125:0/3941171348 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3c7806bd10 0x7f3c780afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:57.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.299+0000 7f3c7c866700 1 --2- 172.21.15.125:0/3941171348 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3c7813f6a0 0x7f3c78156fa0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:57.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.299+0000 7f3c7c866700 1 -- 172.21.15.125:0/3941171348 >> 172.21.15.125:0/3941171348 conn(0x7f3c7806b190 msgr2=0x7f3c78070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:57.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.299+0000 7f3c7c866700 1 -- 172.21.15.125:0/3941171348 shutdown_connections 2023-10-06T03:04:57.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:57.299+0000 7f3c7c866700 1 -- 172.21.15.125:0/3941171348 wait complete. 2023-10-06T03:04:57.312 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:04:57.312 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:04:57.312 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-10-06T03:04:57.312 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T03:04:57.312 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T03:04:57.313 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:04:57.313 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:04:57.313 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:04:57.313 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T03:04:57.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:57.313 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-10-06T03:04:57.331 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:04:57.331 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:04:57.332 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:04:57.332 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:57.332 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-10-06T03:04:57.332 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:57.332 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:04:57.332 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:04:57.332 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2023-10-06T03:04:57.332 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:04:57.332 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:04:57.332 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2023-10-06T03:04:57.332 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:04:57.333 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:04:57.333 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:04:57.333 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:04:57.333 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:04:57.333 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42503sec preferred_lft 42503sec 2023-10-06T03:04:57.333 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2023-10-06T03:04:57.333 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:57.333 INFO:teuthology.orchestra.run.smithi125.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:04:57.333 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 46:01:08:d7:90:9a brd ff:ff:ff:ff:ff:ff 2023-10-06T03:04:57.333 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:04:57.333 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:57.333 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::f829:e8ff:fe3d:51e0/64 scope link 2023-10-06T03:04:57.334 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:57.334 INFO:teuthology.orchestra.run.smithi125.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:04:57.334 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 46:01:08:d7:90:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:04:57.334 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::4401:8ff:fed7:909a/64 scope link tentative 2023-10-06T03:04:57.334 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:57.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:57.334 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:04:57.398 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-10-06T03:04:57.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:57.399 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-10-06T03:04:57.459 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-10-06T03:04:57.459 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:04:57.459 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:04:57.459 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:04:57.459 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:04:57.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:57.460 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:04:57.460 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:04:57.460 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:04:57.460 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:04:57.460 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:04:57.460 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:04:57.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:57.564 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-06T03:04:57.581 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:04:57.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:57.582 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list-id 2023-10-06T03:04:57.639 INFO:teuthology.orchestra.run.smithi125.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T03:04:57.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:57.639 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:04:57.640 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:04:57.640 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:04:57.640 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T03:04:57.640 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:04:57.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:57.733 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T03:04:57.769 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:04:57.769 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:04:57.769 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:04:57.769 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:57.769 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-10-06T03:04:57.770 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:57.770 INFO:teuthology.orchestra.run.smithi125.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:04:57.770 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether c2:92:e0:8c:ae:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:04:57.770 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:04:57.770 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:57.772 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::c092:e0ff:fe8c:ae39/64 scope link 2023-10-06T03:04:57.772 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:57.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:57.787 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T03:04:57.866 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:04:57.866 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:04:57.866 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:04:57.866 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:57.866 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-10-06T03:04:57.867 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:57.867 INFO:teuthology.orchestra.run.smithi125.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:04:57.867 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether c2:92:e0:8c:ae:39 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:04:57.867 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:04:57.867 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:57.867 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::c092:e0ff:fe8c:ae39/64 scope link 2023-10-06T03:04:57.867 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:57.879 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T03:04:57.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:57.880 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:04:57.880 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:04:57.880 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T03:04:57.880 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T03:04:57.880 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T03:04:57.880 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T03:04:57.880 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T03:04:57.880 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:04:58.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:58.100 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:04:58.100 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:04:58.100 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.1 up 2023-10-06T03:04:58.100 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T03:04:58.100 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:04:58.197 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-10-06T03:04:58.198 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:04:58.198 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T03:04:58.216 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T03:04:58.216 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:04:58.217 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T03:04:58.274 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-06T03:04:58.312 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:58.317 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:04:58.342 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:04:58.342 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:04:58.433 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:04:58.434 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:04:58.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:04:58.434 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-06T03:04:58.492 INFO:teuthology.orchestra.run.smithi125.stdout:46 2023-10-06T03:04:58.492 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-10-06T03:04:58.492 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-10-06T03:04:58.534 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-06T03:04:58.561 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:04:58.561 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:04:58.617 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi125.stderr:2023-10-06T03:04:58.616+0000 7f2a2616e540 -1 init, newargv = 0x55a07732f610 newargc=15 2023-10-06T03:04:58.617 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi125.stderr:ceph-fuse[131747]: starting ceph client 2023-10-06T03:04:58.622 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi125.stderr:ceph-fuse[131747]: starting fuse 2023-10-06T03:04:58.628 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:04:58.629 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:04:58.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:04:58.630 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-06T03:04:58.688 INFO:teuthology.orchestra.run.smithi125.stdout:46 2023-10-06T03:04:58.688 INFO:teuthology.orchestra.run.smithi125.stdout:48 2023-10-06T03:04:58.688 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-10-06T03:04:58.688 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:04:58.688 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2023-10-06T03:04:58.689 DEBUG:teuthology.orchestra.run.smithi125:> import re 2023-10-06T03:04:58.689 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-10-06T03:04:58.689 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2023-10-06T03:04:58.689 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:04:58.689 DEBUG:teuthology.orchestra.run.smithi125:> def _find_admin_socket(client_name): 2023-10-06T03:04:58.689 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-10-06T03:04:58.689 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2023-10-06T03:04:58.689 DEBUG:teuthology.orchestra.run.smithi125:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-10-06T03:04:58.689 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:04:58.689 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2023-10-06T03:04:58.689 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2023-10-06T03:04:58.689 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2023-10-06T03:04:58.690 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2023-10-06T03:04:58.690 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:04:58.690 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2023-10-06T03:04:58.690 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T03:04:58.690 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T03:04:58.690 DEBUG:teuthology.orchestra.run.smithi125:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T03:04:58.690 DEBUG:teuthology.orchestra.run.smithi125:> contents = proc_f.read() 2023-10-06T03:04:58.690 DEBUG:teuthology.orchestra.run.smithi125:> if mountpoint in contents: 2023-10-06T03:04:58.690 DEBUG:teuthology.orchestra.run.smithi125:> return f 2023-10-06T03:04:58.690 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T03:04:58.690 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:04:58.690 DEBUG:teuthology.orchestra.run.smithi125:> print(_find_admin_socket("client.2")) 2023-10-06T03:04:58.691 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-10-06T03:04:58.811 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.2.131747.asok 2023-10-06T03:04:58.994 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.131747.asok 2023-10-06T03:04:58.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:04:58.994 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.131747.asok status 2023-10-06T03:04:59.149 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:04:59.149 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2023-10-06T03:04:59.149 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T03:04:59.149 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T03:04:59.149 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "2", 2023-10-06T03:04:59.149 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2023-10-06T03:04:59.149 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-10-06T03:04:59.150 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "131747", 2023-10-06T03:04:59.150 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2023-10-06T03:04:59.150 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:04:59.150 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2023-10-06T03:04:59.150 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2023-10-06T03:04:59.150 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 4758, 2023-10-06T03:04:59.150 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2023-10-06T03:04:59.150 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2023-10-06T03:04:59.150 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2023-10-06T03:04:59.150 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 4758 2023-10-06T03:04:59.151 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:04:59.151 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-06T03:04:59.151 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-06T03:04:59.151 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.2:0", 2023-10-06T03:04:59.151 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 941002401 2023-10-06T03:04:59.151 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:04:59.151 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:04:59.151 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-06T03:04:59.151 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-06T03:04:59.151 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.2:0", 2023-10-06T03:04:59.151 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 941002401 2023-10-06T03:04:59.152 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:04:59.152 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.4758 192.168.0.2:0/941002401", 2023-10-06T03:04:59.152 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "192.168.0.2:0/941002401", 2023-10-06T03:04:59.152 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2023-10-06T03:04:59.152 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 9, 2023-10-06T03:04:59.152 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 27, 2023-10-06T03:04:59.152 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2023-10-06T03:04:59.152 INFO:teuthology.orchestra.run.smithi125.stdout: "blocklisted": false, 2023-10-06T03:04:59.152 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2023-10-06T03:04:59.152 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:04:59.158 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:04:59.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.274+0000 7f71a119b700 1 Processor -- start 2023-10-06T03:04:59.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.274+0000 7f71a119b700 1 -- start start 2023-10-06T03:04:59.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.275+0000 7f71a119b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f719c06ab10 0x7f719c0c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:59.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.275+0000 7f71a119b700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f719c06aee0 0x7f719c159360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:59.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.275+0000 7f71a119b700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f719c067c70 con 0x7f719c0ac670 2023-10-06T03:04:59.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.275+0000 7f71a119b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c069110 con 0x7f719c06ab10 2023-10-06T03:04:59.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.275+0000 7f71a119b700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719c0c7800 con 0x7f719c06aee0 2023-10-06T03:04:59.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.275+0000 7f719ad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f719c06ab10 0x7f719c0c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:59.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.275+0000 7f719ad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f719c06ab10 0x7f719c0c6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51422/0 (socket says 172.21.15.125:51422) 2023-10-06T03:04:59.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.275+0000 7f719ad9d700 1 -- 172.21.15.125:0/4211084263 learned_addr learned my addr 172.21.15.125:0/4211084263 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:59.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.276+0000 7f719b59e700 1 --2- 172.21.15.125:0/4211084263 >> v2:172.21.15.130:3300/0 conn(0x7f719c06aee0 0x7f719c159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:59.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.276+0000 7f719ad9d700 1 -- 172.21.15.125:0/4211084263 >> v2:172.21.15.130:3300/0 conn(0x7f719c06aee0 msgr2=0x7f719c159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:59.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.276+0000 7f719ad9d700 1 --2- 172.21.15.125:0/4211084263 >> v2:172.21.15.130:3300/0 conn(0x7f719c06aee0 0x7f719c159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:59.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.276+0000 7f719ad9d700 1 -- 172.21.15.125:0/4211084263 >> v1:172.21.15.130:6789/0 conn(0x7f719c0ac670 legacy=0x7f719c158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:04:59.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.276+0000 7f719ad9d700 1 -- 172.21.15.125:0/4211084263 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c0c7ae0 con 0x7f719c06ab10 2023-10-06T03:04:59.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.276+0000 7f719ad9d700 1 --2- 172.21.15.125:0/4211084263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f719c06ab10 0x7f719c0c6b40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f719c0c8c10 tx=0x7f7190009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56439bf10858c5bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:59.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.276+0000 7f7199d9b700 1 -- 172.21.15.125:0/4211084263 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719000b820 con 0x7f719c06ab10 2023-10-06T03:04:59.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.276+0000 7f7199d9b700 1 -- 172.21.15.125:0/4211084263 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719000b980 con 0x7f719c06ab10 2023-10-06T03:04:59.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.276+0000 7f7199d9b700 1 -- 172.21.15.125:0/4211084263 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719000bd20 con 0x7f719c06ab10 2023-10-06T03:04:59.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.276+0000 7f71a119b700 1 -- 172.21.15.125:0/4211084263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f719c06ab10 msgr2=0x7f719c0c6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:59.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.276+0000 7f71a119b700 1 --2- 172.21.15.125:0/4211084263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f719c06ab10 0x7f719c0c6b40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f719c0c8c10 tx=0x7f7190009250 comp rx=0 tx=0).stop 2023-10-06T03:04:59.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.276+0000 7f71a119b700 1 -- 172.21.15.125:0/4211084263 shutdown_connections 2023-10-06T03:04:59.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.276+0000 7f71a119b700 1 --2- 172.21.15.125:0/4211084263 >> v2:172.21.15.130:3300/0 conn(0x7f719c06aee0 0x7f719c159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:59.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.277+0000 7f71a119b700 1 --2- 172.21.15.125:0/4211084263 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f719c06ab10 0x7f719c0c6b40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:59.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.277+0000 7f71a119b700 1 -- 172.21.15.125:0/4211084263 >> 172.21.15.125:0/4211084263 conn(0x7f719c0cc5a0 msgr2=0x7f719c0cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:59.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.277+0000 7f71a119b700 1 -- 172.21.15.125:0/4211084263 shutdown_connections 2023-10-06T03:04:59.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.277+0000 7f71a119b700 1 -- 172.21.15.125:0/4211084263 wait complete. 2023-10-06T03:04:59.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.278+0000 7f71a119b700 1 Processor -- start 2023-10-06T03:04:59.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.278+0000 7f71a119b700 1 -- start start 2023-10-06T03:04:59.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.279+0000 7f71a119b700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f719c06ab10 0x7f719c16de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:59.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.279+0000 7f71a119b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f719c06aee0 0x7f719c0aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:59.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.279+0000 7f71a119b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f719c0ac670 0x7f719c0c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:59.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.279+0000 7f71a119b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0c53d0 con 0x7f719c0ac670 2023-10-06T03:04:59.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.279+0000 7f71a119b700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0c4b00 con 0x7f719c06ab10 2023-10-06T03:04:59.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.279+0000 7f71a119b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719c0ab490 con 0x7f719c06aee0 2023-10-06T03:04:59.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.279+0000 7f719b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f719c0ac670 0x7f719c0c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:59.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.279+0000 7f719b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f719c0ac670 0x7f719c0c57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51432/0 (socket says 172.21.15.125:51432) 2023-10-06T03:04:59.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.279+0000 7f719b59e700 1 -- 172.21.15.125:0/2673324846 learned_addr learned my addr 172.21.15.125:0/2673324846 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:04:59.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.279+0000 7f719ad9d700 1 --2- 172.21.15.125:0/2673324846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f719c06ab10 0x7f719c16de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:59.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.279+0000 7f719a59c700 1 --2- 172.21.15.125:0/2673324846 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f719c06aee0 0x7f719c0aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:59.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.280+0000 7f719b59e700 1 -- 172.21.15.125:0/2673324846 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f719c06aee0 msgr2=0x7f719c0aaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:59.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.280+0000 7f719b59e700 1 --2- 172.21.15.125:0/2673324846 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f719c06aee0 0x7f719c0aaf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:59.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.280+0000 7f719b59e700 1 -- 172.21.15.125:0/2673324846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f719c06ab10 msgr2=0x7f719c16de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:59.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.280+0000 7f719b59e700 1 --2- 172.21.15.125:0/2673324846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f719c06ab10 0x7f719c16de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:59.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.280+0000 7f719b59e700 1 -- 172.21.15.125:0/2673324846 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71900094f0 con 0x7f719c0ac670 2023-10-06T03:04:59.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.280+0000 7f719b59e700 1 --2- 172.21.15.125:0/2673324846 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f719c0ac670 0x7f719c0c57f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7194007f30 tx=0x7f71940098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:59.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.280+0000 7f7182ffd700 1 -- 172.21.15.125:0/2673324846 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719400eb90 con 0x7f719c0ac670 2023-10-06T03:04:59.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.280+0000 7f7182ffd700 1 -- 172.21.15.125:0/2673324846 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719400ecf0 con 0x7f719c0ac670 2023-10-06T03:04:59.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.280+0000 7f71a119b700 1 -- 172.21.15.125:0/2673324846 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719c0c5d30 con 0x7f719c0ac670 2023-10-06T03:04:59.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.280+0000 7f7182ffd700 1 -- 172.21.15.125:0/2673324846 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194014670 con 0x7f719c0ac670 2023-10-06T03:04:59.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.280+0000 7f71a119b700 1 -- 172.21.15.125:0/2673324846 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719c0c4d10 con 0x7f719c0ac670 2023-10-06T03:04:59.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.281+0000 7f71a119b700 1 -- 172.21.15.125:0/2673324846 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719c0c5510 con 0x7f719c0ac670 2023-10-06T03:04:59.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.281+0000 7f7182ffd700 1 -- 172.21.15.125:0/2673324846 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7194014a20 con 0x7f719c0ac670 2023-10-06T03:04:59.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.282+0000 7f7182ffd700 1 --2- 172.21.15.125:0/2673324846 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7188066f30 0x7f71880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:04:59.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.282+0000 7f7182ffd700 1 -- 172.21.15.125:0/2673324846 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7194085010 con 0x7f719c0ac670 2023-10-06T03:04:59.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.282+0000 7f719ad9d700 1 --2- 172.21.15.125:0/2673324846 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7188066f30 0x7f71880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:04:59.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.282+0000 7f719ad9d700 1 --2- 172.21.15.125:0/2673324846 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7188066f30 0x7f71880693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f719c0c8c10 tx=0x7f7190016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:04:59.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.286+0000 7f7182ffd700 1 -- 172.21.15.125:0/2673324846 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7194051e30 con 0x7f719c0ac670 2023-10-06T03:04:59.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.513+0000 7f71a119b700 1 -- 172.21.15.125:0/2673324846 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f719c066510 con 0x7f719c0ac670 2023-10-06T03:04:59.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.514+0000 7f7182ffd700 1 -- 172.21.15.125:0/2673324846 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f719400ee60 con 0x7f719c0ac670 2023-10-06T03:04:59.515 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T03:04:59.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.516+0000 7f71a119b700 1 -- 172.21.15.125:0/2673324846 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7188066f30 msgr2=0x7f71880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:59.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.516+0000 7f71a119b700 1 --2- 172.21.15.125:0/2673324846 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7188066f30 0x7f71880693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f719c0c8c10 tx=0x7f7190016000 comp rx=0 tx=0).stop 2023-10-06T03:04:59.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.516+0000 7f71a119b700 1 -- 172.21.15.125:0/2673324846 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f719c0ac670 msgr2=0x7f719c0c57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:04:59.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.516+0000 7f71a119b700 1 --2- 172.21.15.125:0/2673324846 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f719c0ac670 0x7f719c0c57f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7194007f30 tx=0x7f71940098e0 comp rx=0 tx=0).stop 2023-10-06T03:04:59.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.516+0000 7f71a119b700 1 -- 172.21.15.125:0/2673324846 shutdown_connections 2023-10-06T03:04:59.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.516+0000 7f71a119b700 1 --2- 172.21.15.125:0/2673324846 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7188066f30 0x7f71880693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:59.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.516+0000 7f71a119b700 1 --2- 172.21.15.125:0/2673324846 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f719c0ac670 0x7f719c0c57f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:59.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.516+0000 7f71a119b700 1 --2- 172.21.15.125:0/2673324846 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f719c06ab10 0x7f719c16de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:59.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.516+0000 7f71a119b700 1 --2- 172.21.15.125:0/2673324846 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f719c06aee0 0x7f719c0aaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:04:59.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.516+0000 7f71a119b700 1 -- 172.21.15.125:0/2673324846 >> 172.21.15.125:0/2673324846 conn(0x7f719c0cc5a0 msgr2=0x7f719c158130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:04:59.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.516+0000 7f71a119b700 1 -- 172.21.15.125:0/2673324846 shutdown_connections 2023-10-06T03:04:59.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:04:59.516+0000 7f71a119b700 1 -- 172.21.15.125:0/2673324846 wait complete. 2023-10-06T03:04:59.528 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:04:59.529 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:04:59.529 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2023-10-06T03:04:59.529 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T03:04:59.529 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T03:04:59.529 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:04:59.529 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:04:59.529 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:04:59.529 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:04:59.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:59.530 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2023-10-06T03:04:59.553 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:04:59.553 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:04:59.553 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:04:59.553 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:59.553 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-10-06T03:04:59.553 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:59.553 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:04:59.553 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:04:59.553 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2023-10-06T03:04:59.554 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:04:59.554 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:04:59.554 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2023-10-06T03:04:59.554 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:04:59.554 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:04:59.554 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:04:59.554 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:04:59.554 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:04:59.554 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42499sec preferred_lft 42499sec 2023-10-06T03:04:59.554 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2023-10-06T03:04:59.554 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:04:59.555 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T03:04:59.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:59.555 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-10-06T03:04:59.555 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-10-06T03:04:59.555 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add name ceph-brx type bridge 2023-10-06T03:04:59.555 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip addr flush dev ceph-brx 2023-10-06T03:04:59.555 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set ceph-brx up 2023-10-06T03:04:59.555 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T03:04:59.556 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-10-06T03:04:59.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:59.751 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:04:59.785 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-10-06T03:04:59.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:59.786 DEBUG:teuthology.orchestra.run.smithi130:> route 2023-10-06T03:04:59.874 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2023-10-06T03:04:59.874 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:04:59.874 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:04:59.875 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:04:59.875 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:04:59.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:04:59.875 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-10-06T03:04:59.875 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-10-06T03:04:59.875 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:04:59.875 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:04:59.875 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:04:59.876 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-10-06T03:05:00.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:00.109 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-10-06T03:05:00.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:00.127 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list-id 2023-10-06T03:05:00.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:00.185 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-10-06T03:05:00.185 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-10-06T03:05:00.185 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:05:00.185 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T03:05:00.185 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-10-06T03:05:00.280 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T03:05:00.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:00.281 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-10-06T03:05:00.281 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-10-06T03:05:00.281 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T03:05:00.281 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T03:05:00.281 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T03:05:00.281 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T03:05:00.281 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T03:05:00.281 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-10-06T03:05:00.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:00.478 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-10-06T03:05:00.478 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-10-06T03:05:00.478 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.0 up 2023-10-06T03:05:00.478 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T03:05:00.478 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-10-06T03:05:00.575 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-06T03:05:00.575 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:05:00.576 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T03:05:00.593 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T03:05:00.593 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:05:00.593 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:05:00.651 DEBUG:teuthology.orchestra.run.smithi130:> sudo modprobe fuse 2023-10-06T03:05:00.719 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:05:00.719 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:05:00.786 INFO:teuthology.orchestra.run.smithi130.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:05:00.787 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:05:00.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:00.788 DEBUG:teuthology.orchestra.run.smithi130:> ls /sys/fs/fuse/connections 2023-10-06T03:05:00.846 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T03:05:00.847 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-06T03:05:00.889 DEBUG:teuthology.orchestra.run.smithi130:> sudo modprobe fuse 2023-10-06T03:05:00.916 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:05:00.916 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:05:00.973 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi130.stderr:2023-10-06T03:05:00.971+0000 7f7389a41540 -1 init, newargv = 0x55ff19677790 newargc=15 2023-10-06T03:05:00.973 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi130.stderr:ceph-fuse[126720]: starting ceph client 2023-10-06T03:05:00.977 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi130.stderr:ceph-fuse[126720]: starting fuse 2023-10-06T03:05:00.986 INFO:teuthology.orchestra.run.smithi130.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:05:00.986 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:05:00.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:00.987 DEBUG:teuthology.orchestra.run.smithi130:> ls /sys/fs/fuse/connections 2023-10-06T03:05:01.045 INFO:teuthology.orchestra.run.smithi130.stdout:46 2023-10-06T03:05:01.045 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T03:05:01.046 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:05:01.046 DEBUG:teuthology.orchestra.run.smithi130:> import glob 2023-10-06T03:05:01.046 DEBUG:teuthology.orchestra.run.smithi130:> import re 2023-10-06T03:05:01.046 DEBUG:teuthology.orchestra.run.smithi130:> import os 2023-10-06T03:05:01.046 DEBUG:teuthology.orchestra.run.smithi130:> import subprocess 2023-10-06T03:05:01.046 DEBUG:teuthology.orchestra.run.smithi130:> 2023-10-06T03:05:01.046 DEBUG:teuthology.orchestra.run.smithi130:> def _find_admin_socket(client_name): 2023-10-06T03:05:01.046 DEBUG:teuthology.orchestra.run.smithi130:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-06T03:05:01.046 DEBUG:teuthology.orchestra.run.smithi130:> files = glob.glob(asok_path) 2023-10-06T03:05:01.046 DEBUG:teuthology.orchestra.run.smithi130:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-06T03:05:01.046 DEBUG:teuthology.orchestra.run.smithi130:> 2023-10-06T03:05:01.047 DEBUG:teuthology.orchestra.run.smithi130:> # Given a non-glob path, it better be there 2023-10-06T03:05:01.047 DEBUG:teuthology.orchestra.run.smithi130:> if "*" not in asok_path: 2023-10-06T03:05:01.047 DEBUG:teuthology.orchestra.run.smithi130:> assert(len(files) == 1) 2023-10-06T03:05:01.047 DEBUG:teuthology.orchestra.run.smithi130:> return files[0] 2023-10-06T03:05:01.047 DEBUG:teuthology.orchestra.run.smithi130:> 2023-10-06T03:05:01.047 DEBUG:teuthology.orchestra.run.smithi130:> for f in files: 2023-10-06T03:05:01.047 DEBUG:teuthology.orchestra.run.smithi130:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T03:05:01.047 DEBUG:teuthology.orchestra.run.smithi130:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T03:05:01.047 DEBUG:teuthology.orchestra.run.smithi130:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T03:05:01.047 DEBUG:teuthology.orchestra.run.smithi130:> contents = proc_f.read() 2023-10-06T03:05:01.047 DEBUG:teuthology.orchestra.run.smithi130:> if mountpoint in contents: 2023-10-06T03:05:01.047 DEBUG:teuthology.orchestra.run.smithi130:> return f 2023-10-06T03:05:01.047 DEBUG:teuthology.orchestra.run.smithi130:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T03:05:01.048 DEBUG:teuthology.orchestra.run.smithi130:> 2023-10-06T03:05:01.048 DEBUG:teuthology.orchestra.run.smithi130:> print(_find_admin_socket("client.1")) 2023-10-06T03:05:01.048 DEBUG:teuthology.orchestra.run.smithi130:> ' 2023-10-06T03:05:01.168 INFO:teuthology.orchestra.run.smithi130.stdout:/var/run/ceph/ceph-client.1.126720.asok 2023-10-06T03:05:01.350 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.126720.asok 2023-10-06T03:05:01.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:01.350 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.126720.asok status 2023-10-06T03:05:01.504 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-10-06T03:05:01.504 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": { 2023-10-06T03:05:01.504 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T03:05:01.504 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T03:05:01.504 INFO:teuthology.orchestra.run.smithi130.stdout: "entity_id": "1", 2023-10-06T03:05:01.505 INFO:teuthology.orchestra.run.smithi130.stdout: "hostname": "smithi130", 2023-10-06T03:05:01.505 INFO:teuthology.orchestra.run.smithi130.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-06T03:05:01.505 INFO:teuthology.orchestra.run.smithi130.stdout: "pid": "126720", 2023-10-06T03:05:01.505 INFO:teuthology.orchestra.run.smithi130.stdout: "root": "/" 2023-10-06T03:05:01.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-10-06T03:05:01.505 INFO:teuthology.orchestra.run.smithi130.stdout: "dentry_count": 0, 2023-10-06T03:05:01.505 INFO:teuthology.orchestra.run.smithi130.stdout: "dentry_pinned_count": 0, 2023-10-06T03:05:01.505 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 4723, 2023-10-06T03:05:01.505 INFO:teuthology.orchestra.run.smithi130.stdout: "inst": { 2023-10-06T03:05:01.505 INFO:teuthology.orchestra.run.smithi130.stdout: "name": { 2023-10-06T03:05:01.505 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "client", 2023-10-06T03:05:01.505 INFO:teuthology.orchestra.run.smithi130.stdout: "num": 4723 2023-10-06T03:05:01.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-10-06T03:05:01.506 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": { 2023-10-06T03:05:01.506 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-10-06T03:05:01.506 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:05:01.506 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3657407284 2023-10-06T03:05:01.506 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-10-06T03:05:01.506 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-10-06T03:05:01.506 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": { 2023-10-06T03:05:01.506 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-10-06T03:05:01.506 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:05:01.506 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 3657407284 2023-10-06T03:05:01.507 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-10-06T03:05:01.507 INFO:teuthology.orchestra.run.smithi130.stdout: "inst_str": "client.4723 192.168.0.1:0/3657407284", 2023-10-06T03:05:01.507 INFO:teuthology.orchestra.run.smithi130.stdout: "addr_str": "192.168.0.1:0/3657407284", 2023-10-06T03:05:01.507 INFO:teuthology.orchestra.run.smithi130.stdout: "inode_count": 1, 2023-10-06T03:05:01.507 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_epoch": 9, 2023-10-06T03:05:01.507 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_epoch": 27, 2023-10-06T03:05:01.507 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_epoch_barrier": 0, 2023-10-06T03:05:01.507 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklisted": false, 2023-10-06T03:05:01.507 INFO:teuthology.orchestra.run.smithi130.stdout: "fs_name": "cephfs" 2023-10-06T03:05:01.507 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-10-06T03:05:01.514 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:05:01.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.643+0000 7f43891d4700 1 Processor -- start 2023-10-06T03:05:01.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.643+0000 7f43891d4700 1 -- start start 2023-10-06T03:05:01.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.644+0000 7f43891d4700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43840af320 0x7f43840c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:01.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.644+0000 7f43891d4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f43840cc5a0 0x7f4384067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:01.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.644+0000 7f43891d4700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4384067b50 0x7f43840c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:01.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.644+0000 7f43891d4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4384067fd0 con 0x7f43840cc5a0 2023-10-06T03:05:01.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.644+0000 7f43891d4700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43840caa40 con 0x7f4384067b50 2023-10-06T03:05:01.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.644+0000 7f43891d4700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43840c1ca0 con 0x7f43840af320 2023-10-06T03:05:01.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.644+0000 7f438259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f43840cc5a0 0x7f4384067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:01.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.644+0000 7f438259c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f43840cc5a0 0x7f4384067610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51438/0 (socket says 172.21.15.125:51438) 2023-10-06T03:05:01.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.644+0000 7f438259c700 1 -- 172.21.15.125:0/2922435146 learned_addr learned my addr 172.21.15.125:0/2922435146 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:01.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.645+0000 7f438359e700 1 --2- 172.21.15.125:0/2922435146 >> v2:172.21.15.130:3300/0 conn(0x7f4384067b50 0x7f43840c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:01.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.645+0000 7f4382d9d700 1 --2- 172.21.15.125:0/2922435146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43840af320 0x7f43840c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:01.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.645+0000 7f438259c700 1 -- 172.21.15.125:0/2922435146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43840af320 msgr2=0x7f43840c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:01.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.645+0000 7f438259c700 1 --2- 172.21.15.125:0/2922435146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43840af320 0x7f43840c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:01.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.645+0000 7f438259c700 1 -- 172.21.15.125:0/2922435146 >> v2:172.21.15.130:3300/0 conn(0x7f4384067b50 msgr2=0x7f43840c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:01.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.645+0000 7f438259c700 1 --2- 172.21.15.125:0/2922435146 >> v2:172.21.15.130:3300/0 conn(0x7f4384067b50 0x7f43840c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:01.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.645+0000 7f438259c700 1 -- 172.21.15.125:0/2922435146 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43840cca60 con 0x7f43840cc5a0 2023-10-06T03:05:01.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.645+0000 7f438259c700 1 --2- 172.21.15.125:0/2922435146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43840cc5a0 0x7f4384067610 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4384087210 tx=0x7f4374009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9b014a2a7af3dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:01.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.645+0000 7f4381d9b700 1 -- 172.21.15.125:0/2922435146 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437400b860 con 0x7f43840cc5a0 2023-10-06T03:05:01.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.645+0000 7f4381d9b700 1 -- 172.21.15.125:0/2922435146 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f437400b9c0 con 0x7f43840cc5a0 2023-10-06T03:05:01.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.645+0000 7f4381d9b700 1 -- 172.21.15.125:0/2922435146 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f437400bd60 con 0x7f43840cc5a0 2023-10-06T03:05:01.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.646+0000 7f43891d4700 1 -- 172.21.15.125:0/2922435146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43840cc5a0 msgr2=0x7f4384067610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:01.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.646+0000 7f43891d4700 1 --2- 172.21.15.125:0/2922435146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43840cc5a0 0x7f4384067610 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4384087210 tx=0x7f4374009250 comp rx=0 tx=0).stop 2023-10-06T03:05:01.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.646+0000 7f43891d4700 1 -- 172.21.15.125:0/2922435146 shutdown_connections 2023-10-06T03:05:01.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.646+0000 7f43891d4700 1 --2- 172.21.15.125:0/2922435146 >> v2:172.21.15.130:3300/0 conn(0x7f4384067b50 0x7f43840c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:01.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.646+0000 7f43891d4700 1 --2- 172.21.15.125:0/2922435146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43840af320 0x7f43840c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:01.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.646+0000 7f43891d4700 1 --2- 172.21.15.125:0/2922435146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43840cc5a0 0x7f4384067610 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:01.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.646+0000 7f43891d4700 1 -- 172.21.15.125:0/2922435146 >> 172.21.15.125:0/2922435146 conn(0x7f4384068f00 msgr2=0x7f43840cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:01.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.646+0000 7f43891d4700 1 -- 172.21.15.125:0/2922435146 shutdown_connections 2023-10-06T03:05:01.650 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.646+0000 7f43891d4700 1 -- 172.21.15.125:0/2922435146 wait complete. 2023-10-06T03:05:01.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.647+0000 7f43891d4700 1 Processor -- start 2023-10-06T03:05:01.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.647+0000 7f43891d4700 1 -- start start 2023-10-06T03:05:01.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f43891d4700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4384067b50 0x7f438414dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:01.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f43891d4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43840af320 0x7f438416ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:01.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f43891d4700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43840cc5a0 0x7f438406ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:01.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f43891d4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4384159b60 con 0x7f43840af320 2023-10-06T03:05:01.653 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f43891d4700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438415a0e0 con 0x7f43840cc5a0 2023-10-06T03:05:01.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f43891d4700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438416d840 con 0x7f4384067b50 2023-10-06T03:05:01.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f438259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43840af320 0x7f438416ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:01.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f438259c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43840af320 0x7f438416ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51452/0 (socket says 172.21.15.125:51452) 2023-10-06T03:05:01.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f438259c700 1 -- 172.21.15.125:0/1141099260 learned_addr learned my addr 172.21.15.125:0/1141099260 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:01.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f4382d9d700 1 --2- 172.21.15.125:0/1141099260 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4384067b50 0x7f438414dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:01.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f438359e700 1 --2- 172.21.15.125:0/1141099260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43840cc5a0 0x7f438406ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:01.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f438259c700 1 -- 172.21.15.125:0/1141099260 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4384067b50 msgr2=0x7f438414dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:01.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f438259c700 1 --2- 172.21.15.125:0/1141099260 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4384067b50 0x7f438414dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:01.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f438259c700 1 -- 172.21.15.125:0/1141099260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43840cc5a0 msgr2=0x7f438406ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:01.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f438259c700 1 --2- 172.21.15.125:0/1141099260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43840cc5a0 0x7f438406ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:01.654 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f438259c700 1 -- 172.21.15.125:0/1141099260 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43740094f0 con 0x7f43840af320 2023-10-06T03:05:01.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f438259c700 1 --2- 172.21.15.125:0/1141099260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43840af320 0x7f438416ce10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f438406a4d0 tx=0x7f4374017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:01.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f436affd700 1 -- 172.21.15.125:0/1141099260 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374024440 con 0x7f43840af320 2023-10-06T03:05:01.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f436affd700 1 -- 172.21.15.125:0/1141099260 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43740245a0 con 0x7f43840af320 2023-10-06T03:05:01.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.648+0000 7f436affd700 1 -- 172.21.15.125:0/1141099260 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4374024940 con 0x7f43840af320 2023-10-06T03:05:01.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.649+0000 7f43891d4700 1 -- 172.21.15.125:0/1141099260 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438416db20 con 0x7f43840af320 2023-10-06T03:05:01.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.649+0000 7f43891d4700 1 -- 172.21.15.125:0/1141099260 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f438414e170 con 0x7f43840af320 2023-10-06T03:05:01.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.649+0000 7f43891d4700 1 -- 172.21.15.125:0/1141099260 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4384066510 con 0x7f43840af320 2023-10-06T03:05:01.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.650+0000 7f436affd700 1 -- 172.21.15.125:0/1141099260 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f437401a420 con 0x7f43840af320 2023-10-06T03:05:01.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.650+0000 7f436affd700 1 --2- 172.21.15.125:0/1141099260 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4370066f30 0x7f43700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:01.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.650+0000 7f436affd700 1 -- 172.21.15.125:0/1141099260 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4374086880 con 0x7f43840af320 2023-10-06T03:05:01.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.650+0000 7f4382d9d700 1 --2- 172.21.15.125:0/1141099260 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4370066f30 0x7f43700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:01.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.651+0000 7f4382d9d700 1 --2- 172.21.15.125:0/1141099260 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4370066f30 0x7f43700693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43780061f0 tx=0x7f4378008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:01.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.655+0000 7f436affd700 1 -- 172.21.15.125:0/1141099260 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43740536b0 con 0x7f43840af320 2023-10-06T03:05:01.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.878+0000 7f43891d4700 1 -- 172.21.15.125:0/1141099260 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f438415a220 con 0x7f43840af320 2023-10-06T03:05:01.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.879+0000 7f436affd700 1 -- 172.21.15.125:0/1141099260 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4374056cd0 con 0x7f43840af320 2023-10-06T03:05:01.880 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-06T03:05:01.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.881+0000 7f43891d4700 1 -- 172.21.15.125:0/1141099260 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4370066f30 msgr2=0x7f43700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:01.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.881+0000 7f43891d4700 1 --2- 172.21.15.125:0/1141099260 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4370066f30 0x7f43700693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f43780061f0 tx=0x7f4378008040 comp rx=0 tx=0).stop 2023-10-06T03:05:01.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.881+0000 7f43891d4700 1 -- 172.21.15.125:0/1141099260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43840af320 msgr2=0x7f438416ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:01.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.881+0000 7f43891d4700 1 --2- 172.21.15.125:0/1141099260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43840af320 0x7f438416ce10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f438406a4d0 tx=0x7f4374017000 comp rx=0 tx=0).stop 2023-10-06T03:05:01.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.881+0000 7f43891d4700 1 -- 172.21.15.125:0/1141099260 shutdown_connections 2023-10-06T03:05:01.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.881+0000 7f43891d4700 1 --2- 172.21.15.125:0/1141099260 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4370066f30 0x7f43700693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:01.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.881+0000 7f43891d4700 1 --2- 172.21.15.125:0/1141099260 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f43840cc5a0 0x7f438406ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:01.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.881+0000 7f43891d4700 1 --2- 172.21.15.125:0/1141099260 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4384067b50 0x7f438414dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:01.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.881+0000 7f43891d4700 1 --2- 172.21.15.125:0/1141099260 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43840af320 0x7f438416ce10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:01.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.881+0000 7f43891d4700 1 -- 172.21.15.125:0/1141099260 >> 172.21.15.125:0/1141099260 conn(0x7f4384068f00 msgr2=0x7f4384158cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:01.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.881+0000 7f43891d4700 1 -- 172.21.15.125:0/1141099260 shutdown_connections 2023-10-06T03:05:01.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:01.881+0000 7f43891d4700 1 -- 172.21.15.125:0/1141099260 wait complete. 2023-10-06T03:05:01.894 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:05:01.894 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:05:01.894 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi130.front.sepia.ceph.com 2023-10-06T03:05:01.894 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T03:05:01.894 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T03:05:01.894 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:05:01.894 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:05:01.894 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:05:01.894 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T03:05:01.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:01.895 DEBUG:teuthology.orchestra.run.smithi130:> ip addr 2023-10-06T03:05:01.914 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:05:01.914 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:05:01.914 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:05:01.914 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:01.914 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-10-06T03:05:01.914 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:96 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f0 2023-10-06T03:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:d9:37:97 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout: altname enp7s0f1 2023-10-06T03:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:36 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 0c:c4:7a:88:7f:37 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout: inet 172.21.15.130/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft 42497sec preferred_lft 42497sec 2023-10-06T03:05:01.915 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::ec4:7aff:fe88:7f37/64 scope link 2023-10-06T03:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 76:66:43:85:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::9453:fff:fefa:1084/64 scope link 2023-10-06T03:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 76:66:43:85:d3:d3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::7466:43ff:fe85:d3d3/64 scope link tentative 2023-10-06T03:05:01.916 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:01.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:01.917 DEBUG:teuthology.orchestra.run.smithi130:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:05:01.981 INFO:teuthology.orchestra.run.smithi130.stdout:1 2023-10-06T03:05:01.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:01.982 DEBUG:teuthology.orchestra.run.smithi130:> route 2023-10-06T03:05:02.042 INFO:teuthology.orchestra.run.smithi130.stdout:Kernel IP routing table 2023-10-06T03:05:02.042 INFO:teuthology.orchestra.run.smithi130.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:05:02.042 INFO:teuthology.orchestra.run.smithi130.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:05:02.042 INFO:teuthology.orchestra.run.smithi130.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:05:02.042 INFO:teuthology.orchestra.run.smithi130.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:05:02.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:02.042 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-10-06T03:05:02.043 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-10-06T03:05:02.043 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:05:02.043 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:05:02.043 DEBUG:teuthology.orchestra.run.smithi130:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:05:02.043 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-10-06T03:05:02.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:02.147 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-10-06T03:05:02.165 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:05:02.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:02.165 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list-id 2023-10-06T03:05:02.223 INFO:teuthology.orchestra.run.smithi130.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T03:05:02.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:02.223 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-10-06T03:05:02.223 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-10-06T03:05:02.224 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:05:02.224 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T03:05:02.224 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-10-06T03:05:02.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:02.317 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T03:05:02.353 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:05:02.353 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:05:02.354 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:05:02.354 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:02.354 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-10-06T03:05:02.354 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:02.354 INFO:teuthology.orchestra.run.smithi130.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:05:02.354 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 22:ec:95:e8:a5:60 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:05:02.354 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:05:02.354 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:02.354 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::20ec:95ff:fee8:a560/64 scope link tentative 2023-10-06T03:05:02.354 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:02.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:02.361 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T03:05:02.436 INFO:teuthology.orchestra.run.smithi130.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:05:02.436 INFO:teuthology.orchestra.run.smithi130.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:05:02.436 INFO:teuthology.orchestra.run.smithi130.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:05:02.436 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:02.436 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 ::1/128 scope host 2023-10-06T03:05:02.437 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:02.437 INFO:teuthology.orchestra.run.smithi130.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:05:02.437 INFO:teuthology.orchestra.run.smithi130.stdout: link/ether 22:ec:95:e8:a5:60 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T03:05:02.437 INFO:teuthology.orchestra.run.smithi130.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T03:05:02.437 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:02.437 INFO:teuthology.orchestra.run.smithi130.stdout: inet6 fe80::20ec:95ff:fee8:a560/64 scope link tentative 2023-10-06T03:05:02.437 INFO:teuthology.orchestra.run.smithi130.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:02.444 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T03:05:02.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:02.445 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-10-06T03:05:02.445 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-10-06T03:05:02.445 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T03:05:02.445 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T03:05:02.445 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T03:05:02.445 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T03:05:02.445 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T03:05:02.445 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-10-06T03:05:02.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:02.672 DEBUG:teuthology.orchestra.run.smithi130:> (cd / && exec bash -c ' 2023-10-06T03:05:02.672 DEBUG:teuthology.orchestra.run.smithi130:> set -e 2023-10-06T03:05:02.672 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set brx.1 up 2023-10-06T03:05:02.672 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T03:05:02.672 DEBUG:teuthology.orchestra.run.smithi130:> ') 2023-10-06T03:05:02.769 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-10-06T03:05:02.770 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:05:02.770 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T03:05:02.787 INFO:teuthology.orchestra.run.smithi130.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T03:05:02.787 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:05:02.788 DEBUG:teuthology.orchestra.run.smithi130:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T03:05:02.845 DEBUG:teuthology.orchestra.run.smithi130:> sudo modprobe fuse 2023-10-06T03:05:02.913 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:05:02.913 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:05:02.979 INFO:teuthology.orchestra.run.smithi130.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:05:02.980 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:05:02.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:02.981 DEBUG:teuthology.orchestra.run.smithi130:> ls /sys/fs/fuse/connections 2023-10-06T03:05:03.039 INFO:teuthology.orchestra.run.smithi130.stdout:46 2023-10-06T03:05:03.039 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-10-06T03:05:03.039 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-10-06T03:05:03.081 DEBUG:teuthology.orchestra.run.smithi130:> sudo modprobe fuse 2023-10-06T03:05:03.108 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:05:03.109 DEBUG:teuthology.orchestra.run.smithi130:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:05:03.164 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi130.stderr:2023-10-06T03:05:03.162+0000 7f8ddb5bd540 -1 init, newargv = 0x561e02b87c30 newargc=15 2023-10-06T03:05:03.164 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi130.stderr:ceph-fuse[127395]: starting ceph client 2023-10-06T03:05:03.168 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi130.stderr:ceph-fuse[127395]: starting fuse 2023-10-06T03:05:03.177 INFO:teuthology.orchestra.run.smithi130.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:05:03.178 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:05:03.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:03.179 DEBUG:teuthology.orchestra.run.smithi130:> ls /sys/fs/fuse/connections 2023-10-06T03:05:03.237 INFO:teuthology.orchestra.run.smithi130.stdout:46 2023-10-06T03:05:03.237 INFO:teuthology.orchestra.run.smithi130.stdout:48 2023-10-06T03:05:03.237 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-10-06T03:05:03.237 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:05:03.237 DEBUG:teuthology.orchestra.run.smithi130:> import glob 2023-10-06T03:05:03.237 DEBUG:teuthology.orchestra.run.smithi130:> import re 2023-10-06T03:05:03.237 DEBUG:teuthology.orchestra.run.smithi130:> import os 2023-10-06T03:05:03.238 DEBUG:teuthology.orchestra.run.smithi130:> import subprocess 2023-10-06T03:05:03.238 DEBUG:teuthology.orchestra.run.smithi130:> 2023-10-06T03:05:03.238 DEBUG:teuthology.orchestra.run.smithi130:> def _find_admin_socket(client_name): 2023-10-06T03:05:03.238 DEBUG:teuthology.orchestra.run.smithi130:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-10-06T03:05:03.238 DEBUG:teuthology.orchestra.run.smithi130:> files = glob.glob(asok_path) 2023-10-06T03:05:03.238 DEBUG:teuthology.orchestra.run.smithi130:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-10-06T03:05:03.238 DEBUG:teuthology.orchestra.run.smithi130:> 2023-10-06T03:05:03.238 DEBUG:teuthology.orchestra.run.smithi130:> # Given a non-glob path, it better be there 2023-10-06T03:05:03.238 DEBUG:teuthology.orchestra.run.smithi130:> if "*" not in asok_path: 2023-10-06T03:05:03.238 DEBUG:teuthology.orchestra.run.smithi130:> assert(len(files) == 1) 2023-10-06T03:05:03.238 DEBUG:teuthology.orchestra.run.smithi130:> return files[0] 2023-10-06T03:05:03.238 DEBUG:teuthology.orchestra.run.smithi130:> 2023-10-06T03:05:03.239 DEBUG:teuthology.orchestra.run.smithi130:> for f in files: 2023-10-06T03:05:03.239 DEBUG:teuthology.orchestra.run.smithi130:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T03:05:03.239 DEBUG:teuthology.orchestra.run.smithi130:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T03:05:03.239 DEBUG:teuthology.orchestra.run.smithi130:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T03:05:03.239 DEBUG:teuthology.orchestra.run.smithi130:> contents = proc_f.read() 2023-10-06T03:05:03.239 DEBUG:teuthology.orchestra.run.smithi130:> if mountpoint in contents: 2023-10-06T03:05:03.239 DEBUG:teuthology.orchestra.run.smithi130:> return f 2023-10-06T03:05:03.239 DEBUG:teuthology.orchestra.run.smithi130:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T03:05:03.239 DEBUG:teuthology.orchestra.run.smithi130:> 2023-10-06T03:05:03.239 DEBUG:teuthology.orchestra.run.smithi130:> print(_find_admin_socket("client.3")) 2023-10-06T03:05:03.239 DEBUG:teuthology.orchestra.run.smithi130:> ' 2023-10-06T03:05:03.359 INFO:teuthology.orchestra.run.smithi130.stdout:/var/run/ceph/ceph-client.3.127395.asok 2023-10-06T03:05:03.542 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.127395.asok 2023-10-06T03:05:03.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:03.542 DEBUG:teuthology.orchestra.run.smithi130:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.127395.asok status 2023-10-06T03:05:03.696 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2023-10-06T03:05:03.696 INFO:teuthology.orchestra.run.smithi130.stdout: "metadata": { 2023-10-06T03:05:03.696 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T03:05:03.696 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T03:05:03.696 INFO:teuthology.orchestra.run.smithi130.stdout: "entity_id": "3", 2023-10-06T03:05:03.696 INFO:teuthology.orchestra.run.smithi130.stdout: "hostname": "smithi130", 2023-10-06T03:05:03.696 INFO:teuthology.orchestra.run.smithi130.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-10-06T03:05:03.696 INFO:teuthology.orchestra.run.smithi130.stdout: "pid": "127395", 2023-10-06T03:05:03.697 INFO:teuthology.orchestra.run.smithi130.stdout: "root": "/" 2023-10-06T03:05:03.697 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-10-06T03:05:03.697 INFO:teuthology.orchestra.run.smithi130.stdout: "dentry_count": 0, 2023-10-06T03:05:03.697 INFO:teuthology.orchestra.run.smithi130.stdout: "dentry_pinned_count": 0, 2023-10-06T03:05:03.697 INFO:teuthology.orchestra.run.smithi130.stdout: "id": 4735, 2023-10-06T03:05:03.697 INFO:teuthology.orchestra.run.smithi130.stdout: "inst": { 2023-10-06T03:05:03.697 INFO:teuthology.orchestra.run.smithi130.stdout: "name": { 2023-10-06T03:05:03.697 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "client", 2023-10-06T03:05:03.697 INFO:teuthology.orchestra.run.smithi130.stdout: "num": 4735 2023-10-06T03:05:03.697 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-10-06T03:05:03.697 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": { 2023-10-06T03:05:03.697 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-10-06T03:05:03.698 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "192.168.0.2:0", 2023-10-06T03:05:03.698 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 1382961964 2023-10-06T03:05:03.698 INFO:teuthology.orchestra.run.smithi130.stdout: } 2023-10-06T03:05:03.698 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-10-06T03:05:03.698 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": { 2023-10-06T03:05:03.698 INFO:teuthology.orchestra.run.smithi130.stdout: "type": "v1", 2023-10-06T03:05:03.698 INFO:teuthology.orchestra.run.smithi130.stdout: "addr": "192.168.0.2:0", 2023-10-06T03:05:03.698 INFO:teuthology.orchestra.run.smithi130.stdout: "nonce": 1382961964 2023-10-06T03:05:03.698 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2023-10-06T03:05:03.698 INFO:teuthology.orchestra.run.smithi130.stdout: "inst_str": "client.4735 192.168.0.2:0/1382961964", 2023-10-06T03:05:03.698 INFO:teuthology.orchestra.run.smithi130.stdout: "addr_str": "192.168.0.2:0/1382961964", 2023-10-06T03:05:03.699 INFO:teuthology.orchestra.run.smithi130.stdout: "inode_count": 1, 2023-10-06T03:05:03.699 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_epoch": 9, 2023-10-06T03:05:03.699 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_epoch": 27, 2023-10-06T03:05:03.699 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_epoch_barrier": 0, 2023-10-06T03:05:03.699 INFO:teuthology.orchestra.run.smithi130.stdout: "blocklisted": false, 2023-10-06T03:05:03.699 INFO:teuthology.orchestra.run.smithi130.stdout: "fs_name": "cephfs" 2023-10-06T03:05:03.699 INFO:teuthology.orchestra.run.smithi130.stdout:} 2023-10-06T03:05:03.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:03.705 DEBUG:teuthology.orchestra.run.smithi125:> stat --file-system '--printf=%T 2023-10-06T03:05:03.705 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:03.729 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2023-10-06T03:05:03.729 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:03.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:03.729 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:03.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:03.804 DEBUG:teuthology.orchestra.run.smithi125:> stat --file-system '--printf=%T 2023-10-06T03:05:03.804 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.2 2023-10-06T03:05:03.868 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2023-10-06T03:05:03.868 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-10-06T03:05:03.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:03.868 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T03:05:03.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:03.942 DEBUG:teuthology.orchestra.run.smithi130:> stat --file-system '--printf=%T 2023-10-06T03:05:03.942 DEBUG:teuthology.orchestra.run.smithi130:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-06T03:05:03.961 INFO:teuthology.orchestra.run.smithi130.stdout:fuseblk 2023-10-06T03:05:03.961 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-06T03:05:03.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:03.961 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T03:05:04.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:04.029 DEBUG:teuthology.orchestra.run.smithi130:> stat --file-system '--printf=%T 2023-10-06T03:05:04.029 DEBUG:teuthology.orchestra.run.smithi130:> ' -- /home/ubuntu/cephtest/mnt.3 2023-10-06T03:05:04.087 INFO:teuthology.orchestra.run.smithi130.stdout:fuseblk 2023-10-06T03:05:04.087 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-10-06T03:05:04.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:04.088 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T03:05:04.154 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T03:05:04.171 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:05:04.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.302+0000 7f08c0010700 1 Processor -- start 2023-10-06T03:05:04.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.302+0000 7f08c0010700 1 -- start start 2023-10-06T03:05:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.303+0000 7f08c0010700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f08b806e6b0 0x7f08b80c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.303+0000 7f08c0010700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08b80c79a0 0x7f08b80ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.303+0000 7f08c0010700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b80c80b0 con 0x7f08b81555d0 2023-10-06T03:05:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.303+0000 7f08c0010700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b80c6d00 con 0x7f08b806e6b0 2023-10-06T03:05:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.303+0000 7f08c0010700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80c7190 con 0x7f08b80c79a0 2023-10-06T03:05:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.303+0000 7f08bd5ab700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f08b806e6b0 0x7f08b80c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.303+0000 7f08bd5ab700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f08b806e6b0 0x7f08b80c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51466/0 (socket says 172.21.15.125:51466) 2023-10-06T03:05:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.303+0000 7f08bd5ab700 1 -- 172.21.15.125:0/1981494093 learned_addr learned my addr 172.21.15.125:0/1981494093 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.303+0000 7f08be5ad700 1 --2- 172.21.15.125:0/1981494093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08b80c79a0 0x7f08b80ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.303+0000 7f08bd5ab700 1 -- 172.21.15.125:0/1981494093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08b80c79a0 msgr2=0x7f08b80ac5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.303+0000 7f08bd5ab700 1 --2- 172.21.15.125:0/1981494093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08b80c79a0 0x7f08b80ac5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.303+0000 7f08bd5ab700 1 -- 172.21.15.125:0/1981494093 >> v1:172.21.15.130:6789/0 conn(0x7f08b81555d0 legacy=0x7f08b806dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.303+0000 7f08bd5ab700 1 -- 172.21.15.125:0/1981494093 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b80c63d0 con 0x7f08b806e6b0 2023-10-06T03:05:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.303+0000 7f08bd5ab700 1 --2- 172.21.15.125:0/1981494093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08b806e6b0 0x7f08b80c7460 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f08a800ab50 tx=0x7f08a800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2430873d4b3bf70d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.303+0000 7f08bcdaa700 1 -- 172.21.15.125:0/1981494093 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a800ca40 con 0x7f08b806e6b0 2023-10-06T03:05:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.304+0000 7f08bcdaa700 1 -- 172.21.15.125:0/1981494093 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a800cba0 con 0x7f08b806e6b0 2023-10-06T03:05:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.304+0000 7f08bcdaa700 1 -- 172.21.15.125:0/1981494093 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8018400 con 0x7f08b806e6b0 2023-10-06T03:05:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.304+0000 7f08c0010700 1 -- 172.21.15.125:0/1981494093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08b806e6b0 msgr2=0x7f08b80c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.304+0000 7f08c0010700 1 --2- 172.21.15.125:0/1981494093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08b806e6b0 0x7f08b80c7460 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f08a800ab50 tx=0x7f08a800a3f0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.304+0000 7f08c0010700 1 -- 172.21.15.125:0/1981494093 shutdown_connections 2023-10-06T03:05:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.304+0000 7f08c0010700 1 --2- 172.21.15.125:0/1981494093 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08b80c79a0 0x7f08b80ac5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.304+0000 7f08c0010700 1 --2- 172.21.15.125:0/1981494093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08b806e6b0 0x7f08b80c7460 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.304+0000 7f08c0010700 1 -- 172.21.15.125:0/1981494093 >> 172.21.15.125:0/1981494093 conn(0x7f08b80cbd00 msgr2=0x7f08b80cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:04.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.304+0000 7f08c0010700 1 -- 172.21.15.125:0/1981494093 shutdown_connections 2023-10-06T03:05:04.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.304+0000 7f08c0010700 1 -- 172.21.15.125:0/1981494093 wait complete. 2023-10-06T03:05:04.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.305+0000 7f08c0010700 1 Processor -- start 2023-10-06T03:05:04.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.305+0000 7f08c0010700 1 -- start start 2023-10-06T03:05:04.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.306+0000 7f08c0010700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b806e6b0 0x7f08b806a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:04.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.306+0000 7f08c0010700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08b80c79a0 0x7f08b8150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:04.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.306+0000 7f08c0010700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08b81555d0 0x7f08b8151230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:04.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.306+0000 7f08c0010700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b8165610 con 0x7f08b81555d0 2023-10-06T03:05:04.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.306+0000 7f08c0010700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80c02e0 con 0x7f08b806e6b0 2023-10-06T03:05:04.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.306+0000 7f08c0010700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80c0b80 con 0x7f08b80c79a0 2023-10-06T03:05:04.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.306+0000 7f08be5ad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08b81555d0 0x7f08b8151230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:04.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.306+0000 7f08be5ad700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08b81555d0 0x7f08b8151230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51474/0 (socket says 172.21.15.125:51474) 2023-10-06T03:05:04.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.306+0000 7f08be5ad700 1 -- 172.21.15.125:0/2126751040 learned_addr learned my addr 172.21.15.125:0/2126751040 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:04.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.306+0000 7f08bd5ab700 1 --2- 172.21.15.125:0/2126751040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08b80c79a0 0x7f08b8150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:04.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.306+0000 7f08bddac700 1 --2- 172.21.15.125:0/2126751040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b806e6b0 0x7f08b806a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:04.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.306+0000 7f08be5ad700 1 -- 172.21.15.125:0/2126751040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08b80c79a0 msgr2=0x7f08b8150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:04.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.306+0000 7f08be5ad700 1 --2- 172.21.15.125:0/2126751040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08b80c79a0 0x7f08b8150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.306+0000 7f08be5ad700 1 -- 172.21.15.125:0/2126751040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b806e6b0 msgr2=0x7f08b806a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:04.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.306+0000 7f08be5ad700 1 --2- 172.21.15.125:0/2126751040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b806e6b0 0x7f08b806a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.306+0000 7f08be5ad700 1 -- 172.21.15.125:0/2126751040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a800a690 con 0x7f08b81555d0 2023-10-06T03:05:04.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.306+0000 7f08bddac700 1 --2- 172.21.15.125:0/2126751040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b806e6b0 0x7f08b806a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:04.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.307+0000 7f08be5ad700 1 --2- 172.21.15.125:0/2126751040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08b81555d0 0x7f08b8151230 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009e90 tx=0x7f08b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:04.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.307+0000 7f08adffb700 1 -- 172.21.15.125:0/2126751040 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b000cc80 con 0x7f08b81555d0 2023-10-06T03:05:04.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.307+0000 7f08adffb700 1 -- 172.21.15.125:0/2126751040 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b000f040 con 0x7f08b81555d0 2023-10-06T03:05:04.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.307+0000 7f08c0010700 1 -- 172.21.15.125:0/2126751040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b8151770 con 0x7f08b81555d0 2023-10-06T03:05:04.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.307+0000 7f08adffb700 1 -- 172.21.15.125:0/2126751040 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b0014480 con 0x7f08b81555d0 2023-10-06T03:05:04.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.307+0000 7f08c0010700 1 -- 172.21.15.125:0/2126751040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b80c05b0 con 0x7f08b81555d0 2023-10-06T03:05:04.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.308+0000 7f08c0010700 1 -- 172.21.15.125:0/2126751040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b8066510 con 0x7f08b81555d0 2023-10-06T03:05:04.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.308+0000 7f08adffb700 1 -- 172.21.15.125:0/2126751040 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f08b0014830 con 0x7f08b81555d0 2023-10-06T03:05:04.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.309+0000 7f08adffb700 1 --2- 172.21.15.125:0/2126751040 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f089c066fe0 0x7f089c069490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:04.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.309+0000 7f08adffb700 1 -- 172.21.15.125:0/2126751040 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f08b0085530 con 0x7f08b81555d0 2023-10-06T03:05:04.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.309+0000 7f08bddac700 1 --2- 172.21.15.125:0/2126751040 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f089c066fe0 0x7f089c069490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:04.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.309+0000 7f08bddac700 1 --2- 172.21.15.125:0/2126751040 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f089c066fe0 0x7f089c069490 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f08b40017a0 tx=0x7f08b4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:04.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.313+0000 7f08adffb700 1 -- 172.21.15.125:0/2126751040 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08b00522b0 con 0x7f08b81555d0 2023-10-06T03:05:04.499 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.498+0000 7f08c0010700 1 -- 172.21.15.125:0/2126751040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08b80c0cc0 con 0x7f08b81555d0 2023-10-06T03:05:04.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.499+0000 7f08adffb700 1 -- 172.21.15.125:0/2126751040 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18851 (secure 0 0 0) 0x7f08b00558d0 con 0x7f08b81555d0 2023-10-06T03:05:04.500 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:04.501 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:33.645139+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:04:26.828121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:04:28.179225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:04:31.256394+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:05:04.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.501+0000 7f08c0010700 1 -- 172.21.15.125:0/2126751040 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f089c066fe0 msgr2=0x7f089c069490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:04.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.501+0000 7f08c0010700 1 --2- 172.21.15.125:0/2126751040 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f089c066fe0 0x7f089c069490 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f08b40017a0 tx=0x7f08b4009040 comp rx=0 tx=0).stop 2023-10-06T03:05:04.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.501+0000 7f08c0010700 1 -- 172.21.15.125:0/2126751040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08b81555d0 msgr2=0x7f08b8151230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:04.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.501+0000 7f08c0010700 1 --2- 172.21.15.125:0/2126751040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08b81555d0 0x7f08b8151230 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009e90 tx=0x7f08b000b040 comp rx=0 tx=0).stop 2023-10-06T03:05:04.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.501+0000 7f08c0010700 1 -- 172.21.15.125:0/2126751040 shutdown_connections 2023-10-06T03:05:04.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.501+0000 7f08c0010700 1 --2- 172.21.15.125:0/2126751040 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f089c066fe0 0x7f089c069490 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.501+0000 7f08c0010700 1 --2- 172.21.15.125:0/2126751040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08b81555d0 0x7f08b8151230 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.501+0000 7f08c0010700 1 --2- 172.21.15.125:0/2126751040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f08b806e6b0 0x7f08b806a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.501+0000 7f08c0010700 1 --2- 172.21.15.125:0/2126751040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08b80c79a0 0x7f08b8150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.501+0000 7f08c0010700 1 -- 172.21.15.125:0/2126751040 >> 172.21.15.125:0/2126751040 conn(0x7f08b80cbd00 msgr2=0x7f08b8159b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:04.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.501+0000 7f08c0010700 1 -- 172.21.15.125:0/2126751040 shutdown_connections 2023-10-06T03:05:04.504 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.501+0000 7f08c0010700 1 -- 172.21.15.125:0/2126751040 wait complete. 2023-10-06T03:05:04.514 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:04:15.845430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:04:22.729795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:04:26.828121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:04:28.179225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:04:31.256394+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:05:04.515 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:05:04.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.633+0000 7f5723a0a700 1 Processor -- start 2023-10-06T03:05:04.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.633+0000 7f5723a0a700 1 -- start start 2023-10-06T03:05:04.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.634+0000 7f5723a0a700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f571c0c8320 0x7f571c160c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:04.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.634+0000 7f5723a0a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f571c0c9470 con 0x7f571c0af320 2023-10-06T03:05:04.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.634+0000 7f5723a0a700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f571c0c9b40 con 0x7f571c0cba50 2023-10-06T03:05:04.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.634+0000 7f5723a0a700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f571c0c8860 con 0x7f571c0c8320 2023-10-06T03:05:04.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.634+0000 7f57217a6700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f571c0af320 0x7f571c0cb340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46564/0 (socket says 172.21.15.125:46564) 2023-10-06T03:05:04.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.634+0000 7f57217a6700 1 -- 172.21.15.125:0/3124725421 learned_addr learned my addr 172.21.15.125:0/3124725421 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:04.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.635+0000 7f5721fa7700 1 --2- 172.21.15.125:0/3124725421 >> v2:172.21.15.130:3300/0 conn(0x7f571c0c8320 0x7f571c160c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:04.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.635+0000 7f5713fff700 1 -- 172.21.15.125:0/3124725421 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378873150 0 0) 0x7f571c0c9470 con 0x7f571c0af320 2023-10-06T03:05:04.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.635+0000 7f5713fff700 1 -- 172.21.15.125:0/3124725421 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5708003570 con 0x7f571c0af320 2023-10-06T03:05:04.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.635+0000 7f5721fa7700 1 -- 172.21.15.125:0/3124725421 >> v1:172.21.15.130:6789/0 conn(0x7f571c0cba50 legacy=0x7f571c0c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:04.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.635+0000 7f5721fa7700 1 -- 172.21.15.125:0/3124725421 >> v1:172.21.15.125:6789/0 conn(0x7f571c0af320 legacy=0x7f571c0cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:04.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.635+0000 7f5713fff700 1 -- 172.21.15.125:0/3124725421 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150230070 0 0) 0x7f571c0c9b40 con 0x7f571c0cba50 2023-10-06T03:05:04.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.635+0000 7f5721fa7700 1 -- 172.21.15.125:0/3124725421 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571c0c8b40 con 0x7f571c0c8320 2023-10-06T03:05:04.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.635+0000 7f5721fa7700 1 --2- 172.21.15.125:0/3124725421 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f571c0c8320 0x7f571c160c30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5714009e60 tx=0x7f5714009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e79a8ad987bd2f13 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:04.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.635+0000 7f5713fff700 1 -- 172.21.15.125:0/3124725421 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571400e070 con 0x7f571c0c8320 2023-10-06T03:05:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.635+0000 7f5713fff700 1 -- 172.21.15.125:0/3124725421 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571400bb60 con 0x7f571c0c8320 2023-10-06T03:05:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.635+0000 7f5713fff700 1 -- 172.21.15.125:0/3124725421 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714012430 con 0x7f571c0c8320 2023-10-06T03:05:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.636+0000 7f5723a0a700 1 -- 172.21.15.125:0/3124725421 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f571c0c8320 msgr2=0x7f571c160c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.636+0000 7f5723a0a700 1 --2- 172.21.15.125:0/3124725421 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f571c0c8320 0x7f571c160c30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5714009e60 tx=0x7f5714009780 comp rx=0 tx=0).stop 2023-10-06T03:05:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.636+0000 7f5723a0a700 1 -- 172.21.15.125:0/3124725421 shutdown_connections 2023-10-06T03:05:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.636+0000 7f5723a0a700 1 --2- 172.21.15.125:0/3124725421 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f571c0c8320 0x7f571c160c30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.636+0000 7f5723a0a700 1 -- 172.21.15.125:0/3124725421 >> 172.21.15.125:0/3124725421 conn(0x7f571c096120 msgr2=0x7f571c068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.636+0000 7f5723a0a700 1 -- 172.21.15.125:0/3124725421 shutdown_connections 2023-10-06T03:05:04.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.636+0000 7f5723a0a700 1 -- 172.21.15.125:0/3124725421 wait complete. 2023-10-06T03:05:04.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.637+0000 7f5723a0a700 1 Processor -- start 2023-10-06T03:05:04.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.637+0000 7f5723a0a700 1 -- start start 2023-10-06T03:05:04.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f5723a0a700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f571c0af320 0x7f571c151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:04.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f5723a0a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f571c0c8320 0x7f571c158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:04.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f5723a0a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f571c0cba50 0x7f571c0b2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:04.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f5723a0a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c0b0e70 con 0x7f571c0cba50 2023-10-06T03:05:04.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f5723a0a700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571c158050 con 0x7f571c0af320 2023-10-06T03:05:04.642 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f5723a0a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571c151f50 con 0x7f571c0c8320 2023-10-06T03:05:04.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f5721fa7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f571c0cba50 0x7f571c0b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:04.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f5721fa7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f571c0cba50 0x7f571c0b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51478/0 (socket says 172.21.15.125:51478) 2023-10-06T03:05:04.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f5721fa7700 1 -- 172.21.15.125:0/1048781112 learned_addr learned my addr 172.21.15.125:0/1048781112 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:04.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f57217a6700 1 --2- 172.21.15.125:0/1048781112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f571c0af320 0x7f571c151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:04.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f5720fa5700 1 --2- 172.21.15.125:0/1048781112 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f571c0c8320 0x7f571c158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:04.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f5721fa7700 1 -- 172.21.15.125:0/1048781112 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f571c0c8320 msgr2=0x7f571c158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:04.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f5721fa7700 1 --2- 172.21.15.125:0/1048781112 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f571c0c8320 0x7f571c158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f5721fa7700 1 -- 172.21.15.125:0/1048781112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f571c0af320 msgr2=0x7f571c151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:04.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f5721fa7700 1 --2- 172.21.15.125:0/1048781112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f571c0af320 0x7f571c151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f5721fa7700 1 -- 172.21.15.125:0/1048781112 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5714009a20 con 0x7f571c0cba50 2023-10-06T03:05:04.643 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f5721fa7700 1 --2- 172.21.15.125:0/1048781112 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f571c0cba50 0x7f571c0b2320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f571c06df40 tx=0x7f5714019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:04.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f57117fa700 1 -- 172.21.15.125:0/1048781112 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714026480 con 0x7f571c0cba50 2023-10-06T03:05:04.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f57117fa700 1 -- 172.21.15.125:0/1048781112 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5714026640 con 0x7f571c0cba50 2023-10-06T03:05:04.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f5723a0a700 1 -- 172.21.15.125:0/1048781112 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571c0b0680 con 0x7f571c0cba50 2023-10-06T03:05:04.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.638+0000 7f57117fa700 1 -- 172.21.15.125:0/1048781112 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714026a00 con 0x7f571c0cba50 2023-10-06T03:05:04.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.639+0000 7f5723a0a700 1 -- 172.21.15.125:0/1048781112 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571c0b08b0 con 0x7f571c0cba50 2023-10-06T03:05:04.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.640+0000 7f5723a0a700 1 -- 172.21.15.125:0/1048781112 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f571c066510 con 0x7f571c0cba50 2023-10-06T03:05:04.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.640+0000 7f57117fa700 1 -- 172.21.15.125:0/1048781112 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f571401c400 con 0x7f571c0cba50 2023-10-06T03:05:04.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.640+0000 7f57117fa700 1 --2- 172.21.15.125:0/1048781112 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5700066f30 0x7f57000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:04.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.640+0000 7f57117fa700 1 -- 172.21.15.125:0/1048781112 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f57140868f0 con 0x7f571c0cba50 2023-10-06T03:05:04.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.640+0000 7f57217a6700 1 --2- 172.21.15.125:0/1048781112 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5700066f30 0x7f57000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:04.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.640+0000 7f57217a6700 1 --2- 172.21.15.125:0/1048781112 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5700066f30 0x7f57000693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f570c000c00 tx=0x7f570c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:04.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.644+0000 7f57117fa700 1 -- 172.21.15.125:0/1048781112 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5714053710 con 0x7f571c0cba50 2023-10-06T03:05:04.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.824+0000 7f5723a0a700 1 -- 172.21.15.125:0/1048781112 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f571c0c8e80 con 0x7f571c0cba50 2023-10-06T03:05:04.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.825+0000 7f57117fa700 1 -- 172.21.15.125:0/1048781112 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f571402b0a0 con 0x7f571c0cba50 2023-10-06T03:05:04.826 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-06T03:05:04.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.827+0000 7f5723a0a700 1 -- 172.21.15.125:0/1048781112 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5700066f30 msgr2=0x7f57000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:04.828 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.827+0000 7f5723a0a700 1 --2- 172.21.15.125:0/1048781112 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5700066f30 0x7f57000693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f570c000c00 tx=0x7f570c009040 comp rx=0 tx=0).stop 2023-10-06T03:05:04.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.827+0000 7f5723a0a700 1 -- 172.21.15.125:0/1048781112 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f571c0cba50 msgr2=0x7f571c0b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:04.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.827+0000 7f5723a0a700 1 --2- 172.21.15.125:0/1048781112 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f571c0cba50 0x7f571c0b2320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f571c06df40 tx=0x7f5714019000 comp rx=0 tx=0).stop 2023-10-06T03:05:04.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.827+0000 7f5723a0a700 1 -- 172.21.15.125:0/1048781112 shutdown_connections 2023-10-06T03:05:04.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.827+0000 7f5723a0a700 1 --2- 172.21.15.125:0/1048781112 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5700066f30 0x7f57000693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.827+0000 7f5723a0a700 1 --2- 172.21.15.125:0/1048781112 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f571c0cba50 0x7f571c0b2320 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.827+0000 7f5723a0a700 1 --2- 172.21.15.125:0/1048781112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f571c0af320 0x7f571c151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.827+0000 7f5723a0a700 1 --2- 172.21.15.125:0/1048781112 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f571c0c8320 0x7f571c158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.827+0000 7f5723a0a700 1 -- 172.21.15.125:0/1048781112 >> 172.21.15.125:0/1048781112 conn(0x7f571c096120 msgr2=0x7f571c0cabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:04.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.827+0000 7f5723a0a700 1 -- 172.21.15.125:0/1048781112 shutdown_connections 2023-10-06T03:05:04.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.827+0000 7f5723a0a700 1 -- 172.21.15.125:0/1048781112 wait complete. 2023-10-06T03:05:04.840 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:05:04.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.959+0000 7fc9f2222700 1 Processor -- start 2023-10-06T03:05:04.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.959+0000 7fc9f2222700 1 -- start start 2023-10-06T03:05:04.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.960+0000 7fc9f2222700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9ec067d20 0x7fc9ec0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:04.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.960+0000 7fc9f2222700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc9ec0ca190 0x7fc9ec0c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:04.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.960+0000 7fc9f2222700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9ec0cafe0 con 0x7fc9ec0af320 2023-10-06T03:05:04.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.960+0000 7fc9f2222700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9ec0c3b40 con 0x7fc9ec0ca190 2023-10-06T03:05:04.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.960+0000 7fc9f2222700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec0ca710 con 0x7fc9ec067d20 2023-10-06T03:05:04.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.960+0000 7fc9ebfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc9ec0ca190 0x7fc9ec0c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:04.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.960+0000 7fc9eb7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc9ec0af320 0x7fc9ec067610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46566/0 (socket says 172.21.15.125:46566) 2023-10-06T03:05:04.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.960+0000 7fc9eb7fe700 1 -- 172.21.15.125:0/3281811231 learned_addr learned my addr 172.21.15.125:0/3281811231 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:04.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.960+0000 7fc9eaffd700 1 --2- 172.21.15.125:0/3281811231 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9ec067d20 0x7fc9ec0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:04.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.960+0000 7fc9ebfff700 1 -- 172.21.15.125:0/3281811231 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9ec067d20 msgr2=0x7fc9ec0caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:04.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.960+0000 7fc9ebfff700 1 --2- 172.21.15.125:0/3281811231 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9ec067d20 0x7fc9ec0caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.960+0000 7fc9ebfff700 1 -- 172.21.15.125:0/3281811231 >> v1:172.21.15.125:6789/0 conn(0x7fc9ec0af320 legacy=0x7fc9ec067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:04.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.960+0000 7fc9ebfff700 1 -- 172.21.15.125:0/3281811231 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ec0cc750 con 0x7fc9ec0ca190 2023-10-06T03:05:04.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.960+0000 7fc9ea7fc700 1 -- 172.21.15.125:0/3281811231 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822194428 0 0) 0x7fc9e0001290 con 0x7fc9ec0af320 2023-10-06T03:05:04.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.961+0000 7fc9ebfff700 1 --2- 172.21.15.125:0/3281811231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9ec0ca190 0x7fc9ec0c7880 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4009e60 tx=0x7fc9e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24cac4c0e54c0a2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:04.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.961+0000 7fc9ea7fc700 1 -- 172.21.15.125:0/3281811231 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e400e070 con 0x7fc9ec0ca190 2023-10-06T03:05:04.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.961+0000 7fc9ea7fc700 1 -- 172.21.15.125:0/3281811231 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e400bb60 con 0x7fc9ec0ca190 2023-10-06T03:05:04.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.961+0000 7fc9ea7fc700 1 -- 172.21.15.125:0/3281811231 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4012430 con 0x7fc9ec0ca190 2023-10-06T03:05:04.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.961+0000 7fc9f2222700 1 -- 172.21.15.125:0/3281811231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9ec0ca190 msgr2=0x7fc9ec0c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:04.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.961+0000 7fc9f2222700 1 --2- 172.21.15.125:0/3281811231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9ec0ca190 0x7fc9ec0c7880 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4009e60 tx=0x7fc9e4009780 comp rx=0 tx=0).stop 2023-10-06T03:05:04.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.961+0000 7fc9f2222700 1 -- 172.21.15.125:0/3281811231 shutdown_connections 2023-10-06T03:05:04.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.961+0000 7fc9f2222700 1 --2- 172.21.15.125:0/3281811231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9ec0ca190 0x7fc9ec0c7880 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.961+0000 7fc9f2222700 1 --2- 172.21.15.125:0/3281811231 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9ec067d20 0x7fc9ec0caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.961+0000 7fc9f2222700 1 -- 172.21.15.125:0/3281811231 >> 172.21.15.125:0/3281811231 conn(0x7fc9ec096120 msgr2=0x7fc9ec068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:04.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.961+0000 7fc9f2222700 1 -- 172.21.15.125:0/3281811231 shutdown_connections 2023-10-06T03:05:04.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.961+0000 7fc9f2222700 1 -- 172.21.15.125:0/3281811231 wait complete. 2023-10-06T03:05:04.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.963+0000 7fc9f2222700 1 Processor -- start 2023-10-06T03:05:04.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.963+0000 7fc9f2222700 1 -- start start 2023-10-06T03:05:04.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.963+0000 7fc9f2222700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9ec067d20 0x7fc9ec14ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:04.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.963+0000 7fc9f2222700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9ec0af320 0x7fc9ec0c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:04.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.963+0000 7fc9f2222700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9ec0ca190 0x7fc9ec15b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:04.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.963+0000 7fc9f2222700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec14d380 con 0x7fc9ec0ca190 2023-10-06T03:05:04.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.963+0000 7fc9f2222700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec169380 con 0x7fc9ec0af320 2023-10-06T03:05:04.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.963+0000 7fc9f2222700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec0c4ec0 con 0x7fc9ec067d20 2023-10-06T03:05:04.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.964+0000 7fc9ebfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9ec0ca190 0x7fc9ec15b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:04.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.964+0000 7fc9ebfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9ec0ca190 0x7fc9ec15b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:51494/0 (socket says 172.21.15.125:51494) 2023-10-06T03:05:04.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.964+0000 7fc9ebfff700 1 -- 172.21.15.125:0/832495042 learned_addr learned my addr 172.21.15.125:0/832495042 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:04.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.964+0000 7fc9eb7fe700 1 --2- 172.21.15.125:0/832495042 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9ec067d20 0x7fc9ec14ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:04.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.964+0000 7fc9eaffd700 1 --2- 172.21.15.125:0/832495042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9ec0af320 0x7fc9ec0c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:04.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.964+0000 7fc9ebfff700 1 -- 172.21.15.125:0/832495042 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9ec067d20 msgr2=0x7fc9ec14ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:04.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.964+0000 7fc9ebfff700 1 --2- 172.21.15.125:0/832495042 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9ec067d20 0x7fc9ec14ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.964+0000 7fc9ebfff700 1 -- 172.21.15.125:0/832495042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9ec0af320 msgr2=0x7fc9ec0c64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:04.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.964+0000 7fc9ebfff700 1 --2- 172.21.15.125:0/832495042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9ec0af320 0x7fc9ec0c64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:04.970 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.964+0000 7fc9ebfff700 1 -- 172.21.15.125:0/832495042 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e4009a20 con 0x7fc9ec0ca190 2023-10-06T03:05:04.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.964+0000 7fc9ebfff700 1 --2- 172.21.15.125:0/832495042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9ec0ca190 0x7fc9ec15b400 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec06df40 tx=0x7fc9e4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:04.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.964+0000 7fc9d37fe700 1 -- 172.21.15.125:0/832495042 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4012e60 con 0x7fc9ec0ca190 2023-10-06T03:05:04.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.964+0000 7fc9d37fe700 1 -- 172.21.15.125:0/832495042 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e4025440 con 0x7fc9ec0ca190 2023-10-06T03:05:04.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.964+0000 7fc9f2222700 1 -- 172.21.15.125:0/832495042 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ec0c51a0 con 0x7fc9ec0ca190 2023-10-06T03:05:04.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.964+0000 7fc9d37fe700 1 -- 172.21.15.125:0/832495042 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e40257e0 con 0x7fc9ec0ca190 2023-10-06T03:05:04.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.964+0000 7fc9f2222700 1 -- 172.21.15.125:0/832495042 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ec0c5760 con 0x7fc9ec0ca190 2023-10-06T03:05:04.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.965+0000 7fc9f2222700 1 -- 172.21.15.125:0/832495042 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ec066510 con 0x7fc9ec0ca190 2023-10-06T03:05:04.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.966+0000 7fc9d37fe700 1 -- 172.21.15.125:0/832495042 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc9e4003050 con 0x7fc9ec0ca190 2023-10-06T03:05:04.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.966+0000 7fc9d37fe700 1 --2- 172.21.15.125:0/832495042 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc9d8066f30 0x7fc9d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:04.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.966+0000 7fc9d37fe700 1 -- 172.21.15.125:0/832495042 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fc9e4086520 con 0x7fc9ec0ca190 2023-10-06T03:05:04.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.966+0000 7fc9eb7fe700 1 --2- 172.21.15.125:0/832495042 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc9d8066f30 0x7fc9d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:04.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.966+0000 7fc9eb7fe700 1 --2- 172.21.15.125:0/832495042 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc9d8066f30 0x7fc9d80693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec0c8a50 tx=0x7fc9e0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:04.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:04.970+0000 7fc9d37fe700 1 -- 172.21.15.125:0/832495042 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9e4053340 con 0x7fc9ec0ca190 2023-10-06T03:05:05.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.149+0000 7fc9f2222700 1 -- 172.21.15.125:0/832495042 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc9ec0cca30 con 0x7fc9ec0ca190 2023-10-06T03:05:05.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.150+0000 7fc9d37fe700 1 -- 172.21.15.125:0/832495042 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc9e4056960 con 0x7fc9ec0ca190 2023-10-06T03:05:05.152 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-06T03:05:05.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.152+0000 7fc9f2222700 1 -- 172.21.15.125:0/832495042 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc9d8066f30 msgr2=0x7fc9d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:05.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.152+0000 7fc9f2222700 1 --2- 172.21.15.125:0/832495042 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc9d8066f30 0x7fc9d80693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec0c8a50 tx=0x7fc9e0009040 comp rx=0 tx=0).stop 2023-10-06T03:05:05.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.152+0000 7fc9f2222700 1 -- 172.21.15.125:0/832495042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9ec0ca190 msgr2=0x7fc9ec15b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:05.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.152+0000 7fc9f2222700 1 --2- 172.21.15.125:0/832495042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9ec0ca190 0x7fc9ec15b400 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec06df40 tx=0x7fc9e4019000 comp rx=0 tx=0).stop 2023-10-06T03:05:05.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.152+0000 7fc9f2222700 1 -- 172.21.15.125:0/832495042 shutdown_connections 2023-10-06T03:05:05.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.152+0000 7fc9f2222700 1 --2- 172.21.15.125:0/832495042 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc9d8066f30 0x7fc9d80693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.152+0000 7fc9f2222700 1 --2- 172.21.15.125:0/832495042 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc9ec0ca190 0x7fc9ec15b400 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.152+0000 7fc9f2222700 1 --2- 172.21.15.125:0/832495042 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc9ec067d20 0x7fc9ec14ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.152+0000 7fc9f2222700 1 --2- 172.21.15.125:0/832495042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc9ec0af320 0x7fc9ec0c64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.152+0000 7fc9f2222700 1 -- 172.21.15.125:0/832495042 >> 172.21.15.125:0/832495042 conn(0x7fc9ec096120 msgr2=0x7fc9ec06c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:05.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.152+0000 7fc9f2222700 1 -- 172.21.15.125:0/832495042 shutdown_connections 2023-10-06T03:05:05.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.152+0000 7fc9f2222700 1 -- 172.21.15.125:0/832495042 wait complete. 2023-10-06T03:05:05.165 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:05:05.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.286+0000 7ff3c2179700 1 Processor -- start 2023-10-06T03:05:05.287 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.286+0000 7ff3c2179700 1 -- start start 2023-10-06T03:05:05.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.286+0000 7ff3c2179700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff3bc0af320 0x7ff3bc0cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.286+0000 7ff3c2179700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3bc0cb880 0x7ff3bc0c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.286+0000 7ff3c2179700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3bc0c9470 con 0x7ff3bc0c8150 2023-10-06T03:05:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3c2179700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3bc0c9b40 con 0x7ff3bc0af320 2023-10-06T03:05:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3c2179700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc0c85a0 con 0x7ff3bc0cb880 2023-10-06T03:05:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3bbfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff3bc0c8150 0x7ff3bc1565e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43756/0 (socket says 172.21.15.125:43756) 2023-10-06T03:05:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3bbfff700 1 -- 172.21.15.125:0/3771686119 learned_addr learned my addr 172.21.15.125:0/3771686119 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3baffd700 1 --2- 172.21.15.125:0/3771686119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3bc0cb880 0x7ff3bc0c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3ba7fc700 1 -- 172.21.15.125:0/3771686119 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775065612 0 0) 0x7ff3bc0c9470 con 0x7ff3bc0c8150 2023-10-06T03:05:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3ba7fc700 1 -- 172.21.15.125:0/3771686119 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3a4003570 con 0x7ff3bc0c8150 2023-10-06T03:05:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3bb7fe700 1 --2- 172.21.15.125:0/3771686119 >> v2:172.21.15.130:3300/0 conn(0x7ff3bc0af320 0x7ff3bc0cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3ba7fc700 1 -- 172.21.15.125:0/3771686119 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1147663148 0 0) 0x7ff3a4003570 con 0x7ff3bc0c8150 2023-10-06T03:05:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3ba7fc700 1 -- 172.21.15.125:0/3771686119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3bc0cb880 msgr2=0x7ff3bc0c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3ba7fc700 1 --2- 172.21.15.125:0/3771686119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3bc0cb880 0x7ff3bc0c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3ba7fc700 1 -- 172.21.15.125:0/3771686119 >> v2:172.21.15.130:3300/0 conn(0x7ff3bc0af320 msgr2=0x7ff3bc0cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3ba7fc700 1 --2- 172.21.15.125:0/3771686119 >> v2:172.21.15.130:3300/0 conn(0x7ff3bc0af320 0x7ff3bc0cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3ba7fc700 1 -- 172.21.15.125:0/3771686119 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc0cbcf0 con 0x7ff3bc0c8150 2023-10-06T03:05:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3ba7fc700 1 -- 172.21.15.125:0/3771686119 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7ff3b40017f0 con 0x7ff3bc0c8150 2023-10-06T03:05:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3ba7fc700 1 -- 172.21.15.125:0/3771686119 >> v1:172.21.15.125:6789/0 conn(0x7ff3bc0c8150 legacy=0x7ff3bc1565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3ba7fc700 1 --2- 172.21.15.125:0/3771686119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3bc0cb880 0x7ff3a4003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3ba7fc700 1 --2- 172.21.15.125:0/3771686119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3a4003fe0 0x7ff3a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3ba7fc700 1 --2- 172.21.15.125:0/3771686119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3a4004d50 0x7ff3a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3ba7fc700 1 -- 172.21.15.125:0/3771686119 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc0c9b40 con 0x7ff3a4003fe0 2023-10-06T03:05:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3ba7fc700 1 -- 172.21.15.125:0/3771686119 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc0c85a0 con 0x7ff3a4004d50 2023-10-06T03:05:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3ba7fc700 1 -- 172.21.15.125:0/3771686119 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a400ba90 con 0x7ff3bc0cb880 2023-10-06T03:05:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3baffd700 1 --2- 172.21.15.125:0/3771686119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3a4003fe0 0x7ff3a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3bb7fe700 1 --2- 172.21.15.125:0/3771686119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3bc0cb880 0x7ff3a4003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.287+0000 7ff3bbfff700 1 --2- 172.21.15.125:0/3771686119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3a4004d50 0x7ff3a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.288+0000 7ff3baffd700 1 -- 172.21.15.125:0/3771686119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3bc0cb880 msgr2=0x7ff3a4003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.288+0000 7ff3baffd700 1 --2- 172.21.15.125:0/3771686119 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3bc0cb880 0x7ff3a4003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.288+0000 7ff3baffd700 1 -- 172.21.15.125:0/3771686119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3a4004d50 msgr2=0x7ff3a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.288+0000 7ff3baffd700 1 --2- 172.21.15.125:0/3771686119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3a4004d50 0x7ff3a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.288+0000 7ff3baffd700 1 -- 172.21.15.125:0/3771686119 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a4003570 con 0x7ff3a4003fe0 2023-10-06T03:05:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.288+0000 7ff3baffd700 1 --2- 172.21.15.125:0/3771686119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3a4003fe0 0x7ff3a4004810 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009c00 tx=0x7ff3b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee48c3a91d2bd068 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.288+0000 7ff3ba7fc700 1 -- 172.21.15.125:0/3771686119 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b000e6b0 con 0x7ff3a4003fe0 2023-10-06T03:05:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.288+0000 7ff3ba7fc700 1 -- 172.21.15.125:0/3771686119 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b000e810 con 0x7ff3a4003fe0 2023-10-06T03:05:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.288+0000 7ff3ba7fc700 1 -- 172.21.15.125:0/3771686119 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b000ebd0 con 0x7ff3a4003fe0 2023-10-06T03:05:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.288+0000 7ff3c2179700 1 -- 172.21.15.125:0/3771686119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3a4003fe0 msgr2=0x7ff3a4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.288+0000 7ff3c2179700 1 --2- 172.21.15.125:0/3771686119 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3a4003fe0 0x7ff3a4004810 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0009c00 tx=0x7ff3b00091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.288+0000 7ff3bbfff700 1 -- 172.21.15.125:0/3771686119 reap_dead start 2023-10-06T03:05:05.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.288+0000 7ff3c2179700 1 -- 172.21.15.125:0/3771686119 shutdown_connections 2023-10-06T03:05:05.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.288+0000 7ff3c2179700 1 -- 172.21.15.125:0/3771686119 >> 172.21.15.125:0/3771686119 conn(0x7ff3bc096120 msgr2=0x7ff3bc068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:05.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.289+0000 7ff3c2179700 1 -- 172.21.15.125:0/3771686119 shutdown_connections 2023-10-06T03:05:05.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.289+0000 7ff3c2179700 1 -- 172.21.15.125:0/3771686119 wait complete. 2023-10-06T03:05:05.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.290+0000 7ff3c2179700 1 Processor -- start 2023-10-06T03:05:05.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.290+0000 7ff3c2179700 1 -- start start 2023-10-06T03:05:05.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.290+0000 7ff3c2179700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3a4003fe0 0x7ff3bc153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.290+0000 7ff3c2179700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc147990 0x7ff3bc154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.290+0000 7ff3c2179700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3bc154d70 0x7ff3bc0ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.290+0000 7ff3c2179700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc169100 con 0x7ff3bc147990 2023-10-06T03:05:05.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.290+0000 7ff3c2179700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc1551f0 con 0x7ff3bc154d70 2023-10-06T03:05:05.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.290+0000 7ff3c2179700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc16c6e0 con 0x7ff3a4003fe0 2023-10-06T03:05:05.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.291+0000 7ff3baffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc147990 0x7ff3bc154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.291+0000 7ff3baffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc147990 0x7ff3bc154830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39340/0 (socket says 172.21.15.125:39340) 2023-10-06T03:05:05.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.291+0000 7ff3baffd700 1 -- 172.21.15.125:0/1833673787 learned_addr learned my addr 172.21.15.125:0/1833673787 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:05.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.291+0000 7ff3bbfff700 1 --2- 172.21.15.125:0/1833673787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3bc154d70 0x7ff3bc0ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.291+0000 7ff3bb7fe700 1 --2- 172.21.15.125:0/1833673787 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3a4003fe0 0x7ff3bc153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.291+0000 7ff3baffd700 1 -- 172.21.15.125:0/1833673787 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3a4003fe0 msgr2=0x7ff3bc153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:05.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.291+0000 7ff3baffd700 1 --2- 172.21.15.125:0/1833673787 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3a4003fe0 0x7ff3bc153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.291+0000 7ff3baffd700 1 -- 172.21.15.125:0/1833673787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3bc154d70 msgr2=0x7ff3bc0ade30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:05.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.291+0000 7ff3baffd700 1 --2- 172.21.15.125:0/1833673787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3bc154d70 0x7ff3bc0ade30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.291+0000 7ff3baffd700 1 -- 172.21.15.125:0/1833673787 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc154410 con 0x7ff3bc147990 2023-10-06T03:05:05.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.291+0000 7ff3baffd700 1 --2- 172.21.15.125:0/1833673787 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc147990 0x7ff3bc154830 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00091e0 tx=0x7ff3b001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:05.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.291+0000 7ff3a37fe700 1 -- 172.21.15.125:0/1833673787 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0022070 con 0x7ff3bc147990 2023-10-06T03:05:05.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.291+0000 7ff3a37fe700 1 -- 172.21.15.125:0/1833673787 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b000e980 con 0x7ff3bc147990 2023-10-06T03:05:05.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.291+0000 7ff3c2179700 1 -- 172.21.15.125:0/1833673787 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3bc16c980 con 0x7ff3bc147990 2023-10-06T03:05:05.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.291+0000 7ff3a37fe700 1 -- 172.21.15.125:0/1833673787 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b000e6b0 con 0x7ff3bc147990 2023-10-06T03:05:05.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.291+0000 7ff3c2179700 1 -- 172.21.15.125:0/1833673787 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3bc16cf40 con 0x7ff3bc147990 2023-10-06T03:05:05.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.292+0000 7ff3c2179700 1 -- 172.21.15.125:0/1833673787 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3bc066510 con 0x7ff3bc147990 2023-10-06T03:05:05.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.293+0000 7ff3a37fe700 1 -- 172.21.15.125:0/1833673787 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff3b001c450 con 0x7ff3bc147990 2023-10-06T03:05:05.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.293+0000 7ff3a37fe700 1 --2- 172.21.15.125:0/1833673787 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff3a8066f30 0x7ff3a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.293+0000 7ff3a37fe700 1 -- 172.21.15.125:0/1833673787 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff3b0086350 con 0x7ff3bc147990 2023-10-06T03:05:05.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.293+0000 7ff3bb7fe700 1 --2- 172.21.15.125:0/1833673787 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff3a8066f30 0x7ff3a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.294+0000 7ff3bb7fe700 1 --2- 172.21.15.125:0/1833673787 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff3a8066f30 0x7ff3a80693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac006ea0 tx=0x7ff3ac009120 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:05.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.297+0000 7ff3a37fe700 1 -- 172.21.15.125:0/1833673787 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3b0053180 con 0x7ff3bc147990 2023-10-06T03:05:05.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.482+0000 7ff3c2179700 1 -- 172.21.15.125:0/1833673787 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3bc0c8860 con 0x7ff3bc147990 2023-10-06T03:05:05.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.482+0000 7ff3a37fe700 1 -- 172.21.15.125:0/1833673787 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff3b00567a0 con 0x7ff3bc147990 2023-10-06T03:05:05.484 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-06T03:05:05.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.485+0000 7ff3c2179700 1 -- 172.21.15.125:0/1833673787 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff3a8066f30 msgr2=0x7ff3a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:05.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.485+0000 7ff3c2179700 1 --2- 172.21.15.125:0/1833673787 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff3a8066f30 0x7ff3a80693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac006ea0 tx=0x7ff3ac009120 comp rx=0 tx=0).stop 2023-10-06T03:05:05.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.485+0000 7ff3c2179700 1 -- 172.21.15.125:0/1833673787 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc147990 msgr2=0x7ff3bc154830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:05.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.485+0000 7ff3c2179700 1 --2- 172.21.15.125:0/1833673787 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc147990 0x7ff3bc154830 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff3b00091e0 tx=0x7ff3b001a000 comp rx=0 tx=0).stop 2023-10-06T03:05:05.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.485+0000 7ff3c2179700 1 -- 172.21.15.125:0/1833673787 shutdown_connections 2023-10-06T03:05:05.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.485+0000 7ff3c2179700 1 --2- 172.21.15.125:0/1833673787 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff3a8066f30 0x7ff3a80693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.485+0000 7ff3c2179700 1 --2- 172.21.15.125:0/1833673787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3bc154d70 0x7ff3bc0ade30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.485+0000 7ff3c2179700 1 --2- 172.21.15.125:0/1833673787 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff3a4003fe0 0x7ff3bc153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.485+0000 7ff3c2179700 1 --2- 172.21.15.125:0/1833673787 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff3bc147990 0x7ff3bc154830 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.485+0000 7ff3c2179700 1 -- 172.21.15.125:0/1833673787 >> 172.21.15.125:0/1833673787 conn(0x7ff3bc096120 msgr2=0x7ff3bc06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:05.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.485+0000 7ff3c2179700 1 -- 172.21.15.125:0/1833673787 shutdown_connections 2023-10-06T03:05:05.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.485+0000 7ff3c2179700 1 -- 172.21.15.125:0/1833673787 wait complete. 2023-10-06T03:05:05.498 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:05:05.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.616+0000 7fce244a3700 1 Processor -- start 2023-10-06T03:05:05.618 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.616+0000 7fce244a3700 1 -- start start 2023-10-06T03:05:05.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.617+0000 7fce244a3700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c15cef0 0x7fce1c0b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.617+0000 7fce244a3700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fce1c0cc4d0 0x7fce1c0cc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.617+0000 7fce244a3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce1c0cce70 con 0x7fce1c0b01a0 2023-10-06T03:05:05.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.617+0000 7fce244a3700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce1c068e60 con 0x7fce1c0cc4d0 2023-10-06T03:05:05.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.617+0000 7fce244a3700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c15d360 con 0x7fce1c15cef0 2023-10-06T03:05:05.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.617+0000 7fce2223f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fce1c0b01a0 0x7fce1c15a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43772/0 (socket says 172.21.15.125:43772) 2023-10-06T03:05:05.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.617+0000 7fce2223f700 1 -- 172.21.15.125:0/1611889134 learned_addr learned my addr 172.21.15.125:0/1611889134 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:05.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce2123d700 1 -- 172.21.15.125:0/1611889134 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1381386904 0 0) 0x7fce1c0cce70 con 0x7fce1c0b01a0 2023-10-06T03:05:05.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce2123d700 1 -- 172.21.15.125:0/1611889134 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce08003570 con 0x7fce1c0b01a0 2023-10-06T03:05:05.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce22a40700 1 --2- 172.21.15.125:0/1611889134 >> v2:172.21.15.130:3300/0 conn(0x7fce1c0cc4d0 0x7fce1c0cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce21a3e700 1 --2- 172.21.15.125:0/1611889134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c15cef0 0x7fce1c0b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce2123d700 1 -- 172.21.15.125:0/1611889134 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2218325509 0 0) 0x7fce08003570 con 0x7fce1c0b01a0 2023-10-06T03:05:05.625 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce2123d700 1 -- 172.21.15.125:0/1611889134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c15cef0 msgr2=0x7fce1c0b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:05.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce2123d700 1 --2- 172.21.15.125:0/1611889134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c15cef0 0x7fce1c0b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce2123d700 1 -- 172.21.15.125:0/1611889134 >> v2:172.21.15.130:3300/0 conn(0x7fce1c0cc4d0 msgr2=0x7fce1c0cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:05.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce2123d700 1 --2- 172.21.15.125:0/1611889134 >> v2:172.21.15.130:3300/0 conn(0x7fce1c0cc4d0 0x7fce1c0cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce2123d700 1 -- 172.21.15.125:0/1611889134 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c15d640 con 0x7fce1c0b01a0 2023-10-06T03:05:05.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce2123d700 1 -- 172.21.15.125:0/1611889134 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7fce0c001470 con 0x7fce1c0b01a0 2023-10-06T03:05:05.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce2123d700 1 -- 172.21.15.125:0/1611889134 >> v1:172.21.15.125:6789/0 conn(0x7fce1c0b01a0 legacy=0x7fce1c15a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:05.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce2123d700 1 --2- 172.21.15.125:0/1611889134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c15cef0 0x7fce08003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce2123d700 1 --2- 172.21.15.125:0/1611889134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce08003fe0 0x7fce08004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce2123d700 1 --2- 172.21.15.125:0/1611889134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce08004d50 0x7fce080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce2123d700 1 -- 172.21.15.125:0/1611889134 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c068e60 con 0x7fce08004d50 2023-10-06T03:05:05.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce2123d700 1 -- 172.21.15.125:0/1611889134 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c15d360 con 0x7fce08003fe0 2023-10-06T03:05:05.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce2123d700 1 -- 172.21.15.125:0/1611889134 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0800ba90 con 0x7fce1c15cef0 2023-10-06T03:05:05.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce2223f700 1 --2- 172.21.15.125:0/1611889134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c15cef0 0x7fce08003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce22a40700 1 --2- 172.21.15.125:0/1611889134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce08004d50 0x7fce080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce21a3e700 1 --2- 172.21.15.125:0/1611889134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce08003fe0 0x7fce08004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce22a40700 1 -- 172.21.15.125:0/1611889134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c15cef0 msgr2=0x7fce08003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:05.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce22a40700 1 --2- 172.21.15.125:0/1611889134 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c15cef0 0x7fce08003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce22a40700 1 -- 172.21.15.125:0/1611889134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce08003fe0 msgr2=0x7fce08004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:05.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce22a40700 1 --2- 172.21.15.125:0/1611889134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce08003fe0 0x7fce08004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.618+0000 7fce22a40700 1 -- 172.21.15.125:0/1611889134 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce08003570 con 0x7fce08004d50 2023-10-06T03:05:05.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.619+0000 7fce22a40700 1 --2- 172.21.15.125:0/1611889134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce08004d50 0x7fce080051c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fce1400e210 tx=0x7fce1400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5076b93c031d9f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:05.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.619+0000 7fce2123d700 1 -- 172.21.15.125:0/1611889134 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1400ea60 con 0x7fce08004d50 2023-10-06T03:05:05.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.619+0000 7fce2123d700 1 -- 172.21.15.125:0/1611889134 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce1400f040 con 0x7fce08004d50 2023-10-06T03:05:05.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.619+0000 7fce2123d700 1 -- 172.21.15.125:0/1611889134 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1400ee10 con 0x7fce08004d50 2023-10-06T03:05:05.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.619+0000 7fce244a3700 1 -- 172.21.15.125:0/1611889134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce08004d50 msgr2=0x7fce080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:05.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.619+0000 7fce244a3700 1 --2- 172.21.15.125:0/1611889134 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce08004d50 0x7fce080051c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fce1400e210 tx=0x7fce1400b040 comp rx=0 tx=0).stop 2023-10-06T03:05:05.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.619+0000 7fce22a40700 1 -- 172.21.15.125:0/1611889134 reap_dead start 2023-10-06T03:05:05.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.619+0000 7fce244a3700 1 -- 172.21.15.125:0/1611889134 shutdown_connections 2023-10-06T03:05:05.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.619+0000 7fce244a3700 1 -- 172.21.15.125:0/1611889134 >> 172.21.15.125:0/1611889134 conn(0x7fce1c0cdf80 msgr2=0x7fce1c0ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:05.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.619+0000 7fce244a3700 1 -- 172.21.15.125:0/1611889134 shutdown_connections 2023-10-06T03:05:05.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.619+0000 7fce244a3700 1 -- 172.21.15.125:0/1611889134 wait complete. 2023-10-06T03:05:05.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.620+0000 7fce244a3700 1 Processor -- start 2023-10-06T03:05:05.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.621+0000 7fce244a3700 1 -- start start 2023-10-06T03:05:05.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.621+0000 7fce244a3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce08004d50 0x7fce1c151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.621+0000 7fce244a3700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c0b21f0 0x7fce1c1437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.621+0000 7fce244a3700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce1c156480 0x7fce1c1568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.621+0000 7fce244a3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c1524f0 con 0x7fce08004d50 2023-10-06T03:05:05.629 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.621+0000 7fce244a3700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c0b3600 con 0x7fce1c156480 2023-10-06T03:05:05.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.621+0000 7fce244a3700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c156e10 con 0x7fce1c0b21f0 2023-10-06T03:05:05.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.621+0000 7fce2223f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce08004d50 0x7fce1c151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.621+0000 7fce2223f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce08004d50 0x7fce1c151fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39362/0 (socket says 172.21.15.125:39362) 2023-10-06T03:05:05.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.621+0000 7fce2223f700 1 -- 172.21.15.125:0/224762630 learned_addr learned my addr 172.21.15.125:0/224762630 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:05.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.621+0000 7fce22a40700 1 --2- 172.21.15.125:0/224762630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce1c156480 0x7fce1c1568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.621+0000 7fce21a3e700 1 --2- 172.21.15.125:0/224762630 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c0b21f0 0x7fce1c1437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.622+0000 7fce2223f700 1 -- 172.21.15.125:0/224762630 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c0b21f0 msgr2=0x7fce1c1437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:05.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.622+0000 7fce2223f700 1 --2- 172.21.15.125:0/224762630 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c0b21f0 0x7fce1c1437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.622+0000 7fce2223f700 1 -- 172.21.15.125:0/224762630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce1c156480 msgr2=0x7fce1c1568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:05.630 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.622+0000 7fce2223f700 1 --2- 172.21.15.125:0/224762630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce1c156480 0x7fce1c1568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.622+0000 7fce2223f700 1 -- 172.21.15.125:0/224762630 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c0b3a90 con 0x7fce08004d50 2023-10-06T03:05:05.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.622+0000 7fce21a3e700 1 --2- 172.21.15.125:0/224762630 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c0b21f0 0x7fce1c1437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:05.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.622+0000 7fce2223f700 1 --2- 172.21.15.125:0/224762630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce08004d50 0x7fce1c151fb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fce0c007390 tx=0x7fce0c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:05.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.622+0000 7fce127fc700 1 -- 172.21.15.125:0/224762630 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c00f8d0 con 0x7fce08004d50 2023-10-06T03:05:05.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.622+0000 7fce127fc700 1 -- 172.21.15.125:0/224762630 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c00fa50 con 0x7fce08004d50 2023-10-06T03:05:05.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.622+0000 7fce244a3700 1 -- 172.21.15.125:0/224762630 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce1c0b29f0 con 0x7fce08004d50 2023-10-06T03:05:05.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.622+0000 7fce127fc700 1 -- 172.21.15.125:0/224762630 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c00fe10 con 0x7fce08004d50 2023-10-06T03:05:05.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.622+0000 7fce244a3700 1 -- 172.21.15.125:0/224762630 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce1c0b2fb0 con 0x7fce08004d50 2023-10-06T03:05:05.631 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.623+0000 7fce244a3700 1 -- 172.21.15.125:0/224762630 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce1c066510 con 0x7fce08004d50 2023-10-06T03:05:05.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.623+0000 7fce127fc700 1 -- 172.21.15.125:0/224762630 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce0c0135c0 con 0x7fce08004d50 2023-10-06T03:05:05.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.624+0000 7fce127fc700 1 --2- 172.21.15.125:0/224762630 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fce00066f30 0x7fce000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.624+0000 7fce127fc700 1 -- 172.21.15.125:0/224762630 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fce0c084880 con 0x7fce08004d50 2023-10-06T03:05:05.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.624+0000 7fce21a3e700 1 --2- 172.21.15.125:0/224762630 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fce00066f30 0x7fce000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.624+0000 7fce21a3e700 1 --2- 172.21.15.125:0/224762630 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fce00066f30 0x7fce000693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fce1c154350 tx=0x7fce18008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:05.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.628+0000 7fce127fc700 1 -- 172.21.15.125:0/224762630 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce0c051600 con 0x7fce08004d50 2023-10-06T03:05:05.809 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.808+0000 7fce244a3700 1 -- 172.21.15.125:0/224762630 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fce1c15d920 con 0x7fce08004d50 2023-10-06T03:05:05.810 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.808+0000 7fce127fc700 1 -- 172.21.15.125:0/224762630 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fce0c054c20 con 0x7fce08004d50 2023-10-06T03:05:05.810 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-06T03:05:05.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.810+0000 7fce244a3700 1 -- 172.21.15.125:0/224762630 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fce00066f30 msgr2=0x7fce000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:05.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.810+0000 7fce244a3700 1 --2- 172.21.15.125:0/224762630 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fce00066f30 0x7fce000693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fce1c154350 tx=0x7fce18008040 comp rx=0 tx=0).stop 2023-10-06T03:05:05.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.810+0000 7fce244a3700 1 -- 172.21.15.125:0/224762630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce08004d50 msgr2=0x7fce1c151fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:05.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.810+0000 7fce244a3700 1 --2- 172.21.15.125:0/224762630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce08004d50 0x7fce1c151fb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fce0c007390 tx=0x7fce0c001e90 comp rx=0 tx=0).stop 2023-10-06T03:05:05.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.810+0000 7fce244a3700 1 -- 172.21.15.125:0/224762630 shutdown_connections 2023-10-06T03:05:05.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.810+0000 7fce244a3700 1 --2- 172.21.15.125:0/224762630 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fce00066f30 0x7fce000693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.810+0000 7fce244a3700 1 --2- 172.21.15.125:0/224762630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce1c156480 0x7fce1c1568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.810+0000 7fce244a3700 1 --2- 172.21.15.125:0/224762630 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce08004d50 0x7fce1c151fb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.810+0000 7fce244a3700 1 --2- 172.21.15.125:0/224762630 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce1c0b21f0 0x7fce1c1437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.810+0000 7fce244a3700 1 -- 172.21.15.125:0/224762630 >> 172.21.15.125:0/224762630 conn(0x7fce1c0cdf80 msgr2=0x7fce1c0692b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:05.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.811+0000 7fce244a3700 1 -- 172.21.15.125:0/224762630 shutdown_connections 2023-10-06T03:05:05.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.811+0000 7fce244a3700 1 -- 172.21.15.125:0/224762630 wait complete. 2023-10-06T03:05:05.824 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:05:05.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.942+0000 7f11e398b700 1 Processor -- start 2023-10-06T03:05:05.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.943+0000 7f11e398b700 1 -- start start 2023-10-06T03:05:05.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.943+0000 7f11e398b700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f11dc15cb00 0x7f11dc0b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.943+0000 7f11e398b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11dc067610 0x7f11dc068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.943+0000 7f11e398b700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11dc0ca670 con 0x7f11dc15ced0 2023-10-06T03:05:05.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.943+0000 7f11e398b700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11dc068320 con 0x7f11dc15cb00 2023-10-06T03:05:05.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.943+0000 7f11e398b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc067a80 con 0x7f11dc067610 2023-10-06T03:05:05.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.944+0000 7f11e0f26700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11dc067610 0x7f11dc068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.944+0000 7f11e1727700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f11dc15cb00 0x7f11dc0b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.944+0000 7f11e1727700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f11dc15cb00 0x7f11dc0b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:39994/0 (socket says 172.21.15.125:39994) 2023-10-06T03:05:05.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.944+0000 7f11e0f26700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11dc067610 0x7f11dc068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:36406/0 (socket says 172.21.15.125:36406) 2023-10-06T03:05:05.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.944+0000 7f11e1727700 1 -- 172.21.15.125:0/3471137249 learned_addr learned my addr 172.21.15.125:0/3471137249 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:05.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.944+0000 7f11e1f28700 1 --1- 172.21.15.125:0/3471137249 >> v1:172.21.15.130:6789/0 conn(0x7f11dc15ced0 0x7f11dc0c90e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:52134/0 (socket says 172.21.15.125:52134) 2023-10-06T03:05:05.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.944+0000 7f11e1727700 1 -- 172.21.15.125:0/3471137249 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11dc067610 msgr2=0x7f11dc068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:05.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.944+0000 7f11e1727700 1 --2- 172.21.15.125:0/3471137249 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11dc067610 0x7f11dc068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.944+0000 7f11e1727700 1 -- 172.21.15.125:0/3471137249 >> v1:172.21.15.130:6789/0 conn(0x7f11dc15ced0 legacy=0x7f11dc0c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:05.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.944+0000 7f11d3fff700 1 -- 172.21.15.125:0/3471137249 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2554697906 0 0) 0x7f11dc0ca670 con 0x7f11dc15ced0 2023-10-06T03:05:05.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.944+0000 7f11e1727700 1 -- 172.21.15.125:0/3471137249 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc067d60 con 0x7f11dc15cb00 2023-10-06T03:05:05.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.944+0000 7f11e0f26700 1 --2- 172.21.15.125:0/3471137249 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11dc067610 0x7f11dc068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:05:05.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.945+0000 7f11e1727700 1 --2- 172.21.15.125:0/3471137249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11dc15cb00 0x7f11dc0b0240 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009990 tx=0x7f11cc009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b0b49e138133415 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:05.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.945+0000 7f11d3fff700 1 -- 172.21.15.125:0/3471137249 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc009e80 con 0x7f11dc15cb00 2023-10-06T03:05:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.945+0000 7f11d3fff700 1 -- 172.21.15.125:0/3471137249 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11cc005c10 con 0x7f11dc15cb00 2023-10-06T03:05:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.945+0000 7f11e398b700 1 -- 172.21.15.125:0/3471137249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11dc15cb00 msgr2=0x7f11dc0b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.945+0000 7f11e398b700 1 --2- 172.21.15.125:0/3471137249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11dc15cb00 0x7f11dc0b0240 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009990 tx=0x7f11cc009220 comp rx=0 tx=0).stop 2023-10-06T03:05:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.945+0000 7f11e398b700 1 -- 172.21.15.125:0/3471137249 shutdown_connections 2023-10-06T03:05:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.945+0000 7f11e398b700 1 --2- 172.21.15.125:0/3471137249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11dc15cb00 0x7f11dc0b0240 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.945+0000 7f11e398b700 1 --2- 172.21.15.125:0/3471137249 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11dc067610 0x7f11dc068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.945+0000 7f11e398b700 1 -- 172.21.15.125:0/3471137249 >> 172.21.15.125:0/3471137249 conn(0x7f11dc0af730 msgr2=0x7f11dc0afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.945+0000 7f11e398b700 1 -- 172.21.15.125:0/3471137249 shutdown_connections 2023-10-06T03:05:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.945+0000 7f11e398b700 1 -- 172.21.15.125:0/3471137249 wait complete. 2023-10-06T03:05:05.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.946+0000 7f11e398b700 1 Processor -- start 2023-10-06T03:05:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.946+0000 7f11e398b700 1 -- start start 2023-10-06T03:05:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.947+0000 7f11e398b700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11dc067610 0x7f11dc14a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.947+0000 7f11e398b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc15cb00 0x7f11dc169ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.947+0000 7f11e398b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11dc15ced0 0x7f11dc0c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.947+0000 7f11e398b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc15e9d0 con 0x7f11dc15cb00 2023-10-06T03:05:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.947+0000 7f11e398b700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc15ecb0 con 0x7f11dc067610 2023-10-06T03:05:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.947+0000 7f11e398b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc15ef90 con 0x7f11dc15ced0 2023-10-06T03:05:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.947+0000 7f11e0f26700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc15cb00 0x7f11dc169ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.947+0000 7f11e0f26700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc15cb00 0x7f11dc169ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39366/0 (socket says 172.21.15.125:39366) 2023-10-06T03:05:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.947+0000 7f11e0f26700 1 -- 172.21.15.125:0/2318737845 learned_addr learned my addr 172.21.15.125:0/2318737845 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.948+0000 7f11e1727700 1 --2- 172.21.15.125:0/2318737845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11dc067610 0x7f11dc14a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.948+0000 7f11e1f28700 1 --2- 172.21.15.125:0/2318737845 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11dc15ced0 0x7f11dc0c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.948+0000 7f11e0f26700 1 -- 172.21.15.125:0/2318737845 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11dc15ced0 msgr2=0x7f11dc0c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:05.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.948+0000 7f11e0f26700 1 --2- 172.21.15.125:0/2318737845 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11dc15ced0 0x7f11dc0c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.948+0000 7f11e0f26700 1 -- 172.21.15.125:0/2318737845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11dc067610 msgr2=0x7f11dc14a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:05.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.948+0000 7f11e0f26700 1 --2- 172.21.15.125:0/2318737845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11dc067610 0x7f11dc14a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:05.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.948+0000 7f11e0f26700 1 -- 172.21.15.125:0/2318737845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d8009420 con 0x7f11dc15cb00 2023-10-06T03:05:05.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.948+0000 7f11e1727700 1 --2- 172.21.15.125:0/2318737845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11dc067610 0x7f11dc14a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:05.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.948+0000 7f11e0f26700 1 --2- 172.21.15.125:0/2318737845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc15cb00 0x7f11dc169ab0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f11d800ec80 tx=0x7f11d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:05.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.948+0000 7f11d17fa700 1 -- 172.21.15.125:0/2318737845 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d800c9d0 con 0x7f11dc15cb00 2023-10-06T03:05:05.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.948+0000 7f11d17fa700 1 -- 172.21.15.125:0/2318737845 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d800cb30 con 0x7f11dc15cb00 2023-10-06T03:05:05.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.948+0000 7f11e398b700 1 -- 172.21.15.125:0/2318737845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11cc009480 con 0x7f11dc15cb00 2023-10-06T03:05:05.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.948+0000 7f11d17fa700 1 -- 172.21.15.125:0/2318737845 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d8013470 con 0x7f11dc15cb00 2023-10-06T03:05:05.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.948+0000 7f11e398b700 1 -- 172.21.15.125:0/2318737845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11dc15f550 con 0x7f11dc15cb00 2023-10-06T03:05:05.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.949+0000 7f11e398b700 1 -- 172.21.15.125:0/2318737845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11dc06e300 con 0x7f11dc15cb00 2023-10-06T03:05:05.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.949+0000 7f11d17fa700 1 -- 172.21.15.125:0/2318737845 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f11d8013820 con 0x7f11dc15cb00 2023-10-06T03:05:05.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.950+0000 7f11d17fa700 1 --2- 172.21.15.125:0/2318737845 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f11c0066f30 0x7f11c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:05.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.950+0000 7f11e1727700 1 --2- 172.21.15.125:0/2318737845 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f11c0066f30 0x7f11c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:05.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.950+0000 7f11d17fa700 1 -- 172.21.15.125:0/2318737845 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f11d8084a40 con 0x7f11dc15cb00 2023-10-06T03:05:05.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.950+0000 7f11e1727700 1 --2- 172.21.15.125:0/2318737845 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f11c0066f30 0x7f11c00693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009260 tx=0x7f11cc016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:05.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:05.954+0000 7f11d17fa700 1 -- 172.21.15.125:0/2318737845 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11d8086e60 con 0x7f11dc15cb00 2023-10-06T03:05:06.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.134+0000 7f11e398b700 1 -- 172.21.15.125:0/2318737845 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f11dc066510 con 0x7f11dc15cb00 2023-10-06T03:05:06.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.134+0000 7f11d17fa700 1 -- 172.21.15.125:0/2318737845 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f11d8051860 con 0x7f11dc15cb00 2023-10-06T03:05:06.136 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-06T03:05:06.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.136+0000 7f11e398b700 1 -- 172.21.15.125:0/2318737845 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f11c0066f30 msgr2=0x7f11c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:06.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.137+0000 7f11e398b700 1 --2- 172.21.15.125:0/2318737845 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f11c0066f30 0x7f11c00693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009260 tx=0x7f11cc016000 comp rx=0 tx=0).stop 2023-10-06T03:05:06.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.137+0000 7f11e398b700 1 -- 172.21.15.125:0/2318737845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc15cb00 msgr2=0x7f11dc169ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:06.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.137+0000 7f11e398b700 1 --2- 172.21.15.125:0/2318737845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc15cb00 0x7f11dc169ab0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f11d800ec80 tx=0x7f11d80091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.137+0000 7f11e398b700 1 -- 172.21.15.125:0/2318737845 shutdown_connections 2023-10-06T03:05:06.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.137+0000 7f11e398b700 1 --2- 172.21.15.125:0/2318737845 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f11c0066f30 0x7f11c00693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.137+0000 7f11e398b700 1 --2- 172.21.15.125:0/2318737845 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11dc15ced0 0x7f11dc0c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.137+0000 7f11e398b700 1 --2- 172.21.15.125:0/2318737845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11dc067610 0x7f11dc14a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.137+0000 7f11e398b700 1 --2- 172.21.15.125:0/2318737845 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11dc15cb00 0x7f11dc169ab0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.137+0000 7f11e398b700 1 -- 172.21.15.125:0/2318737845 >> 172.21.15.125:0/2318737845 conn(0x7f11dc0af730 msgr2=0x7f11dc0cd190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:06.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.137+0000 7f11e398b700 1 -- 172.21.15.125:0/2318737845 shutdown_connections 2023-10-06T03:05:06.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.137+0000 7f11e398b700 1 -- 172.21.15.125:0/2318737845 wait complete. 2023-10-06T03:05:06.149 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:05:06.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.266+0000 7f71d8583700 1 Processor -- start 2023-10-06T03:05:06.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.266+0000 7f71d8583700 1 -- start start 2023-10-06T03:05:06.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.267+0000 7f71d8583700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71d01590d0 0x7f71d006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.267+0000 7f71d8583700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f71d00ac670 0x7f71d006ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.267+0000 7f71d8583700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d0067c70 con 0x7f71d01594a0 2023-10-06T03:05:06.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.267+0000 7f71d8583700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d0069110 con 0x7f71d00ac670 2023-10-06T03:05:06.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.267+0000 7f71d8583700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00c77e0 con 0x7f71d01590d0 2023-10-06T03:05:06.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.267+0000 7f71d5b1e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f71d00ac670 0x7f71d006ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.267+0000 7f71d6b20700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f71d01594a0 0x7f71d00c6b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43786/0 (socket says 172.21.15.125:43786) 2023-10-06T03:05:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.267+0000 7f71d6b20700 1 -- 172.21.15.125:0/2561827242 learned_addr learned my addr 172.21.15.125:0/2561827242 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.267+0000 7f71d5b1e700 1 --2- 172.21.15.125:0/2561827242 >> v2:172.21.15.125:3300/0 conn(0x7f71d00ac670 0x7f71d006ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39370/0 (socket says 172.21.15.125:39370) 2023-10-06T03:05:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.268+0000 7f71d631f700 1 --2- 172.21.15.125:0/2561827242 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71d01590d0 0x7f71d006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.268+0000 7f71d5b1e700 1 -- 172.21.15.125:0/2561827242 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71d01590d0 msgr2=0x7f71d006a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.268+0000 7f71d5b1e700 1 --2- 172.21.15.125:0/2561827242 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71d01590d0 0x7f71d006a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.268+0000 7f71d5b1e700 1 -- 172.21.15.125:0/2561827242 >> v1:172.21.15.125:6789/0 conn(0x7f71d01594a0 legacy=0x7f71d00c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.268+0000 7f71d5b1e700 1 -- 172.21.15.125:0/2561827242 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d00c7ac0 con 0x7f71d00ac670 2023-10-06T03:05:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.268+0000 7f71d531d700 1 -- 172.21.15.125:0/2561827242 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062778160 0 0) 0x7f71d0067c70 con 0x7f71d01594a0 2023-10-06T03:05:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.268+0000 7f71d631f700 1 --2- 172.21.15.125:0/2561827242 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71d01590d0 0x7f71d006a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.268+0000 7f71d5b1e700 1 --2- 172.21.15.125:0/2561827242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d00ac670 0x7f71d006ae00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0098e0 tx=0x7f71cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da479d0cbe147d26 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.268+0000 7f71d531d700 1 -- 172.21.15.125:0/2561827242 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc009e80 con 0x7f71d00ac670 2023-10-06T03:05:06.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.268+0000 7f71d531d700 1 -- 172.21.15.125:0/2561827242 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc00b860 con 0x7f71d00ac670 2023-10-06T03:05:06.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.268+0000 7f71d531d700 1 -- 172.21.15.125:0/2561827242 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc00bbe0 con 0x7f71d00ac670 2023-10-06T03:05:06.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.268+0000 7f71d8583700 1 -- 172.21.15.125:0/2561827242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d00ac670 msgr2=0x7f71d006ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:06.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.268+0000 7f71d8583700 1 --2- 172.21.15.125:0/2561827242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d00ac670 0x7f71d006ae00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0098e0 tx=0x7f71cc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.269+0000 7f71d8583700 1 -- 172.21.15.125:0/2561827242 shutdown_connections 2023-10-06T03:05:06.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.269+0000 7f71d8583700 1 --2- 172.21.15.125:0/2561827242 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71d01590d0 0x7f71d006a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.269+0000 7f71d8583700 1 --2- 172.21.15.125:0/2561827242 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d00ac670 0x7f71d006ae00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.269+0000 7f71d8583700 1 -- 172.21.15.125:0/2561827242 >> 172.21.15.125:0/2561827242 conn(0x7f71d00cc5a0 msgr2=0x7f71d00cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:06.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.269+0000 7f71d8583700 1 -- 172.21.15.125:0/2561827242 shutdown_connections 2023-10-06T03:05:06.272 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.269+0000 7f71d8583700 1 -- 172.21.15.125:0/2561827242 wait complete. 2023-10-06T03:05:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.270+0000 7f71d8583700 1 Processor -- start 2023-10-06T03:05:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.270+0000 7f71d8583700 1 -- start start 2023-10-06T03:05:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.270+0000 7f71d8583700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71d00ac670 0x7f71d00ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.270+0000 7f71d8583700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d01590d0 0x7f71d0154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.270+0000 7f71d8583700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71d01594a0 0x7f71d0154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.270+0000 7f71d8583700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d015a630 con 0x7f71d01590d0 2023-10-06T03:05:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.270+0000 7f71d8583700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00af8a0 con 0x7f71d01594a0 2023-10-06T03:05:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.270+0000 7f71d8583700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00afb80 con 0x7f71d00ac670 2023-10-06T03:05:06.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.271+0000 7f71d5b1e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d01590d0 0x7f71d0154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.271+0000 7f71d5b1e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d01590d0 0x7f71d0154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39372/0 (socket says 172.21.15.125:39372) 2023-10-06T03:05:06.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.271+0000 7f71d5b1e700 1 -- 172.21.15.125:0/3242138107 learned_addr learned my addr 172.21.15.125:0/3242138107 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:06.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.271+0000 7f71d631f700 1 --2- 172.21.15.125:0/3242138107 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71d00ac670 0x7f71d00ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.271+0000 7f71d6b20700 1 --2- 172.21.15.125:0/3242138107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71d01594a0 0x7f71d0154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.271+0000 7f71d5b1e700 1 -- 172.21.15.125:0/3242138107 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71d00ac670 msgr2=0x7f71d00ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:06.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.271+0000 7f71d5b1e700 1 --2- 172.21.15.125:0/3242138107 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71d00ac670 0x7f71d00ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.271+0000 7f71d5b1e700 1 -- 172.21.15.125:0/3242138107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71d01594a0 msgr2=0x7f71d0154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:06.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.271+0000 7f71d5b1e700 1 --2- 172.21.15.125:0/3242138107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71d01594a0 0x7f71d0154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.271+0000 7f71d5b1e700 1 -- 172.21.15.125:0/3242138107 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc009420 con 0x7f71d01590d0 2023-10-06T03:05:06.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.271+0000 7f71d5b1e700 1 --2- 172.21.15.125:0/3242138107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d01590d0 0x7f71d0154a10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f71d006fa60 tx=0x7f71cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:06.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.271+0000 7f71c67fc700 1 -- 172.21.15.125:0/3242138107 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc00b9d0 con 0x7f71d01590d0 2023-10-06T03:05:06.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.271+0000 7f71c67fc700 1 -- 172.21.15.125:0/3242138107 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71cc00bb30 con 0x7f71d01590d0 2023-10-06T03:05:06.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.271+0000 7f71d8583700 1 -- 172.21.15.125:0/3242138107 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d00afe60 con 0x7f71d01590d0 2023-10-06T03:05:06.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.271+0000 7f71c67fc700 1 -- 172.21.15.125:0/3242138107 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc026680 con 0x7f71d01590d0 2023-10-06T03:05:06.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.271+0000 7f71d8583700 1 -- 172.21.15.125:0/3242138107 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d00aaf20 con 0x7f71d01590d0 2023-10-06T03:05:06.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.272+0000 7f71d8583700 1 -- 172.21.15.125:0/3242138107 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d0066510 con 0x7f71d01590d0 2023-10-06T03:05:06.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.273+0000 7f71c67fc700 1 -- 172.21.15.125:0/3242138107 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71cc023030 con 0x7f71d01590d0 2023-10-06T03:05:06.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.273+0000 7f71c67fc700 1 --2- 172.21.15.125:0/3242138107 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f71b4066f30 0x7f71b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.273+0000 7f71c67fc700 1 -- 172.21.15.125:0/3242138107 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f71cc0862c0 con 0x7f71d01590d0 2023-10-06T03:05:06.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.273+0000 7f71d631f700 1 --2- 172.21.15.125:0/3242138107 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f71b4066f30 0x7f71b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.273+0000 7f71d631f700 1 --2- 172.21.15.125:0/3242138107 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f71b4066f30 0x7f71b40693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f71c000adc0 tx=0x7f71c0006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:06.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.277+0000 7f71c67fc700 1 -- 172.21.15.125:0/3242138107 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71cc053160 con 0x7f71d01590d0 2023-10-06T03:05:06.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.462+0000 7f71d8583700 1 -- 172.21.15.125:0/3242138107 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71d00c7da0 con 0x7f71d01590d0 2023-10-06T03:05:06.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.463+0000 7f71c67fc700 1 -- 172.21.15.125:0/3242138107 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18851 (secure 0 0 0) 0x7f71cc056780 con 0x7f71d01590d0 2023-10-06T03:05:06.465 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:06.465 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:33.645139+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:04:26.828121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:04:28.179225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:04:31.256394+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:05:06.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.465+0000 7f71d8583700 1 -- 172.21.15.125:0/3242138107 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f71b4066f30 msgr2=0x7f71b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:06.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.465+0000 7f71d8583700 1 --2- 172.21.15.125:0/3242138107 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f71b4066f30 0x7f71b40693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f71c000adc0 tx=0x7f71c0006f90 comp rx=0 tx=0).stop 2023-10-06T03:05:06.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.465+0000 7f71d8583700 1 -- 172.21.15.125:0/3242138107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d01590d0 msgr2=0x7f71d0154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:06.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.465+0000 7f71d8583700 1 --2- 172.21.15.125:0/3242138107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d01590d0 0x7f71d0154a10 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f71d006fa60 tx=0x7f71cc017000 comp rx=0 tx=0).stop 2023-10-06T03:05:06.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.465+0000 7f71d8583700 1 -- 172.21.15.125:0/3242138107 shutdown_connections 2023-10-06T03:05:06.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.465+0000 7f71d8583700 1 --2- 172.21.15.125:0/3242138107 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f71b4066f30 0x7f71b40693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.465+0000 7f71d8583700 1 --2- 172.21.15.125:0/3242138107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71d01594a0 0x7f71d0154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.465+0000 7f71d8583700 1 --2- 172.21.15.125:0/3242138107 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71d00ac670 0x7f71d00ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.465+0000 7f71d8583700 1 --2- 172.21.15.125:0/3242138107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f71d01590d0 0x7f71d0154a10 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.465+0000 7f71d8583700 1 -- 172.21.15.125:0/3242138107 >> 172.21.15.125:0/3242138107 conn(0x7f71d00cc5a0 msgr2=0x7f71d006e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.465+0000 7f71d8583700 1 -- 172.21.15.125:0/3242138107 shutdown_connections 2023-10-06T03:05:06.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.465+0000 7f71d8583700 1 -- 172.21.15.125:0/3242138107 wait complete. 2023-10-06T03:05:06.479 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:04:15.845430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:04:22.729795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:04:26.828121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:04:28.179225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:04:31.256394+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:05:06.479 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:05:06.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.598+0000 7ff4ad8fc700 1 Processor -- start 2023-10-06T03:05:06.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.598+0000 7ff4ad8fc700 1 -- start start 2023-10-06T03:05:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4ad8fc700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff4a8155cb0 0x7ff4a8067850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4ad8fc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a80c1d50 con 0x7ff4a81558e0 2023-10-06T03:05:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4ad8fc700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a80ca1b0 con 0x7ff4a80ccf80 2023-10-06T03:05:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4ad8fc700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a80c1740 con 0x7ff4a8155cb0 2023-10-06T03:05:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4a6ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff4a81558e0 0x7ff4a80cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43800/0 (socket says 172.21.15.125:43800) 2023-10-06T03:05:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4a6ffd700 1 -- 172.21.15.125:0/754128277 learned_addr learned my addr 172.21.15.125:0/754128277 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4a67fc700 1 --2- 172.21.15.125:0/754128277 >> v2:172.21.15.130:3300/0 conn(0x7ff4a8155cb0 0x7ff4a8067850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4a5ffb700 1 -- 172.21.15.125:0/754128277 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634732276 0 0) 0x7ff4a80c1d50 con 0x7ff4a81558e0 2023-10-06T03:05:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4a5ffb700 1 -- 172.21.15.125:0/754128277 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff490004680 con 0x7ff4a81558e0 2023-10-06T03:05:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4a5ffb700 1 -- 172.21.15.125:0/754128277 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2530929631 0 0) 0x7ff490004680 con 0x7ff4a81558e0 2023-10-06T03:05:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4a5ffb700 1 -- 172.21.15.125:0/754128277 >> v2:172.21.15.130:3300/0 conn(0x7ff4a8155cb0 msgr2=0x7ff4a8067850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4a5ffb700 1 --2- 172.21.15.125:0/754128277 >> v2:172.21.15.130:3300/0 conn(0x7ff4a8155cb0 0x7ff4a8067850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4a5ffb700 1 -- 172.21.15.125:0/754128277 >> v1:172.21.15.130:6789/0 conn(0x7ff4a80ccf80 legacy=0x7ff4a8067d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4a5ffb700 1 -- 172.21.15.125:0/754128277 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a80c9ed0 con 0x7ff4a81558e0 2023-10-06T03:05:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4a5ffb700 1 -- 172.21.15.125:0/754128277 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7ff49c0015f0 con 0x7ff4a81558e0 2023-10-06T03:05:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4a5ffb700 1 -- 172.21.15.125:0/754128277 >> v1:172.21.15.125:6789/0 conn(0x7ff4a81558e0 legacy=0x7ff4a80cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4a5ffb700 1 --2- 172.21.15.125:0/754128277 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff490004b70 0x7ff490004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4a5ffb700 1 --2- 172.21.15.125:0/754128277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff490005920 0x7ff490005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4a5ffb700 1 --2- 172.21.15.125:0/754128277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4900062d0 0x7ff490003570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4a5ffb700 1 -- 172.21.15.125:0/754128277 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a80c1740 con 0x7ff4900062d0 2023-10-06T03:05:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.599+0000 7ff4a5ffb700 1 -- 172.21.15.125:0/754128277 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff490003cc0 con 0x7ff490005920 2023-10-06T03:05:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.600+0000 7ff4a5ffb700 1 -- 172.21.15.125:0/754128277 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff490003e30 con 0x7ff490004b70 2023-10-06T03:05:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.600+0000 7ff4a77fe700 1 --2- 172.21.15.125:0/754128277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4900062d0 0x7ff490003570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.600+0000 7ff4a67fc700 1 --2- 172.21.15.125:0/754128277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff490005920 0x7ff490005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.600+0000 7ff4a6ffd700 1 --2- 172.21.15.125:0/754128277 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff490004b70 0x7ff490004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.600+0000 7ff4a77fe700 1 -- 172.21.15.125:0/754128277 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff490004b70 msgr2=0x7ff490004f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.600+0000 7ff4a77fe700 1 --2- 172.21.15.125:0/754128277 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff490004b70 0x7ff490004f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.600+0000 7ff4a77fe700 1 -- 172.21.15.125:0/754128277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff490005920 msgr2=0x7ff490005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.600+0000 7ff4a77fe700 1 --2- 172.21.15.125:0/754128277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff490005920 0x7ff490005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.600+0000 7ff4a77fe700 1 -- 172.21.15.125:0/754128277 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff490004680 con 0x7ff4900062d0 2023-10-06T03:05:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.600+0000 7ff4a6ffd700 1 --2- 172.21.15.125:0/754128277 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff490004b70 0x7ff490004f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.600+0000 7ff4a77fe700 1 -- 172.21.15.125:0/754128277 reap_dead start 2023-10-06T03:05:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.600+0000 7ff4a77fe700 1 --2- 172.21.15.125:0/754128277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4900062d0 0x7ff490003570 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0001f90 tx=0x7ff4a0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede1185e728d2cf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.600+0000 7ff4a5ffb700 1 -- 172.21.15.125:0/754128277 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a0001950 con 0x7ff4900062d0 2023-10-06T03:05:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.600+0000 7ff4a5ffb700 1 -- 172.21.15.125:0/754128277 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a000c8b0 con 0x7ff4900062d0 2023-10-06T03:05:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.600+0000 7ff4a5ffb700 1 -- 172.21.15.125:0/754128277 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a000cc50 con 0x7ff4900062d0 2023-10-06T03:05:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.601+0000 7ff4ad8fc700 1 -- 172.21.15.125:0/754128277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4900062d0 msgr2=0x7ff490003570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.601+0000 7ff4ad8fc700 1 --2- 172.21.15.125:0/754128277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4900062d0 0x7ff490003570 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0001f90 tx=0x7ff4a0001640 comp rx=0 tx=0).stop 2023-10-06T03:05:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.601+0000 7ff4ad8fc700 1 -- 172.21.15.125:0/754128277 shutdown_connections 2023-10-06T03:05:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.601+0000 7ff4ad8fc700 1 --2- 172.21.15.125:0/754128277 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4900062d0 0x7ff490003570 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.601+0000 7ff4ad8fc700 1 -- 172.21.15.125:0/754128277 >> 172.21.15.125:0/754128277 conn(0x7ff4a80af730 msgr2=0x7ff4a80afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:06.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.601+0000 7ff4ad8fc700 1 -- 172.21.15.125:0/754128277 shutdown_connections 2023-10-06T03:05:06.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.601+0000 7ff4ad8fc700 1 -- 172.21.15.125:0/754128277 wait complete. 2023-10-06T03:05:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.602+0000 7ff4ad8fc700 1 Processor -- start 2023-10-06T03:05:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.602+0000 7ff4ad8fc700 1 -- start start 2023-10-06T03:05:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff4ad8fc700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4900062d0 0x7ff4a8145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff4ad8fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4a8157170 0x7ff4a81536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff4ad8fc700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4a8153c10 0x7ff4a81498a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff4ad8fc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a8153240 con 0x7ff4a8157170 2023-10-06T03:05:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff4ad8fc700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a8157af0 con 0x7ff4900062d0 2023-10-06T03:05:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff4ad8fc700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a8152630 con 0x7ff4a8153c10 2023-10-06T03:05:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff4a67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4a8157170 0x7ff4a81536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff4a67fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4a8157170 0x7ff4a81536d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39392/0 (socket says 172.21.15.125:39392) 2023-10-06T03:05:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff4a67fc700 1 -- 172.21.15.125:0/4168144761 learned_addr learned my addr 172.21.15.125:0/4168144761 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff4a6ffd700 1 --2- 172.21.15.125:0/4168144761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4900062d0 0x7ff4a8145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff4a77fe700 1 --2- 172.21.15.125:0/4168144761 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4a8153c10 0x7ff4a81498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff4a67fc700 1 -- 172.21.15.125:0/4168144761 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4a8153c10 msgr2=0x7ff4a81498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:06.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff4a67fc700 1 --2- 172.21.15.125:0/4168144761 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4a8153c10 0x7ff4a81498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff4a67fc700 1 -- 172.21.15.125:0/4168144761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4900062d0 msgr2=0x7ff4a8145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff4a67fc700 1 --2- 172.21.15.125:0/4168144761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4900062d0 0x7ff4a8145ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff4a67fc700 1 -- 172.21.15.125:0/4168144761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a8152910 con 0x7ff4a8157170 2023-10-06T03:05:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff4a67fc700 1 --2- 172.21.15.125:0/4168144761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4a8157170 0x7ff4a81536d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff498006ac0 tx=0x7ff4980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff48effd700 1 -- 172.21.15.125:0/4168144761 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff498011ec0 con 0x7ff4a8157170 2023-10-06T03:05:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff48effd700 1 -- 172.21.15.125:0/4168144761 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49800f940 con 0x7ff4a8157170 2023-10-06T03:05:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff4ad8fc700 1 -- 172.21.15.125:0/4168144761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a8152bf0 con 0x7ff4a8157170 2023-10-06T03:05:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff48effd700 1 -- 172.21.15.125:0/4168144761 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49800fcc0 con 0x7ff4a8157170 2023-10-06T03:05:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.603+0000 7ff4ad8fc700 1 -- 172.21.15.125:0/4168144761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a81463e0 con 0x7ff4a8157170 2023-10-06T03:05:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.604+0000 7ff4ad8fc700 1 -- 172.21.15.125:0/4168144761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a8066510 con 0x7ff4a8157170 2023-10-06T03:05:06.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.605+0000 7ff48effd700 1 -- 172.21.15.125:0/4168144761 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff498014650 con 0x7ff4a8157170 2023-10-06T03:05:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.605+0000 7ff48effd700 1 --2- 172.21.15.125:0/4168144761 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff494066f30 0x7ff4940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.605+0000 7ff48effd700 1 -- 172.21.15.125:0/4168144761 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff498018030 con 0x7ff4a8157170 2023-10-06T03:05:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.605+0000 7ff4a6ffd700 1 --2- 172.21.15.125:0/4168144761 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff494066f30 0x7ff4940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.605+0000 7ff4a6ffd700 1 --2- 172.21.15.125:0/4168144761 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff494066f30 0x7ff4940693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0010e0 tx=0x7ff49c00c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:06.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.609+0000 7ff48effd700 1 -- 172.21.15.125:0/4168144761 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff498055b80 con 0x7ff4a8157170 2023-10-06T03:05:06.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.789+0000 7ff4ad8fc700 1 -- 172.21.15.125:0/4168144761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4a80c19e0 con 0x7ff4a8157170 2023-10-06T03:05:06.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.790+0000 7ff48effd700 1 -- 172.21.15.125:0/4168144761 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff498055710 con 0x7ff4a8157170 2023-10-06T03:05:06.791 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-06T03:05:06.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.791+0000 7ff4ad8fc700 1 -- 172.21.15.125:0/4168144761 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff494066f30 msgr2=0x7ff4940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:06.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.791+0000 7ff4ad8fc700 1 --2- 172.21.15.125:0/4168144761 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff494066f30 0x7ff4940693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0010e0 tx=0x7ff49c00c040 comp rx=0 tx=0).stop 2023-10-06T03:05:06.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.791+0000 7ff4ad8fc700 1 -- 172.21.15.125:0/4168144761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4a8157170 msgr2=0x7ff4a81536d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:06.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.791+0000 7ff4ad8fc700 1 --2- 172.21.15.125:0/4168144761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4a8157170 0x7ff4a81536d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff498006ac0 tx=0x7ff4980091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.792+0000 7ff4ad8fc700 1 -- 172.21.15.125:0/4168144761 shutdown_connections 2023-10-06T03:05:06.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.792+0000 7ff4ad8fc700 1 --2- 172.21.15.125:0/4168144761 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff494066f30 0x7ff4940693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.792+0000 7ff4ad8fc700 1 --2- 172.21.15.125:0/4168144761 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff4a8153c10 0x7ff4a81498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.792+0000 7ff4ad8fc700 1 --2- 172.21.15.125:0/4168144761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4900062d0 0x7ff4a8145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.792+0000 7ff4ad8fc700 1 --2- 172.21.15.125:0/4168144761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff4a8157170 0x7ff4a81536d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.792+0000 7ff4ad8fc700 1 -- 172.21.15.125:0/4168144761 >> 172.21.15.125:0/4168144761 conn(0x7ff4a80af730 msgr2=0x7ff4a8067850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:06.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.792+0000 7ff4ad8fc700 1 -- 172.21.15.125:0/4168144761 shutdown_connections 2023-10-06T03:05:06.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.792+0000 7ff4ad8fc700 1 -- 172.21.15.125:0/4168144761 wait complete. 2023-10-06T03:05:06.805 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:05:06.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.923+0000 7f4ad74bb700 1 Processor -- start 2023-10-06T03:05:06.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.923+0000 7f4ad74bb700 1 -- start start 2023-10-06T03:05:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.924+0000 7f4ad74bb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4ad015cb00 0x7f4ad00b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.924+0000 7f4ad74bb700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad0067610 0x7f4ad0068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.924+0000 7f4ad74bb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad00ca670 con 0x7f4ad015ced0 2023-10-06T03:05:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.924+0000 7f4ad74bb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad0068320 con 0x7f4ad015cb00 2023-10-06T03:05:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.924+0000 7f4ad74bb700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0067a80 con 0x7f4ad0067610 2023-10-06T03:05:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.924+0000 7f4ad5257700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4ad015cb00 0x7f4ad00b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.924+0000 7f4ad5a58700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4ad015ced0 0x7f4ad00c90e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43810/0 (socket says 172.21.15.125:43810) 2023-10-06T03:05:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.924+0000 7f4ad5a58700 1 -- 172.21.15.125:0/3526187663 learned_addr learned my addr 172.21.15.125:0/3526187663 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:06.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.925+0000 7f4ad4a56700 1 --2- 172.21.15.125:0/3526187663 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad0067610 0x7f4ad0068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.925+0000 7f4ad5257700 1 -- 172.21.15.125:0/3526187663 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad0067610 msgr2=0x7f4ad0068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:06.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.925+0000 7f4ad5257700 1 --2- 172.21.15.125:0/3526187663 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad0067610 0x7f4ad0068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.925+0000 7f4ad5257700 1 -- 172.21.15.125:0/3526187663 >> v1:172.21.15.125:6789/0 conn(0x7f4ad015ced0 legacy=0x7f4ad00c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:06.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.925+0000 7f4ac7fff700 1 -- 172.21.15.125:0/3526187663 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584913529 0 0) 0x7f4ad00ca670 con 0x7f4ad015ced0 2023-10-06T03:05:06.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.925+0000 7f4ad5257700 1 -- 172.21.15.125:0/3526187663 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad0067d60 con 0x7f4ad015cb00 2023-10-06T03:05:06.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.925+0000 7f4ad4a56700 1 --2- 172.21.15.125:0/3526187663 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad0067610 0x7f4ad0068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:06.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.925+0000 7f4ad5257700 1 --2- 172.21.15.125:0/3526187663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ad015cb00 0x7f4ad00b0240 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00098d0 tx=0x7f4ac0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1947c40d084f7ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:06.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.925+0000 7f4ac7fff700 1 -- 172.21.15.125:0/3526187663 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0009e70 con 0x7f4ad015cb00 2023-10-06T03:05:06.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.925+0000 7f4ac7fff700 1 -- 172.21.15.125:0/3526187663 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac0005c10 con 0x7f4ad015cb00 2023-10-06T03:05:06.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.925+0000 7f4ac7fff700 1 -- 172.21.15.125:0/3526187663 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac000b650 con 0x7f4ad015cb00 2023-10-06T03:05:06.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.925+0000 7f4ad74bb700 1 -- 172.21.15.125:0/3526187663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ad015cb00 msgr2=0x7f4ad00b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:06.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.925+0000 7f4ad74bb700 1 --2- 172.21.15.125:0/3526187663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ad015cb00 0x7f4ad00b0240 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4ac00098d0 tx=0x7f4ac0009120 comp rx=0 tx=0).stop 2023-10-06T03:05:06.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.926+0000 7f4ad74bb700 1 -- 172.21.15.125:0/3526187663 shutdown_connections 2023-10-06T03:05:06.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.926+0000 7f4ad74bb700 1 --2- 172.21.15.125:0/3526187663 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ad015cb00 0x7f4ad00b0240 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.926+0000 7f4ad74bb700 1 --2- 172.21.15.125:0/3526187663 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad0067610 0x7f4ad0068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.926+0000 7f4ad74bb700 1 -- 172.21.15.125:0/3526187663 >> 172.21.15.125:0/3526187663 conn(0x7f4ad00af730 msgr2=0x7f4ad00afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:06.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.926+0000 7f4ad74bb700 1 -- 172.21.15.125:0/3526187663 shutdown_connections 2023-10-06T03:05:06.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.926+0000 7f4ad74bb700 1 -- 172.21.15.125:0/3526187663 wait complete. 2023-10-06T03:05:06.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.927+0000 7f4ad74bb700 1 Processor -- start 2023-10-06T03:05:06.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.927+0000 7f4ad74bb700 1 -- start start 2023-10-06T03:05:06.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ad74bb700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ad0067610 0x7f4ad014ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ad74bb700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad015cb00 0x7f4ad00c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ad74bb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ad015ced0 0x7f4ad00c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ad74bb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00c4010 con 0x7f4ad015ced0 2023-10-06T03:05:06.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ad74bb700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00c8d60 con 0x7f4ad0067610 2023-10-06T03:05:06.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ad74bb700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad00c9040 con 0x7f4ad015cb00 2023-10-06T03:05:06.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ad5a58700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ad015ced0 0x7f4ad00c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.935 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ad5a58700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ad015ced0 0x7f4ad00c6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39396/0 (socket says 172.21.15.125:39396) 2023-10-06T03:05:06.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ad5a58700 1 -- 172.21.15.125:0/1380384740 learned_addr learned my addr 172.21.15.125:0/1380384740 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:06.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ad5257700 1 --2- 172.21.15.125:0/1380384740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ad0067610 0x7f4ad014ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ad4a56700 1 --2- 172.21.15.125:0/1380384740 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad015cb00 0x7f4ad00c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ad5a58700 1 -- 172.21.15.125:0/1380384740 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad015cb00 msgr2=0x7f4ad00c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:06.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ad5a58700 1 --2- 172.21.15.125:0/1380384740 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad015cb00 0x7f4ad00c5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ad5a58700 1 -- 172.21.15.125:0/1380384740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ad0067610 msgr2=0x7f4ad014ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:06.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ad5a58700 1 --2- 172.21.15.125:0/1380384740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ad0067610 0x7f4ad014ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:06.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ad5a58700 1 -- 172.21.15.125:0/1380384740 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac00093c0 con 0x7f4ad015ced0 2023-10-06T03:05:06.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ad5a58700 1 --2- 172.21.15.125:0/1380384740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ad015ced0 0x7f4ad00c6db0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800cc10 tx=0x7f4ac8001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:06.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ac57fa700 1 -- 172.21.15.125:0/1380384740 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac800a850 con 0x7f4ad015ced0 2023-10-06T03:05:06.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ac57fa700 1 -- 172.21.15.125:0/1380384740 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac800a9d0 con 0x7f4ad015ced0 2023-10-06T03:05:06.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ad74bb700 1 -- 172.21.15.125:0/1380384740 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad00c39c0 con 0x7f4ad015ced0 2023-10-06T03:05:06.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ac57fa700 1 -- 172.21.15.125:0/1380384740 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac800ad90 con 0x7f4ad015ced0 2023-10-06T03:05:06.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.928+0000 7f4ad74bb700 1 -- 172.21.15.125:0/1380384740 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad00c65a0 con 0x7f4ad015ced0 2023-10-06T03:05:06.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.929+0000 7f4ad74bb700 1 -- 172.21.15.125:0/1380384740 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad0066510 con 0x7f4ad015ced0 2023-10-06T03:05:06.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.930+0000 7f4ac57fa700 1 -- 172.21.15.125:0/1380384740 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ac8007300 con 0x7f4ad015ced0 2023-10-06T03:05:06.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.930+0000 7f4ac57fa700 1 --2- 172.21.15.125:0/1380384740 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4ab4066f30 0x7f4ab40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:06.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.930+0000 7f4ac57fa700 1 -- 172.21.15.125:0/1380384740 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4ac8084ba0 con 0x7f4ad015ced0 2023-10-06T03:05:06.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.930+0000 7f4ad5257700 1 --2- 172.21.15.125:0/1380384740 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4ab4066f30 0x7f4ab40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:06.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.931+0000 7f4ad5257700 1 --2- 172.21.15.125:0/1380384740 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4ab4066f30 0x7f4ab40693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0009160 tx=0x7f4ac0016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:06.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:06.934+0000 7f4ac57fa700 1 -- 172.21.15.125:0/1380384740 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ac8051a40 con 0x7f4ad015ced0 2023-10-06T03:05:07.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.115+0000 7f4ad74bb700 1 -- 172.21.15.125:0/1380384740 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4ad00c1790 con 0x7f4ad015ced0 2023-10-06T03:05:07.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.115+0000 7f4ac57fa700 1 -- 172.21.15.125:0/1380384740 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4ac8055060 con 0x7f4ad015ced0 2023-10-06T03:05:07.117 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-06T03:05:07.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.117+0000 7f4ad74bb700 1 -- 172.21.15.125:0/1380384740 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4ab4066f30 msgr2=0x7f4ab40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:07.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.117+0000 7f4ad74bb700 1 --2- 172.21.15.125:0/1380384740 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4ab4066f30 0x7f4ab40693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0009160 tx=0x7f4ac0016000 comp rx=0 tx=0).stop 2023-10-06T03:05:07.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.117+0000 7f4ad74bb700 1 -- 172.21.15.125:0/1380384740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ad015ced0 msgr2=0x7f4ad00c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:07.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.117+0000 7f4ad74bb700 1 --2- 172.21.15.125:0/1380384740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ad015ced0 0x7f4ad00c6db0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4ac800cc10 tx=0x7f4ac8001970 comp rx=0 tx=0).stop 2023-10-06T03:05:07.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.117+0000 7f4ad74bb700 1 -- 172.21.15.125:0/1380384740 shutdown_connections 2023-10-06T03:05:07.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.117+0000 7f4ad74bb700 1 --2- 172.21.15.125:0/1380384740 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4ab4066f30 0x7f4ab40693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.117+0000 7f4ad74bb700 1 --2- 172.21.15.125:0/1380384740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ad015ced0 0x7f4ad00c6db0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.117+0000 7f4ad74bb700 1 --2- 172.21.15.125:0/1380384740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ad0067610 0x7f4ad014ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.117+0000 7f4ad74bb700 1 --2- 172.21.15.125:0/1380384740 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ad015cb00 0x7f4ad00c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.117+0000 7f4ad74bb700 1 -- 172.21.15.125:0/1380384740 >> 172.21.15.125:0/1380384740 conn(0x7f4ad00af730 msgr2=0x7f4ad006b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:07.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.117+0000 7f4ad74bb700 1 -- 172.21.15.125:0/1380384740 shutdown_connections 2023-10-06T03:05:07.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.117+0000 7f4ad74bb700 1 -- 172.21.15.125:0/1380384740 wait complete. 2023-10-06T03:05:07.130 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:05:07.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.248+0000 7f90d2900700 1 Processor -- start 2023-10-06T03:05:07.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.249+0000 7f90d2900700 1 -- start start 2023-10-06T03:05:07.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.249+0000 7f90d2900700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f90cc156de0 0x7f90cc1571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:07.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.249+0000 7f90d2900700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f90cc0cd790 0x7f90cc0ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:07.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.249+0000 7f90d2900700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90cc0cd300 con 0x7f90cc0cc060 2023-10-06T03:05:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.249+0000 7f90d2900700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90cc0cc4e0 con 0x7f90cc0cd790 2023-10-06T03:05:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.249+0000 7f90d2900700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90cc0cc6f0 con 0x7f90cc156de0 2023-10-06T03:05:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.249+0000 7f90d0e9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f90cc0cd790 0x7f90cc0ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.249+0000 7f90cb7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f90cc0cc060 0x7f90cc15b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43822/0 (socket says 172.21.15.125:43822) 2023-10-06T03:05:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.249+0000 7f90cb7fe700 1 -- 172.21.15.125:0/3547102868 learned_addr learned my addr 172.21.15.125:0/3547102868 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.250+0000 7f90cbfff700 1 --2- 172.21.15.125:0/3547102868 >> v2:172.21.15.130:3300/0 conn(0x7f90cc156de0 0x7f90cc1571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.250+0000 7f90d0e9d700 1 -- 172.21.15.125:0/3547102868 >> v2:172.21.15.130:3300/0 conn(0x7f90cc156de0 msgr2=0x7f90cc1571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.250+0000 7f90d0e9d700 1 --2- 172.21.15.125:0/3547102868 >> v2:172.21.15.130:3300/0 conn(0x7f90cc156de0 0x7f90cc1571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.250+0000 7f90d0e9d700 1 -- 172.21.15.125:0/3547102868 >> v1:172.21.15.125:6789/0 conn(0x7f90cc0cc060 legacy=0x7f90cc15b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.250+0000 7f90d0e9d700 1 -- 172.21.15.125:0/3547102868 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc0cc9d0 con 0x7f90cc0cd790 2023-10-06T03:05:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.250+0000 7f90caffd700 1 -- 172.21.15.125:0/3547102868 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758284213 0 0) 0x7f90cc0cd300 con 0x7f90cc0cc060 2023-10-06T03:05:07.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.250+0000 7f90cbfff700 1 --2- 172.21.15.125:0/3547102868 >> v2:172.21.15.130:3300/0 conn(0x7f90cc156de0 0x7f90cc1571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:07.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.250+0000 7f90d0e9d700 1 --2- 172.21.15.125:0/3547102868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90cc0cd790 0x7f90cc0ca890 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0cbae0 tx=0x7f90c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcda0c58ab5cf23a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:07.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.250+0000 7f90caffd700 1 -- 172.21.15.125:0/3547102868 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c400e070 con 0x7f90cc0cd790 2023-10-06T03:05:07.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.250+0000 7f90caffd700 1 -- 172.21.15.125:0/3547102868 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c400bc30 con 0x7f90cc0cd790 2023-10-06T03:05:07.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.250+0000 7f90caffd700 1 -- 172.21.15.125:0/3547102868 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4012430 con 0x7f90cc0cd790 2023-10-06T03:05:07.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.250+0000 7f90d2900700 1 -- 172.21.15.125:0/3547102868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90cc0cd790 msgr2=0x7f90cc0ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:07.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.250+0000 7f90d2900700 1 --2- 172.21.15.125:0/3547102868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90cc0cd790 0x7f90cc0ca890 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0cbae0 tx=0x7f90c4009780 comp rx=0 tx=0).stop 2023-10-06T03:05:07.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.251+0000 7f90d2900700 1 -- 172.21.15.125:0/3547102868 shutdown_connections 2023-10-06T03:05:07.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.251+0000 7f90d2900700 1 --2- 172.21.15.125:0/3547102868 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90cc0cd790 0x7f90cc0ca890 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.251+0000 7f90d2900700 1 --2- 172.21.15.125:0/3547102868 >> v2:172.21.15.130:3300/0 conn(0x7f90cc156de0 0x7f90cc1571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.251+0000 7f90d2900700 1 -- 172.21.15.125:0/3547102868 >> 172.21.15.125:0/3547102868 conn(0x7f90cc0cdf80 msgr2=0x7f90cc0ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:07.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.251+0000 7f90d2900700 1 -- 172.21.15.125:0/3547102868 shutdown_connections 2023-10-06T03:05:07.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.251+0000 7f90d2900700 1 -- 172.21.15.125:0/3547102868 wait complete. 2023-10-06T03:05:07.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.252+0000 7f90d2900700 1 Processor -- start 2023-10-06T03:05:07.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.252+0000 7f90d2900700 1 -- start start 2023-10-06T03:05:07.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90d2900700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90cc0cc060 0x7f90cc0ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:07.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90d2900700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90cc0cd790 0x7f90cc0af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:07.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90d2900700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90cc156de0 0x7f90cc0ad330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:07.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90d2900700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0ad870 con 0x7f90cc156de0 2023-10-06T03:05:07.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90d2900700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0ae850 con 0x7f90cc0cd790 2023-10-06T03:05:07.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90d2900700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0aeb30 con 0x7f90cc0cc060 2023-10-06T03:05:07.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90d0e9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90cc156de0 0x7f90cc0ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:07.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90d0e9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90cc156de0 0x7f90cc0ad330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39412/0 (socket says 172.21.15.125:39412) 2023-10-06T03:05:07.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90d0e9d700 1 -- 172.21.15.125:0/359167617 learned_addr learned my addr 172.21.15.125:0/359167617 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:07.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90cbfff700 1 --2- 172.21.15.125:0/359167617 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90cc0cc060 0x7f90cc0ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:07.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90cb7fe700 1 --2- 172.21.15.125:0/359167617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90cc0cd790 0x7f90cc0af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:07.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90d0e9d700 1 -- 172.21.15.125:0/359167617 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90cc0cc060 msgr2=0x7f90cc0ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:07.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90d0e9d700 1 --2- 172.21.15.125:0/359167617 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90cc0cc060 0x7f90cc0ae260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90d0e9d700 1 -- 172.21.15.125:0/359167617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90cc0cd790 msgr2=0x7f90cc0af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:07.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90d0e9d700 1 --2- 172.21.15.125:0/359167617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90cc0cd790 0x7f90cc0af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90d0e9d700 1 -- 172.21.15.125:0/359167617 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c4009a20 con 0x7f90cc156de0 2023-10-06T03:05:07.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90d0e9d700 1 --2- 172.21.15.125:0/359167617 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90cc156de0 0x7f90cc0ad330 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f90c4012580 tx=0x7f90c4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:07.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90b3fff700 1 -- 172.21.15.125:0/359167617 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4012e10 con 0x7f90cc156de0 2023-10-06T03:05:07.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90b3fff700 1 -- 172.21.15.125:0/359167617 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c401e630 con 0x7f90cc156de0 2023-10-06T03:05:07.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90d2900700 1 -- 172.21.15.125:0/359167617 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90cc0aee10 con 0x7f90cc156de0 2023-10-06T03:05:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90b3fff700 1 -- 172.21.15.125:0/359167617 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c401e9f0 con 0x7f90cc156de0 2023-10-06T03:05:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.253+0000 7f90d2900700 1 -- 172.21.15.125:0/359167617 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90cc0af3d0 con 0x7f90cc156de0 2023-10-06T03:05:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.254+0000 7f90d2900700 1 -- 172.21.15.125:0/359167617 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90cc0af5c0 con 0x7f90cc156de0 2023-10-06T03:05:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.255+0000 7f90b3fff700 1 -- 172.21.15.125:0/359167617 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90c4024070 con 0x7f90cc156de0 2023-10-06T03:05:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.255+0000 7f90b3fff700 1 --2- 172.21.15.125:0/359167617 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f90b8066f30 0x7f90b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.255+0000 7f90b3fff700 1 -- 172.21.15.125:0/359167617 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f90c40872b0 con 0x7f90cc156de0 2023-10-06T03:05:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.255+0000 7f90cbfff700 1 --2- 172.21.15.125:0/359167617 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f90b8066f30 0x7f90b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:07.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.256+0000 7f90cbfff700 1 --2- 172.21.15.125:0/359167617 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f90b8066f30 0x7f90b80693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f90c0006fd0 tx=0x7f90c0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:07.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.260+0000 7f90b3fff700 1 -- 172.21.15.125:0/359167617 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90c4054030 con 0x7f90cc156de0 2023-10-06T03:05:07.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.440+0000 7f90d2900700 1 -- 172.21.15.125:0/359167617 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90cc066510 con 0x7f90cc156de0 2023-10-06T03:05:07.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.440+0000 7f90b3fff700 1 -- 172.21.15.125:0/359167617 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f90c4057650 con 0x7f90cc156de0 2023-10-06T03:05:07.442 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-06T03:05:07.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.442+0000 7f90d2900700 1 -- 172.21.15.125:0/359167617 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f90b8066f30 msgr2=0x7f90b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:07.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.442+0000 7f90d2900700 1 --2- 172.21.15.125:0/359167617 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f90b8066f30 0x7f90b80693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f90c0006fd0 tx=0x7f90c0008040 comp rx=0 tx=0).stop 2023-10-06T03:05:07.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.442+0000 7f90d2900700 1 -- 172.21.15.125:0/359167617 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90cc156de0 msgr2=0x7f90cc0ad330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:07.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.442+0000 7f90d2900700 1 --2- 172.21.15.125:0/359167617 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90cc156de0 0x7f90cc0ad330 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f90c4012580 tx=0x7f90c4019000 comp rx=0 tx=0).stop 2023-10-06T03:05:07.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.442+0000 7f90d2900700 1 -- 172.21.15.125:0/359167617 shutdown_connections 2023-10-06T03:05:07.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.442+0000 7f90d2900700 1 --2- 172.21.15.125:0/359167617 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f90b8066f30 0x7f90b80693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.442+0000 7f90d2900700 1 --2- 172.21.15.125:0/359167617 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90cc156de0 0x7f90cc0ad330 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.442+0000 7f90d2900700 1 --2- 172.21.15.125:0/359167617 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90cc0cc060 0x7f90cc0ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.442+0000 7f90d2900700 1 --2- 172.21.15.125:0/359167617 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90cc0cd790 0x7f90cc0af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.442+0000 7f90d2900700 1 -- 172.21.15.125:0/359167617 >> 172.21.15.125:0/359167617 conn(0x7f90cc0cdf80 msgr2=0x7f90cc1507e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:07.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.443+0000 7f90d2900700 1 -- 172.21.15.125:0/359167617 shutdown_connections 2023-10-06T03:05:07.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.443+0000 7f90d2900700 1 -- 172.21.15.125:0/359167617 wait complete. 2023-10-06T03:05:07.455 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:05:07.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.575+0000 7f81bcbb6700 1 Processor -- start 2023-10-06T03:05:07.576 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.575+0000 7f81bcbb6700 1 -- start start 2023-10-06T03:05:07.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.575+0000 7f81bcbb6700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f81b80ca440 0x7f81b81558e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:07.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.576+0000 7f81bcbb6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b80c1d50 con 0x7f81b80c3440 2023-10-06T03:05:07.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.576+0000 7f81bcbb6700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b80ca1b0 con 0x7f81b80b0240 2023-10-06T03:05:07.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.576+0000 7f81bcbb6700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b8063940 con 0x7f81b80ca440 2023-10-06T03:05:07.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.576+0000 7f81b5d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f81b80c3440 0x7f81b8063230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43830/0 (socket says 172.21.15.125:43830) 2023-10-06T03:05:07.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.576+0000 7f81b5d9b700 1 -- 172.21.15.125:0/3071834398 learned_addr learned my addr 172.21.15.125:0/3071834398 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:07.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.576+0000 7f81b659c700 1 --2- 172.21.15.125:0/3071834398 >> v2:172.21.15.130:3300/0 conn(0x7f81b80ca440 0x7f81b81558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:07.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.576+0000 7f81b559a700 1 -- 172.21.15.125:0/3071834398 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260554304 0 0) 0x7f81b80c1d50 con 0x7f81b80c3440 2023-10-06T03:05:07.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.576+0000 7f81b559a700 1 -- 172.21.15.125:0/3071834398 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81a0003570 con 0x7f81b80c3440 2023-10-06T03:05:07.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.576+0000 7f81b559a700 1 -- 172.21.15.125:0/3071834398 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 418027390 0 0) 0x7f81a0003570 con 0x7f81b80c3440 2023-10-06T03:05:07.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.576+0000 7f81b659c700 1 -- 172.21.15.125:0/3071834398 >> v1:172.21.15.130:6789/0 conn(0x7f81b80b0240 legacy=0x7f81b80cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:07.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.576+0000 7f81b659c700 1 -- 172.21.15.125:0/3071834398 >> v1:172.21.15.125:6789/0 conn(0x7f81b80c3440 legacy=0x7f81b8063230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:07.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.576+0000 7f81b659c700 1 -- 172.21.15.125:0/3071834398 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b80c1740 con 0x7f81b80ca440 2023-10-06T03:05:07.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.576+0000 7f81b659c700 1 --2- 172.21.15.125:0/3071834398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81b80ca440 0x7f81b81558e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f81ac0098d0 tx=0x7f81ac009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0c2a9a375171a63 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:07.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.577+0000 7f81b559a700 1 -- 172.21.15.125:0/3071834398 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a8001470 con 0x7f81b80ca440 2023-10-06T03:05:07.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.577+0000 7f81b559a700 1 -- 172.21.15.125:0/3071834398 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac011420 con 0x7f81b80ca440 2023-10-06T03:05:07.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.577+0000 7f81b559a700 1 -- 172.21.15.125:0/3071834398 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac0117c0 con 0x7f81b80ca440 2023-10-06T03:05:07.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.577+0000 7f81bcbb6700 1 -- 172.21.15.125:0/3071834398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81b80ca440 msgr2=0x7f81b81558e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:07.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.577+0000 7f81bcbb6700 1 --2- 172.21.15.125:0/3071834398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81b80ca440 0x7f81b81558e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f81ac0098d0 tx=0x7f81ac009120 comp rx=0 tx=0).stop 2023-10-06T03:05:07.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.577+0000 7f81bcbb6700 1 -- 172.21.15.125:0/3071834398 shutdown_connections 2023-10-06T03:05:07.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.577+0000 7f81bcbb6700 1 --2- 172.21.15.125:0/3071834398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81b80ca440 0x7f81b81558e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.577+0000 7f81bcbb6700 1 -- 172.21.15.125:0/3071834398 >> 172.21.15.125:0/3071834398 conn(0x7f81b80af730 msgr2=0x7f81b80afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:07.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.577+0000 7f81bcbb6700 1 -- 172.21.15.125:0/3071834398 shutdown_connections 2023-10-06T03:05:07.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.577+0000 7f81bcbb6700 1 -- 172.21.15.125:0/3071834398 wait complete. 2023-10-06T03:05:07.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.578+0000 7f81bcbb6700 1 Processor -- start 2023-10-06T03:05:07.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.578+0000 7f81bcbb6700 1 -- start start 2023-10-06T03:05:07.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.579+0000 7f81bcbb6700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81b80b0240 0x7f81b8155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:07.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.579+0000 7f81bcbb6700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81b80c3440 0x7f81b816a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:07.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.579+0000 7f81bcbb6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81b80ca440 0x7f81b814b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:07.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.579+0000 7f81bcbb6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b8146a10 con 0x7f81b80ca440 2023-10-06T03:05:07.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.579+0000 7f81bcbb6700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b814b9b0 con 0x7f81b80b0240 2023-10-06T03:05:07.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.579+0000 7f81bcbb6700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b814bc30 con 0x7f81b80c3440 2023-10-06T03:05:07.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.579+0000 7f81b6d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81b80ca440 0x7f81b814b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:07.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.579+0000 7f81b6d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81b80ca440 0x7f81b814b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39418/0 (socket says 172.21.15.125:39418) 2023-10-06T03:05:07.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.579+0000 7f81b6d9d700 1 -- 172.21.15.125:0/2468949731 learned_addr learned my addr 172.21.15.125:0/2468949731 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:07.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.579+0000 7f81b659c700 1 --2- 172.21.15.125:0/2468949731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81b80b0240 0x7f81b8155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:07.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.579+0000 7f81b5d9b700 1 --2- 172.21.15.125:0/2468949731 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81b80c3440 0x7f81b816a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:07.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.579+0000 7f81b6d9d700 1 -- 172.21.15.125:0/2468949731 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81b80c3440 msgr2=0x7f81b816a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:07.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.579+0000 7f81b6d9d700 1 --2- 172.21.15.125:0/2468949731 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81b80c3440 0x7f81b816a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.579+0000 7f81b6d9d700 1 -- 172.21.15.125:0/2468949731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81b80b0240 msgr2=0x7f81b8155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:07.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.579+0000 7f81b6d9d700 1 --2- 172.21.15.125:0/2468949731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81b80b0240 0x7f81b8155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.579+0000 7f81b6d9d700 1 -- 172.21.15.125:0/2468949731 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ac0093c0 con 0x7f81b80ca440 2023-10-06T03:05:07.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.579+0000 7f81b659c700 1 --2- 172.21.15.125:0/2468949731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81b80b0240 0x7f81b8155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:07.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.580+0000 7f81b6d9d700 1 --2- 172.21.15.125:0/2468949731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81b80ca440 0x7f81b814b470 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f81b000c910 tx=0x7f81b00016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:07.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.580+0000 7f81a67fc700 1 -- 172.21.15.125:0/2468949731 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b000ce50 con 0x7f81b80ca440 2023-10-06T03:05:07.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.580+0000 7f81a67fc700 1 -- 172.21.15.125:0/2468949731 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b000a7e0 con 0x7f81b80ca440 2023-10-06T03:05:07.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.580+0000 7f81bcbb6700 1 -- 172.21.15.125:0/2468949731 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b81460e0 con 0x7f81b80ca440 2023-10-06T03:05:07.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.580+0000 7f81a67fc700 1 -- 172.21.15.125:0/2468949731 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b000aba0 con 0x7f81b80ca440 2023-10-06T03:05:07.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.580+0000 7f81bcbb6700 1 -- 172.21.15.125:0/2468949731 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b81466a0 con 0x7f81b80ca440 2023-10-06T03:05:07.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.581+0000 7f81bcbb6700 1 -- 172.21.15.125:0/2468949731 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b8146b80 con 0x7f81b80ca440 2023-10-06T03:05:07.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.581+0000 7f81a67fc700 1 -- 172.21.15.125:0/2468949731 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81b0012420 con 0x7f81b80ca440 2023-10-06T03:05:07.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.581+0000 7f81a67fc700 1 --2- 172.21.15.125:0/2468949731 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f8198066f30 0x7f81980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:07.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.582+0000 7f81a67fc700 1 -- 172.21.15.125:0/2468949731 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f81b0084ce0 con 0x7f81b80ca440 2023-10-06T03:05:07.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.582+0000 7f81b659c700 1 --2- 172.21.15.125:0/2468949731 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f8198066f30 0x7f81980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:07.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.582+0000 7f81b659c700 1 --2- 172.21.15.125:0/2468949731 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f8198066f30 0x7f81980693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81ac003080 tx=0x7f81ac016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:07.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.586+0000 7f81a67fc700 1 -- 172.21.15.125:0/2468949731 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f81b0051b00 con 0x7f81b80ca440 2023-10-06T03:05:07.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.766+0000 7f81bcbb6700 1 -- 172.21.15.125:0/2468949731 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f81b8066510 con 0x7f81b80ca440 2023-10-06T03:05:07.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.766+0000 7f81a67fc700 1 -- 172.21.15.125:0/2468949731 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f81b0055120 con 0x7f81b80ca440 2023-10-06T03:05:07.768 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-06T03:05:07.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.768+0000 7f81bcbb6700 1 -- 172.21.15.125:0/2468949731 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f8198066f30 msgr2=0x7f81980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:07.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.768+0000 7f81bcbb6700 1 --2- 172.21.15.125:0/2468949731 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f8198066f30 0x7f81980693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81ac003080 tx=0x7f81ac016000 comp rx=0 tx=0).stop 2023-10-06T03:05:07.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.768+0000 7f81bcbb6700 1 -- 172.21.15.125:0/2468949731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81b80ca440 msgr2=0x7f81b814b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:07.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.768+0000 7f81bcbb6700 1 --2- 172.21.15.125:0/2468949731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81b80ca440 0x7f81b814b470 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f81b000c910 tx=0x7f81b00016b0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.768+0000 7f81bcbb6700 1 -- 172.21.15.125:0/2468949731 shutdown_connections 2023-10-06T03:05:07.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.768+0000 7f81bcbb6700 1 --2- 172.21.15.125:0/2468949731 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f8198066f30 0x7f81980693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.768+0000 7f81bcbb6700 1 --2- 172.21.15.125:0/2468949731 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f81b80ca440 0x7f81b814b470 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.768+0000 7f81bcbb6700 1 --2- 172.21.15.125:0/2468949731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f81b80b0240 0x7f81b8155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.768+0000 7f81bcbb6700 1 --2- 172.21.15.125:0/2468949731 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f81b80c3440 0x7f81b816a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.768+0000 7f81bcbb6700 1 -- 172.21.15.125:0/2468949731 >> 172.21.15.125:0/2468949731 conn(0x7f81b80af730 msgr2=0x7f81b806ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:07.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.769+0000 7f81bcbb6700 1 -- 172.21.15.125:0/2468949731 shutdown_connections 2023-10-06T03:05:07.771 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.769+0000 7f81bcbb6700 1 -- 172.21.15.125:0/2468949731 wait complete. 2023-10-06T03:05:07.781 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:05:07.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.900+0000 7efe437b9700 1 Processor -- start 2023-10-06T03:05:07.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.900+0000 7efe437b9700 1 -- start start 2023-10-06T03:05:07.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.901+0000 7efe437b9700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efe3c0b01a0 0x7efe3c0b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:07.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.901+0000 7efe437b9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efe3c15cef0 0x7efe3c15a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:07.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.901+0000 7efe437b9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c15a850 con 0x7efe3c0cc4d0 2023-10-06T03:05:07.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.901+0000 7efe437b9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c068e60 con 0x7efe3c15cef0 2023-10-06T03:05:07.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.901+0000 7efe437b9700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe3c15d360 con 0x7efe3c0b01a0 2023-10-06T03:05:07.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.901+0000 7efe40d54700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efe3c15cef0 0x7efe3c15a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:07.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.901+0000 7efe41d56700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7efe3c0cc4d0 0x7efe3c0cc930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43844/0 (socket says 172.21.15.125:43844) 2023-10-06T03:05:07.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.901+0000 7efe40d54700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efe3c15cef0 0x7efe3c15a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39424/0 (socket says 172.21.15.125:39424) 2023-10-06T03:05:07.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.901+0000 7efe41d56700 1 -- 172.21.15.125:0/2114225152 learned_addr learned my addr 172.21.15.125:0/2114225152 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:07.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.901+0000 7efe41555700 1 --2- 172.21.15.125:0/2114225152 >> v2:172.21.15.130:3300/0 conn(0x7efe3c0b01a0 0x7efe3c0b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:07.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.901+0000 7efe40d54700 1 -- 172.21.15.125:0/2114225152 >> v2:172.21.15.130:3300/0 conn(0x7efe3c0b01a0 msgr2=0x7efe3c0b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:07.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.901+0000 7efe40d54700 1 --2- 172.21.15.125:0/2114225152 >> v2:172.21.15.130:3300/0 conn(0x7efe3c0b01a0 0x7efe3c0b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.901+0000 7efe40d54700 1 -- 172.21.15.125:0/2114225152 >> v1:172.21.15.125:6789/0 conn(0x7efe3c0cc4d0 legacy=0x7efe3c0cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:07.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.901+0000 7efe33fff700 1 -- 172.21.15.125:0/2114225152 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618185684 0 0) 0x7efe3c15a850 con 0x7efe3c0cc4d0 2023-10-06T03:05:07.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.901+0000 7efe40d54700 1 -- 172.21.15.125:0/2114225152 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c15d640 con 0x7efe3c15cef0 2023-10-06T03:05:07.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.901+0000 7efe41555700 1 --2- 172.21.15.125:0/2114225152 >> v2:172.21.15.130:3300/0 conn(0x7efe3c0b01a0 0x7efe3c0b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:07.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.902+0000 7efe40d54700 1 --2- 172.21.15.125:0/2114225152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe3c15cef0 0x7efe3c15a310 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0cbae0 tx=0x7efe380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33686e57cca7a578 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:07.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.902+0000 7efe33fff700 1 -- 172.21.15.125:0/2114225152 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3800b6b0 con 0x7efe3c15cef0 2023-10-06T03:05:07.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.902+0000 7efe33fff700 1 -- 172.21.15.125:0/2114225152 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3800b810 con 0x7efe3c15cef0 2023-10-06T03:05:07.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.902+0000 7efe33fff700 1 -- 172.21.15.125:0/2114225152 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3800bbb0 con 0x7efe3c15cef0 2023-10-06T03:05:07.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.902+0000 7efe437b9700 1 -- 172.21.15.125:0/2114225152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe3c15cef0 msgr2=0x7efe3c15a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:07.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.902+0000 7efe437b9700 1 --2- 172.21.15.125:0/2114225152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe3c15cef0 0x7efe3c15a310 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efe3c0cbae0 tx=0x7efe380091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.902+0000 7efe437b9700 1 -- 172.21.15.125:0/2114225152 shutdown_connections 2023-10-06T03:05:07.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.902+0000 7efe437b9700 1 --2- 172.21.15.125:0/2114225152 >> v2:172.21.15.130:3300/0 conn(0x7efe3c0b01a0 0x7efe3c0b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.902+0000 7efe437b9700 1 --2- 172.21.15.125:0/2114225152 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe3c15cef0 0x7efe3c15a310 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.902+0000 7efe437b9700 1 -- 172.21.15.125:0/2114225152 >> 172.21.15.125:0/2114225152 conn(0x7efe3c0cdf80 msgr2=0x7efe3c0ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:07.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.902+0000 7efe437b9700 1 -- 172.21.15.125:0/2114225152 shutdown_connections 2023-10-06T03:05:07.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.902+0000 7efe437b9700 1 -- 172.21.15.125:0/2114225152 wait complete. 2023-10-06T03:05:07.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.903+0000 7efe437b9700 1 Processor -- start 2023-10-06T03:05:07.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.903+0000 7efe437b9700 1 -- start start 2023-10-06T03:05:07.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.904+0000 7efe437b9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe3c0b01a0 0x7efe3c155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:07.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.904+0000 7efe437b9700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe3c0cc4d0 0x7efe3c0b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:07.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.904+0000 7efe437b9700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe3c15cef0 0x7efe3c156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.904+0000 7efe437b9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c0b1700 con 0x7efe3c0b01a0 2023-10-06T03:05:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.904+0000 7efe437b9700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c1551d0 con 0x7efe3c15cef0 2023-10-06T03:05:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.904+0000 7efe437b9700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c1554b0 con 0x7efe3c0cc4d0 2023-10-06T03:05:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.904+0000 7efe41555700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe3c0b01a0 0x7efe3c155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.904+0000 7efe41555700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe3c0b01a0 0x7efe3c155cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39430/0 (socket says 172.21.15.125:39430) 2023-10-06T03:05:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.904+0000 7efe41555700 1 -- 172.21.15.125:0/648024959 learned_addr learned my addr 172.21.15.125:0/648024959 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.905+0000 7efe41d56700 1 --2- 172.21.15.125:0/648024959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe3c15cef0 0x7efe3c156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.905+0000 7efe40d54700 1 --2- 172.21.15.125:0/648024959 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe3c0cc4d0 0x7efe3c0b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.905+0000 7efe41555700 1 -- 172.21.15.125:0/648024959 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe3c0cc4d0 msgr2=0x7efe3c0b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.905+0000 7efe41555700 1 --2- 172.21.15.125:0/648024959 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe3c0cc4d0 0x7efe3c0b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.905+0000 7efe41555700 1 -- 172.21.15.125:0/648024959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe3c15cef0 msgr2=0x7efe3c156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:07.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.905+0000 7efe41555700 1 --2- 172.21.15.125:0/648024959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe3c15cef0 0x7efe3c156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:07.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.905+0000 7efe41555700 1 -- 172.21.15.125:0/648024959 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe38009420 con 0x7efe3c0b01a0 2023-10-06T03:05:07.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.905+0000 7efe41555700 1 --2- 172.21.15.125:0/648024959 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe3c0b01a0 0x7efe3c155cb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00c830 tx=0x7efe2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:07.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.905+0000 7efe317fa700 1 -- 172.21.15.125:0/648024959 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c011600 con 0x7efe3c0b01a0 2023-10-06T03:05:07.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.905+0000 7efe317fa700 1 -- 172.21.15.125:0/648024959 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c011760 con 0x7efe3c0b01a0 2023-10-06T03:05:07.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.905+0000 7efe437b9700 1 -- 172.21.15.125:0/648024959 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c155790 con 0x7efe3c0b01a0 2023-10-06T03:05:07.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.905+0000 7efe317fa700 1 -- 172.21.15.125:0/648024959 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c011b20 con 0x7efe3c0b01a0 2023-10-06T03:05:07.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.905+0000 7efe437b9700 1 -- 172.21.15.125:0/648024959 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c0b39b0 con 0x7efe3c0b01a0 2023-10-06T03:05:07.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.906+0000 7efe437b9700 1 -- 172.21.15.125:0/648024959 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c066510 con 0x7efe3c0b01a0 2023-10-06T03:05:07.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.906+0000 7efe317fa700 1 -- 172.21.15.125:0/648024959 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe2c01a450 con 0x7efe3c0b01a0 2023-10-06T03:05:07.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.907+0000 7efe317fa700 1 --2- 172.21.15.125:0/648024959 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efe20066f30 0x7efe200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:07.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.907+0000 7efe40d54700 1 --2- 172.21.15.125:0/648024959 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efe20066f30 0x7efe200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:07.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.907+0000 7efe317fa700 1 -- 172.21.15.125:0/648024959 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7efe2c084e30 con 0x7efe3c0b01a0 2023-10-06T03:05:07.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.907+0000 7efe40d54700 1 --2- 172.21.15.125:0/648024959 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efe20066f30 0x7efe200693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efe380093f0 tx=0x7efe38017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:07.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:07.911+0000 7efe317fa700 1 -- 172.21.15.125:0/648024959 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe2c051c50 con 0x7efe3c0b01a0 2023-10-06T03:05:08.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.092+0000 7efe437b9700 1 -- 172.21.15.125:0/648024959 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efe3c15d920 con 0x7efe3c0b01a0 2023-10-06T03:05:08.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.093+0000 7efe317fa700 1 -- 172.21.15.125:0/648024959 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7efe2c0150a0 con 0x7efe3c0b01a0 2023-10-06T03:05:08.095 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-06T03:05:08.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.095+0000 7efe437b9700 1 -- 172.21.15.125:0/648024959 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efe20066f30 msgr2=0x7efe200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:08.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.095+0000 7efe437b9700 1 --2- 172.21.15.125:0/648024959 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efe20066f30 0x7efe200693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7efe380093f0 tx=0x7efe38017000 comp rx=0 tx=0).stop 2023-10-06T03:05:08.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.095+0000 7efe437b9700 1 -- 172.21.15.125:0/648024959 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe3c0b01a0 msgr2=0x7efe3c155cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:08.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.095+0000 7efe437b9700 1 --2- 172.21.15.125:0/648024959 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe3c0b01a0 0x7efe3c155cb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00c830 tx=0x7efe2c008040 comp rx=0 tx=0).stop 2023-10-06T03:05:08.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.095+0000 7efe437b9700 1 -- 172.21.15.125:0/648024959 shutdown_connections 2023-10-06T03:05:08.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.095+0000 7efe437b9700 1 --2- 172.21.15.125:0/648024959 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efe20066f30 0x7efe200693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.095+0000 7efe437b9700 1 --2- 172.21.15.125:0/648024959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe3c15cef0 0x7efe3c156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.095+0000 7efe437b9700 1 --2- 172.21.15.125:0/648024959 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe3c0b01a0 0x7efe3c155cb0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.095+0000 7efe437b9700 1 --2- 172.21.15.125:0/648024959 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe3c0cc4d0 0x7efe3c0b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.095+0000 7efe437b9700 1 -- 172.21.15.125:0/648024959 >> 172.21.15.125:0/648024959 conn(0x7efe3c0cdf80 msgr2=0x7efe3c154240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:08.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.095+0000 7efe437b9700 1 -- 172.21.15.125:0/648024959 shutdown_connections 2023-10-06T03:05:08.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.095+0000 7efe437b9700 1 -- 172.21.15.125:0/648024959 wait complete. 2023-10-06T03:05:08.108 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:05:08.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.224+0000 7f67bc84f700 1 Processor -- start 2023-10-06T03:05:08.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.224+0000 7f67bc84f700 1 -- start start 2023-10-06T03:05:08.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.224+0000 7f67bc84f700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f67b8157050 0x7f67b80ab7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:08.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.224+0000 7f67bc84f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f67b80abd00 0x7f67b806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:08.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.225+0000 7f67bc84f700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b80acdb0 con 0x7f67b806ae00 2023-10-06T03:05:08.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.225+0000 7f67bc84f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b806b2a0 con 0x7f67b80abd00 2023-10-06T03:05:08.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.225+0000 7f67bc84f700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b80b0380 con 0x7f67b8157050 2023-10-06T03:05:08.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.225+0000 7f67b5d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f67b80abd00 0x7f67b806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:08.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.225+0000 7f67b5d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f67b80abd00 0x7f67b806a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39432/0 (socket says 172.21.15.125:39432) 2023-10-06T03:05:08.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.225+0000 7f67b5d9b700 1 -- 172.21.15.125:0/1391035528 learned_addr learned my addr 172.21.15.125:0/1391035528 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:08.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.225+0000 7f67b659c700 1 --2- 172.21.15.125:0/1391035528 >> v2:172.21.15.130:3300/0 conn(0x7f67b8157050 0x7f67b80ab7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:08.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.225+0000 7f67b5d9b700 1 -- 172.21.15.125:0/1391035528 >> v2:172.21.15.130:3300/0 conn(0x7f67b8157050 msgr2=0x7f67b80ab7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:08.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.225+0000 7f67b5d9b700 1 --2- 172.21.15.125:0/1391035528 >> v2:172.21.15.130:3300/0 conn(0x7f67b8157050 0x7f67b80ab7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.225+0000 7f67b5d9b700 1 -- 172.21.15.125:0/1391035528 >> v1:172.21.15.130:6789/0 conn(0x7f67b806ae00 legacy=0x7f67b806e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:08.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.225+0000 7f67b5d9b700 1 -- 172.21.15.125:0/1391035528 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b8157420 con 0x7f67b80abd00 2023-10-06T03:05:08.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.225+0000 7f67b5d9b700 1 --2- 172.21.15.125:0/1391035528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67b80abd00 0x7f67b806a8c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f67a80099b0 tx=0x7f67a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec2175f9612fe15 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:08.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.225+0000 7f67b559a700 1 -- 172.21.15.125:0/1391035528 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a800b820 con 0x7f67b80abd00 2023-10-06T03:05:08.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.225+0000 7f67b559a700 1 -- 172.21.15.125:0/1391035528 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a800b980 con 0x7f67b80abd00 2023-10-06T03:05:08.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.225+0000 7f67b559a700 1 -- 172.21.15.125:0/1391035528 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a800bd20 con 0x7f67b80abd00 2023-10-06T03:05:08.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.226+0000 7f67bc84f700 1 -- 172.21.15.125:0/1391035528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67b80abd00 msgr2=0x7f67b806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:08.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.226+0000 7f67bc84f700 1 --2- 172.21.15.125:0/1391035528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67b80abd00 0x7f67b806a8c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f67a80099b0 tx=0x7f67a8009250 comp rx=0 tx=0).stop 2023-10-06T03:05:08.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.226+0000 7f67bc84f700 1 -- 172.21.15.125:0/1391035528 shutdown_connections 2023-10-06T03:05:08.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.226+0000 7f67bc84f700 1 --2- 172.21.15.125:0/1391035528 >> v2:172.21.15.130:3300/0 conn(0x7f67b8157050 0x7f67b80ab7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.226+0000 7f67bc84f700 1 --2- 172.21.15.125:0/1391035528 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67b80abd00 0x7f67b806a8c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.226+0000 7f67bc84f700 1 -- 172.21.15.125:0/1391035528 >> 172.21.15.125:0/1391035528 conn(0x7f67b80cc5a0 msgr2=0x7f67b80cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:08.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.226+0000 7f67bc84f700 1 -- 172.21.15.125:0/1391035528 shutdown_connections 2023-10-06T03:05:08.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.226+0000 7f67bc84f700 1 -- 172.21.15.125:0/1391035528 wait complete. 2023-10-06T03:05:08.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.227+0000 7f67bc84f700 1 Processor -- start 2023-10-06T03:05:08.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.227+0000 7f67bc84f700 1 -- start start 2023-10-06T03:05:08.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67bc84f700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67b806ae00 0x7f67b8155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:08.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67bc84f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67b80abd00 0x7f67b816a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:08.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67bc84f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67b8157050 0x7f67b80ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:08.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67bc84f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b80c77f0 con 0x7f67b8157050 2023-10-06T03:05:08.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67bc84f700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b80c6be0 con 0x7f67b806ae00 2023-10-06T03:05:08.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67bc84f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b80c6ec0 con 0x7f67b80abd00 2023-10-06T03:05:08.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67b6d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67b8157050 0x7f67b80ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:08.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67b6d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67b8157050 0x7f67b80ab0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39436/0 (socket says 172.21.15.125:39436) 2023-10-06T03:05:08.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67b6d9d700 1 -- 172.21.15.125:0/3786281997 learned_addr learned my addr 172.21.15.125:0/3786281997 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:08.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67b659c700 1 --2- 172.21.15.125:0/3786281997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67b806ae00 0x7f67b8155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:08.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67b5d9b700 1 --2- 172.21.15.125:0/3786281997 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67b80abd00 0x7f67b816a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:08.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67b6d9d700 1 -- 172.21.15.125:0/3786281997 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67b80abd00 msgr2=0x7f67b816a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:08.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67b6d9d700 1 --2- 172.21.15.125:0/3786281997 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67b80abd00 0x7f67b816a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67b6d9d700 1 -- 172.21.15.125:0/3786281997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67b806ae00 msgr2=0x7f67b8155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:08.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67b6d9d700 1 --2- 172.21.15.125:0/3786281997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67b806ae00 0x7f67b8155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67b6d9d700 1 -- 172.21.15.125:0/3786281997 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a80094f0 con 0x7f67b8157050 2023-10-06T03:05:08.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67b6d9d700 1 --2- 172.21.15.125:0/3786281997 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67b8157050 0x7f67b80ab0e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f67b000c840 tx=0x7f67b0001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:08.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67ae7fc700 1 -- 172.21.15.125:0/3786281997 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b0012630 con 0x7f67b8157050 2023-10-06T03:05:08.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67ae7fc700 1 -- 172.21.15.125:0/3786281997 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b00127b0 con 0x7f67b8157050 2023-10-06T03:05:08.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.228+0000 7f67bc84f700 1 -- 172.21.15.125:0/3786281997 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b80c71a0 con 0x7f67b8157050 2023-10-06T03:05:08.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.229+0000 7f67ae7fc700 1 -- 172.21.15.125:0/3786281997 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b0012b70 con 0x7f67b8157050 2023-10-06T03:05:08.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.229+0000 7f67bc84f700 1 -- 172.21.15.125:0/3786281997 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b816ab20 con 0x7f67b8157050 2023-10-06T03:05:08.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.229+0000 7f67bc84f700 1 -- 172.21.15.125:0/3786281997 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b8066510 con 0x7f67b8157050 2023-10-06T03:05:08.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.230+0000 7f67ae7fc700 1 -- 172.21.15.125:0/3786281997 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f67b001a3a0 con 0x7f67b8157050 2023-10-06T03:05:08.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.230+0000 7f67ae7fc700 1 --2- 172.21.15.125:0/3786281997 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6798066f30 0x7f67980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:08.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.230+0000 7f67b659c700 1 --2- 172.21.15.125:0/3786281997 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6798066f30 0x7f67980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:08.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.230+0000 7f67ae7fc700 1 -- 172.21.15.125:0/3786281997 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f67b0084ab0 con 0x7f67b8157050 2023-10-06T03:05:08.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.231+0000 7f67b659c700 1 --2- 172.21.15.125:0/3786281997 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6798066f30 0x7f67980693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f67a0006fd0 tx=0x7f67a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:08.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.235+0000 7f67ae7fc700 1 -- 172.21.15.125:0/3786281997 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67b00518d0 con 0x7f67b8157050 2023-10-06T03:05:08.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.418+0000 7f67bc84f700 1 -- 172.21.15.125:0/3786281997 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67b80ac1a0 con 0x7f67b8157050 2023-10-06T03:05:08.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.419+0000 7f67ae7fc700 1 -- 172.21.15.125:0/3786281997 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18851 (secure 0 0 0) 0x7f67b0054ef0 con 0x7f67b8157050 2023-10-06T03:05:08.421 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:08.421 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:04:33.645139+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:04:26.828121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:04:28.179225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:04:31.256394+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:05:08.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.421+0000 7f67bc84f700 1 -- 172.21.15.125:0/3786281997 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6798066f30 msgr2=0x7f67980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:08.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.421+0000 7f67bc84f700 1 --2- 172.21.15.125:0/3786281997 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6798066f30 0x7f67980693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f67a0006fd0 tx=0x7f67a0008040 comp rx=0 tx=0).stop 2023-10-06T03:05:08.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.421+0000 7f67bc84f700 1 -- 172.21.15.125:0/3786281997 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67b8157050 msgr2=0x7f67b80ab0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:08.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.421+0000 7f67bc84f700 1 --2- 172.21.15.125:0/3786281997 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67b8157050 0x7f67b80ab0e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f67b000c840 tx=0x7f67b0001670 comp rx=0 tx=0).stop 2023-10-06T03:05:08.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.421+0000 7f67bc84f700 1 -- 172.21.15.125:0/3786281997 shutdown_connections 2023-10-06T03:05:08.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.421+0000 7f67bc84f700 1 --2- 172.21.15.125:0/3786281997 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6798066f30 0x7f67980693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.421+0000 7f67bc84f700 1 --2- 172.21.15.125:0/3786281997 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f67b8157050 0x7f67b80ab0e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.421+0000 7f67bc84f700 1 --2- 172.21.15.125:0/3786281997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67b806ae00 0x7f67b8155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.421+0000 7f67bc84f700 1 --2- 172.21.15.125:0/3786281997 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f67b80abd00 0x7f67b816a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.421+0000 7f67bc84f700 1 -- 172.21.15.125:0/3786281997 >> 172.21.15.125:0/3786281997 conn(0x7f67b80cc5a0 msgr2=0x7f67b80cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:08.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.421+0000 7f67bc84f700 1 -- 172.21.15.125:0/3786281997 shutdown_connections 2023-10-06T03:05:08.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.422+0000 7f67bc84f700 1 -- 172.21.15.125:0/3786281997 wait complete. 2023-10-06T03:05:08.435 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:04:15.845430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:04:22.729795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:04:26.828121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:04:28.179225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:04:31.256394+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:05:08.435 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:05:08.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.553+0000 7fd98031e700 1 Processor -- start 2023-10-06T03:05:08.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.553+0000 7fd98031e700 1 -- start start 2023-10-06T03:05:08.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.554+0000 7fd98031e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd978156210 0x7fd97815a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:08.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.554+0000 7fd98031e700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd97815a810 0x7fd9780c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:08.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.554+0000 7fd98031e700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9780ae830 con 0x7fd978155e40 2023-10-06T03:05:08.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.554+0000 7fd98031e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd978159b60 con 0x7fd978156210 2023-10-06T03:05:08.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.554+0000 7fd98031e700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd978159e40 con 0x7fd97815a810 2023-10-06T03:05:08.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.554+0000 7fd97d8b9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd978156210 0x7fd97815a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:08.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.554+0000 7fd97d8b9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd978156210 0x7fd97815a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39440/0 (socket says 172.21.15.125:39440) 2023-10-06T03:05:08.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.554+0000 7fd97d8b9700 1 -- 172.21.15.125:0/3743460335 learned_addr learned my addr 172.21.15.125:0/3743460335 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:08.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.555+0000 7fd97e8bb700 1 --2- 172.21.15.125:0/3743460335 >> v2:172.21.15.130:3300/0 conn(0x7fd97815a810 0x7fd9780c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:08.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.555+0000 7fd97d8b9700 1 -- 172.21.15.125:0/3743460335 >> v2:172.21.15.130:3300/0 conn(0x7fd97815a810 msgr2=0x7fd9780c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:08.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.555+0000 7fd97d8b9700 1 --2- 172.21.15.125:0/3743460335 >> v2:172.21.15.130:3300/0 conn(0x7fd97815a810 0x7fd9780c7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.555+0000 7fd97d8b9700 1 -- 172.21.15.125:0/3743460335 >> v1:172.21.15.130:6789/0 conn(0x7fd978155e40 legacy=0x7fd97806e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.555+0000 7fd97d8b9700 1 -- 172.21.15.125:0/3743460335 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97806e850 con 0x7fd978156210 2023-10-06T03:05:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.555+0000 7fd97e8bb700 1 --2- 172.21.15.125:0/3743460335 >> v2:172.21.15.130:3300/0 conn(0x7fd97815a810 0x7fd9780c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.555+0000 7fd97d8b9700 1 --2- 172.21.15.125:0/3743460335 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd978156210 0x7fd97815a2d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd978159ac0 tx=0x7fd974009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbdb67c593b4341 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.555+0000 7fd97d0b8700 1 -- 172.21.15.125:0/3743460335 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97400b820 con 0x7fd978156210 2023-10-06T03:05:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.555+0000 7fd97d0b8700 1 -- 172.21.15.125:0/3743460335 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97400b980 con 0x7fd978156210 2023-10-06T03:05:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.555+0000 7fd97d0b8700 1 -- 172.21.15.125:0/3743460335 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97400bd20 con 0x7fd978156210 2023-10-06T03:05:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.556+0000 7fd98031e700 1 -- 172.21.15.125:0/3743460335 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd978156210 msgr2=0x7fd97815a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.556+0000 7fd98031e700 1 --2- 172.21.15.125:0/3743460335 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd978156210 0x7fd97815a2d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd978159ac0 tx=0x7fd974009250 comp rx=0 tx=0).stop 2023-10-06T03:05:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.556+0000 7fd98031e700 1 -- 172.21.15.125:0/3743460335 shutdown_connections 2023-10-06T03:05:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.556+0000 7fd98031e700 1 --2- 172.21.15.125:0/3743460335 >> v2:172.21.15.130:3300/0 conn(0x7fd97815a810 0x7fd9780c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.556+0000 7fd98031e700 1 --2- 172.21.15.125:0/3743460335 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd978156210 0x7fd97815a2d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.556+0000 7fd98031e700 1 -- 172.21.15.125:0/3743460335 >> 172.21.15.125:0/3743460335 conn(0x7fd9780cbd60 msgr2=0x7fd9780cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:08.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.556+0000 7fd98031e700 1 -- 172.21.15.125:0/3743460335 shutdown_connections 2023-10-06T03:05:08.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.556+0000 7fd98031e700 1 -- 172.21.15.125:0/3743460335 wait complete. 2023-10-06T03:05:08.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.557+0000 7fd98031e700 1 Processor -- start 2023-10-06T03:05:08.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.557+0000 7fd98031e700 1 -- start start 2023-10-06T03:05:08.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd98031e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd978155e40 0x7fd9781697a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:08.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd98031e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd978156210 0x7fd97816a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:08.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd98031e700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd97815a810 0x7fd9780afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:08.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd98031e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9780b0200 con 0x7fd978156210 2023-10-06T03:05:08.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd98031e700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9780c0880 con 0x7fd97815a810 2023-10-06T03:05:08.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd98031e700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9780b0b60 con 0x7fd978155e40 2023-10-06T03:05:08.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd97d8b9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd978156210 0x7fd97816a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:08.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd97d8b9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd978156210 0x7fd97816a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39456/0 (socket says 172.21.15.125:39456) 2023-10-06T03:05:08.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd97d8b9700 1 -- 172.21.15.125:0/2759916035 learned_addr learned my addr 172.21.15.125:0/2759916035 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:08.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd97e8bb700 1 --2- 172.21.15.125:0/2759916035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd97815a810 0x7fd9780afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:08.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd97e0ba700 1 --2- 172.21.15.125:0/2759916035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd978155e40 0x7fd9781697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:08.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd97d8b9700 1 -- 172.21.15.125:0/2759916035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd978155e40 msgr2=0x7fd9781697a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:08.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd97d8b9700 1 --2- 172.21.15.125:0/2759916035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd978155e40 0x7fd9781697a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd97d8b9700 1 -- 172.21.15.125:0/2759916035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd97815a810 msgr2=0x7fd9780afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:08.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd97d8b9700 1 --2- 172.21.15.125:0/2759916035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd97815a810 0x7fd9780afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd97d8b9700 1 -- 172.21.15.125:0/2759916035 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9740094f0 con 0x7fd978156210 2023-10-06T03:05:08.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd97e8bb700 1 --2- 172.21.15.125:0/2759916035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd97815a810 0x7fd9780afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:08.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd97d8b9700 1 --2- 172.21.15.125:0/2759916035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd978156210 0x7fd97816a980 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd97806d770 tx=0x7fd974016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:08.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd96e7fc700 1 -- 172.21.15.125:0/2759916035 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974011e20 con 0x7fd978156210 2023-10-06T03:05:08.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd96e7fc700 1 -- 172.21.15.125:0/2759916035 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd974020070 con 0x7fd978156210 2023-10-06T03:05:08.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd98031e700 1 -- 172.21.15.125:0/2759916035 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd978169db0 con 0x7fd978156210 2023-10-06T03:05:08.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd96e7fc700 1 -- 172.21.15.125:0/2759916035 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97401b6a0 con 0x7fd978156210 2023-10-06T03:05:08.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.558+0000 7fd98031e700 1 -- 172.21.15.125:0/2759916035 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97816a370 con 0x7fd978156210 2023-10-06T03:05:08.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.559+0000 7fd98031e700 1 -- 172.21.15.125:0/2759916035 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9780c0a30 con 0x7fd978156210 2023-10-06T03:05:08.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.560+0000 7fd96e7fc700 1 -- 172.21.15.125:0/2759916035 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd974022030 con 0x7fd978156210 2023-10-06T03:05:08.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.560+0000 7fd96e7fc700 1 --2- 172.21.15.125:0/2759916035 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd95c066f30 0x7fd95c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:08.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.560+0000 7fd96e7fc700 1 -- 172.21.15.125:0/2759916035 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd9740868f0 con 0x7fd978156210 2023-10-06T03:05:08.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.560+0000 7fd97e0ba700 1 --2- 172.21.15.125:0/2759916035 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd95c066f30 0x7fd95c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:08.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.560+0000 7fd97e0ba700 1 --2- 172.21.15.125:0/2759916035 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd95c066f30 0x7fd95c0693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd9680038a0 tx=0x7fd968009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:08.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.564+0000 7fd96e7fc700 1 -- 172.21.15.125:0/2759916035 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9780c0a30 con 0x7fd978156210 2023-10-06T03:05:08.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.745+0000 7fd98031e700 1 -- 172.21.15.125:0/2759916035 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd9780c0a30 con 0x7fd978156210 2023-10-06T03:05:08.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.745+0000 7fd96e7fc700 1 -- 172.21.15.125:0/2759916035 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd9780c0a30 con 0x7fd978156210 2023-10-06T03:05:08.747 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-06T03:05:08.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.747+0000 7fd98031e700 1 -- 172.21.15.125:0/2759916035 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd95c066f30 msgr2=0x7fd95c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:08.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.747+0000 7fd98031e700 1 --2- 172.21.15.125:0/2759916035 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd95c066f30 0x7fd95c0693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd9680038a0 tx=0x7fd968009040 comp rx=0 tx=0).stop 2023-10-06T03:05:08.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.747+0000 7fd98031e700 1 -- 172.21.15.125:0/2759916035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd978156210 msgr2=0x7fd97816a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:08.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.747+0000 7fd98031e700 1 --2- 172.21.15.125:0/2759916035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd978156210 0x7fd97816a980 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd97806d770 tx=0x7fd974016000 comp rx=0 tx=0).stop 2023-10-06T03:05:08.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.747+0000 7fd98031e700 1 -- 172.21.15.125:0/2759916035 shutdown_connections 2023-10-06T03:05:08.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.747+0000 7fd98031e700 1 --2- 172.21.15.125:0/2759916035 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd95c066f30 0x7fd95c0693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.747+0000 7fd98031e700 1 --2- 172.21.15.125:0/2759916035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd97815a810 0x7fd9780afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.747+0000 7fd98031e700 1 --2- 172.21.15.125:0/2759916035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd978155e40 0x7fd9781697a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.747+0000 7fd98031e700 1 --2- 172.21.15.125:0/2759916035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd978156210 0x7fd97816a980 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.747+0000 7fd98031e700 1 -- 172.21.15.125:0/2759916035 >> 172.21.15.125:0/2759916035 conn(0x7fd9780cbd60 msgr2=0x7fd978154370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:08.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.747+0000 7fd98031e700 1 -- 172.21.15.125:0/2759916035 shutdown_connections 2023-10-06T03:05:08.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.747+0000 7fd98031e700 1 -- 172.21.15.125:0/2759916035 wait complete. 2023-10-06T03:05:08.760 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:05:08.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.880+0000 7f7cf5dac700 1 Processor -- start 2023-10-06T03:05:08.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.881+0000 7f7cf5dac700 1 -- start start 2023-10-06T03:05:08.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.881+0000 7f7cf5dac700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7cf00af320 0x7f7cf00caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:08.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.881+0000 7f7cf5dac700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cf0067d20 0x7f7cf00c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:08.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.881+0000 7f7cf5dac700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf00cafe0 con 0x7f7cf00ca190 2023-10-06T03:05:08.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.881+0000 7f7cf5dac700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf00c3b40 con 0x7f7cf00af320 2023-10-06T03:05:08.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.881+0000 7f7cf5dac700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf00ca710 con 0x7f7cf0067d20 2023-10-06T03:05:08.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.882+0000 7f7ceeffd700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f7cf00ca190 0x7f7cf0067610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:52194/0 (socket says 172.21.15.125:52194) 2023-10-06T03:05:08.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.882+0000 7f7ceeffd700 1 -- 172.21.15.125:0/367670939 learned_addr learned my addr 172.21.15.125:0/367670939 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:08.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.882+0000 7f7cef7fe700 1 --2- 172.21.15.125:0/367670939 >> v2:172.21.15.130:3300/0 conn(0x7f7cf00af320 0x7f7cf00caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:08.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.882+0000 7f7ceffff700 1 --2- 172.21.15.125:0/367670939 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cf0067d20 0x7f7cf00c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:08.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.882+0000 7f7ceffff700 1 -- 172.21.15.125:0/367670939 >> v2:172.21.15.130:3300/0 conn(0x7f7cf00af320 msgr2=0x7f7cf00caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:08.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.882+0000 7f7ceffff700 1 --2- 172.21.15.125:0/367670939 >> v2:172.21.15.130:3300/0 conn(0x7f7cf00af320 0x7f7cf00caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.882+0000 7f7ceffff700 1 -- 172.21.15.125:0/367670939 >> v1:172.21.15.130:6789/0 conn(0x7f7cf00ca190 legacy=0x7f7cf0067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:08.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.882+0000 7f7ceffff700 1 -- 172.21.15.125:0/367670939 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf00cc750 con 0x7f7cf0067d20 2023-10-06T03:05:08.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.882+0000 7f7cef7fe700 1 --2- 172.21.15.125:0/367670939 >> v2:172.21.15.130:3300/0 conn(0x7f7cf00af320 0x7f7cf00caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:05:08.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.882+0000 7f7ceffff700 1 --2- 172.21.15.125:0/367670939 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cf0067d20 0x7f7cf00c7880 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8009e60 tx=0x7f7ce8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=444f877af1526739 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:08.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.883+0000 7f7cee7fc700 1 -- 172.21.15.125:0/367670939 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce800e070 con 0x7f7cf0067d20 2023-10-06T03:05:08.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.883+0000 7f7cee7fc700 1 -- 172.21.15.125:0/367670939 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce800bb60 con 0x7f7cf0067d20 2023-10-06T03:05:08.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.883+0000 7f7cee7fc700 1 -- 172.21.15.125:0/367670939 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8012430 con 0x7f7cf0067d20 2023-10-06T03:05:08.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.883+0000 7f7cf5dac700 1 -- 172.21.15.125:0/367670939 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cf0067d20 msgr2=0x7f7cf00c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:08.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.883+0000 7f7cf5dac700 1 --2- 172.21.15.125:0/367670939 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cf0067d20 0x7f7cf00c7880 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8009e60 tx=0x7f7ce8009780 comp rx=0 tx=0).stop 2023-10-06T03:05:08.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.883+0000 7f7cf5dac700 1 -- 172.21.15.125:0/367670939 shutdown_connections 2023-10-06T03:05:08.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.883+0000 7f7cf5dac700 1 --2- 172.21.15.125:0/367670939 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cf0067d20 0x7f7cf00c7880 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.883+0000 7f7cf5dac700 1 --2- 172.21.15.125:0/367670939 >> v2:172.21.15.130:3300/0 conn(0x7f7cf00af320 0x7f7cf00caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.883+0000 7f7cf5dac700 1 -- 172.21.15.125:0/367670939 >> 172.21.15.125:0/367670939 conn(0x7f7cf0096120 msgr2=0x7f7cf0068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:08.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.883+0000 7f7cf5dac700 1 -- 172.21.15.125:0/367670939 shutdown_connections 2023-10-06T03:05:08.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.883+0000 7f7cf5dac700 1 -- 172.21.15.125:0/367670939 wait complete. 2023-10-06T03:05:08.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.885+0000 7f7cf5dac700 1 Processor -- start 2023-10-06T03:05:08.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.885+0000 7f7cf5dac700 1 -- start start 2023-10-06T03:05:08.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.886+0000 7f7cf5dac700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cf0067d20 0x7f7cf01512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:08.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.886+0000 7f7cf5dac700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cf00af320 0x7f7cf0154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:08.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.886+0000 7f7cf5dac700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cf00ca190 0x7f7cf01529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.886+0000 7f7cf5dac700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf01554e0 con 0x7f7cf00af320 2023-10-06T03:05:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.886+0000 7f7cf5dac700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf01569e0 con 0x7f7cf0067d20 2023-10-06T03:05:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.886+0000 7f7cf5dac700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf0156f80 con 0x7f7cf00ca190 2023-10-06T03:05:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.886+0000 7f7ceeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cf00af320 0x7f7cf0154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.886+0000 7f7cef7fe700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cf0067d20 0x7f7cf01512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.886+0000 7f7ceeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cf00af320 0x7f7cf0154620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39466/0 (socket says 172.21.15.125:39466) 2023-10-06T03:05:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.886+0000 7f7ceeffd700 1 -- 172.21.15.125:0/1650968649 learned_addr learned my addr 172.21.15.125:0/1650968649 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.886+0000 7f7ceffff700 1 --2- 172.21.15.125:0/1650968649 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cf00ca190 0x7f7cf01529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.886+0000 7f7ceeffd700 1 -- 172.21.15.125:0/1650968649 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cf00ca190 msgr2=0x7f7cf01529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:08.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.886+0000 7f7ceeffd700 1 --2- 172.21.15.125:0/1650968649 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cf00ca190 0x7f7cf01529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.886+0000 7f7ceeffd700 1 -- 172.21.15.125:0/1650968649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cf0067d20 msgr2=0x7f7cf01512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:08.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.886+0000 7f7ceeffd700 1 --2- 172.21.15.125:0/1650968649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cf0067d20 0x7f7cf01512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:08.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.886+0000 7f7ceeffd700 1 -- 172.21.15.125:0/1650968649 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce40093c0 con 0x7f7cf00af320 2023-10-06T03:05:08.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.886+0000 7f7ceeffd700 1 --2- 172.21.15.125:0/1650968649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cf00af320 0x7f7cf0154620 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000c560 tx=0x7f7ce0001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:08.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.886+0000 7f7cd77fe700 1 -- 172.21.15.125:0/1650968649 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0005b30 con 0x7f7cf00af320 2023-10-06T03:05:08.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.887+0000 7f7cd77fe700 1 -- 172.21.15.125:0/1650968649 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce0005c90 con 0x7f7cf00af320 2023-10-06T03:05:08.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.887+0000 7f7cd77fe700 1 -- 172.21.15.125:0/1650968649 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0007320 con 0x7f7cf00af320 2023-10-06T03:05:08.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.887+0000 7f7cf5dac700 1 -- 172.21.15.125:0/1650968649 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce8009a20 con 0x7f7cf00af320 2023-10-06T03:05:08.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.887+0000 7f7cf5dac700 1 -- 172.21.15.125:0/1650968649 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf0155200 con 0x7f7cf00af320 2023-10-06T03:05:08.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.887+0000 7f7cf5dac700 1 -- 172.21.15.125:0/1650968649 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf0066510 con 0x7f7cf00af320 2023-10-06T03:05:08.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.888+0000 7f7cd77fe700 1 -- 172.21.15.125:0/1650968649 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ce001b3b0 con 0x7f7cf00af320 2023-10-06T03:05:08.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.888+0000 7f7cd77fe700 1 --2- 172.21.15.125:0/1650968649 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7cdc066f30 0x7f7cdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:08.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.889+0000 7f7cef7fe700 1 --2- 172.21.15.125:0/1650968649 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7cdc066f30 0x7f7cdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:08.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.889+0000 7f7cd77fe700 1 -- 172.21.15.125:0/1650968649 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f7ce0083c60 con 0x7f7cf00af320 2023-10-06T03:05:08.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.889+0000 7f7cef7fe700 1 --2- 172.21.15.125:0/1650968649 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7cdc066f30 0x7f7cdc0693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009f30 tx=0x7f7ce4009120 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:08.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:08.893+0000 7f7cd77fe700 1 -- 172.21.15.125:0/1650968649 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ce00509e0 con 0x7f7cf00af320 2023-10-06T03:05:09.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.071+0000 7f7cf5dac700 1 -- 172.21.15.125:0/1650968649 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7cf00cafe0 con 0x7f7cf00af320 2023-10-06T03:05:09.073 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.072+0000 7f7cd77fe700 1 -- 172.21.15.125:0/1650968649 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7cf00cafe0 con 0x7f7cf00af320 2023-10-06T03:05:09.074 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-06T03:05:09.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.074+0000 7f7cf5dac700 1 -- 172.21.15.125:0/1650968649 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7cdc066f30 msgr2=0x7f7cdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:09.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.074+0000 7f7cf5dac700 1 --2- 172.21.15.125:0/1650968649 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7cdc066f30 0x7f7cdc0693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009f30 tx=0x7f7ce4009120 comp rx=0 tx=0).stop 2023-10-06T03:05:09.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.074+0000 7f7cf5dac700 1 -- 172.21.15.125:0/1650968649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cf00af320 msgr2=0x7f7cf0154620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:09.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.074+0000 7f7cf5dac700 1 --2- 172.21.15.125:0/1650968649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cf00af320 0x7f7cf0154620 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000c560 tx=0x7f7ce0001020 comp rx=0 tx=0).stop 2023-10-06T03:05:09.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.074+0000 7f7cf5dac700 1 -- 172.21.15.125:0/1650968649 shutdown_connections 2023-10-06T03:05:09.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.074+0000 7f7cf5dac700 1 --2- 172.21.15.125:0/1650968649 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7cdc066f30 0x7f7cdc0693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.074+0000 7f7cf5dac700 1 --2- 172.21.15.125:0/1650968649 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7cf00ca190 0x7f7cf01529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.074+0000 7f7cf5dac700 1 --2- 172.21.15.125:0/1650968649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cf0067d20 0x7f7cf01512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.074+0000 7f7cf5dac700 1 --2- 172.21.15.125:0/1650968649 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7cf00af320 0x7f7cf0154620 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.074+0000 7f7cf5dac700 1 -- 172.21.15.125:0/1650968649 >> 172.21.15.125:0/1650968649 conn(0x7f7cf0096120 msgr2=0x7f7cf0151a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:09.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.074+0000 7f7cf5dac700 1 -- 172.21.15.125:0/1650968649 shutdown_connections 2023-10-06T03:05:09.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.074+0000 7f7cf5dac700 1 -- 172.21.15.125:0/1650968649 wait complete. 2023-10-06T03:05:09.087 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:05:09.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.206+0000 7f2fa61a2700 1 Processor -- start 2023-10-06T03:05:09.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.206+0000 7f2fa61a2700 1 -- start start 2023-10-06T03:05:09.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.207+0000 7f2fa61a2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2fa01558e0 0x7f2fa00cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:09.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.207+0000 7f2fa61a2700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fa00ca440 0x7f2fa00ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:09.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.207+0000 7f2fa61a2700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa00c1d50 con 0x7f2fa0155cb0 2023-10-06T03:05:09.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.207+0000 7f2fa61a2700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa00ca1b0 con 0x7f2fa01558e0 2023-10-06T03:05:09.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.207+0000 7f2fa61a2700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa00c1740 con 0x7f2fa00ca440 2023-10-06T03:05:09.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.208+0000 7f2f9f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2fa01558e0 0x7f2fa00cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:09.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.208+0000 7f2f9f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2fa01558e0 0x7f2fa00cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39476/0 (socket says 172.21.15.125:39476) 2023-10-06T03:05:09.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.208+0000 7f2f9f7fe700 1 -- 172.21.15.125:0/2610169003 learned_addr learned my addr 172.21.15.125:0/2610169003 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:09.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.208+0000 7f2f9f7fe700 1 -- 172.21.15.125:0/2610169003 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fa00ca440 msgr2=0x7f2fa00ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:09.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.208+0000 7f2f9ffff700 1 --2- 172.21.15.125:0/2610169003 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fa00ca440 0x7f2fa00ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:09.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.208+0000 7f2f9f7fe700 1 --2- 172.21.15.125:0/2610169003 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fa00ca440 0x7f2fa00ccdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.208+0000 7f2f9f7fe700 1 -- 172.21.15.125:0/2610169003 >> v1:172.21.15.130:6789/0 conn(0x7f2fa0155cb0 legacy=0x7f2fa01595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:09.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.208+0000 7f2f9f7fe700 1 -- 172.21.15.125:0/2610169003 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa00c9ed0 con 0x7f2fa01558e0 2023-10-06T03:05:09.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.208+0000 7f2f9f7fe700 1 --2- 172.21.15.125:0/2610169003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fa01558e0 0x7f2fa00cc870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f94009990 tx=0x7f2f94009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d561c582b66f1d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:09.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.208+0000 7f2f9e7fc700 1 -- 172.21.15.125:0/2610169003 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f94005c10 con 0x7f2fa01558e0 2023-10-06T03:05:09.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.208+0000 7f2f9e7fc700 1 -- 172.21.15.125:0/2610169003 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f94005d70 con 0x7f2fa01558e0 2023-10-06T03:05:09.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.208+0000 7f2f9e7fc700 1 -- 172.21.15.125:0/2610169003 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9400b840 con 0x7f2fa01558e0 2023-10-06T03:05:09.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.209+0000 7f2fa61a2700 1 -- 172.21.15.125:0/2610169003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fa01558e0 msgr2=0x7f2fa00cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:09.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.209+0000 7f2fa61a2700 1 --2- 172.21.15.125:0/2610169003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fa01558e0 0x7f2fa00cc870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f94009990 tx=0x7f2f94009220 comp rx=0 tx=0).stop 2023-10-06T03:05:09.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.209+0000 7f2fa61a2700 1 -- 172.21.15.125:0/2610169003 shutdown_connections 2023-10-06T03:05:09.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.209+0000 7f2fa61a2700 1 --2- 172.21.15.125:0/2610169003 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fa00ca440 0x7f2fa00ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.209+0000 7f2fa61a2700 1 --2- 172.21.15.125:0/2610169003 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fa01558e0 0x7f2fa00cc870 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.209+0000 7f2fa61a2700 1 -- 172.21.15.125:0/2610169003 >> 172.21.15.125:0/2610169003 conn(0x7f2fa00af730 msgr2=0x7f2fa00afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:09.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.209+0000 7f2fa61a2700 1 -- 172.21.15.125:0/2610169003 shutdown_connections 2023-10-06T03:05:09.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.209+0000 7f2fa61a2700 1 -- 172.21.15.125:0/2610169003 wait complete. 2023-10-06T03:05:09.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.210+0000 7f2fa61a2700 1 Processor -- start 2023-10-06T03:05:09.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.210+0000 7f2fa61a2700 1 -- start start 2023-10-06T03:05:09.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2fa61a2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fa00ca440 0x7f2fa01411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:09.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2fa61a2700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fa01558e0 0x7f2fa0145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2fa61a2700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fa01463f0 0x7f2fa0158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2fa61a2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa0098c50 con 0x7f2fa00ca440 2023-10-06T03:05:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2fa61a2700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa0146890 con 0x7f2fa01463f0 2023-10-06T03:05:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2fa61a2700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa00987c0 con 0x7f2fa01558e0 2023-10-06T03:05:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2f9f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fa00ca440 0x7f2fa01411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2f9f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fa00ca440 0x7f2fa01411b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39488/0 (socket says 172.21.15.125:39488) 2023-10-06T03:05:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2f9f7fe700 1 -- 172.21.15.125:0/2810807686 learned_addr learned my addr 172.21.15.125:0/2810807686 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2f9f7fe700 1 -- 172.21.15.125:0/2810807686 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fa01558e0 msgr2=0x7f2fa0145eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2f9effd700 1 --2- 172.21.15.125:0/2810807686 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fa01558e0 0x7f2fa0145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2f9ffff700 1 --2- 172.21.15.125:0/2810807686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fa01463f0 0x7f2fa0158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:09.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2f9f7fe700 1 --2- 172.21.15.125:0/2810807686 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fa01558e0 0x7f2fa0145eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2f9f7fe700 1 -- 172.21.15.125:0/2810807686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fa01463f0 msgr2=0x7f2fa0158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:09.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2f9f7fe700 1 --2- 172.21.15.125:0/2810807686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fa01463f0 0x7f2fa0158730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2f9f7fe700 1 -- 172.21.15.125:0/2810807686 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f94009480 con 0x7f2fa00ca440 2023-10-06T03:05:09.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2f9f7fe700 1 --2- 172.21.15.125:0/2810807686 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fa00ca440 0x7f2fa01411b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2f940030c0 tx=0x7f2f94015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:09.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2f877fe700 1 -- 172.21.15.125:0/2810807686 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f94000cf0 con 0x7f2fa00ca440 2023-10-06T03:05:09.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2f877fe700 1 -- 172.21.15.125:0/2810807686 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f94011cc0 con 0x7f2fa00ca440 2023-10-06T03:05:09.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.211+0000 7f2fa61a2700 1 -- 172.21.15.125:0/2810807686 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa0097bd0 con 0x7f2fa00ca440 2023-10-06T03:05:09.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.212+0000 7f2f877fe700 1 -- 172.21.15.125:0/2810807686 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9401d680 con 0x7f2fa00ca440 2023-10-06T03:05:09.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.212+0000 7f2fa61a2700 1 -- 172.21.15.125:0/2810807686 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa0098170 con 0x7f2fa00ca440 2023-10-06T03:05:09.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.212+0000 7f2fa61a2700 1 -- 172.21.15.125:0/2810807686 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa0066510 con 0x7f2fa00ca440 2023-10-06T03:05:09.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.213+0000 7f2f877fe700 1 -- 172.21.15.125:0/2810807686 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f9401da70 con 0x7f2fa00ca440 2023-10-06T03:05:09.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.213+0000 7f2f877fe700 1 --2- 172.21.15.125:0/2810807686 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2f8c066f60 0x7f2f8c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:09.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.213+0000 7f2f877fe700 1 -- 172.21.15.125:0/2810807686 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f2f940866b0 con 0x7f2fa00ca440 2023-10-06T03:05:09.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.213+0000 7f2f9effd700 1 --2- 172.21.15.125:0/2810807686 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2f8c066f60 0x7f2f8c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:09.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.214+0000 7f2f9effd700 1 --2- 172.21.15.125:0/2810807686 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2f8c066f60 0x7f2f8c069410 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0146a80 tx=0x7f2f90008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:09.218 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.217+0000 7f2f877fe700 1 -- 172.21.15.125:0/2810807686 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f940534d0 con 0x7f2fa00ca440 2023-10-06T03:05:09.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.403+0000 7f2fa61a2700 1 -- 172.21.15.125:0/2810807686 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2fa00c19e0 con 0x7f2fa00ca440 2023-10-06T03:05:09.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.404+0000 7f2f877fe700 1 -- 172.21.15.125:0/2810807686 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2f94056af0 con 0x7f2fa00ca440 2023-10-06T03:05:09.405 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-06T03:05:09.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.406+0000 7f2fa61a2700 1 -- 172.21.15.125:0/2810807686 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2f8c066f60 msgr2=0x7f2f8c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:09.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.406+0000 7f2fa61a2700 1 --2- 172.21.15.125:0/2810807686 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2f8c066f60 0x7f2f8c069410 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0146a80 tx=0x7f2f90008040 comp rx=0 tx=0).stop 2023-10-06T03:05:09.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.406+0000 7f2fa61a2700 1 -- 172.21.15.125:0/2810807686 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fa00ca440 msgr2=0x7f2fa01411b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:09.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.406+0000 7f2fa61a2700 1 --2- 172.21.15.125:0/2810807686 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fa00ca440 0x7f2fa01411b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2f940030c0 tx=0x7f2f94015000 comp rx=0 tx=0).stop 2023-10-06T03:05:09.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.406+0000 7f2fa61a2700 1 -- 172.21.15.125:0/2810807686 shutdown_connections 2023-10-06T03:05:09.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.406+0000 7f2fa61a2700 1 --2- 172.21.15.125:0/2810807686 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2f8c066f60 0x7f2f8c069410 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.406+0000 7f2fa61a2700 1 --2- 172.21.15.125:0/2810807686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fa01463f0 0x7f2fa0158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.406+0000 7f2fa61a2700 1 --2- 172.21.15.125:0/2810807686 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2fa00ca440 0x7f2fa01411b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.406+0000 7f2fa61a2700 1 --2- 172.21.15.125:0/2810807686 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2fa01558e0 0x7f2fa0145eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.406+0000 7f2fa61a2700 1 -- 172.21.15.125:0/2810807686 >> 172.21.15.125:0/2810807686 conn(0x7f2fa00af730 msgr2=0x7f2fa0146cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:09.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.406+0000 7f2fa61a2700 1 -- 172.21.15.125:0/2810807686 shutdown_connections 2023-10-06T03:05:09.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.406+0000 7f2fa61a2700 1 -- 172.21.15.125:0/2810807686 wait complete. 2023-10-06T03:05:09.419 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:05:09.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.538+0000 7f77c97bf700 1 Processor -- start 2023-10-06T03:05:09.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.538+0000 7f77c97bf700 1 -- start start 2023-10-06T03:05:09.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.539+0000 7f77c97bf700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77c41595a0 0x7f77c40b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:09.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.539+0000 7f77c97bf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f77c40cc7f0 0x7f77c40ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:09.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.539+0000 7f77c97bf700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c40cc360 con 0x7f77c41591d0 2023-10-06T03:05:09.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.539+0000 7f77c97bf700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c40cba70 con 0x7f77c40cc7f0 2023-10-06T03:05:09.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.539+0000 7f77c97bf700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40b2740 con 0x7f77c41595a0 2023-10-06T03:05:09.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.539+0000 7f77c37fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f77c40cc7f0 0x7f77c40ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:09.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.539+0000 7f77c37fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f77c40cc7f0 0x7f77c40ccc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39492/0 (socket says 172.21.15.125:39492) 2023-10-06T03:05:09.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.539+0000 7f77c37fe700 1 -- 172.21.15.125:0/587108080 learned_addr learned my addr 172.21.15.125:0/587108080 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:09.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.539+0000 7f77c27fc700 1 --2- 172.21.15.125:0/587108080 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77c41595a0 0x7f77c40b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:09.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.539+0000 7f77c37fe700 1 -- 172.21.15.125:0/587108080 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77c41595a0 msgr2=0x7f77c40b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:09.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.539+0000 7f77c37fe700 1 --2- 172.21.15.125:0/587108080 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77c41595a0 0x7f77c40b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.539+0000 7f77c37fe700 1 -- 172.21.15.125:0/587108080 >> v1:172.21.15.130:6789/0 conn(0x7f77c41591d0 legacy=0x7f77c40b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:09.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.539+0000 7f77c37fe700 1 -- 172.21.15.125:0/587108080 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c40cbd10 con 0x7f77c40cc7f0 2023-10-06T03:05:09.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.539+0000 7f77c37fe700 1 --2- 172.21.15.125:0/587108080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77c40cc7f0 0x7f77c40ccc50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f77bc009f20 tx=0x7f77bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691641cac41b5812 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:09.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.540+0000 7f77c1ffb700 1 -- 172.21.15.125:0/587108080 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc00e070 con 0x7f77c40cc7f0 2023-10-06T03:05:09.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.540+0000 7f77c1ffb700 1 -- 172.21.15.125:0/587108080 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77bc00ba80 con 0x7f77c40cc7f0 2023-10-06T03:05:09.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.540+0000 7f77c1ffb700 1 -- 172.21.15.125:0/587108080 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc0092e0 con 0x7f77c40cc7f0 2023-10-06T03:05:09.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.540+0000 7f77c97bf700 1 -- 172.21.15.125:0/587108080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77c40cc7f0 msgr2=0x7f77c40ccc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:09.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.540+0000 7f77c97bf700 1 --2- 172.21.15.125:0/587108080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77c40cc7f0 0x7f77c40ccc50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f77bc009f20 tx=0x7f77bc009840 comp rx=0 tx=0).stop 2023-10-06T03:05:09.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.540+0000 7f77c97bf700 1 -- 172.21.15.125:0/587108080 shutdown_connections 2023-10-06T03:05:09.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.540+0000 7f77c97bf700 1 --2- 172.21.15.125:0/587108080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77c40cc7f0 0x7f77c40ccc50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.540+0000 7f77c97bf700 1 --2- 172.21.15.125:0/587108080 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77c41595a0 0x7f77c40b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.540+0000 7f77c97bf700 1 -- 172.21.15.125:0/587108080 >> 172.21.15.125:0/587108080 conn(0x7f77c406ed40 msgr2=0x7f77c406f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:09.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.540+0000 7f77c97bf700 1 -- 172.21.15.125:0/587108080 shutdown_connections 2023-10-06T03:05:09.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.540+0000 7f77c97bf700 1 -- 172.21.15.125:0/587108080 wait complete. 2023-10-06T03:05:09.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.541+0000 7f77c97bf700 1 Processor -- start 2023-10-06T03:05:09.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.541+0000 7f77c97bf700 1 -- start start 2023-10-06T03:05:09.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.542+0000 7f77c97bf700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77c40cc7f0 0x7f77c41583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:09.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.542+0000 7f77c97bf700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77c41591d0 0x7f77c41688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:09.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.542+0000 7f77c97bf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77c41595a0 0x7f77c4156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:09.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.542+0000 7f77c97bf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c4169230 con 0x7f77c41595a0 2023-10-06T03:05:09.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.542+0000 7f77c97bf700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c416cbf0 con 0x7f77c40cc7f0 2023-10-06T03:05:09.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.542+0000 7f77c97bf700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c416ced0 con 0x7f77c41591d0 2023-10-06T03:05:09.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.542+0000 7f77c37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77c41595a0 0x7f77c4156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:09.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.542+0000 7f77c37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77c41595a0 0x7f77c4156630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39498/0 (socket says 172.21.15.125:39498) 2023-10-06T03:05:09.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.542+0000 7f77c37fe700 1 -- 172.21.15.125:0/2948995060 learned_addr learned my addr 172.21.15.125:0/2948995060 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:09.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.542+0000 7f77c27fc700 1 --2- 172.21.15.125:0/2948995060 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77c41591d0 0x7f77c41688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:09.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.542+0000 7f77c2ffd700 1 --2- 172.21.15.125:0/2948995060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77c40cc7f0 0x7f77c41583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:09.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.543+0000 7f77c37fe700 1 -- 172.21.15.125:0/2948995060 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77c41591d0 msgr2=0x7f77c41688d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:09.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.543+0000 7f77c37fe700 1 --2- 172.21.15.125:0/2948995060 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77c41591d0 0x7f77c41688d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.543+0000 7f77c37fe700 1 -- 172.21.15.125:0/2948995060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77c40cc7f0 msgr2=0x7f77c41583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:09.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.543+0000 7f77c37fe700 1 --2- 172.21.15.125:0/2948995060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77c40cc7f0 0x7f77c41583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.543+0000 7f77c37fe700 1 -- 172.21.15.125:0/2948995060 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77bc009ae0 con 0x7f77c41595a0 2023-10-06T03:05:09.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.543+0000 7f77c27fc700 1 --2- 172.21.15.125:0/2948995060 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77c41591d0 0x7f77c41688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:09.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.543+0000 7f77c37fe700 1 --2- 172.21.15.125:0/2948995060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77c41595a0 0x7f77c4156630 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00b6c0 tx=0x7f77bc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:09.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.543+0000 7f77aaffd700 1 -- 172.21.15.125:0/2948995060 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc0032f0 con 0x7f77c41595a0 2023-10-06T03:05:09.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.543+0000 7f77aaffd700 1 -- 172.21.15.125:0/2948995060 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77bc008e80 con 0x7f77c41595a0 2023-10-06T03:05:09.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.543+0000 7f77c97bf700 1 -- 172.21.15.125:0/2948995060 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c416d1b0 con 0x7f77c41595a0 2023-10-06T03:05:09.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.543+0000 7f77aaffd700 1 -- 172.21.15.125:0/2948995060 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc026670 con 0x7f77c41595a0 2023-10-06T03:05:09.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.543+0000 7f77c97bf700 1 -- 172.21.15.125:0/2948995060 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c41588f0 con 0x7f77c41595a0 2023-10-06T03:05:09.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.544+0000 7f77c97bf700 1 -- 172.21.15.125:0/2948995060 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c41693a0 con 0x7f77c41595a0 2023-10-06T03:05:09.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.544+0000 7f77aaffd700 1 -- 172.21.15.125:0/2948995060 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77bc003040 con 0x7f77c41595a0 2023-10-06T03:05:09.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.545+0000 7f77aaffd700 1 --2- 172.21.15.125:0/2948995060 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f77b0066f30 0x7f77b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:09.549 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.545+0000 7f77c2ffd700 1 --2- 172.21.15.125:0/2948995060 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f77b0066f30 0x7f77b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:09.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.545+0000 7f77aaffd700 1 -- 172.21.15.125:0/2948995060 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f77bc086a00 con 0x7f77c41595a0 2023-10-06T03:05:09.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.545+0000 7f77c2ffd700 1 --2- 172.21.15.125:0/2948995060 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f77b0066f30 0x7f77b00693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f77b8003890 tx=0x7f77b8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:09.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.549+0000 7f77aaffd700 1 -- 172.21.15.125:0/2948995060 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77bc053820 con 0x7f77c41595a0 2023-10-06T03:05:09.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.732+0000 7f77c97bf700 1 -- 172.21.15.125:0/2948995060 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77c4066510 con 0x7f77c41595a0 2023-10-06T03:05:09.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.732+0000 7f77aaffd700 1 -- 172.21.15.125:0/2948995060 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f77bc056e40 con 0x7f77c41595a0 2023-10-06T03:05:09.734 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-06T03:05:09.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.734+0000 7f77c97bf700 1 -- 172.21.15.125:0/2948995060 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f77b0066f30 msgr2=0x7f77b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:09.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.734+0000 7f77c97bf700 1 --2- 172.21.15.125:0/2948995060 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f77b0066f30 0x7f77b00693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f77b8003890 tx=0x7f77b8009040 comp rx=0 tx=0).stop 2023-10-06T03:05:09.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.734+0000 7f77c97bf700 1 -- 172.21.15.125:0/2948995060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77c41595a0 msgr2=0x7f77c4156630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:09.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.734+0000 7f77c97bf700 1 --2- 172.21.15.125:0/2948995060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77c41595a0 0x7f77c4156630 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f77bc00b6c0 tx=0x7f77bc018000 comp rx=0 tx=0).stop 2023-10-06T03:05:09.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.734+0000 7f77c97bf700 1 -- 172.21.15.125:0/2948995060 shutdown_connections 2023-10-06T03:05:09.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.734+0000 7f77c97bf700 1 --2- 172.21.15.125:0/2948995060 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f77b0066f30 0x7f77b00693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.734+0000 7f77c97bf700 1 --2- 172.21.15.125:0/2948995060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77c41595a0 0x7f77c4156630 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.734+0000 7f77c97bf700 1 --2- 172.21.15.125:0/2948995060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77c40cc7f0 0x7f77c41583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.734+0000 7f77c97bf700 1 --2- 172.21.15.125:0/2948995060 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77c41591d0 0x7f77c41688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.734+0000 7f77c97bf700 1 -- 172.21.15.125:0/2948995060 >> 172.21.15.125:0/2948995060 conn(0x7f77c406ed40 msgr2=0x7f77c40ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:09.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.734+0000 7f77c97bf700 1 -- 172.21.15.125:0/2948995060 shutdown_connections 2023-10-06T03:05:09.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.734+0000 7f77c97bf700 1 -- 172.21.15.125:0/2948995060 wait complete. 2023-10-06T03:05:09.747 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:05:09.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.871+0000 7f98258f8700 1 Processor -- start 2023-10-06T03:05:09.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.872+0000 7f98258f8700 1 -- start start 2023-10-06T03:05:09.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.872+0000 7f98258f8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9820159050 0x7f98200b1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:09.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.872+0000 7f98258f8700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9820068a30 0x7f982015d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:09.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.872+0000 7f98258f8700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98200b0cb0 con 0x7f982006c8f0 2023-10-06T03:05:09.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.872+0000 7f98258f8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98200b1680 con 0x7f9820159050 2023-10-06T03:05:09.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.872+0000 7f98258f8700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982015ddb0 con 0x7f9820068a30 2023-10-06T03:05:09.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.873+0000 7f981effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9820159050 0x7f98200b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:09.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.873+0000 7f981effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9820159050 0x7f98200b1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39502/0 (socket says 172.21.15.125:39502) 2023-10-06T03:05:09.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.873+0000 7f981effd700 1 -- 172.21.15.125:0/2639524701 learned_addr learned my addr 172.21.15.125:0/2639524701 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:09.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.873+0000 7f981e7fc700 1 --2- 172.21.15.125:0/2639524701 >> v2:172.21.15.130:3300/0 conn(0x7f9820068a30 0x7f982015d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:09.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.873+0000 7f981effd700 1 -- 172.21.15.125:0/2639524701 >> v2:172.21.15.130:3300/0 conn(0x7f9820068a30 msgr2=0x7f982015d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:09.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.873+0000 7f981effd700 1 --2- 172.21.15.125:0/2639524701 >> v2:172.21.15.130:3300/0 conn(0x7f9820068a30 0x7f982015d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.873+0000 7f981effd700 1 -- 172.21.15.125:0/2639524701 >> v1:172.21.15.130:6789/0 conn(0x7f982006c8f0 legacy=0x7f982006cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:09.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.873+0000 7f981effd700 1 -- 172.21.15.125:0/2639524701 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98200b00a0 con 0x7f9820159050 2023-10-06T03:05:09.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.873+0000 7f981effd700 1 --2- 172.21.15.125:0/2639524701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9820159050 0x7f98200b1140 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f982006c230 tx=0x7f9814009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b788596fd330f3d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:09.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.873+0000 7f981dffb700 1 -- 172.21.15.125:0/2639524701 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814009e70 con 0x7f9820159050 2023-10-06T03:05:09.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.873+0000 7f981dffb700 1 -- 172.21.15.125:0/2639524701 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981400b860 con 0x7f9820159050 2023-10-06T03:05:09.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.873+0000 7f981dffb700 1 -- 172.21.15.125:0/2639524701 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981400bc00 con 0x7f9820159050 2023-10-06T03:05:09.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.874+0000 7f98258f8700 1 -- 172.21.15.125:0/2639524701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9820159050 msgr2=0x7f98200b1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:09.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.874+0000 7f98258f8700 1 --2- 172.21.15.125:0/2639524701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9820159050 0x7f98200b1140 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f982006c230 tx=0x7f9814009250 comp rx=0 tx=0).stop 2023-10-06T03:05:09.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.874+0000 7f98258f8700 1 -- 172.21.15.125:0/2639524701 shutdown_connections 2023-10-06T03:05:09.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.874+0000 7f98258f8700 1 --2- 172.21.15.125:0/2639524701 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9820159050 0x7f98200b1140 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.874+0000 7f98258f8700 1 --2- 172.21.15.125:0/2639524701 >> v2:172.21.15.130:3300/0 conn(0x7f9820068a30 0x7f982015d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.874+0000 7f98258f8700 1 -- 172.21.15.125:0/2639524701 >> 172.21.15.125:0/2639524701 conn(0x7f982006b170 msgr2=0x7f982006b570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:09.877 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.874+0000 7f98258f8700 1 -- 172.21.15.125:0/2639524701 shutdown_connections 2023-10-06T03:05:09.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.874+0000 7f98258f8700 1 -- 172.21.15.125:0/2639524701 wait complete. 2023-10-06T03:05:09.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.875+0000 7f98258f8700 1 Processor -- start 2023-10-06T03:05:09.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.875+0000 7f98258f8700 1 -- start start 2023-10-06T03:05:09.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f98258f8700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9820068a30 0x7f98200ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:09.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f98258f8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f982006c8f0 0x7f982015cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:09.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f98258f8700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9820159050 0x7f98200adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:09.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f98258f8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982015c760 con 0x7f982006c8f0 2023-10-06T03:05:09.880 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f98258f8700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982015bb50 con 0x7f9820068a30 2023-10-06T03:05:09.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f98258f8700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982015be30 con 0x7f9820159050 2023-10-06T03:05:09.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f981e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f982006c8f0 0x7f982015cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:09.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f981e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f982006c8f0 0x7f982015cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39508/0 (socket says 172.21.15.125:39508) 2023-10-06T03:05:09.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f981e7fc700 1 -- 172.21.15.125:0/254331765 learned_addr learned my addr 172.21.15.125:0/254331765 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:09.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f981effd700 1 --2- 172.21.15.125:0/254331765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9820068a30 0x7f98200ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:09.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f981e7fc700 1 -- 172.21.15.125:0/254331765 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9820159050 msgr2=0x7f98200adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:09.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f981e7fc700 1 --2- 172.21.15.125:0/254331765 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9820159050 0x7f98200adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f981e7fc700 1 -- 172.21.15.125:0/254331765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9820068a30 msgr2=0x7f98200ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:09.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f981e7fc700 1 --2- 172.21.15.125:0/254331765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9820068a30 0x7f98200ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:09.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f981e7fc700 1 -- 172.21.15.125:0/254331765 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98140094f0 con 0x7f982006c8f0 2023-10-06T03:05:09.881 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f981e7fc700 1 --2- 172.21.15.125:0/254331765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f982006c8f0 0x7f982015cbf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f981000ec80 tx=0x7f98100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:09.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f9806ffd700 1 -- 172.21.15.125:0/254331765 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981000c9d0 con 0x7f982006c8f0 2023-10-06T03:05:09.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f9806ffd700 1 -- 172.21.15.125:0/254331765 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981000cb30 con 0x7f982006c8f0 2023-10-06T03:05:09.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f9806ffd700 1 -- 172.21.15.125:0/254331765 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9810013470 con 0x7f982006c8f0 2023-10-06T03:05:09.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.876+0000 7f98258f8700 1 -- 172.21.15.125:0/254331765 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f982015c110 con 0x7f982006c8f0 2023-10-06T03:05:09.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.877+0000 7f98258f8700 1 -- 172.21.15.125:0/254331765 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f982014c290 con 0x7f982006c8f0 2023-10-06T03:05:09.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.877+0000 7f98258f8700 1 -- 172.21.15.125:0/254331765 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982015c8d0 con 0x7f982006c8f0 2023-10-06T03:05:09.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.878+0000 7f9806ffd700 1 -- 172.21.15.125:0/254331765 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9810013820 con 0x7f982006c8f0 2023-10-06T03:05:09.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.878+0000 7f9806ffd700 1 --2- 172.21.15.125:0/254331765 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f980c066f30 0x7f980c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:09.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.878+0000 7f981effd700 1 --2- 172.21.15.125:0/254331765 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f980c066f30 0x7f980c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:09.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.878+0000 7f9806ffd700 1 -- 172.21.15.125:0/254331765 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f9810084d10 con 0x7f982006c8f0 2023-10-06T03:05:09.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.879+0000 7f981effd700 1 --2- 172.21.15.125:0/254331765 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f980c066f30 0x7f980c0693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f982006c230 tx=0x7f9814017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:09.885 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:09.883+0000 7f9806ffd700 1 -- 172.21.15.125:0/254331765 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9810051b30 con 0x7f982006c8f0 2023-10-06T03:05:10.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.062+0000 7f98258f8700 1 -- 172.21.15.125:0/254331765 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9820066510 con 0x7f982006c8f0 2023-10-06T03:05:10.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.063+0000 7f9806ffd700 1 -- 172.21.15.125:0/254331765 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9810055150 con 0x7f982006c8f0 2023-10-06T03:05:10.064 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-06T03:05:10.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.064+0000 7f98258f8700 1 -- 172.21.15.125:0/254331765 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f980c066f30 msgr2=0x7f980c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:10.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.064+0000 7f98258f8700 1 --2- 172.21.15.125:0/254331765 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f980c066f30 0x7f980c0693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f982006c230 tx=0x7f9814017000 comp rx=0 tx=0).stop 2023-10-06T03:05:10.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.064+0000 7f98258f8700 1 -- 172.21.15.125:0/254331765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f982006c8f0 msgr2=0x7f982015cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:10.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.064+0000 7f98258f8700 1 --2- 172.21.15.125:0/254331765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f982006c8f0 0x7f982015cbf0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f981000ec80 tx=0x7f98100091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.064+0000 7f98258f8700 1 -- 172.21.15.125:0/254331765 shutdown_connections 2023-10-06T03:05:10.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.064+0000 7f98258f8700 1 --2- 172.21.15.125:0/254331765 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f980c066f30 0x7f980c0693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.064+0000 7f98258f8700 1 --2- 172.21.15.125:0/254331765 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9820159050 0x7f98200adbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.064+0000 7f98258f8700 1 --2- 172.21.15.125:0/254331765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9820068a30 0x7f98200ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.064+0000 7f98258f8700 1 --2- 172.21.15.125:0/254331765 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f982006c8f0 0x7f982015cbf0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.064+0000 7f98258f8700 1 -- 172.21.15.125:0/254331765 >> 172.21.15.125:0/254331765 conn(0x7f982006b170 msgr2=0x7f98201582e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:10.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.064+0000 7f98258f8700 1 -- 172.21.15.125:0/254331765 shutdown_connections 2023-10-06T03:05:10.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.065+0000 7f98258f8700 1 -- 172.21.15.125:0/254331765 wait complete. 2023-10-06T03:05:10.078 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:05:10.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.194+0000 7f4e5d0f0700 1 Processor -- start 2023-10-06T03:05:10.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.194+0000 7f4e5d0f0700 1 -- start start 2023-10-06T03:05:10.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.195+0000 7f4e5d0f0700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4e581590d0 0x7f4e5806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.195+0000 7f4e5d0f0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e581594a0 0x7f4e5806ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.195+0000 7f4e5d0f0700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e58067c70 con 0x7f4e580ac670 2023-10-06T03:05:10.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.195+0000 7f4e5d0f0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e58069110 con 0x7f4e581594a0 2023-10-06T03:05:10.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.195+0000 7f4e5d0f0700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e580c77e0 con 0x7f4e581590d0 2023-10-06T03:05:10.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.195+0000 7f4e5759e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e581594a0 0x7f4e5806ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.195+0000 7f4e5759e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e581594a0 0x7f4e5806ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39516/0 (socket says 172.21.15.125:39516) 2023-10-06T03:05:10.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.195+0000 7f4e5759e700 1 -- 172.21.15.125:0/4057249524 learned_addr learned my addr 172.21.15.125:0/4057249524 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:10.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.195+0000 7f4e5759e700 1 -- 172.21.15.125:0/4057249524 >> v2:172.21.15.130:3300/0 conn(0x7f4e581590d0 msgr2=0x7f4e5806a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:10.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.195+0000 7f4e56d9d700 1 --2- 172.21.15.125:0/4057249524 >> v2:172.21.15.130:3300/0 conn(0x7f4e581590d0 0x7f4e5806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.196+0000 7f4e5759e700 1 --2- 172.21.15.125:0/4057249524 >> v2:172.21.15.130:3300/0 conn(0x7f4e581590d0 0x7f4e5806a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.196+0000 7f4e5759e700 1 -- 172.21.15.125:0/4057249524 >> v1:172.21.15.130:6789/0 conn(0x7f4e580ac670 legacy=0x7f4e580c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:10.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.196+0000 7f4e5759e700 1 -- 172.21.15.125:0/4057249524 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e580c7ac0 con 0x7f4e581594a0 2023-10-06T03:05:10.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.196+0000 7f4e56d9d700 1 --2- 172.21.15.125:0/4057249524 >> v2:172.21.15.130:3300/0 conn(0x7f4e581590d0 0x7f4e5806a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:10.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.196+0000 7f4e5759e700 1 --2- 172.21.15.125:0/4057249524 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e581594a0 0x7f4e5806ae00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4e5806b7a0 tx=0x7f4e50009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6335754008755282 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:10.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.196+0000 7f4e55d9b700 1 -- 172.21.15.125:0/4057249524 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5000e070 con 0x7f4e581594a0 2023-10-06T03:05:10.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.196+0000 7f4e55d9b700 1 -- 172.21.15.125:0/4057249524 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5000ba10 con 0x7f4e581594a0 2023-10-06T03:05:10.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.196+0000 7f4e55d9b700 1 -- 172.21.15.125:0/4057249524 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e500092e0 con 0x7f4e581594a0 2023-10-06T03:05:10.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.196+0000 7f4e5d0f0700 1 -- 172.21.15.125:0/4057249524 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e581594a0 msgr2=0x7f4e5806ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:10.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.196+0000 7f4e5d0f0700 1 --2- 172.21.15.125:0/4057249524 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e581594a0 0x7f4e5806ae00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4e5806b7a0 tx=0x7f4e50009840 comp rx=0 tx=0).stop 2023-10-06T03:05:10.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.196+0000 7f4e5d0f0700 1 -- 172.21.15.125:0/4057249524 shutdown_connections 2023-10-06T03:05:10.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.196+0000 7f4e5d0f0700 1 --2- 172.21.15.125:0/4057249524 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e581594a0 0x7f4e5806ae00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.196+0000 7f4e5d0f0700 1 --2- 172.21.15.125:0/4057249524 >> v2:172.21.15.130:3300/0 conn(0x7f4e581590d0 0x7f4e5806a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.196+0000 7f4e5d0f0700 1 -- 172.21.15.125:0/4057249524 >> 172.21.15.125:0/4057249524 conn(0x7f4e580cc5a0 msgr2=0x7f4e580cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:10.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.196+0000 7f4e5d0f0700 1 -- 172.21.15.125:0/4057249524 shutdown_connections 2023-10-06T03:05:10.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.196+0000 7f4e5d0f0700 1 -- 172.21.15.125:0/4057249524 wait complete. 2023-10-06T03:05:10.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.198+0000 7f4e5d0f0700 1 Processor -- start 2023-10-06T03:05:10.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.198+0000 7f4e5d0f0700 1 -- start start 2023-10-06T03:05:10.203 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.198+0000 7f4e5d0f0700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e580ac670 0x7f4e5815c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.198+0000 7f4e5d0f0700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e581590d0 0x7f4e5815a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.198+0000 7f4e5d0f0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e581594a0 0x7f4e581692d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.198+0000 7f4e5d0f0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e580a9ef0 con 0x7f4e581594a0 2023-10-06T03:05:10.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.198+0000 7f4e5d0f0700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5815aad0 con 0x7f4e580ac670 2023-10-06T03:05:10.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.198+0000 7f4e5d0f0700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5815adb0 con 0x7f4e581590d0 2023-10-06T03:05:10.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.199+0000 7f4e5759e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e581594a0 0x7f4e581692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.199+0000 7f4e5759e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e581594a0 0x7f4e581692d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39524/0 (socket says 172.21.15.125:39524) 2023-10-06T03:05:10.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.199+0000 7f4e5759e700 1 -- 172.21.15.125:0/3308948526 learned_addr learned my addr 172.21.15.125:0/3308948526 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:10.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.199+0000 7f4e56d9d700 1 --2- 172.21.15.125:0/3308948526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e580ac670 0x7f4e5815c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.199+0000 7f4e5659c700 1 --2- 172.21.15.125:0/3308948526 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e581590d0 0x7f4e5815a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.199+0000 7f4e5759e700 1 -- 172.21.15.125:0/3308948526 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e581590d0 msgr2=0x7f4e5815a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:10.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.199+0000 7f4e5759e700 1 --2- 172.21.15.125:0/3308948526 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e581590d0 0x7f4e5815a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.199+0000 7f4e5759e700 1 -- 172.21.15.125:0/3308948526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e580ac670 msgr2=0x7f4e5815c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:10.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.199+0000 7f4e5759e700 1 --2- 172.21.15.125:0/3308948526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e580ac670 0x7f4e5815c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.199+0000 7f4e5759e700 1 -- 172.21.15.125:0/3308948526 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e50009ae0 con 0x7f4e581594a0 2023-10-06T03:05:10.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.199+0000 7f4e5759e700 1 --2- 172.21.15.125:0/3308948526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e581594a0 0x7f4e581692d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009fd0 tx=0x7f4e50017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:10.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.199+0000 7f4e4effd700 1 -- 172.21.15.125:0/3308948526 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5000bee0 con 0x7f4e581594a0 2023-10-06T03:05:10.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.199+0000 7f4e4effd700 1 -- 172.21.15.125:0/3308948526 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e500032f0 con 0x7f4e581594a0 2023-10-06T03:05:10.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.199+0000 7f4e5d0f0700 1 -- 172.21.15.125:0/3308948526 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5815b090 con 0x7f4e581594a0 2023-10-06T03:05:10.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.199+0000 7f4e4effd700 1 -- 172.21.15.125:0/3308948526 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5001d420 con 0x7f4e581594a0 2023-10-06T03:05:10.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.199+0000 7f4e5d0f0700 1 -- 172.21.15.125:0/3308948526 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5815a7a0 con 0x7f4e581594a0 2023-10-06T03:05:10.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.200+0000 7f4e5d0f0700 1 -- 172.21.15.125:0/3308948526 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e580aa0a0 con 0x7f4e581594a0 2023-10-06T03:05:10.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.201+0000 7f4e4effd700 1 -- 172.21.15.125:0/3308948526 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e5001d810 con 0x7f4e581594a0 2023-10-06T03:05:10.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.201+0000 7f4e4effd700 1 --2- 172.21.15.125:0/3308948526 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4e38066f30 0x7f4e380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.201+0000 7f4e4effd700 1 -- 172.21.15.125:0/3308948526 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4e50086450 con 0x7f4e581594a0 2023-10-06T03:05:10.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.201+0000 7f4e56d9d700 1 --2- 172.21.15.125:0/3308948526 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4e38066f30 0x7f4e380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.202+0000 7f4e56d9d700 1 --2- 172.21.15.125:0/3308948526 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4e38066f30 0x7f4e380693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800adc0 tx=0x7f4e48006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:10.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.205+0000 7f4e4effd700 1 -- 172.21.15.125:0/3308948526 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e500532f0 con 0x7f4e581594a0 2023-10-06T03:05:10.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.390+0000 7f4e5d0f0700 1 -- 172.21.15.125:0/3308948526 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e58066510 con 0x7f4e581594a0 2023-10-06T03:05:10.393 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.391+0000 7f4e4effd700 1 -- 172.21.15.125:0/3308948526 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18947 (secure 0 0 0) 0x7f4e50056910 con 0x7f4e581594a0 2023-10-06T03:05:10.393 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:10.393 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":28,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:05:10.379746+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:04:26.828121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:04:28.179225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:04:31.256394+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:05:10.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.394+0000 7f4e5d0f0700 1 -- 172.21.15.125:0/3308948526 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4e38066f30 msgr2=0x7f4e380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:10.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.394+0000 7f4e5d0f0700 1 --2- 172.21.15.125:0/3308948526 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4e38066f30 0x7f4e380693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800adc0 tx=0x7f4e48006f90 comp rx=0 tx=0).stop 2023-10-06T03:05:10.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.394+0000 7f4e5d0f0700 1 -- 172.21.15.125:0/3308948526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e581594a0 msgr2=0x7f4e581692d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:10.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.394+0000 7f4e5d0f0700 1 --2- 172.21.15.125:0/3308948526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e581594a0 0x7f4e581692d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009fd0 tx=0x7f4e50017000 comp rx=0 tx=0).stop 2023-10-06T03:05:10.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.394+0000 7f4e5d0f0700 1 -- 172.21.15.125:0/3308948526 shutdown_connections 2023-10-06T03:05:10.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.394+0000 7f4e5d0f0700 1 --2- 172.21.15.125:0/3308948526 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4e38066f30 0x7f4e380693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.394+0000 7f4e5d0f0700 1 --2- 172.21.15.125:0/3308948526 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e581594a0 0x7f4e581692d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.394+0000 7f4e5d0f0700 1 --2- 172.21.15.125:0/3308948526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e580ac670 0x7f4e5815c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.394+0000 7f4e5d0f0700 1 --2- 172.21.15.125:0/3308948526 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e581590d0 0x7f4e5815a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.394+0000 7f4e5d0f0700 1 -- 172.21.15.125:0/3308948526 >> 172.21.15.125:0/3308948526 conn(0x7f4e580cc5a0 msgr2=0x7f4e580cc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:10.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.394+0000 7f4e5d0f0700 1 -- 172.21.15.125:0/3308948526 shutdown_connections 2023-10-06T03:05:10.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.394+0000 7f4e5d0f0700 1 -- 172.21.15.125:0/3308948526 wait complete. 2023-10-06T03:05:10.408 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:04:15.845430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:04:22.729795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:04:26.828121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:04:28.179225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:04:31.256394+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:05:10.408 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:05:10.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.527+0000 7ff4983fc700 1 Processor -- start 2023-10-06T03:05:10.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.527+0000 7ff4983fc700 1 -- start start 2023-10-06T03:05:10.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.528+0000 7ff4983fc700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff4900af320 0x7ff4900caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.528+0000 7ff4983fc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4900cafe0 con 0x7ff490067d20 2023-10-06T03:05:10.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.528+0000 7ff4983fc700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4900c3b40 con 0x7ff4900ca190 2023-10-06T03:05:10.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.528+0000 7ff4983fc700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4900ca710 con 0x7ff4900af320 2023-10-06T03:05:10.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.528+0000 7ff496999700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff490067d20 0x7ff4900c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43846/0 (socket says 172.21.15.125:43846) 2023-10-06T03:05:10.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.528+0000 7ff496999700 1 -- 172.21.15.125:0/1117583648 learned_addr learned my addr 172.21.15.125:0/1117583648 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:10.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.528+0000 7ff495196700 1 -- 172.21.15.125:0/1117583648 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747443960 0 0) 0x7ff488001490 con 0x7ff490067d20 2023-10-06T03:05:10.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.528+0000 7ff495196700 1 -- 172.21.15.125:0/1117583648 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff47c003570 con 0x7ff490067d20 2023-10-06T03:05:10.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.528+0000 7ff496198700 1 --2- 172.21.15.125:0/1117583648 >> v2:172.21.15.130:3300/0 conn(0x7ff4900af320 0x7ff4900caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.528+0000 7ff495196700 1 -- 172.21.15.125:0/1117583648 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 330401887 0 0) 0x7ff47c003570 con 0x7ff490067d20 2023-10-06T03:05:10.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.528+0000 7ff495196700 1 -- 172.21.15.125:0/1117583648 >> v2:172.21.15.130:3300/0 conn(0x7ff4900af320 msgr2=0x7ff4900caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:10.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.528+0000 7ff495196700 1 --2- 172.21.15.125:0/1117583648 >> v2:172.21.15.130:3300/0 conn(0x7ff4900af320 0x7ff4900caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.528+0000 7ff495196700 1 -- 172.21.15.125:0/1117583648 >> v1:172.21.15.130:6789/0 conn(0x7ff4900ca190 legacy=0x7ff490067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:10.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.528+0000 7ff495196700 1 -- 172.21.15.125:0/1117583648 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4900cc750 con 0x7ff490067d20 2023-10-06T03:05:10.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.528+0000 7ff495196700 1 -- 172.21.15.125:0/1117583648 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7ff488001980 con 0x7ff490067d20 2023-10-06T03:05:10.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.528+0000 7ff495196700 1 -- 172.21.15.125:0/1117583648 >> v1:172.21.15.125:6789/0 conn(0x7ff490067d20 legacy=0x7ff4900c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:10.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.528+0000 7ff495196700 1 --2- 172.21.15.125:0/1117583648 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff47c003a60 0x7ff47c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.528+0000 7ff495196700 1 --2- 172.21.15.125:0/1117583648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff47c004810 0x7ff47c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.529+0000 7ff495196700 1 --2- 172.21.15.125:0/1117583648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff47c0053c0 0x7ff47c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.529+0000 7ff495196700 1 -- 172.21.15.125:0/1117583648 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4900ca710 con 0x7ff47c0053c0 2023-10-06T03:05:10.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.529+0000 7ff495196700 1 -- 172.21.15.125:0/1117583648 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c00c2d0 con 0x7ff47c004810 2023-10-06T03:05:10.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.529+0000 7ff495196700 1 -- 172.21.15.125:0/1117583648 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c00c490 con 0x7ff47c003a60 2023-10-06T03:05:10.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.529+0000 7ff496999700 1 --2- 172.21.15.125:0/1117583648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff47c0053c0 0x7ff47c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.529+0000 7ff496198700 1 --2- 172.21.15.125:0/1117583648 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff47c003a60 0x7ff47c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.529+0000 7ff495997700 1 --2- 172.21.15.125:0/1117583648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff47c004810 0x7ff47c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.529+0000 7ff496999700 1 -- 172.21.15.125:0/1117583648 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff47c003a60 msgr2=0x7ff47c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:10.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.529+0000 7ff496999700 1 --2- 172.21.15.125:0/1117583648 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff47c003a60 0x7ff47c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.529+0000 7ff496999700 1 -- 172.21.15.125:0/1117583648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff47c004810 msgr2=0x7ff47c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:10.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.529+0000 7ff496999700 1 --2- 172.21.15.125:0/1117583648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff47c004810 0x7ff47c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.529+0000 7ff496999700 1 -- 172.21.15.125:0/1117583648 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c003570 con 0x7ff47c0053c0 2023-10-06T03:05:10.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.529+0000 7ff496999700 1 -- 172.21.15.125:0/1117583648 reap_dead start 2023-10-06T03:05:10.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.529+0000 7ff496999700 1 --2- 172.21.15.125:0/1117583648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff47c0053c0 0x7ff47c00ba60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff4900c96a0 tx=0x7ff48800a170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2000ebc338e9937e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:10.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.529+0000 7ff495196700 1 -- 172.21.15.125:0/1117583648 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48800c5a0 con 0x7ff47c0053c0 2023-10-06T03:05:10.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.529+0000 7ff495196700 1 -- 172.21.15.125:0/1117583648 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48800c720 con 0x7ff47c0053c0 2023-10-06T03:05:10.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.529+0000 7ff495196700 1 -- 172.21.15.125:0/1117583648 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48800cae0 con 0x7ff47c0053c0 2023-10-06T03:05:10.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.530+0000 7ff4983fc700 1 -- 172.21.15.125:0/1117583648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff47c0053c0 msgr2=0x7ff47c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:10.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.530+0000 7ff4983fc700 1 --2- 172.21.15.125:0/1117583648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff47c0053c0 0x7ff47c00ba60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff4900c96a0 tx=0x7ff48800a170 comp rx=0 tx=0).stop 2023-10-06T03:05:10.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.530+0000 7ff4983fc700 1 -- 172.21.15.125:0/1117583648 shutdown_connections 2023-10-06T03:05:10.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.530+0000 7ff4983fc700 1 --2- 172.21.15.125:0/1117583648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff47c0053c0 0x7ff47c00ba60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.530+0000 7ff4983fc700 1 -- 172.21.15.125:0/1117583648 >> 172.21.15.125:0/1117583648 conn(0x7ff490096120 msgr2=0x7ff490068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:10.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.530+0000 7ff4983fc700 1 -- 172.21.15.125:0/1117583648 shutdown_connections 2023-10-06T03:05:10.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.530+0000 7ff4983fc700 1 -- 172.21.15.125:0/1117583648 wait complete. 2023-10-06T03:05:10.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.531+0000 7ff4983fc700 1 Processor -- start 2023-10-06T03:05:10.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.531+0000 7ff4983fc700 1 -- start start 2023-10-06T03:05:10.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.532+0000 7ff4983fc700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff47c0053c0 0x7ff49015bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.532+0000 7ff4983fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff49015d230 0x7ff490158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.532+0000 7ff4983fc700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff49015a880 0x7ff490169900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.532+0000 7ff4983fc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49015cda0 con 0x7ff49015d230 2023-10-06T03:05:10.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.532+0000 7ff4983fc700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49015c190 con 0x7ff49015a880 2023-10-06T03:05:10.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.532+0000 7ff4983fc700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49015c470 con 0x7ff47c0053c0 2023-10-06T03:05:10.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.532+0000 7ff495997700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff49015d230 0x7ff490158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.532+0000 7ff495997700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff49015d230 0x7ff490158c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39534/0 (socket says 172.21.15.125:39534) 2023-10-06T03:05:10.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.532+0000 7ff495997700 1 -- 172.21.15.125:0/2994240285 learned_addr learned my addr 172.21.15.125:0/2994240285 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:10.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.532+0000 7ff496198700 1 --2- 172.21.15.125:0/2994240285 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff47c0053c0 0x7ff49015bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.532+0000 7ff496999700 1 --2- 172.21.15.125:0/2994240285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff49015a880 0x7ff490169900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.533+0000 7ff495997700 1 -- 172.21.15.125:0/2994240285 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff47c0053c0 msgr2=0x7ff49015bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:10.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.533+0000 7ff495997700 1 --2- 172.21.15.125:0/2994240285 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff47c0053c0 0x7ff49015bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.533+0000 7ff495997700 1 -- 172.21.15.125:0/2994240285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff49015a880 msgr2=0x7ff490169900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:10.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.533+0000 7ff495997700 1 --2- 172.21.15.125:0/2994240285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff49015a880 0x7ff490169900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.533+0000 7ff495997700 1 -- 172.21.15.125:0/2994240285 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49015c750 con 0x7ff49015d230 2023-10-06T03:05:10.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.533+0000 7ff496198700 1 --2- 172.21.15.125:0/2994240285 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff47c0053c0 0x7ff49015bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:10.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.533+0000 7ff496999700 1 --2- 172.21.15.125:0/2994240285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff49015a880 0x7ff490169900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:10.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.533+0000 7ff495997700 1 --2- 172.21.15.125:0/2994240285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff49015d230 0x7ff490158c50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff480002950 tx=0x7ff480007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:10.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.533+0000 7ff4867fc700 1 -- 172.21.15.125:0/2994240285 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff480002e90 con 0x7ff49015d230 2023-10-06T03:05:10.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.533+0000 7ff4867fc700 1 -- 172.21.15.125:0/2994240285 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48000f8d0 con 0x7ff49015d230 2023-10-06T03:05:10.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.533+0000 7ff4983fc700 1 -- 172.21.15.125:0/2994240285 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49015ca30 con 0x7ff49015d230 2023-10-06T03:05:10.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.533+0000 7ff4867fc700 1 -- 172.21.15.125:0/2994240285 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48000fc70 con 0x7ff49015d230 2023-10-06T03:05:10.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.533+0000 7ff4983fc700 1 -- 172.21.15.125:0/2994240285 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff490169e40 con 0x7ff49015d230 2023-10-06T03:05:10.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.534+0000 7ff4983fc700 1 -- 172.21.15.125:0/2994240285 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49015cf50 con 0x7ff49015d230 2023-10-06T03:05:10.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.534+0000 7ff4867fc700 1 -- 172.21.15.125:0/2994240285 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff48001c400 con 0x7ff49015d230 2023-10-06T03:05:10.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.535+0000 7ff4867fc700 1 --2- 172.21.15.125:0/2994240285 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff474066f30 0x7ff4740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.535+0000 7ff4867fc700 1 -- 172.21.15.125:0/2994240285 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6867+0+0 (secure 0 0 0) 0x7ff480084e90 con 0x7ff49015d230 2023-10-06T03:05:10.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.535+0000 7ff496198700 1 --2- 172.21.15.125:0/2994240285 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff474066f30 0x7ff4740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.535+0000 7ff496198700 1 --2- 172.21.15.125:0/2994240285 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff474066f30 0x7ff4740693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00b2b0 tx=0x7ff48c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:10.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.539+0000 7ff4867fc700 1 -- 172.21.15.125:0/2994240285 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff49015cf50 con 0x7ff49015d230 2023-10-06T03:05:10.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.723+0000 7ff4983fc700 1 -- 172.21.15.125:0/2994240285 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff490066510 con 0x7ff49015d230 2023-10-06T03:05:10.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.724+0000 7ff4867fc700 1 -- 172.21.15.125:0/2994240285 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff480051d20 con 0x7ff49015d230 2023-10-06T03:05:10.725 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-06T03:05:10.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.726+0000 7ff4983fc700 1 -- 172.21.15.125:0/2994240285 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff474066f30 msgr2=0x7ff4740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:10.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.726+0000 7ff4983fc700 1 --2- 172.21.15.125:0/2994240285 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff474066f30 0x7ff4740693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00b2b0 tx=0x7ff48c008040 comp rx=0 tx=0).stop 2023-10-06T03:05:10.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.726+0000 7ff4983fc700 1 -- 172.21.15.125:0/2994240285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff49015d230 msgr2=0x7ff490158c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:10.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.726+0000 7ff4983fc700 1 --2- 172.21.15.125:0/2994240285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff49015d230 0x7ff490158c50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff480002950 tx=0x7ff480007d30 comp rx=0 tx=0).stop 2023-10-06T03:05:10.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.726+0000 7ff4983fc700 1 -- 172.21.15.125:0/2994240285 shutdown_connections 2023-10-06T03:05:10.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.726+0000 7ff4983fc700 1 --2- 172.21.15.125:0/2994240285 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff474066f30 0x7ff4740693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.726+0000 7ff4983fc700 1 --2- 172.21.15.125:0/2994240285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff49015a880 0x7ff490169900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.726+0000 7ff4983fc700 1 --2- 172.21.15.125:0/2994240285 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff47c0053c0 0x7ff49015bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.726+0000 7ff4983fc700 1 --2- 172.21.15.125:0/2994240285 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff49015d230 0x7ff490158c50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.726+0000 7ff4983fc700 1 -- 172.21.15.125:0/2994240285 >> 172.21.15.125:0/2994240285 conn(0x7ff490096120 msgr2=0x7ff490067610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:10.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.726+0000 7ff4983fc700 1 -- 172.21.15.125:0/2994240285 shutdown_connections 2023-10-06T03:05:10.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.726+0000 7ff4983fc700 1 -- 172.21.15.125:0/2994240285 wait complete. 2023-10-06T03:05:10.739 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:05:10.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.859+0000 7fc7fff92700 1 Processor -- start 2023-10-06T03:05:10.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.860+0000 7fc7fff92700 1 -- start start 2023-10-06T03:05:10.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.860+0000 7fc7fff92700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc7f8156de0 0x7fc7f81571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.860+0000 7fc7fff92700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7f80cd790 0x7fc7f80ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.860+0000 7fc7fff92700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f80cd300 con 0x7fc7f80cc060 2023-10-06T03:05:10.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.860+0000 7fc7fff92700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f80cc4e0 con 0x7fc7f8156de0 2023-10-06T03:05:10.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.860+0000 7fc7fff92700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80cc6f0 con 0x7fc7f80cd790 2023-10-06T03:05:10.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.861+0000 7fc7fdd2e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc7f8156de0 0x7fc7f81571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.861+0000 7fc7fd52d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc7f80cc060 0x7fc7f815b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43848/0 (socket says 172.21.15.125:43848) 2023-10-06T03:05:10.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.861+0000 7fc7fd52d700 1 -- 172.21.15.125:0/411340548 learned_addr learned my addr 172.21.15.125:0/411340548 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:10.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.861+0000 7fc7fe52f700 1 --2- 172.21.15.125:0/411340548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7f80cd790 0x7fc7f80ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.861+0000 7fc7fdd2e700 1 -- 172.21.15.125:0/411340548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7f80cd790 msgr2=0x7fc7f80ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:10.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.861+0000 7fc7fdd2e700 1 --2- 172.21.15.125:0/411340548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7f80cd790 0x7fc7f80ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.861+0000 7fc7fdd2e700 1 -- 172.21.15.125:0/411340548 >> v1:172.21.15.125:6789/0 conn(0x7fc7f80cc060 legacy=0x7fc7f815b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:10.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.861+0000 7fc7fdd2e700 1 -- 172.21.15.125:0/411340548 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f80cc9d0 con 0x7fc7f8156de0 2023-10-06T03:05:10.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.861+0000 7fc7fcd2c700 1 -- 172.21.15.125:0/411340548 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953606608 0 0) 0x7fc7f80cd300 con 0x7fc7f80cc060 2023-10-06T03:05:10.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.861+0000 7fc7fdd2e700 1 --2- 172.21.15.125:0/411340548 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7f8156de0 0x7fc7f81571b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80098e0 tx=0x7fc7e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc147fb01b47acc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:10.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.861+0000 7fc7fcd2c700 1 -- 172.21.15.125:0/411340548 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e800b640 con 0x7fc7f8156de0 2023-10-06T03:05:10.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.861+0000 7fc7fcd2c700 1 -- 172.21.15.125:0/411340548 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e800b7a0 con 0x7fc7f8156de0 2023-10-06T03:05:10.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.861+0000 7fc7fcd2c700 1 -- 172.21.15.125:0/411340548 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e800bb40 con 0x7fc7f8156de0 2023-10-06T03:05:10.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.862+0000 7fc7fff92700 1 -- 172.21.15.125:0/411340548 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7f8156de0 msgr2=0x7fc7f81571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:10.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.862+0000 7fc7fff92700 1 --2- 172.21.15.125:0/411340548 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7f8156de0 0x7fc7f81571b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80098e0 tx=0x7fc7e80091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.862+0000 7fc7fff92700 1 -- 172.21.15.125:0/411340548 shutdown_connections 2023-10-06T03:05:10.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.862+0000 7fc7fff92700 1 --2- 172.21.15.125:0/411340548 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7f80cd790 0x7fc7f80ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.862+0000 7fc7fff92700 1 --2- 172.21.15.125:0/411340548 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7f8156de0 0x7fc7f81571b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.862+0000 7fc7fff92700 1 -- 172.21.15.125:0/411340548 >> 172.21.15.125:0/411340548 conn(0x7fc7f80cdf80 msgr2=0x7fc7f80ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:10.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.862+0000 7fc7fff92700 1 -- 172.21.15.125:0/411340548 shutdown_connections 2023-10-06T03:05:10.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.862+0000 7fc7fff92700 1 -- 172.21.15.125:0/411340548 wait complete. 2023-10-06T03:05:10.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.863+0000 7fc7fff92700 1 Processor -- start 2023-10-06T03:05:10.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.863+0000 7fc7fff92700 1 -- start start 2023-10-06T03:05:10.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7fff92700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7f80cc060 0x7fc7f80c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7fff92700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7f80cd790 0x7fc7f8157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7fff92700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7f8156de0 0x7fc7f8157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7fff92700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f814d880 con 0x7fc7f80cd790 2023-10-06T03:05:10.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7fff92700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80c6580 con 0x7fc7f8156de0 2023-10-06T03:05:10.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7fff92700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80c6860 con 0x7fc7f80cc060 2023-10-06T03:05:10.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7fd52d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7f80cd790 0x7fc7f8157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7fd52d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7f80cd790 0x7fc7f8157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39552/0 (socket says 172.21.15.125:39552) 2023-10-06T03:05:10.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7fd52d700 1 -- 172.21.15.125:0/2007524562 learned_addr learned my addr 172.21.15.125:0/2007524562 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:10.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7fdd2e700 1 --2- 172.21.15.125:0/2007524562 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7f80cc060 0x7fc7f80c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7fe52f700 1 --2- 172.21.15.125:0/2007524562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7f8156de0 0x7fc7f8157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7fd52d700 1 -- 172.21.15.125:0/2007524562 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7f80cc060 msgr2=0x7fc7f80c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:10.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7fd52d700 1 --2- 172.21.15.125:0/2007524562 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7f80cc060 0x7fc7f80c7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7fd52d700 1 -- 172.21.15.125:0/2007524562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7f8156de0 msgr2=0x7fc7f8157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:10.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7fd52d700 1 --2- 172.21.15.125:0/2007524562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7f8156de0 0x7fc7f8157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:10.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7fd52d700 1 -- 172.21.15.125:0/2007524562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e8009420 con 0x7fc7f80cd790 2023-10-06T03:05:10.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7fd52d700 1 --2- 172.21.15.125:0/2007524562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7f80cd790 0x7fc7f8157750 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc7f400c7e0 tx=0x7fc7f4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:10.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7edffb700 1 -- 172.21.15.125:0/2007524562 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4005b30 con 0x7fc7f80cd790 2023-10-06T03:05:10.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7edffb700 1 -- 172.21.15.125:0/2007524562 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f4005c90 con 0x7fc7f80cd790 2023-10-06T03:05:10.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7fff92700 1 -- 172.21.15.125:0/2007524562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f80c6b40 con 0x7fc7f80cd790 2023-10-06T03:05:10.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.864+0000 7fc7edffb700 1 -- 172.21.15.125:0/2007524562 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f4007300 con 0x7fc7f80cd790 2023-10-06T03:05:10.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.865+0000 7fc7fff92700 1 -- 172.21.15.125:0/2007524562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f80c7100 con 0x7fc7f80cd790 2023-10-06T03:05:10.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.866+0000 7fc7fff92700 1 -- 172.21.15.125:0/2007524562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f8157500 con 0x7fc7f80cd790 2023-10-06T03:05:10.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.866+0000 7fc7edffb700 1 -- 172.21.15.125:0/2007524562 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7f401b3b0 con 0x7fc7f80cd790 2023-10-06T03:05:10.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.866+0000 7fc7edffb700 1 --2- 172.21.15.125:0/2007524562 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc7dc066f30 0x7fc7dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:10.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.866+0000 7fc7edffb700 1 -- 172.21.15.125:0/2007524562 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fc7f4083f50 con 0x7fc7f80cd790 2023-10-06T03:05:10.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.866+0000 7fc7fdd2e700 1 --2- 172.21.15.125:0/2007524562 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc7dc066f30 0x7fc7dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:10.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.867+0000 7fc7fdd2e700 1 --2- 172.21.15.125:0/2007524562 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc7dc066f30 0x7fc7dc0693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80093f0 tx=0x7fc7e8017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:10.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:10.870+0000 7fc7edffb700 1 -- 172.21.15.125:0/2007524562 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7f4050d30 con 0x7fc7f80cd790 2023-10-06T03:05:11.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.052+0000 7fc7fff92700 1 -- 172.21.15.125:0/2007524562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc7f80c62d0 con 0x7fc7f80cd790 2023-10-06T03:05:11.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.053+0000 7fc7edffb700 1 -- 172.21.15.125:0/2007524562 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc7f4017020 con 0x7fc7f80cd790 2023-10-06T03:05:11.055 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-06T03:05:11.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.055+0000 7fc7fff92700 1 -- 172.21.15.125:0/2007524562 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc7dc066f30 msgr2=0x7fc7dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:11.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.055+0000 7fc7fff92700 1 --2- 172.21.15.125:0/2007524562 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc7dc066f30 0x7fc7dc0693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc7e80093f0 tx=0x7fc7e8017000 comp rx=0 tx=0).stop 2023-10-06T03:05:11.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.055+0000 7fc7fff92700 1 -- 172.21.15.125:0/2007524562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7f80cd790 msgr2=0x7fc7f8157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:11.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.055+0000 7fc7fff92700 1 --2- 172.21.15.125:0/2007524562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7f80cd790 0x7fc7f8157750 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc7f400c7e0 tx=0x7fc7f4007df0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.055+0000 7fc7fff92700 1 -- 172.21.15.125:0/2007524562 shutdown_connections 2023-10-06T03:05:11.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.055+0000 7fc7fff92700 1 --2- 172.21.15.125:0/2007524562 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc7dc066f30 0x7fc7dc0693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.055+0000 7fc7fff92700 1 --2- 172.21.15.125:0/2007524562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc7f8156de0 0x7fc7f8157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.055+0000 7fc7fff92700 1 --2- 172.21.15.125:0/2007524562 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc7f80cc060 0x7fc7f80c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.055+0000 7fc7fff92700 1 --2- 172.21.15.125:0/2007524562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc7f80cd790 0x7fc7f8157750 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.055+0000 7fc7fff92700 1 -- 172.21.15.125:0/2007524562 >> 172.21.15.125:0/2007524562 conn(0x7fc7f80cdf80 msgr2=0x7fc7f8150b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:11.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.055+0000 7fc7fff92700 1 -- 172.21.15.125:0/2007524562 shutdown_connections 2023-10-06T03:05:11.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.055+0000 7fc7fff92700 1 -- 172.21.15.125:0/2007524562 wait complete. 2023-10-06T03:05:11.068 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:05:11.189 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.188+0000 7f4a42b93700 1 Processor -- start 2023-10-06T03:05:11.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.188+0000 7f4a42b93700 1 -- start start 2023-10-06T03:05:11.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.189+0000 7f4a42b93700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4a3c067d20 0x7f4a3c0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:11.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.189+0000 7f4a42b93700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4a3c0ca190 0x7f4a3c0c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:11.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.189+0000 7f4a42b93700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a3c0cafe0 con 0x7f4a3c0af320 2023-10-06T03:05:11.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.189+0000 7f4a42b93700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3c0c3b40 con 0x7f4a3c067d20 2023-10-06T03:05:11.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.189+0000 7f4a42b93700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3c0ca710 con 0x7f4a3c0ca190 2023-10-06T03:05:11.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.189+0000 7f4a3bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4a3c067d20 0x7f4a3c0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:11.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.189+0000 7f4a4092f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4a3c0af320 0x7f4a3c067610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43864/0 (socket says 172.21.15.125:43864) 2023-10-06T03:05:11.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.189+0000 7f4a4092f700 1 -- 172.21.15.125:0/2073035742 learned_addr learned my addr 172.21.15.125:0/2073035742 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:11.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.189+0000 7f4a41130700 1 --2- 172.21.15.125:0/2073035742 >> v2:172.21.15.130:3300/0 conn(0x7f4a3c0ca190 0x7f4a3c0c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:11.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.189+0000 7f4a3bfff700 1 -- 172.21.15.125:0/2073035742 >> v2:172.21.15.130:3300/0 conn(0x7f4a3c0ca190 msgr2=0x7f4a3c0c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:11.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.189+0000 7f4a3bfff700 1 --2- 172.21.15.125:0/2073035742 >> v2:172.21.15.130:3300/0 conn(0x7f4a3c0ca190 0x7f4a3c0c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.189+0000 7f4a3bfff700 1 -- 172.21.15.125:0/2073035742 >> v1:172.21.15.125:6789/0 conn(0x7f4a3c0af320 legacy=0x7f4a3c067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:11.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.189+0000 7f4a3b7fe700 1 -- 172.21.15.125:0/2073035742 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930383275 0 0) 0x7f4a30001290 con 0x7f4a3c0af320 2023-10-06T03:05:11.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.189+0000 7f4a3bfff700 1 -- 172.21.15.125:0/2073035742 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a3c0cc750 con 0x7f4a3c067d20 2023-10-06T03:05:11.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.189+0000 7f4a41130700 1 --2- 172.21.15.125:0/2073035742 >> v2:172.21.15.130:3300/0 conn(0x7f4a3c0ca190 0x7f4a3c0c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:11.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.189+0000 7f4a3bfff700 1 --2- 172.21.15.125:0/2073035742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a3c067d20 0x7f4a3c0caaa0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0cdfe0 tx=0x7f4a280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3aa5c4efc7ed780 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:11.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.190+0000 7f4a3b7fe700 1 -- 172.21.15.125:0/2073035742 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2800b6b0 con 0x7f4a3c067d20 2023-10-06T03:05:11.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.190+0000 7f4a3b7fe700 1 -- 172.21.15.125:0/2073035742 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2800b810 con 0x7f4a3c067d20 2023-10-06T03:05:11.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.190+0000 7f4a3b7fe700 1 -- 172.21.15.125:0/2073035742 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2800bbb0 con 0x7f4a3c067d20 2023-10-06T03:05:11.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.190+0000 7f4a42b93700 1 -- 172.21.15.125:0/2073035742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a3c067d20 msgr2=0x7f4a3c0caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:11.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.190+0000 7f4a42b93700 1 --2- 172.21.15.125:0/2073035742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a3c067d20 0x7f4a3c0caaa0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c0cdfe0 tx=0x7f4a280091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.190+0000 7f4a42b93700 1 -- 172.21.15.125:0/2073035742 shutdown_connections 2023-10-06T03:05:11.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.190+0000 7f4a42b93700 1 --2- 172.21.15.125:0/2073035742 >> v2:172.21.15.130:3300/0 conn(0x7f4a3c0ca190 0x7f4a3c0c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.190+0000 7f4a42b93700 1 --2- 172.21.15.125:0/2073035742 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a3c067d20 0x7f4a3c0caaa0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.190+0000 7f4a42b93700 1 -- 172.21.15.125:0/2073035742 >> 172.21.15.125:0/2073035742 conn(0x7f4a3c096120 msgr2=0x7f4a3c068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:11.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.190+0000 7f4a42b93700 1 -- 172.21.15.125:0/2073035742 shutdown_connections 2023-10-06T03:05:11.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.190+0000 7f4a42b93700 1 -- 172.21.15.125:0/2073035742 wait complete. 2023-10-06T03:05:11.196 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.191+0000 7f4a42b93700 1 Processor -- start 2023-10-06T03:05:11.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.191+0000 7f4a42b93700 1 -- start start 2023-10-06T03:05:11.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.192+0000 7f4a42b93700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3c067d20 0x7f4a3c159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:11.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.192+0000 7f4a42b93700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a3c0af320 0x7f4a3c15c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:11.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.192+0000 7f4a42b93700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a3c0ca190 0x7f4a3c0afd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:11.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.192+0000 7f4a42b93700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c15b060 con 0x7f4a3c0ca190 2023-10-06T03:05:11.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.192+0000 7f4a42b93700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c0b0280 con 0x7f4a3c0af320 2023-10-06T03:05:11.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.192+0000 7f4a42b93700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a3c15ee30 con 0x7f4a3c067d20 2023-10-06T03:05:11.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.192+0000 7f4a41130700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a3c0ca190 0x7f4a3c0afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:11.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.192+0000 7f4a41130700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a3c0ca190 0x7f4a3c0afd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39566/0 (socket says 172.21.15.125:39566) 2023-10-06T03:05:11.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.192+0000 7f4a41130700 1 -- 172.21.15.125:0/269343756 learned_addr learned my addr 172.21.15.125:0/269343756 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:11.197 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.192+0000 7f4a41130700 1 -- 172.21.15.125:0/269343756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3c067d20 msgr2=0x7f4a3c159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:11.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.192+0000 7f4a41130700 1 --2- 172.21.15.125:0/269343756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3c067d20 0x7f4a3c159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.192+0000 7f4a41130700 1 -- 172.21.15.125:0/269343756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a3c0af320 msgr2=0x7f4a3c15c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:11.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.192+0000 7f4a41130700 1 --2- 172.21.15.125:0/269343756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a3c0af320 0x7f4a3c15c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.192+0000 7f4a41130700 1 -- 172.21.15.125:0/269343756 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a28009420 con 0x7f4a3c0ca190 2023-10-06T03:05:11.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.193+0000 7f4a41130700 1 --2- 172.21.15.125:0/269343756 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a3c0ca190 0x7f4a3c0afd40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4a34009fc0 tx=0x7f4a340099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:11.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.193+0000 7f4a38ff9700 1 -- 172.21.15.125:0/269343756 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3400dce0 con 0x7f4a3c0ca190 2023-10-06T03:05:11.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.193+0000 7f4a38ff9700 1 -- 172.21.15.125:0/269343756 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3400f040 con 0x7f4a3c0ca190 2023-10-06T03:05:11.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.193+0000 7f4a42b93700 1 -- 172.21.15.125:0/269343756 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a3c15e500 con 0x7f4a3c0ca190 2023-10-06T03:05:11.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.193+0000 7f4a38ff9700 1 -- 172.21.15.125:0/269343756 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a34015690 con 0x7f4a3c0ca190 2023-10-06T03:05:11.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.193+0000 7f4a42b93700 1 -- 172.21.15.125:0/269343756 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a3c15eac0 con 0x7f4a3c0ca190 2023-10-06T03:05:11.198 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.194+0000 7f4a42b93700 1 -- 172.21.15.125:0/269343756 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a3c066510 con 0x7f4a3c0ca190 2023-10-06T03:05:11.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.194+0000 7f4a38ff9700 1 -- 172.21.15.125:0/269343756 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a3401e3b0 con 0x7f4a3c0ca190 2023-10-06T03:05:11.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.195+0000 7f4a38ff9700 1 --2- 172.21.15.125:0/269343756 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4a20066f30 0x7f4a200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:11.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.195+0000 7f4a38ff9700 1 -- 172.21.15.125:0/269343756 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f4a34084f40 con 0x7f4a3c0ca190 2023-10-06T03:05:11.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.195+0000 7f4a4092f700 1 --2- 172.21.15.125:0/269343756 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4a20066f30 0x7f4a200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:11.199 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.195+0000 7f4a4092f700 1 --2- 172.21.15.125:0/269343756 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4a20066f30 0x7f4a200693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4a300014f0 tx=0x7f4a30001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:11.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.199+0000 7f4a38ff9700 1 -- 172.21.15.125:0/269343756 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a34051c80 con 0x7f4a3c0ca190 2023-10-06T03:05:11.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.378+0000 7f4a42b93700 1 -- 172.21.15.125:0/269343756 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4a3c15ef70 con 0x7f4a3c0ca190 2023-10-06T03:05:11.380 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.378+0000 7f4a38ff9700 1 -- 172.21.15.125:0/269343756 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4a3401a020 con 0x7f4a3c0ca190 2023-10-06T03:05:11.380 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-06T03:05:11.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.380+0000 7f4a42b93700 1 -- 172.21.15.125:0/269343756 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4a20066f30 msgr2=0x7f4a200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:11.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.380+0000 7f4a42b93700 1 --2- 172.21.15.125:0/269343756 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4a20066f30 0x7f4a200693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4a300014f0 tx=0x7f4a30001390 comp rx=0 tx=0).stop 2023-10-06T03:05:11.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.380+0000 7f4a42b93700 1 -- 172.21.15.125:0/269343756 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a3c0ca190 msgr2=0x7f4a3c0afd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:11.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.380+0000 7f4a42b93700 1 --2- 172.21.15.125:0/269343756 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a3c0ca190 0x7f4a3c0afd40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4a34009fc0 tx=0x7f4a340099b0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.380+0000 7f4a42b93700 1 -- 172.21.15.125:0/269343756 shutdown_connections 2023-10-06T03:05:11.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.380+0000 7f4a42b93700 1 --2- 172.21.15.125:0/269343756 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4a20066f30 0x7f4a200693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.380+0000 7f4a42b93700 1 --2- 172.21.15.125:0/269343756 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4a3c0ca190 0x7f4a3c0afd40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.382 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.380+0000 7f4a42b93700 1 --2- 172.21.15.125:0/269343756 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4a3c067d20 0x7f4a3c159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.380+0000 7f4a42b93700 1 --2- 172.21.15.125:0/269343756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a3c0af320 0x7f4a3c15c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.380+0000 7f4a42b93700 1 -- 172.21.15.125:0/269343756 >> 172.21.15.125:0/269343756 conn(0x7f4a3c096120 msgr2=0x7f4a3c0c30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.380+0000 7f4a42b93700 1 -- 172.21.15.125:0/269343756 shutdown_connections 2023-10-06T03:05:11.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.380+0000 7f4a42b93700 1 -- 172.21.15.125:0/269343756 wait complete. 2023-10-06T03:05:11.395 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:05:11.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.513+0000 7fce7c77b700 1 Processor -- start 2023-10-06T03:05:11.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.513+0000 7fce7c77b700 1 -- start start 2023-10-06T03:05:11.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.514+0000 7fce7c77b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fce740af320 0x7fce740caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:11.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.514+0000 7fce7c77b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce740ca190 0x7fce74067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:11.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.514+0000 7fce7c77b700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce740cafe0 con 0x7fce74067b50 2023-10-06T03:05:11.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.514+0000 7fce7c77b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce74067fd0 con 0x7fce740af320 2023-10-06T03:05:11.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.514+0000 7fce7c77b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce740c3b40 con 0x7fce740ca190 2023-10-06T03:05:11.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.515+0000 7fce7a517700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fce740af320 0x7fce740caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:11.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.515+0000 7fce7a517700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fce740af320 0x7fce740caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39568/0 (socket says 172.21.15.125:39568) 2023-10-06T03:05:11.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.515+0000 7fce7a517700 1 -- 172.21.15.125:0/4140751735 learned_addr learned my addr 172.21.15.125:0/4140751735 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:11.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.515+0000 7fce7a517700 1 -- 172.21.15.125:0/4140751735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce740ca190 msgr2=0x7fce74067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:11.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.515+0000 7fce79d16700 1 --2- 172.21.15.125:0/4140751735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce740ca190 0x7fce74067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:11.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.515+0000 7fce7a517700 1 --2- 172.21.15.125:0/4140751735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce740ca190 0x7fce74067610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.515+0000 7fce7a517700 1 -- 172.21.15.125:0/4140751735 >> v1:172.21.15.130:6789/0 conn(0x7fce74067b50 legacy=0x7fce740c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:11.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.515+0000 7fce7a517700 1 -- 172.21.15.125:0/4140751735 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce740ca710 con 0x7fce740af320 2023-10-06T03:05:11.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.515+0000 7fce7a517700 1 --2- 172.21.15.125:0/4140751735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce740af320 0x7fce740caaa0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fce68009990 tx=0x7fce68009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03c45d5a92b21c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:11.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.515+0000 7fce79515700 1 -- 172.21.15.125:0/4140751735 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce68005c10 con 0x7fce740af320 2023-10-06T03:05:11.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.515+0000 7fce79515700 1 -- 172.21.15.125:0/4140751735 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce68005d70 con 0x7fce740af320 2023-10-06T03:05:11.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.515+0000 7fce79515700 1 -- 172.21.15.125:0/4140751735 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6800b860 con 0x7fce740af320 2023-10-06T03:05:11.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.516+0000 7fce7c77b700 1 -- 172.21.15.125:0/4140751735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce740af320 msgr2=0x7fce740caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:11.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.516+0000 7fce7c77b700 1 --2- 172.21.15.125:0/4140751735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce740af320 0x7fce740caaa0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fce68009990 tx=0x7fce68009220 comp rx=0 tx=0).stop 2023-10-06T03:05:11.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.516+0000 7fce7c77b700 1 -- 172.21.15.125:0/4140751735 shutdown_connections 2023-10-06T03:05:11.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.516+0000 7fce7c77b700 1 --2- 172.21.15.125:0/4140751735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce740af320 0x7fce740caaa0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.516+0000 7fce7c77b700 1 --2- 172.21.15.125:0/4140751735 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce740ca190 0x7fce74067610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.516+0000 7fce7c77b700 1 -- 172.21.15.125:0/4140751735 >> 172.21.15.125:0/4140751735 conn(0x7fce74096120 msgr2=0x7fce74068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:11.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.516+0000 7fce7c77b700 1 -- 172.21.15.125:0/4140751735 shutdown_connections 2023-10-06T03:05:11.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.516+0000 7fce7c77b700 1 -- 172.21.15.125:0/4140751735 wait complete. 2023-10-06T03:05:11.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.517+0000 7fce7c77b700 1 Processor -- start 2023-10-06T03:05:11.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.517+0000 7fce7c77b700 1 -- start start 2023-10-06T03:05:11.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce7c77b700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce74067b50 0x7fce74156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:11.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce7c77b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce740af320 0x7fce740b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:11.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce7c77b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce740ca190 0x7fce7406b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:11.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce7c77b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7416a670 con 0x7fce740af320 2023-10-06T03:05:11.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce7c77b700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce74169a60 con 0x7fce74067b50 2023-10-06T03:05:11.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce7c77b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce74169d40 con 0x7fce740ca190 2023-10-06T03:05:11.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce79d16700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce740af320 0x7fce740b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:11.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce79d16700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce740af320 0x7fce740b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39570/0 (socket says 172.21.15.125:39570) 2023-10-06T03:05:11.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce79d16700 1 -- 172.21.15.125:0/1165351986 learned_addr learned my addr 172.21.15.125:0/1165351986 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:11.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce7a517700 1 --2- 172.21.15.125:0/1165351986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce74067b50 0x7fce74156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:11.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce7ad18700 1 --2- 172.21.15.125:0/1165351986 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce740ca190 0x7fce7406b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:11.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce79d16700 1 -- 172.21.15.125:0/1165351986 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce740ca190 msgr2=0x7fce7406b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:11.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce79d16700 1 --2- 172.21.15.125:0/1165351986 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce740ca190 0x7fce7406b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce79d16700 1 -- 172.21.15.125:0/1165351986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce74067b50 msgr2=0x7fce74156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:11.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce79d16700 1 --2- 172.21.15.125:0/1165351986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce74067b50 0x7fce74156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce79d16700 1 -- 172.21.15.125:0/1165351986 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce68009480 con 0x7fce740af320 2023-10-06T03:05:11.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce7ad18700 1 --2- 172.21.15.125:0/1165351986 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce740ca190 0x7fce7406b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:11.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce79d16700 1 --2- 172.21.15.125:0/1165351986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce740af320 0x7fce740b2460 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fce7000c7d0 tx=0x7fce70008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:11.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce667fc700 1 -- 172.21.15.125:0/1165351986 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70011600 con 0x7fce740af320 2023-10-06T03:05:11.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce667fc700 1 -- 172.21.15.125:0/1165351986 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce70011760 con 0x7fce740af320 2023-10-06T03:05:11.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce7c77b700 1 -- 172.21.15.125:0/1165351986 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce7416a020 con 0x7fce740af320 2023-10-06T03:05:11.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce667fc700 1 -- 172.21.15.125:0/1165351986 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70011b20 con 0x7fce740af320 2023-10-06T03:05:11.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.518+0000 7fce7c77b700 1 -- 172.21.15.125:0/1165351986 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce74169670 con 0x7fce740af320 2023-10-06T03:05:11.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.519+0000 7fce7c77b700 1 -- 172.21.15.125:0/1165351986 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7416a4c0 con 0x7fce740af320 2023-10-06T03:05:11.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.520+0000 7fce667fc700 1 -- 172.21.15.125:0/1165351986 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce70018350 con 0x7fce740af320 2023-10-06T03:05:11.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.520+0000 7fce667fc700 1 --2- 172.21.15.125:0/1165351986 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fce58066f30 0x7fce580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:11.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.520+0000 7fce667fc700 1 -- 172.21.15.125:0/1165351986 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fce70084940 con 0x7fce740af320 2023-10-06T03:05:11.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.520+0000 7fce7a517700 1 --2- 172.21.15.125:0/1165351986 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fce58066f30 0x7fce580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:11.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.521+0000 7fce7a517700 1 --2- 172.21.15.125:0/1165351986 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fce58066f30 0x7fce580693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fce68007fd0 tx=0x7fce68015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:11.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.524+0000 7fce667fc700 1 -- 172.21.15.125:0/1165351986 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce70051720 con 0x7fce740af320 2023-10-06T03:05:11.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.704+0000 7fce7c77b700 1 -- 172.21.15.125:0/1165351986 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fce74096a90 con 0x7fce740af320 2023-10-06T03:05:11.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.704+0000 7fce667fc700 1 -- 172.21.15.125:0/1165351986 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fce7001e020 con 0x7fce740af320 2023-10-06T03:05:11.706 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-06T03:05:11.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.706+0000 7fce7c77b700 1 -- 172.21.15.125:0/1165351986 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fce58066f30 msgr2=0x7fce580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:11.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.706+0000 7fce7c77b700 1 --2- 172.21.15.125:0/1165351986 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fce58066f30 0x7fce580693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fce68007fd0 tx=0x7fce68015000 comp rx=0 tx=0).stop 2023-10-06T03:05:11.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.706+0000 7fce7c77b700 1 -- 172.21.15.125:0/1165351986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce740af320 msgr2=0x7fce740b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:11.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.706+0000 7fce7c77b700 1 --2- 172.21.15.125:0/1165351986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce740af320 0x7fce740b2460 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fce7000c7d0 tx=0x7fce70008040 comp rx=0 tx=0).stop 2023-10-06T03:05:11.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.706+0000 7fce7c77b700 1 -- 172.21.15.125:0/1165351986 shutdown_connections 2023-10-06T03:05:11.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.706+0000 7fce7c77b700 1 --2- 172.21.15.125:0/1165351986 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fce58066f30 0x7fce580693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.706+0000 7fce7c77b700 1 --2- 172.21.15.125:0/1165351986 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fce740ca190 0x7fce7406b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.706+0000 7fce7c77b700 1 --2- 172.21.15.125:0/1165351986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fce74067b50 0x7fce74156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.706+0000 7fce7c77b700 1 --2- 172.21.15.125:0/1165351986 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fce740af320 0x7fce740b2460 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.706+0000 7fce7c77b700 1 -- 172.21.15.125:0/1165351986 >> 172.21.15.125:0/1165351986 conn(0x7fce74096120 msgr2=0x7fce74158990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:11.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.707+0000 7fce7c77b700 1 -- 172.21.15.125:0/1165351986 shutdown_connections 2023-10-06T03:05:11.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.707+0000 7fce7c77b700 1 -- 172.21.15.125:0/1165351986 wait complete. 2023-10-06T03:05:11.719 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:05:11.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.839+0000 7fb800a9f700 1 Processor -- start 2023-10-06T03:05:11.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.839+0000 7fb800a9f700 1 -- start start 2023-10-06T03:05:11.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.840+0000 7fb800a9f700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb7fc0af320 0x7fb7fc0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:11.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.840+0000 7fb800a9f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb7fc0ca190 0x7fb7fc067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:11.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.840+0000 7fb800a9f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7fc067b50 0x7fb7fc0c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:11.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.840+0000 7fb800a9f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7fc067fd0 con 0x7fb7fc0ca190 2023-10-06T03:05:11.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.840+0000 7fb800a9f700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7fc0cafe0 con 0x7fb7fc0af320 2023-10-06T03:05:11.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.840+0000 7fb800a9f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0c3b40 con 0x7fb7fc067b50 2023-10-06T03:05:11.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.840+0000 7fb7f9d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb7fc0ca190 0x7fb7fc067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:11.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.840+0000 7fb7f9d9b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb7fc0ca190 0x7fb7fc067610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39582/0 (socket says 172.21.15.125:39582) 2023-10-06T03:05:11.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.840+0000 7fb7f9d9b700 1 -- 172.21.15.125:0/3972513552 learned_addr learned my addr 172.21.15.125:0/3972513552 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:11.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.840+0000 7fb7fa59c700 1 --2- 172.21.15.125:0/3972513552 >> v2:172.21.15.130:3300/0 conn(0x7fb7fc0af320 0x7fb7fc0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:11.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.840+0000 7fb7fad9d700 1 --2- 172.21.15.125:0/3972513552 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7fc067b50 0x7fb7fc0c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:11.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.840+0000 7fb7f9d9b700 1 -- 172.21.15.125:0/3972513552 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7fc067b50 msgr2=0x7fb7fc0c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:11.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.840+0000 7fb7f9d9b700 1 --2- 172.21.15.125:0/3972513552 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7fc067b50 0x7fb7fc0c1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.840+0000 7fb7f9d9b700 1 -- 172.21.15.125:0/3972513552 >> v2:172.21.15.130:3300/0 conn(0x7fb7fc0af320 msgr2=0x7fb7fc0caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:11.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.840+0000 7fb7f9d9b700 1 --2- 172.21.15.125:0/3972513552 >> v2:172.21.15.130:3300/0 conn(0x7fb7fc0af320 0x7fb7fc0caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.840+0000 7fb7f9d9b700 1 -- 172.21.15.125:0/3972513552 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc0ca710 con 0x7fb7fc0ca190 2023-10-06T03:05:11.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.840+0000 7fb7f9d9b700 1 --2- 172.21.15.125:0/3972513552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7fc0ca190 0x7fb7fc067610 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc06eff0 tx=0x7fb7f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136a98f12913de3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:11.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.840+0000 7fb7f959a700 1 -- 172.21.15.125:0/3972513552 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f000b860 con 0x7fb7fc0ca190 2023-10-06T03:05:11.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.841+0000 7fb7f959a700 1 -- 172.21.15.125:0/3972513552 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f000b9c0 con 0x7fb7fc0ca190 2023-10-06T03:05:11.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.841+0000 7fb7f959a700 1 -- 172.21.15.125:0/3972513552 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f000bd80 con 0x7fb7fc0ca190 2023-10-06T03:05:11.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.841+0000 7fb800a9f700 1 -- 172.21.15.125:0/3972513552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7fc0ca190 msgr2=0x7fb7fc067610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:11.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.841+0000 7fb800a9f700 1 --2- 172.21.15.125:0/3972513552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7fc0ca190 0x7fb7fc067610 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc06eff0 tx=0x7fb7f0009250 comp rx=0 tx=0).stop 2023-10-06T03:05:11.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.841+0000 7fb800a9f700 1 -- 172.21.15.125:0/3972513552 shutdown_connections 2023-10-06T03:05:11.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.841+0000 7fb800a9f700 1 --2- 172.21.15.125:0/3972513552 >> v2:172.21.15.130:3300/0 conn(0x7fb7fc0af320 0x7fb7fc0caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.841+0000 7fb800a9f700 1 --2- 172.21.15.125:0/3972513552 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7fc067b50 0x7fb7fc0c1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.841+0000 7fb800a9f700 1 --2- 172.21.15.125:0/3972513552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7fc0ca190 0x7fb7fc067610 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.841+0000 7fb800a9f700 1 -- 172.21.15.125:0/3972513552 >> 172.21.15.125:0/3972513552 conn(0x7fb7fc096120 msgr2=0x7fb7fc068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:11.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.841+0000 7fb800a9f700 1 -- 172.21.15.125:0/3972513552 shutdown_connections 2023-10-06T03:05:11.845 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.841+0000 7fb800a9f700 1 -- 172.21.15.125:0/3972513552 wait complete. 2023-10-06T03:05:11.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.842+0000 7fb800a9f700 1 Processor -- start 2023-10-06T03:05:11.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.842+0000 7fb800a9f700 1 -- start start 2023-10-06T03:05:11.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.843+0000 7fb800a9f700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7fc067b50 0x7fb7fc0c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:11.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.843+0000 7fb800a9f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7fc0af320 0x7fb7fc144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:11.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.843+0000 7fb800a9f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7fc0ca190 0x7fb7fc1694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:11.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.843+0000 7fb800a9f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc153590 con 0x7fb7fc0af320 2023-10-06T03:05:11.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.843+0000 7fb800a9f700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc16a6c0 con 0x7fb7fc067b50 2023-10-06T03:05:11.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.843+0000 7fb800a9f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0c6670 con 0x7fb7fc0ca190 2023-10-06T03:05:11.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.843+0000 7fb7f9d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7fc0af320 0x7fb7fc144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:11.848 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.843+0000 7fb7f9d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7fc0af320 0x7fb7fc144b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39588/0 (socket says 172.21.15.125:39588) 2023-10-06T03:05:11.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.843+0000 7fb7f9d9b700 1 -- 172.21.15.125:0/2328576965 learned_addr learned my addr 172.21.15.125:0/2328576965 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:11.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.843+0000 7fb7fa59c700 1 --2- 172.21.15.125:0/2328576965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7fc067b50 0x7fb7fc0c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:11.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.843+0000 7fb7fad9d700 1 --2- 172.21.15.125:0/2328576965 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7fc0ca190 0x7fb7fc1694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:11.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.843+0000 7fb7f9d9b700 1 -- 172.21.15.125:0/2328576965 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7fc0ca190 msgr2=0x7fb7fc1694f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:11.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.843+0000 7fb7f9d9b700 1 --2- 172.21.15.125:0/2328576965 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7fc0ca190 0x7fb7fc1694f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.843+0000 7fb7f9d9b700 1 -- 172.21.15.125:0/2328576965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7fc067b50 msgr2=0x7fb7fc0c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:11.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.843+0000 7fb7f9d9b700 1 --2- 172.21.15.125:0/2328576965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7fc067b50 0x7fb7fc0c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:11.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.843+0000 7fb7f9d9b700 1 -- 172.21.15.125:0/2328576965 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f00094f0 con 0x7fb7fc0af320 2023-10-06T03:05:11.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.843+0000 7fb7fa59c700 1 --2- 172.21.15.125:0/2328576965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7fc067b50 0x7fb7fc0c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:11.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.844+0000 7fb7f9d9b700 1 --2- 172.21.15.125:0/2328576965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7fc0af320 0x7fb7fc144b70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0006fd0 tx=0x7fb7f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:11.849 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.844+0000 7fb7ea7fc700 1 -- 172.21.15.125:0/2328576965 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0020070 con 0x7fb7fc0af320 2023-10-06T03:05:11.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.844+0000 7fb7ea7fc700 1 -- 172.21.15.125:0/2328576965 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f001a420 con 0x7fb7fc0af320 2023-10-06T03:05:11.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.844+0000 7fb800a9f700 1 -- 172.21.15.125:0/2328576965 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7fc0c6950 con 0x7fb7fc0af320 2023-10-06T03:05:11.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.844+0000 7fb7ea7fc700 1 -- 172.21.15.125:0/2328576965 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f001a7e0 con 0x7fb7fc0af320 2023-10-06T03:05:11.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.844+0000 7fb800a9f700 1 -- 172.21.15.125:0/2328576965 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7fc153ac0 con 0x7fb7fc0af320 2023-10-06T03:05:11.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.845+0000 7fb800a9f700 1 -- 172.21.15.125:0/2328576965 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7fc153ce0 con 0x7fb7fc0af320 2023-10-06T03:05:11.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.845+0000 7fb7ea7fc700 1 -- 172.21.15.125:0/2328576965 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7f001ab50 con 0x7fb7fc0af320 2023-10-06T03:05:11.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.845+0000 7fb7ea7fc700 1 --2- 172.21.15.125:0/2328576965 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb7dc066f30 0x7fb7dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:11.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.846+0000 7fb7fa59c700 1 --2- 172.21.15.125:0/2328576965 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb7dc066f30 0x7fb7dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:11.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.846+0000 7fb7ea7fc700 1 -- 172.21.15.125:0/2328576965 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fb7f0085ce0 con 0x7fb7fc0af320 2023-10-06T03:05:11.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.846+0000 7fb7fa59c700 1 --2- 172.21.15.125:0/2328576965 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb7dc066f30 0x7fb7dc0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc155b00 tx=0x7fb7ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:11.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:11.850+0000 7fb7ea7fc700 1 -- 172.21.15.125:0/2328576965 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7f0052b40 con 0x7fb7fc0af320 2023-10-06T03:05:12.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.033+0000 7fb800a9f700 1 -- 172.21.15.125:0/2328576965 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb7fc066510 con 0x7fb7fc0af320 2023-10-06T03:05:12.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.033+0000 7fb7ea7fc700 1 -- 172.21.15.125:0/2328576965 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb7f0015020 con 0x7fb7fc0af320 2023-10-06T03:05:12.035 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-06T03:05:12.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.035+0000 7fb800a9f700 1 -- 172.21.15.125:0/2328576965 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb7dc066f30 msgr2=0x7fb7dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:12.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.035+0000 7fb800a9f700 1 --2- 172.21.15.125:0/2328576965 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb7dc066f30 0x7fb7dc0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc155b00 tx=0x7fb7ec008040 comp rx=0 tx=0).stop 2023-10-06T03:05:12.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.035+0000 7fb800a9f700 1 -- 172.21.15.125:0/2328576965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7fc0af320 msgr2=0x7fb7fc144b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:12.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.035+0000 7fb800a9f700 1 --2- 172.21.15.125:0/2328576965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7fc0af320 0x7fb7fc144b70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0006fd0 tx=0x7fb7f0017000 comp rx=0 tx=0).stop 2023-10-06T03:05:12.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.035+0000 7fb800a9f700 1 -- 172.21.15.125:0/2328576965 shutdown_connections 2023-10-06T03:05:12.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.035+0000 7fb800a9f700 1 --2- 172.21.15.125:0/2328576965 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb7dc066f30 0x7fb7dc0693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:12.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.035+0000 7fb800a9f700 1 --2- 172.21.15.125:0/2328576965 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb7fc0ca190 0x7fb7fc1694f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:12.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.035+0000 7fb800a9f700 1 --2- 172.21.15.125:0/2328576965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7fc067b50 0x7fb7fc0c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:12.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.035+0000 7fb800a9f700 1 --2- 172.21.15.125:0/2328576965 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb7fc0af320 0x7fb7fc144b70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:12.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.035+0000 7fb800a9f700 1 -- 172.21.15.125:0/2328576965 >> 172.21.15.125:0/2328576965 conn(0x7fb7fc096120 msgr2=0x7fb7fc0c3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:12.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.035+0000 7fb800a9f700 1 -- 172.21.15.125:0/2328576965 shutdown_connections 2023-10-06T03:05:12.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.036+0000 7fb800a9f700 1 -- 172.21.15.125:0/2328576965 wait complete. 2023-10-06T03:05:12.083 INFO:tasks.cephfs_test_runner:Starting test: test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) That a client who does not have the capability for setting 2023-10-06T03:05:12.083 INFO:tasks.cephfs_test_runner:test_forbidden_modification (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-10-06T03:05:12.083 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2023-10-06T03:05:12.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.200+0000 7f4e13a4f700 1 Processor -- start 2023-10-06T03:05:12.202 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.200+0000 7f4e13a4f700 1 -- start start 2023-10-06T03:05:12.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.201+0000 7f4e13a4f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e0c0af320 0x7f4e0c0c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:12.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.201+0000 7f4e13a4f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e0c067d20 0x7f4e0c0c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:12.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.201+0000 7f4e13a4f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0c0caa40 con 0x7f4e0c0cc5a0 2023-10-06T03:05:12.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.201+0000 7f4e13a4f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0c0c1ca0 con 0x7f4e0c067d20 2023-10-06T03:05:12.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.201+0000 7f4e13a4f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c0cca60 con 0x7f4e0c0af320 2023-10-06T03:05:12.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.201+0000 7f4e11fec700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e0c067d20 0x7f4e0c0c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:12.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.201+0000 7f4e10fea700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4e0c0cc5a0 0x7f4e0c067610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43880/0 (socket says 172.21.15.125:43880) 2023-10-06T03:05:12.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.201+0000 7f4e10fea700 1 -- 172.21.15.125:0/1255527537 learned_addr learned my addr 172.21.15.125:0/1255527537 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:12.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.202+0000 7f4e117eb700 1 --2- 172.21.15.125:0/1255527537 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e0c0af320 0x7f4e0c0c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:12.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.202+0000 7f4e11fec700 1 -- 172.21.15.125:0/1255527537 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e0c0af320 msgr2=0x7f4e0c0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:12.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.202+0000 7f4e11fec700 1 --2- 172.21.15.125:0/1255527537 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e0c0af320 0x7f4e0c0c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:12.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.202+0000 7f4e11fec700 1 -- 172.21.15.125:0/1255527537 >> v1:172.21.15.125:6789/0 conn(0x7f4e0c0cc5a0 legacy=0x7f4e0c067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:12.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.202+0000 7f4e03fff700 1 -- 172.21.15.125:0/1255527537 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138723616 0 0) 0x7f4e0c0caa40 con 0x7f4e0c0cc5a0 2023-10-06T03:05:12.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.202+0000 7f4e11fec700 1 -- 172.21.15.125:0/1255527537 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c0cac90 con 0x7f4e0c067d20 2023-10-06T03:05:12.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.202+0000 7f4e11fec700 1 --2- 172.21.15.125:0/1255527537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e0c067d20 0x7f4e0c0c2130 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4e04009e60 tx=0x7f4e04009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deee473adf573d37 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.202+0000 7f4e03fff700 1 -- 172.21.15.125:0/1255527537 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0400e070 con 0x7f4e0c067d20 2023-10-06T03:05:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.202+0000 7f4e03fff700 1 -- 172.21.15.125:0/1255527537 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0400bc30 con 0x7f4e0c067d20 2023-10-06T03:05:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.202+0000 7f4e03fff700 1 -- 172.21.15.125:0/1255527537 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e04012430 con 0x7f4e0c067d20 2023-10-06T03:05:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.203+0000 7f4e13a4f700 1 -- 172.21.15.125:0/1255527537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e0c067d20 msgr2=0x7f4e0c0c2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.203+0000 7f4e13a4f700 1 --2- 172.21.15.125:0/1255527537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e0c067d20 0x7f4e0c0c2130 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4e04009e60 tx=0x7f4e04009780 comp rx=0 tx=0).stop 2023-10-06T03:05:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.203+0000 7f4e13a4f700 1 -- 172.21.15.125:0/1255527537 shutdown_connections 2023-10-06T03:05:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.203+0000 7f4e13a4f700 1 --2- 172.21.15.125:0/1255527537 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e0c067d20 0x7f4e0c0c2130 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.203+0000 7f4e13a4f700 1 --2- 172.21.15.125:0/1255527537 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e0c0af320 0x7f4e0c0c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.203+0000 7f4e13a4f700 1 -- 172.21.15.125:0/1255527537 >> 172.21.15.125:0/1255527537 conn(0x7f4e0c068f00 msgr2=0x7f4e0c0cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.203+0000 7f4e13a4f700 1 -- 172.21.15.125:0/1255527537 shutdown_connections 2023-10-06T03:05:12.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.203+0000 7f4e13a4f700 1 -- 172.21.15.125:0/1255527537 wait complete. 2023-10-06T03:05:12.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.204+0000 7f4e13a4f700 1 Processor -- start 2023-10-06T03:05:12.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.204+0000 7f4e13a4f700 1 -- start start 2023-10-06T03:05:12.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e13a4f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e0c067d20 0x7f4e0c153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:12.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e13a4f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e0c0af320 0x7f4e0c16a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:12.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e13a4f700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e0c0cc5a0 0x7f4e0c15fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:12.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e13a4f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c16a810 con 0x7f4e0c067d20 2023-10-06T03:05:12.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e13a4f700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c15ff70 con 0x7f4e0c0cc5a0 2023-10-06T03:05:12.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e13a4f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c16cf50 con 0x7f4e0c0af320 2023-10-06T03:05:12.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e117eb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e0c067d20 0x7f4e0c153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:12.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e117eb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e0c067d20 0x7f4e0c153d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39606/0 (socket says 172.21.15.125:39606) 2023-10-06T03:05:12.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e117eb700 1 -- 172.21.15.125:0/3405886665 learned_addr learned my addr 172.21.15.125:0/3405886665 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:12.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e10fea700 1 --2- 172.21.15.125:0/3405886665 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e0c0af320 0x7f4e0c16a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:12.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e11fec700 1 --2- 172.21.15.125:0/3405886665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e0c0cc5a0 0x7f4e0c15fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:12.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e117eb700 1 -- 172.21.15.125:0/3405886665 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e0c0af320 msgr2=0x7f4e0c16a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:12.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e117eb700 1 --2- 172.21.15.125:0/3405886665 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e0c0af320 0x7f4e0c16a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:12.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e117eb700 1 -- 172.21.15.125:0/3405886665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e0c0cc5a0 msgr2=0x7f4e0c15fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:12.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e117eb700 1 --2- 172.21.15.125:0/3405886665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e0c0cc5a0 0x7f4e0c15fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:12.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e117eb700 1 -- 172.21.15.125:0/3405886665 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e04009a20 con 0x7f4e0c067d20 2023-10-06T03:05:12.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e10fea700 1 --2- 172.21.15.125:0/3405886665 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e0c0af320 0x7f4e0c16a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:12.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e11fec700 1 --2- 172.21.15.125:0/3405886665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e0c0cc5a0 0x7f4e0c15fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:12.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e117eb700 1 --2- 172.21.15.125:0/3405886665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e0c067d20 0x7f4e0c153d30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc00c880 tx=0x7f4dfc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:12.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e017fa700 1 -- 172.21.15.125:0/3405886665 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc011600 con 0x7f4e0c067d20 2023-10-06T03:05:12.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e017fa700 1 -- 172.21.15.125:0/3405886665 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc011760 con 0x7f4e0c067d20 2023-10-06T03:05:12.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e13a4f700 1 -- 172.21.15.125:0/3405886665 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0c16d1f0 con 0x7f4e0c067d20 2023-10-06T03:05:12.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e017fa700 1 -- 172.21.15.125:0/3405886665 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc011b20 con 0x7f4e0c067d20 2023-10-06T03:05:12.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.205+0000 7f4e13a4f700 1 -- 172.21.15.125:0/3405886665 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0c16d7b0 con 0x7f4e0c067d20 2023-10-06T03:05:12.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.206+0000 7f4e13a4f700 1 -- 172.21.15.125:0/3405886665 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0c066510 con 0x7f4e0c067d20 2023-10-06T03:05:12.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.207+0000 7f4e017fa700 1 -- 172.21.15.125:0/3405886665 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4dfc018360 con 0x7f4e0c067d20 2023-10-06T03:05:12.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.207+0000 7f4e017fa700 1 --2- 172.21.15.125:0/3405886665 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4df0066f30 0x7f4df00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:12.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.207+0000 7f4e017fa700 1 -- 172.21.15.125:0/3405886665 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f4dfc0846b0 con 0x7f4e0c067d20 2023-10-06T03:05:12.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.207+0000 7f4e10fea700 1 --2- 172.21.15.125:0/3405886665 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4df0066f30 0x7f4df00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:12.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.208+0000 7f4e10fea700 1 --2- 172.21.15.125:0/3405886665 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4df0066f30 0x7f4df00693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0c2ba0 tx=0x7f4e08009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:12.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.211+0000 7f4e017fa700 1 -- 172.21.15.125:0/3405886665 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4dfc051490 con 0x7f4e0c067d20 2023-10-06T03:05:12.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:12.472+0000 7f4e13a4f700 1 -- 172.21.15.125:0/3405886665 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7f4e0c0caf70 con 0x7f4e0c067d20 2023-10-06T03:05:13.404 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.403+0000 7f4e017fa700 1 -- 172.21.15.125:0/3405886665 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v64) v1 ==== 150+0+0 (secure 0 0 0) 0x7f4dfc054ab0 con 0x7f4e0c067d20 2023-10-06T03:05:13.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.405+0000 7f4e13a4f700 1 -- 172.21.15.125:0/3405886665 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4df0066f30 msgr2=0x7f4df00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:13.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.405+0000 7f4e13a4f700 1 --2- 172.21.15.125:0/3405886665 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4df0066f30 0x7f4df00693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c0c2ba0 tx=0x7f4e08009040 comp rx=0 tx=0).stop 2023-10-06T03:05:13.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.405+0000 7f4e13a4f700 1 -- 172.21.15.125:0/3405886665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e0c067d20 msgr2=0x7f4e0c153d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:13.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.405+0000 7f4e13a4f700 1 --2- 172.21.15.125:0/3405886665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e0c067d20 0x7f4e0c153d30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc00c880 tx=0x7f4dfc008040 comp rx=0 tx=0).stop 2023-10-06T03:05:13.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.406+0000 7f4e13a4f700 1 -- 172.21.15.125:0/3405886665 shutdown_connections 2023-10-06T03:05:13.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.406+0000 7f4e13a4f700 1 --2- 172.21.15.125:0/3405886665 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4df0066f30 0x7f4df00693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:13.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.406+0000 7f4e13a4f700 1 --2- 172.21.15.125:0/3405886665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e0c0cc5a0 0x7f4e0c15fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:13.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.406+0000 7f4e13a4f700 1 --2- 172.21.15.125:0/3405886665 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e0c067d20 0x7f4e0c153d30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:13.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.406+0000 7f4e13a4f700 1 --2- 172.21.15.125:0/3405886665 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e0c0af320 0x7f4e0c16a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:13.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.406+0000 7f4e13a4f700 1 -- 172.21.15.125:0/3405886665 >> 172.21.15.125:0/3405886665 conn(0x7f4e0c068f00 msgr2=0x7f4e0c0c3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:13.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.406+0000 7f4e13a4f700 1 -- 172.21.15.125:0/3405886665 shutdown_connections 2023-10-06T03:05:13.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.406+0000 7f4e13a4f700 1 -- 172.21.15.125:0/3405886665 wait complete. 2023-10-06T03:05:13.421 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T03:05:13.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.546+0000 7fd37b869700 1 Processor -- start 2023-10-06T03:05:13.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.546+0000 7fd37b869700 1 -- start start 2023-10-06T03:05:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.547+0000 7fd37b869700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd3741571b0 0x7fd3740cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.547+0000 7fd37b869700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3740cd300 con 0x7fd374156de0 2023-10-06T03:05:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.547+0000 7fd37b869700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3740cc6f0 con 0x7fd3740cd790 2023-10-06T03:05:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.547+0000 7fd37b869700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3740cc9d0 con 0x7fd3741571b0 2023-10-06T03:05:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.547+0000 7fd379605700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd374156de0 0x7fd37415b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43884/0 (socket says 172.21.15.125:43884) 2023-10-06T03:05:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.547+0000 7fd379605700 1 -- 172.21.15.125:0/672416466 learned_addr learned my addr 172.21.15.125:0/672416466 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.547+0000 7fd378e04700 1 --2- 172.21.15.125:0/672416466 >> v2:172.21.15.125:3300/0 conn(0x7fd3741571b0 0x7fd3740cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.547+0000 7fd36bfff700 1 -- 172.21.15.125:0/672416466 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983346674 0 0) 0x7fd3740cd300 con 0x7fd374156de0 2023-10-06T03:05:13.550 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.547+0000 7fd36bfff700 1 -- 172.21.15.125:0/672416466 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd360003570 con 0x7fd374156de0 2023-10-06T03:05:13.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.547+0000 7fd378e04700 1 -- 172.21.15.125:0/672416466 >> v1:172.21.15.130:6789/0 conn(0x7fd3740cd790 legacy=0x7fd3740ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:13.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.547+0000 7fd378e04700 1 -- 172.21.15.125:0/672416466 >> v1:172.21.15.125:6789/0 conn(0x7fd374156de0 legacy=0x7fd37415b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:13.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.547+0000 7fd378e04700 1 -- 172.21.15.125:0/672416466 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3740cccb0 con 0x7fd3741571b0 2023-10-06T03:05:13.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.547+0000 7fd378e04700 1 --2- 172.21.15.125:0/672416466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3741571b0 0x7fd3740cc060 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd3640098e0 tx=0x7fd3640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce4ac8c7e677e0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:13.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.547+0000 7fd36bfff700 1 -- 172.21.15.125:0/672416466 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36400b640 con 0x7fd3741571b0 2023-10-06T03:05:13.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.548+0000 7fd36bfff700 1 -- 172.21.15.125:0/672416466 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36400b7a0 con 0x7fd3741571b0 2023-10-06T03:05:13.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.548+0000 7fd36bfff700 1 -- 172.21.15.125:0/672416466 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36400bb40 con 0x7fd3741571b0 2023-10-06T03:05:13.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.548+0000 7fd37b869700 1 -- 172.21.15.125:0/672416466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3741571b0 msgr2=0x7fd3740cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:13.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.548+0000 7fd37b869700 1 --2- 172.21.15.125:0/672416466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3741571b0 0x7fd3740cc060 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd3640098e0 tx=0x7fd3640091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:13.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.548+0000 7fd37b869700 1 -- 172.21.15.125:0/672416466 shutdown_connections 2023-10-06T03:05:13.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.548+0000 7fd37b869700 1 --2- 172.21.15.125:0/672416466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3741571b0 0x7fd3740cc060 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:13.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.548+0000 7fd37b869700 1 -- 172.21.15.125:0/672416466 >> 172.21.15.125:0/672416466 conn(0x7fd3740cdf80 msgr2=0x7fd3740ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:13.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.548+0000 7fd37b869700 1 -- 172.21.15.125:0/672416466 shutdown_connections 2023-10-06T03:05:13.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.548+0000 7fd37b869700 1 -- 172.21.15.125:0/672416466 wait complete. 2023-10-06T03:05:13.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.550+0000 7fd37b869700 1 Processor -- start 2023-10-06T03:05:13.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.550+0000 7fd37b869700 1 -- start start 2023-10-06T03:05:13.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.551+0000 7fd37b869700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3740cd790 0x7fd374167a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:13.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.551+0000 7fd37b869700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd374156de0 0x7fd3740c6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:13.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.551+0000 7fd37b869700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3741571b0 0x7fd3740c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:13.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.551+0000 7fd37b869700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37414d360 con 0x7fd3741571b0 2023-10-06T03:05:13.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.551+0000 7fd37b869700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740b0e30 con 0x7fd374156de0 2023-10-06T03:05:13.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.551+0000 7fd37b869700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740c5fb0 con 0x7fd3740cd790 2023-10-06T03:05:13.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.551+0000 7fd379e06700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3741571b0 0x7fd3740c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:13.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.551+0000 7fd379e06700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3741571b0 0x7fd3740c6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39630/0 (socket says 172.21.15.125:39630) 2023-10-06T03:05:13.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.551+0000 7fd379e06700 1 -- 172.21.15.125:0/374434474 learned_addr learned my addr 172.21.15.125:0/374434474 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:13.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.551+0000 7fd379e06700 1 -- 172.21.15.125:0/374434474 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3740cd790 msgr2=0x7fd374167a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:13.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.551+0000 7fd379e06700 1 --2- 172.21.15.125:0/374434474 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3740cd790 0x7fd374167a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:13.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.551+0000 7fd379e06700 1 -- 172.21.15.125:0/374434474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd374156de0 msgr2=0x7fd3740c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:13.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.551+0000 7fd379e06700 1 --2- 172.21.15.125:0/374434474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd374156de0 0x7fd3740c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:13.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.551+0000 7fd379e06700 1 -- 172.21.15.125:0/374434474 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd364009420 con 0x7fd3741571b0 2023-10-06T03:05:13.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.551+0000 7fd379e06700 1 --2- 172.21.15.125:0/374434474 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3741571b0 0x7fd3740c6a40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00c8e0 tx=0x7fd36c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:13.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.551+0000 7fd3697fa700 1 -- 172.21.15.125:0/374434474 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c00ce80 con 0x7fd3741571b0 2023-10-06T03:05:13.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.552+0000 7fd3697fa700 1 -- 172.21.15.125:0/374434474 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c00a870 con 0x7fd3741571b0 2023-10-06T03:05:13.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.552+0000 7fd37b869700 1 -- 172.21.15.125:0/374434474 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3740c53a0 con 0x7fd3741571b0 2023-10-06T03:05:13.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.552+0000 7fd3697fa700 1 -- 172.21.15.125:0/374434474 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c00ac10 con 0x7fd3741571b0 2023-10-06T03:05:13.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.552+0000 7fd37b869700 1 -- 172.21.15.125:0/374434474 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3740c5730 con 0x7fd3741571b0 2023-10-06T03:05:13.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.552+0000 7fd37b869700 1 -- 172.21.15.125:0/374434474 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3740c5d30 con 0x7fd3741571b0 2023-10-06T03:05:13.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.553+0000 7fd3697fa700 1 -- 172.21.15.125:0/374434474 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd36c012420 con 0x7fd3741571b0 2023-10-06T03:05:13.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.553+0000 7fd3697fa700 1 --2- 172.21.15.125:0/374434474 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd358066f30 0x7fd3580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:13.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.553+0000 7fd3697fa700 1 -- 172.21.15.125:0/374434474 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fd36c084d00 con 0x7fd3741571b0 2023-10-06T03:05:13.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.553+0000 7fd379605700 1 --2- 172.21.15.125:0/374434474 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd358066f30 0x7fd3580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:13.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.554+0000 7fd379605700 1 --2- 172.21.15.125:0/374434474 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd358066f30 0x7fd3580693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd3700058d0 tx=0x7fd3700079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:13.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.557+0000 7fd3697fa700 1 -- 172.21.15.125:0/374434474 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd36c055570 con 0x7fd3741571b0 2023-10-06T03:05:13.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.739+0000 7fd37b869700 1 -- 172.21.15.125:0/374434474 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd374066510 con 0x7fd3741571b0 2023-10-06T03:05:13.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.745+0000 7fd3697fa700 1 -- 172.21.15.125:0/374434474 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd36c055100 con 0x7fd3741571b0 2023-10-06T03:05:13.748 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.747+0000 7fd37b869700 1 -- 172.21.15.125:0/374434474 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd358066f30 msgr2=0x7fd3580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:13.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.747+0000 7fd37b869700 1 --2- 172.21.15.125:0/374434474 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd358066f30 0x7fd3580693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd3700058d0 tx=0x7fd3700079d0 comp rx=0 tx=0).stop 2023-10-06T03:05:13.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.747+0000 7fd37b869700 1 -- 172.21.15.125:0/374434474 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3741571b0 msgr2=0x7fd3740c6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:13.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.747+0000 7fd37b869700 1 --2- 172.21.15.125:0/374434474 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3741571b0 0x7fd3740c6a40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00c8e0 tx=0x7fd36c001710 comp rx=0 tx=0).stop 2023-10-06T03:05:13.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.747+0000 7fd37b869700 1 -- 172.21.15.125:0/374434474 shutdown_connections 2023-10-06T03:05:13.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.747+0000 7fd37b869700 1 --2- 172.21.15.125:0/374434474 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd358066f30 0x7fd3580693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:13.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.747+0000 7fd37b869700 1 --2- 172.21.15.125:0/374434474 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3741571b0 0x7fd3740c6a40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:13.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.747+0000 7fd37b869700 1 --2- 172.21.15.125:0/374434474 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3740cd790 0x7fd374167a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:13.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.747+0000 7fd37b869700 1 --2- 172.21.15.125:0/374434474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd374156de0 0x7fd3740c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:13.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.747+0000 7fd37b869700 1 -- 172.21.15.125:0/374434474 >> 172.21.15.125:0/374434474 conn(0x7fd3740cdf80 msgr2=0x7fd37406c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:13.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.747+0000 7fd37b869700 1 -- 172.21.15.125:0/374434474 shutdown_connections 2023-10-06T03:05:13.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:13.747+0000 7fd37b869700 1 -- 172.21.15.125:0/374434474 wait complete. 2023-10-06T03:05:13.760 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:05:13.760 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:05:13.802 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:05:13.855 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:05:13.855 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2023-10-06T03:05:13.855 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:05:13.855 DEBUG:teuthology.orchestra.run.smithi125:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:13.892 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T03:05:13.892 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:05:13.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:13.893 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:05:13.951 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi130.front.sepia.ceph.com... 2023-10-06T03:05:13.951 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:05:13.951 DEBUG:teuthology.orchestra.run.smithi130:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-06T03:05:13.995 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T03:05:13.995 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-10-06T03:05:13.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:13.996 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T03:05:14.243 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2023-10-06T03:05:14.243 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:05:14.243 DEBUG:teuthology.orchestra.run.smithi125:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-10-06T03:05:14.290 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T03:05:14.290 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:05:14.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:14.291 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T03:05:14.349 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi130.front.sepia.ceph.com... 2023-10-06T03:05:14.349 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:05:14.349 DEBUG:teuthology.orchestra.run.smithi130:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-10-06T03:05:14.397 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T03:05:14.398 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-10-06T03:05:14.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:14.398 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T03:05:14.459 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T03:05:14.459 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:05:14.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.577+0000 7f17caaef700 1 Processor -- start 2023-10-06T03:05:14.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.577+0000 7f17caaef700 1 -- start start 2023-10-06T03:05:14.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.578+0000 7f17caaef700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f17c40af320 0x7f17c40c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:14.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.578+0000 7f17caaef700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f17c4067d20 0x7f17c40c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:14.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.578+0000 7f17caaef700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c40caa40 con 0x7f17c40cc5a0 2023-10-06T03:05:14.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.578+0000 7f17caaef700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c40c1ca0 con 0x7f17c40af320 2023-10-06T03:05:14.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.578+0000 7f17caaef700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c40cca60 con 0x7f17c4067d20 2023-10-06T03:05:14.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.578+0000 7f17c888b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f17c40af320 0x7f17c40c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:14.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.578+0000 7f17c3fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f17c40cc5a0 0x7f17c4067610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43892/0 (socket says 172.21.15.125:43892) 2023-10-06T03:05:14.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.578+0000 7f17c3fff700 1 -- 172.21.15.125:0/4095933958 learned_addr learned my addr 172.21.15.125:0/4095933958 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:14.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.579+0000 7f17c908c700 1 --2- 172.21.15.125:0/4095933958 >> v2:172.21.15.130:3300/0 conn(0x7f17c4067d20 0x7f17c40c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:14.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.579+0000 7f17c888b700 1 -- 172.21.15.125:0/4095933958 >> v2:172.21.15.130:3300/0 conn(0x7f17c4067d20 msgr2=0x7f17c40c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:14.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.579+0000 7f17c888b700 1 --2- 172.21.15.125:0/4095933958 >> v2:172.21.15.130:3300/0 conn(0x7f17c4067d20 0x7f17c40c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:14.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.579+0000 7f17c888b700 1 -- 172.21.15.125:0/4095933958 >> v1:172.21.15.125:6789/0 conn(0x7f17c40cc5a0 legacy=0x7f17c4067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:14.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.579+0000 7f17c888b700 1 -- 172.21.15.125:0/4095933958 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c40cac90 con 0x7f17c40af320 2023-10-06T03:05:14.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.579+0000 7f17c37fe700 1 -- 172.21.15.125:0/4095933958 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413239542 0 0) 0x7f17c40caa40 con 0x7f17c40cc5a0 2023-10-06T03:05:14.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.579+0000 7f17c888b700 1 --2- 172.21.15.125:0/4095933958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17c40af320 0x7f17c40c8ed0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f17c406f150 tx=0x7f17b8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86978d56752787f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:14.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.579+0000 7f17c37fe700 1 -- 172.21.15.125:0/4095933958 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8005c10 con 0x7f17c40af320 2023-10-06T03:05:14.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.579+0000 7f17c37fe700 1 -- 172.21.15.125:0/4095933958 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b8005d70 con 0x7f17c40af320 2023-10-06T03:05:14.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.579+0000 7f17c37fe700 1 -- 172.21.15.125:0/4095933958 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8006260 con 0x7f17c40af320 2023-10-06T03:05:14.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.579+0000 7f17caaef700 1 -- 172.21.15.125:0/4095933958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17c40af320 msgr2=0x7f17c40c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:14.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.579+0000 7f17caaef700 1 --2- 172.21.15.125:0/4095933958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17c40af320 0x7f17c40c8ed0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f17c406f150 tx=0x7f17b8009120 comp rx=0 tx=0).stop 2023-10-06T03:05:14.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.580+0000 7f17caaef700 1 -- 172.21.15.125:0/4095933958 shutdown_connections 2023-10-06T03:05:14.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.580+0000 7f17caaef700 1 --2- 172.21.15.125:0/4095933958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17c40af320 0x7f17c40c8ed0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:14.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.580+0000 7f17caaef700 1 --2- 172.21.15.125:0/4095933958 >> v2:172.21.15.130:3300/0 conn(0x7f17c4067d20 0x7f17c40c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:14.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.580+0000 7f17caaef700 1 -- 172.21.15.125:0/4095933958 >> 172.21.15.125:0/4095933958 conn(0x7f17c4068f00 msgr2=0x7f17c40cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:14.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.580+0000 7f17caaef700 1 -- 172.21.15.125:0/4095933958 shutdown_connections 2023-10-06T03:05:14.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.580+0000 7f17caaef700 1 -- 172.21.15.125:0/4095933958 wait complete. 2023-10-06T03:05:14.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.581+0000 7f17caaef700 1 Processor -- start 2023-10-06T03:05:14.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.581+0000 7f17caaef700 1 -- start start 2023-10-06T03:05:14.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17caaef700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17c4067d20 0x7f17c40b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:14.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17caaef700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17c40af320 0x7f17c415b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:14.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17caaef700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17c40cc5a0 0x7f17c40b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:14.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17caaef700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c416a700 con 0x7f17c40af320 2023-10-06T03:05:14.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17caaef700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c416a420 con 0x7f17c40cc5a0 2023-10-06T03:05:14.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17caaef700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40afdb0 con 0x7f17c4067d20 2023-10-06T03:05:14.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17c3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17c40af320 0x7f17c415b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:14.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17c3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17c40af320 0x7f17c415b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39640/0 (socket says 172.21.15.125:39640) 2023-10-06T03:05:14.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17c3fff700 1 -- 172.21.15.125:0/4084677441 learned_addr learned my addr 172.21.15.125:0/4084677441 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:14.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17c888b700 1 --2- 172.21.15.125:0/4084677441 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17c4067d20 0x7f17c40b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:14.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17c908c700 1 --2- 172.21.15.125:0/4084677441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17c40cc5a0 0x7f17c40b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:14.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17c3fff700 1 -- 172.21.15.125:0/4084677441 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17c4067d20 msgr2=0x7f17c40b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:14.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17c3fff700 1 --2- 172.21.15.125:0/4084677441 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17c4067d20 0x7f17c40b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:14.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17c3fff700 1 -- 172.21.15.125:0/4084677441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17c40cc5a0 msgr2=0x7f17c40b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:14.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17c3fff700 1 --2- 172.21.15.125:0/4084677441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17c40cc5a0 0x7f17c40b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:14.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17c3fff700 1 -- 172.21.15.125:0/4084677441 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b80093c0 con 0x7f17c40af320 2023-10-06T03:05:14.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17c908c700 1 --2- 172.21.15.125:0/4084677441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17c40cc5a0 0x7f17c40b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:14.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17c3fff700 1 --2- 172.21.15.125:0/4084677441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17c40af320 0x7f17c415b000 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f17b000c5b0 tx=0x7f17b0000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:14.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17c0ff9700 1 -- 172.21.15.125:0/4084677441 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0005b30 con 0x7f17c40af320 2023-10-06T03:05:14.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17c0ff9700 1 -- 172.21.15.125:0/4084677441 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b0005c90 con 0x7f17c40af320 2023-10-06T03:05:14.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17caaef700 1 -- 172.21.15.125:0/4084677441 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c40b0090 con 0x7f17c40af320 2023-10-06T03:05:14.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17c0ff9700 1 -- 172.21.15.125:0/4084677441 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b00072e0 con 0x7f17c40af320 2023-10-06T03:05:14.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.582+0000 7f17caaef700 1 -- 172.21.15.125:0/4084677441 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c40b0dd0 con 0x7f17c40af320 2023-10-06T03:05:14.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.583+0000 7f17caaef700 1 -- 172.21.15.125:0/4084677441 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c40afc10 con 0x7f17c40af320 2023-10-06T03:05:14.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.584+0000 7f17c0ff9700 1 -- 172.21.15.125:0/4084677441 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17b001b3b0 con 0x7f17c40af320 2023-10-06T03:05:14.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.584+0000 7f17c0ff9700 1 --2- 172.21.15.125:0/4084677441 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f17a8066f30 0x7f17a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:14.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.584+0000 7f17c0ff9700 1 -- 172.21.15.125:0/4084677441 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f17b0083d20 con 0x7f17c40af320 2023-10-06T03:05:14.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.584+0000 7f17c888b700 1 --2- 172.21.15.125:0/4084677441 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f17a8066f30 0x7f17a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:14.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.585+0000 7f17c888b700 1 --2- 172.21.15.125:0/4084677441 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f17a8066f30 0x7f17a80693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f17c415c280 tx=0x7f17b8016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:14.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.588+0000 7f17c0ff9700 1 -- 172.21.15.125:0/4084677441 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17b004b5a0 con 0x7f17c40af320 2023-10-06T03:05:14.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.811+0000 7f17caaef700 1 -- 172.21.15.125:0/4084677441 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17c40b05b0 con 0x7f17c40af320 2023-10-06T03:05:14.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.811+0000 7f17c0ff9700 1 -- 172.21.15.125:0/4084677441 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f17c40b05b0 con 0x7f17c40af320 2023-10-06T03:05:14.813 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:14.813 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/1260071130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1260071130},{"type":"v1","addr":"172.21.15.130:6834","nonce":1260071130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/63925154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":63925154},{"type":"v1","addr":"172.21.15.125:6836","nonce":63925154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/1057811891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1057811891},{"type":"v1","addr":"172.21.15.125:6837","nonce":1057811891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:04:29.211664+0000","modified":"2023-10-06T03:04:42.275374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/4004582354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":4004582354},{"type":"v1","addr":"172.21.15.130:6835","nonce":4004582354}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:05:14.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.813+0000 7f17caaef700 1 -- 172.21.15.125:0/4084677441 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f17a8066f30 msgr2=0x7f17a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:14.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.813+0000 7f17caaef700 1 --2- 172.21.15.125:0/4084677441 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f17a8066f30 0x7f17a80693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f17c415c280 tx=0x7f17b8016000 comp rx=0 tx=0).stop 2023-10-06T03:05:14.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.813+0000 7f17caaef700 1 -- 172.21.15.125:0/4084677441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17c40af320 msgr2=0x7f17c415b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:14.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.813+0000 7f17caaef700 1 --2- 172.21.15.125:0/4084677441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17c40af320 0x7f17c415b000 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f17b000c5b0 tx=0x7f17b0000fe0 comp rx=0 tx=0).stop 2023-10-06T03:05:14.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.813+0000 7f17caaef700 1 -- 172.21.15.125:0/4084677441 shutdown_connections 2023-10-06T03:05:14.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.813+0000 7f17caaef700 1 --2- 172.21.15.125:0/4084677441 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f17a8066f30 0x7f17a80693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:14.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.813+0000 7f17caaef700 1 --2- 172.21.15.125:0/4084677441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17c40cc5a0 0x7f17c40b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:14.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.813+0000 7f17caaef700 1 --2- 172.21.15.125:0/4084677441 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17c4067d20 0x7f17c40b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:14.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.813+0000 7f17caaef700 1 --2- 172.21.15.125:0/4084677441 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17c40af320 0x7f17c415b000 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:14.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.813+0000 7f17caaef700 1 -- 172.21.15.125:0/4084677441 >> 172.21.15.125:0/4084677441 conn(0x7f17c4068f00 msgr2=0x7f17c41576d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:14.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.813+0000 7f17caaef700 1 -- 172.21.15.125:0/4084677441 shutdown_connections 2023-10-06T03:05:14.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.813+0000 7f17caaef700 1 -- 172.21.15.125:0/4084677441 wait complete. 2023-10-06T03:05:14.816 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 9 2023-10-06T03:05:14.827 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:05:14.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.942+0000 7fb157508700 1 Processor -- start 2023-10-06T03:05:14.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.943+0000 7fb157508700 1 -- start start 2023-10-06T03:05:14.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.943+0000 7fb157508700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb150158f70 0x7fb1500b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:14.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.943+0000 7fb157508700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1500b44a0 con 0x7fb1500b1b50 2023-10-06T03:05:14.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.943+0000 7fb157508700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1500b4780 con 0x7fb150159340 2023-10-06T03:05:14.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.943+0000 7fb157508700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1500b4a60 con 0x7fb150158f70 2023-10-06T03:05:14.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.944+0000 7fb155aa5700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb1500b1b50 0x7fb15015a9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:43898/0 (socket says 172.21.15.125:43898) 2023-10-06T03:05:14.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.944+0000 7fb155aa5700 1 -- 172.21.15.125:0/320990796 learned_addr learned my addr 172.21.15.125:0/320990796 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:14.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.944+0000 7fb1552a4700 1 --2- 172.21.15.125:0/320990796 >> v2:172.21.15.130:3300/0 conn(0x7fb150158f70 0x7fb1500b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:14.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.944+0000 7fb143fff700 1 -- 172.21.15.125:0/320990796 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093632162 0 0) 0x7fb1500b44a0 con 0x7fb1500b1b50 2023-10-06T03:05:14.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.944+0000 7fb143fff700 1 -- 172.21.15.125:0/320990796 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb13c003570 con 0x7fb1500b1b50 2023-10-06T03:05:14.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.944+0000 7fb143fff700 1 -- 172.21.15.125:0/320990796 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472201994 0 0) 0x7fb1500b4780 con 0x7fb150159340 2023-10-06T03:05:14.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.944+0000 7fb143fff700 1 -- 172.21.15.125:0/320990796 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1500b44a0 con 0x7fb150159340 2023-10-06T03:05:14.947 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.944+0000 7fb1552a4700 1 -- 172.21.15.125:0/320990796 >> v1:172.21.15.130:6789/0 conn(0x7fb150159340 legacy=0x7fb1500b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.944+0000 7fb1552a4700 1 -- 172.21.15.125:0/320990796 >> v1:172.21.15.125:6789/0 conn(0x7fb1500b1b50 legacy=0x7fb15015a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.944+0000 7fb143fff700 1 -- 172.21.15.125:0/320990796 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 11118076 0 0) 0x7fb13c003570 con 0x7fb1500b1b50 2023-10-06T03:05:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.944+0000 7fb1552a4700 1 -- 172.21.15.125:0/320990796 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1500b4d40 con 0x7fb150158f70 2023-10-06T03:05:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.944+0000 7fb1552a4700 1 --2- 172.21.15.125:0/320990796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb150158f70 0x7fb1500b5540 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0098e0 tx=0x7fb14c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4f42694fe54d0ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.944+0000 7fb143fff700 1 -- 172.21.15.125:0/320990796 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1480017f0 con 0x7fb150158f70 2023-10-06T03:05:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.944+0000 7fb143fff700 1 -- 172.21.15.125:0/320990796 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14c011420 con 0x7fb150158f70 2023-10-06T03:05:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.944+0000 7fb143fff700 1 -- 172.21.15.125:0/320990796 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c0117c0 con 0x7fb150158f70 2023-10-06T03:05:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.945+0000 7fb157508700 1 -- 172.21.15.125:0/320990796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb150158f70 msgr2=0x7fb1500b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.945+0000 7fb157508700 1 --2- 172.21.15.125:0/320990796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb150158f70 0x7fb1500b5540 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0098e0 tx=0x7fb14c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.945+0000 7fb157508700 1 -- 172.21.15.125:0/320990796 shutdown_connections 2023-10-06T03:05:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.945+0000 7fb157508700 1 --2- 172.21.15.125:0/320990796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb150158f70 0x7fb1500b5540 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:14.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.945+0000 7fb157508700 1 -- 172.21.15.125:0/320990796 >> 172.21.15.125:0/320990796 conn(0x7fb15006ed40 msgr2=0x7fb15006f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:14.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.945+0000 7fb157508700 1 -- 172.21.15.125:0/320990796 shutdown_connections 2023-10-06T03:05:14.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.945+0000 7fb157508700 1 -- 172.21.15.125:0/320990796 wait complete. 2023-10-06T03:05:14.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.946+0000 7fb157508700 1 Processor -- start 2023-10-06T03:05:14.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.946+0000 7fb157508700 1 -- start start 2023-10-06T03:05:14.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.947+0000 7fb157508700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1500b1b50 0x7fb15014dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:14.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.947+0000 7fb157508700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb150158f70 0x7fb15015dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:14.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.947+0000 7fb157508700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb150159340 0x7fb15015e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:14.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.947+0000 7fb157508700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15014fd70 con 0x7fb150159340 2023-10-06T03:05:14.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.947+0000 7fb157508700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1501562c0 con 0x7fb150158f70 2023-10-06T03:05:14.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.947+0000 7fb157508700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1501565a0 con 0x7fb1500b1b50 2023-10-06T03:05:14.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.947+0000 7fb155aa5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb150159340 0x7fb15015e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:14.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.947+0000 7fb155aa5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb150159340 0x7fb15015e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39656/0 (socket says 172.21.15.125:39656) 2023-10-06T03:05:14.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.947+0000 7fb155aa5700 1 -- 172.21.15.125:0/2694545815 learned_addr learned my addr 172.21.15.125:0/2694545815 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:14.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.947+0000 7fb1552a4700 1 --2- 172.21.15.125:0/2694545815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1500b1b50 0x7fb15014dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:14.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.947+0000 7fb154aa3700 1 --2- 172.21.15.125:0/2694545815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb150158f70 0x7fb15015dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:14.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.948+0000 7fb155aa5700 1 -- 172.21.15.125:0/2694545815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1500b1b50 msgr2=0x7fb15014dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:14.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.948+0000 7fb155aa5700 1 --2- 172.21.15.125:0/2694545815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1500b1b50 0x7fb15014dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:14.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.948+0000 7fb155aa5700 1 -- 172.21.15.125:0/2694545815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb150158f70 msgr2=0x7fb15015dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:14.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.948+0000 7fb155aa5700 1 --2- 172.21.15.125:0/2694545815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb150158f70 0x7fb15015dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:14.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.948+0000 7fb155aa5700 1 -- 172.21.15.125:0/2694545815 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c009420 con 0x7fb150159340 2023-10-06T03:05:14.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.948+0000 7fb155aa5700 1 --2- 172.21.15.125:0/2694545815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb150159340 0x7fb15015e2a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb14800cc80 tx=0x7fb148007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:14.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.948+0000 7fb1417fa700 1 -- 172.21.15.125:0/2694545815 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148004dc0 con 0x7fb150159340 2023-10-06T03:05:14.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.948+0000 7fb1417fa700 1 -- 172.21.15.125:0/2694545815 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14800a660 con 0x7fb150159340 2023-10-06T03:05:14.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.948+0000 7fb157508700 1 -- 172.21.15.125:0/2694545815 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb150156880 con 0x7fb150159340 2023-10-06T03:05:14.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.948+0000 7fb1417fa700 1 -- 172.21.15.125:0/2694545815 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14800aa20 con 0x7fb150159340 2023-10-06T03:05:14.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.948+0000 7fb157508700 1 -- 172.21.15.125:0/2694545815 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb150156e40 con 0x7fb150159340 2023-10-06T03:05:14.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.949+0000 7fb157508700 1 -- 172.21.15.125:0/2694545815 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb150157060 con 0x7fb150159340 2023-10-06T03:05:14.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.949+0000 7fb1417fa700 1 -- 172.21.15.125:0/2694545815 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb148007150 con 0x7fb150159340 2023-10-06T03:05:14.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.950+0000 7fb1417fa700 1 --2- 172.21.15.125:0/2694545815 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb134066f30 0x7fb1340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:14.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.950+0000 7fb1417fa700 1 -- 172.21.15.125:0/2694545815 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fb148083fb0 con 0x7fb150159340 2023-10-06T03:05:14.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.950+0000 7fb1552a4700 1 --2- 172.21.15.125:0/2694545815 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb134066f30 0x7fb1340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:14.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.950+0000 7fb1552a4700 1 --2- 172.21.15.125:0/2694545815 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb134066f30 0x7fb1340693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0093f0 tx=0x7fb14c016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:14.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:14.954+0000 7fb1417fa700 1 -- 172.21.15.125:0/2694545815 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb148050e10 con 0x7fb150159340 2023-10-06T03:05:15.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.137+0000 7fb157508700 1 -- 172.21.15.125:0/2694545815 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb150066510 con 0x7fb150159340 2023-10-06T03:05:15.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.138+0000 7fb1417fa700 1 -- 172.21.15.125:0/2694545815 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18947 (secure 0 0 0) 0x7fb148018020 con 0x7fb150159340 2023-10-06T03:05:15.140 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:15.140 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":29,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:05:11.385603+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:04:26.828121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:04:28.179225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:04:31.256394+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:05:15.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.140+0000 7fb157508700 1 -- 172.21.15.125:0/2694545815 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb134066f30 msgr2=0x7fb1340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.140+0000 7fb157508700 1 --2- 172.21.15.125:0/2694545815 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb134066f30 0x7fb1340693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0093f0 tx=0x7fb14c016000 comp rx=0 tx=0).stop 2023-10-06T03:05:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.140+0000 7fb157508700 1 -- 172.21.15.125:0/2694545815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb150159340 msgr2=0x7fb15015e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.140+0000 7fb157508700 1 --2- 172.21.15.125:0/2694545815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb150159340 0x7fb15015e2a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb14800cc80 tx=0x7fb148007d20 comp rx=0 tx=0).stop 2023-10-06T03:05:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.140+0000 7fb157508700 1 -- 172.21.15.125:0/2694545815 shutdown_connections 2023-10-06T03:05:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.140+0000 7fb157508700 1 --2- 172.21.15.125:0/2694545815 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb134066f30 0x7fb1340693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.140+0000 7fb157508700 1 --2- 172.21.15.125:0/2694545815 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb150159340 0x7fb15015e2a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.140+0000 7fb157508700 1 --2- 172.21.15.125:0/2694545815 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1500b1b50 0x7fb15014dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.140+0000 7fb157508700 1 --2- 172.21.15.125:0/2694545815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb150158f70 0x7fb15015dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.140+0000 7fb157508700 1 -- 172.21.15.125:0/2694545815 >> 172.21.15.125:0/2694545815 conn(0x7fb15006ed40 msgr2=0x7fb1500d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:15.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.140+0000 7fb157508700 1 -- 172.21.15.125:0/2694545815 shutdown_connections 2023-10-06T03:05:15.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.140+0000 7fb157508700 1 -- 172.21.15.125:0/2694545815 wait complete. 2023-10-06T03:05:15.153 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:04:15.845430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:04:22.729795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:04:26.828121+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:04:28.179225+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-06T03:04:31.256394+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:05:15.154 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:05:15.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.273+0000 7f7a208c1700 1 Processor -- start 2023-10-06T03:05:15.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.273+0000 7f7a208c1700 1 -- start start 2023-10-06T03:05:15.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.274+0000 7f7a208c1700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7a1c0af320 0x7f7a1c0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:15.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.274+0000 7f7a208c1700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7a1c0ca190 0x7f7a1c067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:15.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.274+0000 7f7a208c1700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c0cafe0 con 0x7f7a1c067b50 2023-10-06T03:05:15.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.274+0000 7f7a208c1700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1c067fd0 con 0x7f7a1c0af320 2023-10-06T03:05:15.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.274+0000 7f7a208c1700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1c0c3b40 con 0x7f7a1c0ca190 2023-10-06T03:05:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.274+0000 7f7a1a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7a1c0af320 0x7f7a1c0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.274+0000 7f7a1a59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7a1c0af320 0x7f7a1c0caaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39672/0 (socket says 172.21.15.125:39672) 2023-10-06T03:05:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.274+0000 7f7a1a59c700 1 -- 172.21.15.125:0/2846839096 learned_addr learned my addr 172.21.15.125:0/2846839096 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.274+0000 7f7a19d9b700 1 --2- 172.21.15.125:0/2846839096 >> v2:172.21.15.130:3300/0 conn(0x7f7a1c0ca190 0x7f7a1c067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.275+0000 7f7a1a59c700 1 -- 172.21.15.125:0/2846839096 >> v2:172.21.15.130:3300/0 conn(0x7f7a1c0ca190 msgr2=0x7f7a1c067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.275+0000 7f7a1a59c700 1 --2- 172.21.15.125:0/2846839096 >> v2:172.21.15.130:3300/0 conn(0x7f7a1c0ca190 0x7f7a1c067610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.275+0000 7f7a1a59c700 1 -- 172.21.15.125:0/2846839096 >> v1:172.21.15.130:6789/0 conn(0x7f7a1c067b50 legacy=0x7f7a1c0c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.275+0000 7f7a1a59c700 1 -- 172.21.15.125:0/2846839096 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c0ca710 con 0x7f7a1c0af320 2023-10-06T03:05:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.275+0000 7f7a1a59c700 1 --2- 172.21.15.125:0/2846839096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a1c0af320 0x7f7a1c0caaa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c06dec0 tx=0x7f7a10009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952ebdbb0a9bed9f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:15.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.275+0000 7f7a1959a700 1 -- 172.21.15.125:0/2846839096 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a10005c10 con 0x7f7a1c0af320 2023-10-06T03:05:15.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.275+0000 7f7a1959a700 1 -- 172.21.15.125:0/2846839096 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a10005d70 con 0x7f7a1c0af320 2023-10-06T03:05:15.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.275+0000 7f7a1959a700 1 -- 172.21.15.125:0/2846839096 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1000b8a0 con 0x7f7a1c0af320 2023-10-06T03:05:15.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.275+0000 7f7a208c1700 1 -- 172.21.15.125:0/2846839096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a1c0af320 msgr2=0x7f7a1c0caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:15.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.275+0000 7f7a208c1700 1 --2- 172.21.15.125:0/2846839096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a1c0af320 0x7f7a1c0caaa0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c06dec0 tx=0x7f7a10009220 comp rx=0 tx=0).stop 2023-10-06T03:05:15.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.276+0000 7f7a208c1700 1 -- 172.21.15.125:0/2846839096 shutdown_connections 2023-10-06T03:05:15.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.276+0000 7f7a208c1700 1 --2- 172.21.15.125:0/2846839096 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a1c0af320 0x7f7a1c0caaa0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.276+0000 7f7a208c1700 1 --2- 172.21.15.125:0/2846839096 >> v2:172.21.15.130:3300/0 conn(0x7f7a1c0ca190 0x7f7a1c067610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.276+0000 7f7a208c1700 1 -- 172.21.15.125:0/2846839096 >> 172.21.15.125:0/2846839096 conn(0x7f7a1c096120 msgr2=0x7f7a1c068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:15.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.276+0000 7f7a208c1700 1 -- 172.21.15.125:0/2846839096 shutdown_connections 2023-10-06T03:05:15.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.276+0000 7f7a208c1700 1 -- 172.21.15.125:0/2846839096 wait complete. 2023-10-06T03:05:15.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.277+0000 7f7a208c1700 1 Processor -- start 2023-10-06T03:05:15.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.277+0000 7f7a208c1700 1 -- start start 2023-10-06T03:05:15.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.277+0000 7f7a208c1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a1c067b50 0x7f7a1c16a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:15.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.277+0000 7f7a208c1700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a1c0af320 0x7f7a1c0b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:15.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.277+0000 7f7a208c1700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a1c0ca190 0x7f7a1c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:15.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.277+0000 7f7a208c1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c151b80 con 0x7f7a1c067b50 2023-10-06T03:05:15.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.278+0000 7f7a208c1700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c16a790 con 0x7f7a1c0af320 2023-10-06T03:05:15.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.278+0000 7f7a208c1700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0c4770 con 0x7f7a1c0ca190 2023-10-06T03:05:15.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.278+0000 7f7a1a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a1c067b50 0x7f7a1c16a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:15.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.278+0000 7f7a1a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a1c067b50 0x7f7a1c16a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52072/0 (socket says 172.21.15.125:52072) 2023-10-06T03:05:15.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.278+0000 7f7a1a59c700 1 -- 172.21.15.125:0/222653604 learned_addr learned my addr 172.21.15.125:0/222653604 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.278+0000 7f7a19d9b700 1 --2- 172.21.15.125:0/222653604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a1c0af320 0x7f7a1c0b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.278+0000 7f7a1ad9d700 1 --2- 172.21.15.125:0/222653604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a1c0ca190 0x7f7a1c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.278+0000 7f7a1a59c700 1 -- 172.21.15.125:0/222653604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a1c0ca190 msgr2=0x7f7a1c0c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.278+0000 7f7a1a59c700 1 --2- 172.21.15.125:0/222653604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a1c0ca190 0x7f7a1c0c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.278+0000 7f7a1a59c700 1 -- 172.21.15.125:0/222653604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a1c0af320 msgr2=0x7f7a1c0b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.278+0000 7f7a1a59c700 1 --2- 172.21.15.125:0/222653604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a1c0af320 0x7f7a1c0b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.278+0000 7f7a1a59c700 1 -- 172.21.15.125:0/222653604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a10009480 con 0x7f7a1c067b50 2023-10-06T03:05:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.278+0000 7f7a1ad9d700 1 --2- 172.21.15.125:0/222653604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a1c0ca190 0x7f7a1c0c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.278+0000 7f7a1a59c700 1 --2- 172.21.15.125:0/222653604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a1c067b50 0x7f7a1c16a250 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000b3c0 tx=0x7f7a10016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.278+0000 7f7a0a7fc700 1 -- 172.21.15.125:0/222653604 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1001a420 con 0x7f7a1c067b50 2023-10-06T03:05:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.278+0000 7f7a0a7fc700 1 -- 172.21.15.125:0/222653604 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1001a5a0 con 0x7f7a1c067b50 2023-10-06T03:05:15.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.278+0000 7f7a0a7fc700 1 -- 172.21.15.125:0/222653604 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1001a960 con 0x7f7a1c067b50 2023-10-06T03:05:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.278+0000 7f7a208c1700 1 -- 172.21.15.125:0/222653604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1c153640 con 0x7f7a1c067b50 2023-10-06T03:05:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.278+0000 7f7a208c1700 1 -- 172.21.15.125:0/222653604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c153c00 con 0x7f7a1c067b50 2023-10-06T03:05:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.279+0000 7f7a208c1700 1 -- 172.21.15.125:0/222653604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1c153e20 con 0x7f7a1c067b50 2023-10-06T03:05:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.279+0000 7f7a0a7fc700 1 -- 172.21.15.125:0/222653604 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a1001ad50 con 0x7f7a1c067b50 2023-10-06T03:05:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.280+0000 7f7a0a7fc700 1 --2- 172.21.15.125:0/222653604 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f79fc066f30 0x7f79fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.280+0000 7f7a0a7fc700 1 -- 172.21.15.125:0/222653604 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f7a10085d30 con 0x7f7a1c067b50 2023-10-06T03:05:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.280+0000 7f7a19d9b700 1 --2- 172.21.15.125:0/222653604 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f79fc066f30 0x7f79fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:15.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.280+0000 7f7a19d9b700 1 --2- 172.21.15.125:0/222653604 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f79fc066f30 0x7f79fc0693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c0c7160 tx=0x7f7a0c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:15.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.284+0000 7f7a0a7fc700 1 -- 172.21.15.125:0/222653604 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a10052bc0 con 0x7f7a1c067b50 2023-10-06T03:05:15.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.466+0000 7f7a208c1700 1 -- 172.21.15.125:0/222653604 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a1c066510 con 0x7f7a1c067b50 2023-10-06T03:05:15.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.467+0000 7f7a0a7fc700 1 -- 172.21.15.125:0/222653604 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a10029020 con 0x7f7a1c067b50 2023-10-06T03:05:15.468 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-06T03:05:15.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.469+0000 7f7a208c1700 1 -- 172.21.15.125:0/222653604 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f79fc066f30 msgr2=0x7f79fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.469+0000 7f7a208c1700 1 --2- 172.21.15.125:0/222653604 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f79fc066f30 0x7f79fc0693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c0c7160 tx=0x7f7a0c008040 comp rx=0 tx=0).stop 2023-10-06T03:05:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.469+0000 7f7a208c1700 1 -- 172.21.15.125:0/222653604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a1c067b50 msgr2=0x7f7a1c16a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.469+0000 7f7a208c1700 1 --2- 172.21.15.125:0/222653604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a1c067b50 0x7f7a1c16a250 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000b3c0 tx=0x7f7a10016000 comp rx=0 tx=0).stop 2023-10-06T03:05:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.469+0000 7f7a208c1700 1 -- 172.21.15.125:0/222653604 shutdown_connections 2023-10-06T03:05:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.469+0000 7f7a208c1700 1 --2- 172.21.15.125:0/222653604 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f79fc066f30 0x7f79fc0693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.469+0000 7f7a208c1700 1 --2- 172.21.15.125:0/222653604 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a1c0ca190 0x7f7a1c0c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.469+0000 7f7a208c1700 1 --2- 172.21.15.125:0/222653604 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a1c067b50 0x7f7a1c16a250 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.469+0000 7f7a208c1700 1 --2- 172.21.15.125:0/222653604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a1c0af320 0x7f7a1c0b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.469+0000 7f7a208c1700 1 -- 172.21.15.125:0/222653604 >> 172.21.15.125:0/222653604 conn(0x7f7a1c096120 msgr2=0x7f7a1c06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.469+0000 7f7a208c1700 1 -- 172.21.15.125:0/222653604 shutdown_connections 2023-10-06T03:05:15.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.469+0000 7f7a208c1700 1 -- 172.21.15.125:0/222653604 wait complete. 2023-10-06T03:05:15.482 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:05:15.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.601+0000 7f97c7007700 1 Processor -- start 2023-10-06T03:05:15.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.601+0000 7f97c7007700 1 -- start start 2023-10-06T03:05:15.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.602+0000 7f97c7007700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f97c01571b0 0x7f97c00cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:15.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.602+0000 7f97c7007700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97c00cd790 0x7f97c00ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:15.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.602+0000 7f97c7007700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c00cd300 con 0x7f97c0156de0 2023-10-06T03:05:15.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.602+0000 7f97c7007700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c00cc6f0 con 0x7f97c01571b0 2023-10-06T03:05:15.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.602+0000 7f97c7007700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00cc9d0 con 0x7f97c00cd790 2023-10-06T03:05:15.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.602+0000 7f97c55a4700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97c00cd790 0x7f97c00ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:15.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.602+0000 7f97bffff700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f97c01571b0 0x7f97c00cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:15.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.602+0000 7f97c55a4700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97c00cd790 0x7f97c00ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:49396/0 (socket says 172.21.15.125:49396) 2023-10-06T03:05:15.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.602+0000 7f97bffff700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f97c01571b0 0x7f97c00cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:58378/0 (socket says 172.21.15.125:58378) 2023-10-06T03:05:15.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.602+0000 7f97c55a4700 1 -- 172.21.15.125:0/1376056727 learned_addr learned my addr 172.21.15.125:0/1376056727 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.602+0000 7f97c4da3700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f97c0156de0 0x7f97c015b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:47052/0 (socket says 172.21.15.125:47052) 2023-10-06T03:05:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.603+0000 7f97bffff700 1 -- 172.21.15.125:0/1376056727 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97c00cd790 msgr2=0x7f97c00ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.603+0000 7f97bffff700 1 --2- 172.21.15.125:0/1376056727 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97c00cd790 0x7f97c00ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.603+0000 7f97bffff700 1 -- 172.21.15.125:0/1376056727 >> v1:172.21.15.130:6789/0 conn(0x7f97c0156de0 legacy=0x7f97c015b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.603+0000 7f97bffff700 1 -- 172.21.15.125:0/1376056727 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c00cccb0 con 0x7f97c01571b0 2023-10-06T03:05:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.603+0000 7f97bf7fe700 1 -- 172.21.15.125:0/1376056727 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436660739 0 0) 0x7f97c00cd300 con 0x7f97c0156de0 2023-10-06T03:05:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.603+0000 7f97bffff700 1 --2- 172.21.15.125:0/1376056727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97c01571b0 0x7f97c00cc060 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0098e0 tx=0x7f97ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c100009fca552310 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.603+0000 7f97bf7fe700 1 -- 172.21.15.125:0/1376056727 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac00b640 con 0x7f97c01571b0 2023-10-06T03:05:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.603+0000 7f97bf7fe700 1 -- 172.21.15.125:0/1376056727 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ac00b7a0 con 0x7f97c01571b0 2023-10-06T03:05:15.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.603+0000 7f97bf7fe700 1 -- 172.21.15.125:0/1376056727 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac00bb40 con 0x7f97c01571b0 2023-10-06T03:05:15.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.604+0000 7f97c7007700 1 -- 172.21.15.125:0/1376056727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97c01571b0 msgr2=0x7f97c00cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:15.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.604+0000 7f97c7007700 1 --2- 172.21.15.125:0/1376056727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97c01571b0 0x7f97c00cc060 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0098e0 tx=0x7f97ac0091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.604+0000 7f97c7007700 1 -- 172.21.15.125:0/1376056727 shutdown_connections 2023-10-06T03:05:15.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.604+0000 7f97c7007700 1 --2- 172.21.15.125:0/1376056727 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97c00cd790 0x7f97c00ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.604+0000 7f97c7007700 1 --2- 172.21.15.125:0/1376056727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97c01571b0 0x7f97c00cc060 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.604+0000 7f97c7007700 1 -- 172.21.15.125:0/1376056727 >> 172.21.15.125:0/1376056727 conn(0x7f97c00cdf80 msgr2=0x7f97c00ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:15.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.604+0000 7f97c7007700 1 -- 172.21.15.125:0/1376056727 shutdown_connections 2023-10-06T03:05:15.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.604+0000 7f97c7007700 1 -- 172.21.15.125:0/1376056727 wait complete. 2023-10-06T03:05:15.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.605+0000 7f97c7007700 1 Processor -- start 2023-10-06T03:05:15.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.605+0000 7f97c7007700 1 -- start start 2023-10-06T03:05:15.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97c7007700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c00cd790 0x7f97c00afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:15.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97c7007700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97c0156de0 0x7f97c014cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:15.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97c7007700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97c01571b0 0x7f97c014f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:15.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97c7007700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00ae960 con 0x7f97c00cd790 2023-10-06T03:05:15.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97c7007700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00af720 con 0x7f97c0156de0 2023-10-06T03:05:15.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97c7007700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00aeb50 con 0x7f97c01571b0 2023-10-06T03:05:15.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97c4da3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c00cd790 0x7f97c00afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:15.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97c4da3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c00cd790 0x7f97c00afbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52088/0 (socket says 172.21.15.125:52088) 2023-10-06T03:05:15.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97c4da3700 1 -- 172.21.15.125:0/3786078055 learned_addr learned my addr 172.21.15.125:0/3786078055 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:15.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97c55a4700 1 --2- 172.21.15.125:0/3786078055 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97c01571b0 0x7f97c014f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97bffff700 1 --2- 172.21.15.125:0/3786078055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97c0156de0 0x7f97c014cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97c4da3700 1 -- 172.21.15.125:0/3786078055 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97c01571b0 msgr2=0x7f97c014f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97c4da3700 1 --2- 172.21.15.125:0/3786078055 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97c01571b0 0x7f97c014f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97c4da3700 1 -- 172.21.15.125:0/3786078055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97c0156de0 msgr2=0x7f97c014cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97c4da3700 1 --2- 172.21.15.125:0/3786078055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97c0156de0 0x7f97c014cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97c4da3700 1 -- 172.21.15.125:0/3786078055 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ac009420 con 0x7f97c00cd790 2023-10-06T03:05:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97c4da3700 1 --2- 172.21.15.125:0/3786078055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c00cd790 0x7f97c00afbb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f97b40011e0 tx=0x7f97b4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97bcff9700 1 -- 172.21.15.125:0/3786078055 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b4005a70 con 0x7f97c00cd790 2023-10-06T03:05:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97bcff9700 1 -- 172.21.15.125:0/3786078055 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b4005bd0 con 0x7f97c00cd790 2023-10-06T03:05:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97c7007700 1 -- 172.21.15.125:0/3786078055 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c00aedf0 con 0x7f97c00cd790 2023-10-06T03:05:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97bcff9700 1 -- 172.21.15.125:0/3786078055 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b40070d0 con 0x7f97c00cd790 2023-10-06T03:05:15.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.606+0000 7f97c7007700 1 -- 172.21.15.125:0/3786078055 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c00af3b0 con 0x7f97c00cd790 2023-10-06T03:05:15.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.607+0000 7f97c7007700 1 -- 172.21.15.125:0/3786078055 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c00afa00 con 0x7f97c00cd790 2023-10-06T03:05:15.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.608+0000 7f97bcff9700 1 -- 172.21.15.125:0/3786078055 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f97b4007440 con 0x7f97c00cd790 2023-10-06T03:05:15.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.608+0000 7f97bcff9700 1 --2- 172.21.15.125:0/3786078055 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f97a4066f30 0x7f97a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:15.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.608+0000 7f97bcff9700 1 -- 172.21.15.125:0/3786078055 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f97b4083e80 con 0x7f97c00cd790 2023-10-06T03:05:15.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.608+0000 7f97bffff700 1 --2- 172.21.15.125:0/3786078055 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f97a4066f30 0x7f97a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:15.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.609+0000 7f97bffff700 1 --2- 172.21.15.125:0/3786078055 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f97a4066f30 0x7f97a40693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0093f0 tx=0x7f97ac017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:15.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.612+0000 7f97bcff9700 1 -- 172.21.15.125:0/3786078055 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97b4050c60 con 0x7f97c00cd790 2023-10-06T03:05:15.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.792+0000 7f97c7007700 1 -- 172.21.15.125:0/3786078055 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f97c0066510 con 0x7f97c00cd790 2023-10-06T03:05:15.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.793+0000 7f97bcff9700 1 -- 172.21.15.125:0/3786078055 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f97b4017070 con 0x7f97c00cd790 2023-10-06T03:05:15.794 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-06T03:05:15.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.795+0000 7f97c7007700 1 -- 172.21.15.125:0/3786078055 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f97a4066f30 msgr2=0x7f97a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:15.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.795+0000 7f97c7007700 1 --2- 172.21.15.125:0/3786078055 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f97a4066f30 0x7f97a40693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0093f0 tx=0x7f97ac017000 comp rx=0 tx=0).stop 2023-10-06T03:05:15.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.795+0000 7f97c7007700 1 -- 172.21.15.125:0/3786078055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c00cd790 msgr2=0x7f97c00afbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:15.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.795+0000 7f97c7007700 1 --2- 172.21.15.125:0/3786078055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c00cd790 0x7f97c00afbb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f97b40011e0 tx=0x7f97b4007e10 comp rx=0 tx=0).stop 2023-10-06T03:05:15.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.795+0000 7f97c7007700 1 -- 172.21.15.125:0/3786078055 shutdown_connections 2023-10-06T03:05:15.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.795+0000 7f97c7007700 1 --2- 172.21.15.125:0/3786078055 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f97a4066f30 0x7f97a40693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.795+0000 7f97c7007700 1 --2- 172.21.15.125:0/3786078055 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97c01571b0 0x7f97c014f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.795+0000 7f97c7007700 1 --2- 172.21.15.125:0/3786078055 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f97c00cd790 0x7f97c00afbb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.795+0000 7f97c7007700 1 --2- 172.21.15.125:0/3786078055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97c0156de0 0x7f97c014cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.795+0000 7f97c7007700 1 -- 172.21.15.125:0/3786078055 >> 172.21.15.125:0/3786078055 conn(0x7f97c00cdf80 msgr2=0x7f97c0150b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:15.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.795+0000 7f97c7007700 1 -- 172.21.15.125:0/3786078055 shutdown_connections 2023-10-06T03:05:15.797 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.795+0000 7f97c7007700 1 -- 172.21.15.125:0/3786078055 wait complete. 2023-10-06T03:05:15.808 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:05:15.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.927+0000 7f664f9fb700 1 Processor -- start 2023-10-06T03:05:15.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.928+0000 7f664f9fb700 1 -- start start 2023-10-06T03:05:15.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.928+0000 7f664f9fb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f66481558e0 0x7f66480cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:15.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.928+0000 7f664f9fb700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6648155cb0 0x7f66480ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:15.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.928+0000 7f664f9fb700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66480c1d50 con 0x7f66480ca440 2023-10-06T03:05:15.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.928+0000 7f664f9fb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6648063940 con 0x7f66481558e0 2023-10-06T03:05:15.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.928+0000 7f664f9fb700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66480ca1b0 con 0x7f6648155cb0 2023-10-06T03:05:15.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.928+0000 7f664d797700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f66481558e0 0x7f66480cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:15.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.928+0000 7f664d797700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f66481558e0 0x7f66480cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52100/0 (socket says 172.21.15.125:52100) 2023-10-06T03:05:15.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.928+0000 7f664d797700 1 -- 172.21.15.125:0/388064590 learned_addr learned my addr 172.21.15.125:0/388064590 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:15.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.929+0000 7f664d797700 1 -- 172.21.15.125:0/388064590 >> v2:172.21.15.130:3300/0 conn(0x7f6648155cb0 msgr2=0x7f66480ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:15.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.929+0000 7f664cf96700 1 --2- 172.21.15.125:0/388064590 >> v2:172.21.15.130:3300/0 conn(0x7f6648155cb0 0x7f66480ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:15.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.929+0000 7f664d797700 1 --2- 172.21.15.125:0/388064590 >> v2:172.21.15.130:3300/0 conn(0x7f6648155cb0 0x7f66480ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.929+0000 7f664d797700 1 -- 172.21.15.125:0/388064590 >> v1:172.21.15.130:6789/0 conn(0x7f66480ca440 legacy=0x7f6648063230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:15.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.929+0000 7f664d797700 1 -- 172.21.15.125:0/388064590 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66480c1740 con 0x7f66481558e0 2023-10-06T03:05:15.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.929+0000 7f664cf96700 1 --2- 172.21.15.125:0/388064590 >> v2:172.21.15.130:3300/0 conn(0x7f6648155cb0 0x7f66480ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:15.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.929+0000 7f664d797700 1 --2- 172.21.15.125:0/388064590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66481558e0 0x7f66480cc870 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6648159540 tx=0x7f6638009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c43be01d61447 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:15.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.929+0000 7f663ffff700 1 -- 172.21.15.125:0/388064590 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6638005c10 con 0x7f66481558e0 2023-10-06T03:05:15.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.929+0000 7f663ffff700 1 -- 172.21.15.125:0/388064590 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6638005d70 con 0x7f66481558e0 2023-10-06T03:05:15.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.929+0000 7f663ffff700 1 -- 172.21.15.125:0/388064590 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663800b840 con 0x7f66481558e0 2023-10-06T03:05:15.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.930+0000 7f664f9fb700 1 -- 172.21.15.125:0/388064590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66481558e0 msgr2=0x7f66480cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:15.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.930+0000 7f664f9fb700 1 --2- 172.21.15.125:0/388064590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66481558e0 0x7f66480cc870 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6648159540 tx=0x7f6638009220 comp rx=0 tx=0).stop 2023-10-06T03:05:15.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.930+0000 7f664f9fb700 1 -- 172.21.15.125:0/388064590 shutdown_connections 2023-10-06T03:05:15.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.930+0000 7f664f9fb700 1 --2- 172.21.15.125:0/388064590 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66481558e0 0x7f66480cc870 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.930+0000 7f664f9fb700 1 --2- 172.21.15.125:0/388064590 >> v2:172.21.15.130:3300/0 conn(0x7f6648155cb0 0x7f66480ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.930+0000 7f664f9fb700 1 -- 172.21.15.125:0/388064590 >> 172.21.15.125:0/388064590 conn(0x7f66480af730 msgr2=0x7f66480afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:15.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.930+0000 7f664f9fb700 1 -- 172.21.15.125:0/388064590 shutdown_connections 2023-10-06T03:05:15.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.930+0000 7f664f9fb700 1 -- 172.21.15.125:0/388064590 wait complete. 2023-10-06T03:05:15.936 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.931+0000 7f664f9fb700 1 Processor -- start 2023-10-06T03:05:15.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.931+0000 7f664f9fb700 1 -- start start 2023-10-06T03:05:15.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.932+0000 7f664f9fb700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66480ca440 0x7f6648154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:15.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.932+0000 7f664f9fb700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66481558e0 0x7f6648096ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:15.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.932+0000 7f664f9fb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6648098c60 0x7f664814af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:15.937 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.932+0000 7f664f9fb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6648099ce0 con 0x7f6648098c60 2023-10-06T03:05:15.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.932+0000 7f664f9fb700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66481550a0 con 0x7f66480ca440 2023-10-06T03:05:15.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.932+0000 7f664f9fb700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66480990d0 con 0x7f66481558e0 2023-10-06T03:05:15.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.932+0000 7f664df98700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6648098c60 0x7f664814af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:15.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.932+0000 7f664df98700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6648098c60 0x7f664814af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52104/0 (socket says 172.21.15.125:52104) 2023-10-06T03:05:15.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.932+0000 7f664df98700 1 -- 172.21.15.125:0/2910232666 learned_addr learned my addr 172.21.15.125:0/2910232666 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:15.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.932+0000 7f664d797700 1 --2- 172.21.15.125:0/2910232666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66480ca440 0x7f6648154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:15.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.932+0000 7f664cf96700 1 --2- 172.21.15.125:0/2910232666 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66481558e0 0x7f6648096ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:15.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.933+0000 7f664df98700 1 -- 172.21.15.125:0/2910232666 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66481558e0 msgr2=0x7f6648096ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:15.938 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.933+0000 7f664df98700 1 --2- 172.21.15.125:0/2910232666 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66481558e0 0x7f6648096ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.933+0000 7f664df98700 1 -- 172.21.15.125:0/2910232666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66480ca440 msgr2=0x7f6648154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:15.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.933+0000 7f664df98700 1 --2- 172.21.15.125:0/2910232666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66480ca440 0x7f6648154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:15.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.933+0000 7f664df98700 1 -- 172.21.15.125:0/2910232666 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6638009480 con 0x7f6648098c60 2023-10-06T03:05:15.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.933+0000 7f664d797700 1 --2- 172.21.15.125:0/2910232666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66480ca440 0x7f6648154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:15.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.933+0000 7f664df98700 1 --2- 172.21.15.125:0/2910232666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6648098c60 0x7f664814af70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f664000c890 tx=0x7f66400026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:15.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.933+0000 7f663d7fa700 1 -- 172.21.15.125:0/2910232666 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6640012630 con 0x7f6648098c60 2023-10-06T03:05:15.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.933+0000 7f663d7fa700 1 -- 172.21.15.125:0/2910232666 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6640012790 con 0x7f6648098c60 2023-10-06T03:05:15.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.933+0000 7f664f9fb700 1 -- 172.21.15.125:0/2910232666 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66480993b0 con 0x7f6648098c60 2023-10-06T03:05:15.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.933+0000 7f663d7fa700 1 -- 172.21.15.125:0/2910232666 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6640012b50 con 0x7f6648098c60 2023-10-06T03:05:15.939 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.933+0000 7f664f9fb700 1 -- 172.21.15.125:0/2910232666 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6648099970 con 0x7f6648098c60 2023-10-06T03:05:15.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.934+0000 7f664f9fb700 1 -- 172.21.15.125:0/2910232666 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6648066510 con 0x7f6648098c60 2023-10-06T03:05:15.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.934+0000 7f663d7fa700 1 -- 172.21.15.125:0/2910232666 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f664000a420 con 0x7f6648098c60 2023-10-06T03:05:15.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.935+0000 7f663d7fa700 1 --2- 172.21.15.125:0/2910232666 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f662c066f30 0x7f662c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:15.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.935+0000 7f663d7fa700 1 -- 172.21.15.125:0/2910232666 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f6640084da0 con 0x7f6648098c60 2023-10-06T03:05:15.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.935+0000 7f664d797700 1 --2- 172.21.15.125:0/2910232666 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f662c066f30 0x7f662c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:15.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.935+0000 7f664d797700 1 --2- 172.21.15.125:0/2910232666 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f662c066f30 0x7f662c0693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f66380030c0 tx=0x7f6638015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:15.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:15.939+0000 7f663d7fa700 1 -- 172.21.15.125:0/2910232666 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6640051b80 con 0x7f6648098c60 2023-10-06T03:05:16.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.120+0000 7f664f9fb700 1 -- 172.21.15.125:0/2910232666 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6648099e20 con 0x7f6648098c60 2023-10-06T03:05:16.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.121+0000 7f663d7fa700 1 -- 172.21.15.125:0/2910232666 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f66400551a0 con 0x7f6648098c60 2023-10-06T03:05:16.122 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-06T03:05:16.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.123+0000 7f664f9fb700 1 -- 172.21.15.125:0/2910232666 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f662c066f30 msgr2=0x7f662c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:16.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.123+0000 7f664f9fb700 1 --2- 172.21.15.125:0/2910232666 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f662c066f30 0x7f662c0693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f66380030c0 tx=0x7f6638015000 comp rx=0 tx=0).stop 2023-10-06T03:05:16.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.123+0000 7f664f9fb700 1 -- 172.21.15.125:0/2910232666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6648098c60 msgr2=0x7f664814af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:16.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.123+0000 7f664f9fb700 1 --2- 172.21.15.125:0/2910232666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6648098c60 0x7f664814af70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f664000c890 tx=0x7f66400026a0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.123+0000 7f664f9fb700 1 -- 172.21.15.125:0/2910232666 shutdown_connections 2023-10-06T03:05:16.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.123+0000 7f664f9fb700 1 --2- 172.21.15.125:0/2910232666 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f662c066f30 0x7f662c0693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.123+0000 7f664f9fb700 1 --2- 172.21.15.125:0/2910232666 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6648098c60 0x7f664814af70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.123+0000 7f664f9fb700 1 --2- 172.21.15.125:0/2910232666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66480ca440 0x7f6648154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.123+0000 7f664f9fb700 1 --2- 172.21.15.125:0/2910232666 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66481558e0 0x7f6648096ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.123+0000 7f664f9fb700 1 -- 172.21.15.125:0/2910232666 >> 172.21.15.125:0/2910232666 conn(0x7f66480af730 msgr2=0x7f664806c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:16.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.123+0000 7f664f9fb700 1 -- 172.21.15.125:0/2910232666 shutdown_connections 2023-10-06T03:05:16.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.123+0000 7f664f9fb700 1 -- 172.21.15.125:0/2910232666 wait complete. 2023-10-06T03:05:16.136 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:05:16.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.255+0000 7fa0a8d95700 1 Processor -- start 2023-10-06T03:05:16.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.255+0000 7fa0a8d95700 1 -- start start 2023-10-06T03:05:16.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.256+0000 7fa0a8d95700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a415cb00 0x7fa0a40b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:16.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.256+0000 7fa0a8d95700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa0a4067610 0x7fa0a4068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:16.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.256+0000 7fa0a8d95700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a40ca670 con 0x7fa0a415ced0 2023-10-06T03:05:16.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.256+0000 7fa0a8d95700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a4068320 con 0x7fa0a4067610 2023-10-06T03:05:16.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.256+0000 7fa0a8d95700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4067a80 con 0x7fa0a415cb00 2023-10-06T03:05:16.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.256+0000 7fa0a259c700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a415cb00 0x7fa0a40b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:16.259 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.256+0000 7fa0a259c700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a415cb00 0x7fa0a40b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:49424/0 (socket says 172.21.15.125:49424) 2023-10-06T03:05:16.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.256+0000 7fa0a259c700 1 -- 172.21.15.125:0/49722895 learned_addr learned my addr 172.21.15.125:0/49722895 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:16.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.256+0000 7fa0a1d9b700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa0a4067610 0x7fa0a4068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:16.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.256+0000 7fa0a2d9d700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fa0a415ced0 0x7fa0a40c90e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:47076/0 (socket says 172.21.15.125:47076) 2023-10-06T03:05:16.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.256+0000 7fa0a259c700 1 -- 172.21.15.125:0/49722895 >> v2:172.21.15.130:3300/0 conn(0x7fa0a4067610 msgr2=0x7fa0a4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:16.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.256+0000 7fa0a259c700 1 --2- 172.21.15.125:0/49722895 >> v2:172.21.15.130:3300/0 conn(0x7fa0a4067610 0x7fa0a4068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.256+0000 7fa0a259c700 1 -- 172.21.15.125:0/49722895 >> v1:172.21.15.130:6789/0 conn(0x7fa0a415ced0 legacy=0x7fa0a40c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:16.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.256+0000 7fa0a159a700 1 -- 172.21.15.125:0/49722895 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122841596 0 0) 0x7fa0a40ca670 con 0x7fa0a415ced0 2023-10-06T03:05:16.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.256+0000 7fa0a259c700 1 -- 172.21.15.125:0/49722895 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a4067d60 con 0x7fa0a415cb00 2023-10-06T03:05:16.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.256+0000 7fa0a1d9b700 1 --2- 172.21.15.125:0/49722895 >> v2:172.21.15.130:3300/0 conn(0x7fa0a4067610 0x7fa0a4068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:05:16.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.257+0000 7fa0a259c700 1 --2- 172.21.15.125:0/49722895 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a415cb00 0x7fa0a40b0240 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa094009990 tx=0x7fa094009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fa4ada32a76a6f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:16.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.257+0000 7fa0a159a700 1 -- 172.21.15.125:0/49722895 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa094009e80 con 0x7fa0a415cb00 2023-10-06T03:05:16.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.257+0000 7fa0a159a700 1 -- 172.21.15.125:0/49722895 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa094005c10 con 0x7fa0a415cb00 2023-10-06T03:05:16.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.257+0000 7fa0a159a700 1 -- 172.21.15.125:0/49722895 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09400b650 con 0x7fa0a415cb00 2023-10-06T03:05:16.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.257+0000 7fa0a8d95700 1 -- 172.21.15.125:0/49722895 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a415cb00 msgr2=0x7fa0a40b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:16.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.257+0000 7fa0a8d95700 1 --2- 172.21.15.125:0/49722895 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a415cb00 0x7fa0a40b0240 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa094009990 tx=0x7fa094009220 comp rx=0 tx=0).stop 2023-10-06T03:05:16.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.257+0000 7fa0a8d95700 1 -- 172.21.15.125:0/49722895 shutdown_connections 2023-10-06T03:05:16.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.257+0000 7fa0a8d95700 1 --2- 172.21.15.125:0/49722895 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a415cb00 0x7fa0a40b0240 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.257+0000 7fa0a8d95700 1 --2- 172.21.15.125:0/49722895 >> v2:172.21.15.130:3300/0 conn(0x7fa0a4067610 0x7fa0a4068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.257+0000 7fa0a8d95700 1 -- 172.21.15.125:0/49722895 >> 172.21.15.125:0/49722895 conn(0x7fa0a40af730 msgr2=0x7fa0a40afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:16.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.257+0000 7fa0a8d95700 1 -- 172.21.15.125:0/49722895 shutdown_connections 2023-10-06T03:05:16.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.258+0000 7fa0a8d95700 1 -- 172.21.15.125:0/49722895 wait complete. 2023-10-06T03:05:16.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.259+0000 7fa0a8d95700 1 Processor -- start 2023-10-06T03:05:16.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.259+0000 7fa0a8d95700 1 -- start start 2023-10-06T03:05:16.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.259+0000 7fa0a8d95700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a4067610 0x7fa0a414a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:16.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.259+0000 7fa0a8d95700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0a415cb00 0x7fa0a41696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:16.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.259+0000 7fa0a8d95700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0a415ced0 0x7fa0a415e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:16.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.259+0000 7fa0a8d95700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a416a630 con 0x7fa0a415ced0 2023-10-06T03:05:16.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.259+0000 7fa0a8d95700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a416a070 con 0x7fa0a415cb00 2023-10-06T03:05:16.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.259+0000 7fa0a8d95700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a416a350 con 0x7fa0a4067610 2023-10-06T03:05:16.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.260+0000 7fa0a2d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0a415ced0 0x7fa0a415e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:16.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.260+0000 7fa0a1d9b700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0a415cb00 0x7fa0a41696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:16.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.260+0000 7fa0a2d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0a415ced0 0x7fa0a415e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52120/0 (socket says 172.21.15.125:52120) 2023-10-06T03:05:16.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.260+0000 7fa0a2d9d700 1 -- 172.21.15.125:0/684871611 learned_addr learned my addr 172.21.15.125:0/684871611 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:16.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.260+0000 7fa0a259c700 1 --2- 172.21.15.125:0/684871611 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a4067610 0x7fa0a414a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:16.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.260+0000 7fa0a2d9d700 1 -- 172.21.15.125:0/684871611 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a4067610 msgr2=0x7fa0a414a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:16.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.260+0000 7fa0a2d9d700 1 --2- 172.21.15.125:0/684871611 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a4067610 0x7fa0a414a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.260+0000 7fa0a2d9d700 1 -- 172.21.15.125:0/684871611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0a415cb00 msgr2=0x7fa0a41696b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:16.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.260+0000 7fa0a2d9d700 1 --2- 172.21.15.125:0/684871611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0a415cb00 0x7fa0a41696b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.260+0000 7fa0a2d9d700 1 -- 172.21.15.125:0/684871611 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa098009420 con 0x7fa0a415ced0 2023-10-06T03:05:16.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.260+0000 7fa0a2d9d700 1 --2- 172.21.15.125:0/684871611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0a415ced0 0x7fa0a415e990 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00ccc0 tx=0x7fa09c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:16.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.260+0000 7fa0927fc700 1 -- 172.21.15.125:0/684871611 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c005df0 con 0x7fa0a415ced0 2023-10-06T03:05:16.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.260+0000 7fa0927fc700 1 -- 172.21.15.125:0/684871611 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c00a670 con 0x7fa0a415ced0 2023-10-06T03:05:16.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.260+0000 7fa0a8d95700 1 -- 172.21.15.125:0/684871611 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa094009480 con 0x7fa0a415ced0 2023-10-06T03:05:16.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.260+0000 7fa0927fc700 1 -- 172.21.15.125:0/684871611 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c00aa30 con 0x7fa0a415ced0 2023-10-06T03:05:16.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.260+0000 7fa0a8d95700 1 -- 172.21.15.125:0/684871611 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a415d800 con 0x7fa0a415ced0 2023-10-06T03:05:16.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.261+0000 7fa0a8d95700 1 -- 172.21.15.125:0/684871611 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a415d380 con 0x7fa0a415ced0 2023-10-06T03:05:16.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.261+0000 7fa0927fc700 1 -- 172.21.15.125:0/684871611 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa09c0070f0 con 0x7fa0a415ced0 2023-10-06T03:05:16.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.262+0000 7fa0927fc700 1 --2- 172.21.15.125:0/684871611 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa084066f30 0x7fa0840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:16.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.262+0000 7fa0927fc700 1 -- 172.21.15.125:0/684871611 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fa09c0849f0 con 0x7fa0a415ced0 2023-10-06T03:05:16.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.262+0000 7fa0a259c700 1 --2- 172.21.15.125:0/684871611 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa084066f30 0x7fa0840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:16.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.262+0000 7fa0a259c700 1 --2- 172.21.15.125:0/684871611 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa084066f30 0x7fa0840693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa094009260 tx=0x7fa094016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:16.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.266+0000 7fa0927fc700 1 -- 172.21.15.125:0/684871611 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0a415d380 con 0x7fa0a415ced0 2023-10-06T03:05:16.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.451+0000 7fa0a8d95700 1 -- 172.21.15.125:0/684871611 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa0a415d380 con 0x7fa0a415ced0 2023-10-06T03:05:16.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.451+0000 7fa0927fc700 1 -- 172.21.15.125:0/684871611 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa0a415d380 con 0x7fa0a415ced0 2023-10-06T03:05:16.453 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-06T03:05:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.453+0000 7fa0a8d95700 1 -- 172.21.15.125:0/684871611 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa084066f30 msgr2=0x7fa0840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.453+0000 7fa0a8d95700 1 --2- 172.21.15.125:0/684871611 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa084066f30 0x7fa0840693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa094009260 tx=0x7fa094016000 comp rx=0 tx=0).stop 2023-10-06T03:05:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.453+0000 7fa0a8d95700 1 -- 172.21.15.125:0/684871611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0a415ced0 msgr2=0x7fa0a415e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.453+0000 7fa0a8d95700 1 --2- 172.21.15.125:0/684871611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0a415ced0 0x7fa0a415e990 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa09c00ccc0 tx=0x7fa09c001a20 comp rx=0 tx=0).stop 2023-10-06T03:05:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.453+0000 7fa0a8d95700 1 -- 172.21.15.125:0/684871611 shutdown_connections 2023-10-06T03:05:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.453+0000 7fa0a8d95700 1 --2- 172.21.15.125:0/684871611 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa084066f30 0x7fa0840693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.453+0000 7fa0a8d95700 1 --2- 172.21.15.125:0/684871611 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa0a415ced0 0x7fa0a415e990 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.453+0000 7fa0a8d95700 1 --2- 172.21.15.125:0/684871611 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa0a4067610 0x7fa0a414a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.453+0000 7fa0a8d95700 1 --2- 172.21.15.125:0/684871611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0a415cb00 0x7fa0a41696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.453+0000 7fa0a8d95700 1 -- 172.21.15.125:0/684871611 >> 172.21.15.125:0/684871611 conn(0x7fa0a40af730 msgr2=0x7fa0a406aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:16.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.453+0000 7fa0a8d95700 1 -- 172.21.15.125:0/684871611 shutdown_connections 2023-10-06T03:05:16.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.453+0000 7fa0a8d95700 1 -- 172.21.15.125:0/684871611 wait complete. 2023-10-06T03:05:16.466 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-06T03:05:16.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.585+0000 7f329692e700 1 Processor -- start 2023-10-06T03:05:16.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.585+0000 7f329692e700 1 -- start start 2023-10-06T03:05:16.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.586+0000 7f329692e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32900af320 0x7f32900cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:16.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.586+0000 7f329692e700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f32900cb880 0x7f32900c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:16.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.586+0000 7f329692e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f32900c8150 0x7f32901565e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:16.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.586+0000 7f329692e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32900c9470 con 0x7f32900c8150 2023-10-06T03:05:16.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.586+0000 7f329692e700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32900cbcf0 con 0x7f32900cb880 2023-10-06T03:05:16.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.586+0000 7f329692e700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32900c9b40 con 0x7f32900af320 2023-10-06T03:05:16.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.586+0000 7f3294ecb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f32900c8150 0x7f32901565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:16.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.587+0000 7f3294ecb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f32900c8150 0x7f32901565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52126/0 (socket says 172.21.15.125:52126) 2023-10-06T03:05:16.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.587+0000 7f3294ecb700 1 -- 172.21.15.125:0/3993278675 learned_addr learned my addr 172.21.15.125:0/3993278675 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:16.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.587+0000 7f328ffff700 1 --2- 172.21.15.125:0/3993278675 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32900af320 0x7f32900cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:16.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.587+0000 7f328f7fe700 1 --2- 172.21.15.125:0/3993278675 >> v2:172.21.15.130:3300/0 conn(0x7f32900cb880 0x7f32900c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:16.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.587+0000 7f3294ecb700 1 -- 172.21.15.125:0/3993278675 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32900af320 msgr2=0x7f32900cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:16.590 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.587+0000 7f3294ecb700 1 --2- 172.21.15.125:0/3993278675 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32900af320 0x7f32900cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.587+0000 7f3294ecb700 1 -- 172.21.15.125:0/3993278675 >> v2:172.21.15.130:3300/0 conn(0x7f32900cb880 msgr2=0x7f32900c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:16.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.587+0000 7f3294ecb700 1 --2- 172.21.15.125:0/3993278675 >> v2:172.21.15.130:3300/0 conn(0x7f32900cb880 0x7f32900c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.587+0000 7f3294ecb700 1 -- 172.21.15.125:0/3993278675 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32900c85a0 con 0x7f32900c8150 2023-10-06T03:05:16.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.587+0000 7f328ffff700 1 --2- 172.21.15.125:0/3993278675 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32900af320 0x7f32900cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:16.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.587+0000 7f328f7fe700 1 --2- 172.21.15.125:0/3993278675 >> v2:172.21.15.130:3300/0 conn(0x7f32900cb880 0x7f32900c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:16.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.587+0000 7f3294ecb700 1 --2- 172.21.15.125:0/3993278675 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32900c8150 0x7f32901565e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f329006dec0 tx=0x7f328800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a9b56b2ee4cd80 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:16.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.587+0000 7f328effd700 1 -- 172.21.15.125:0/3993278675 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3288010070 con 0x7f32900c8150 2023-10-06T03:05:16.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.587+0000 7f328effd700 1 -- 172.21.15.125:0/3993278675 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328800de90 con 0x7f32900c8150 2023-10-06T03:05:16.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.587+0000 7f328effd700 1 -- 172.21.15.125:0/3993278675 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328800b320 con 0x7f32900c8150 2023-10-06T03:05:16.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.588+0000 7f329692e700 1 -- 172.21.15.125:0/3993278675 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32900c8150 msgr2=0x7f32901565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:16.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.588+0000 7f329692e700 1 --2- 172.21.15.125:0/3993278675 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32900c8150 0x7f32901565e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f329006dec0 tx=0x7f328800ba50 comp rx=0 tx=0).stop 2023-10-06T03:05:16.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.588+0000 7f329692e700 1 -- 172.21.15.125:0/3993278675 shutdown_connections 2023-10-06T03:05:16.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.588+0000 7f329692e700 1 --2- 172.21.15.125:0/3993278675 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32900c8150 0x7f32901565e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.588+0000 7f329692e700 1 --2- 172.21.15.125:0/3993278675 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32900af320 0x7f32900cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.588+0000 7f329692e700 1 --2- 172.21.15.125:0/3993278675 >> v2:172.21.15.130:3300/0 conn(0x7f32900cb880 0x7f32900c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.588+0000 7f329692e700 1 -- 172.21.15.125:0/3993278675 >> 172.21.15.125:0/3993278675 conn(0x7f3290096120 msgr2=0x7f3290068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:16.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.588+0000 7f329692e700 1 -- 172.21.15.125:0/3993278675 shutdown_connections 2023-10-06T03:05:16.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.588+0000 7f329692e700 1 -- 172.21.15.125:0/3993278675 wait complete. 2023-10-06T03:05:16.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.589+0000 7f329692e700 1 Processor -- start 2023-10-06T03:05:16.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.589+0000 7f329692e700 1 -- start start 2023-10-06T03:05:16.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.590+0000 7f329692e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32900af320 0x7f3290099a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:16.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.590+0000 7f329692e700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32900c8150 0x7f32900ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:16.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.590+0000 7f329692e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32900cb880 0x7f32900b2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:16.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.590+0000 7f329692e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32900979c0 con 0x7f32900cb880 2023-10-06T03:05:16.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.590+0000 7f329692e700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3290097ca0 con 0x7f32900c8150 2023-10-06T03:05:16.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.590+0000 7f329692e700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3290097f80 con 0x7f32900af320 2023-10-06T03:05:16.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.590+0000 7f3294ecb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32900cb880 0x7f32900b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:16.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.590+0000 7f3294ecb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32900cb880 0x7f32900b2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52128/0 (socket says 172.21.15.125:52128) 2023-10-06T03:05:16.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.590+0000 7f3294ecb700 1 -- 172.21.15.125:0/2704660893 learned_addr learned my addr 172.21.15.125:0/2704660893 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:16.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.590+0000 7f328ffff700 1 --2- 172.21.15.125:0/2704660893 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32900af320 0x7f3290099a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:16.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.590+0000 7f328f7fe700 1 --2- 172.21.15.125:0/2704660893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32900c8150 0x7f32900ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:16.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.590+0000 7f3294ecb700 1 -- 172.21.15.125:0/2704660893 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32900af320 msgr2=0x7f3290099a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:16.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.590+0000 7f3294ecb700 1 --2- 172.21.15.125:0/2704660893 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32900af320 0x7f3290099a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.590+0000 7f3294ecb700 1 -- 172.21.15.125:0/2704660893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32900c8150 msgr2=0x7f32900ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:16.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.590+0000 7f3294ecb700 1 --2- 172.21.15.125:0/2704660893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32900c8150 0x7f32900ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.590+0000 7f3294ecb700 1 -- 172.21.15.125:0/2704660893 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328800bcf0 con 0x7f32900cb880 2023-10-06T03:05:16.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.590+0000 7f3294ecb700 1 --2- 172.21.15.125:0/2704660893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32900cb880 0x7f32900b2200 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f329006df40 tx=0x7f328801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:16.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.591+0000 7f3277fff700 1 -- 172.21.15.125:0/2704660893 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3288009b00 con 0x7f32900cb880 2023-10-06T03:05:16.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.591+0000 7f3277fff700 1 -- 172.21.15.125:0/2704660893 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3288009c80 con 0x7f32900cb880 2023-10-06T03:05:16.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.591+0000 7f329692e700 1 -- 172.21.15.125:0/2704660893 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3290098260 con 0x7f32900cb880 2023-10-06T03:05:16.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.591+0000 7f3277fff700 1 -- 172.21.15.125:0/2704660893 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328801e440 con 0x7f32900cb880 2023-10-06T03:05:16.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.591+0000 7f329692e700 1 -- 172.21.15.125:0/2704660893 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32900ae5c0 con 0x7f32900cb880 2023-10-06T03:05:16.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.592+0000 7f329692e700 1 -- 172.21.15.125:0/2704660893 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329004bb80 con 0x7f32900cb880 2023-10-06T03:05:16.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.592+0000 7f3277fff700 1 -- 172.21.15.125:0/2704660893 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3288003040 con 0x7f32900cb880 2023-10-06T03:05:16.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.592+0000 7f3277fff700 1 --2- 172.21.15.125:0/2704660893 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f327c066f30 0x7f327c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:16.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.593+0000 7f328ffff700 1 --2- 172.21.15.125:0/2704660893 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f327c066f30 0x7f327c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:16.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.593+0000 7f3277fff700 1 -- 172.21.15.125:0/2704660893 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f32880863a0 con 0x7f32900cb880 2023-10-06T03:05:16.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.593+0000 7f328ffff700 1 --2- 172.21.15.125:0/2704660893 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f327c066f30 0x7f327c0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3284006ea0 tx=0x7f3284008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:16.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.597+0000 7f3277fff700 1 -- 172.21.15.125:0/2704660893 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3288053180 con 0x7f32900cb880 2023-10-06T03:05:16.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.777+0000 7f329692e700 1 -- 172.21.15.125:0/2704660893 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f329006ee30 con 0x7f32900cb880 2023-10-06T03:05:16.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.778+0000 7f3277fff700 1 -- 172.21.15.125:0/2704660893 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f32880567a0 con 0x7f32900cb880 2023-10-06T03:05:16.779 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-06T03:05:16.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.780+0000 7f329692e700 1 -- 172.21.15.125:0/2704660893 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f327c066f30 msgr2=0x7f327c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:16.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.780+0000 7f329692e700 1 --2- 172.21.15.125:0/2704660893 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f327c066f30 0x7f327c0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3284006ea0 tx=0x7f3284008040 comp rx=0 tx=0).stop 2023-10-06T03:05:16.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.780+0000 7f329692e700 1 -- 172.21.15.125:0/2704660893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32900cb880 msgr2=0x7f32900b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:16.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.780+0000 7f329692e700 1 --2- 172.21.15.125:0/2704660893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32900cb880 0x7f32900b2200 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f329006df40 tx=0x7f328801a000 comp rx=0 tx=0).stop 2023-10-06T03:05:16.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.780+0000 7f329692e700 1 -- 172.21.15.125:0/2704660893 shutdown_connections 2023-10-06T03:05:16.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.780+0000 7f329692e700 1 --2- 172.21.15.125:0/2704660893 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f327c066f30 0x7f327c0693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.780+0000 7f329692e700 1 --2- 172.21.15.125:0/2704660893 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f32900cb880 0x7f32900b2200 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.780+0000 7f329692e700 1 --2- 172.21.15.125:0/2704660893 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f32900af320 0x7f3290099a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.780+0000 7f329692e700 1 --2- 172.21.15.125:0/2704660893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32900c8150 0x7f32900ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.780+0000 7f329692e700 1 -- 172.21.15.125:0/2704660893 >> 172.21.15.125:0/2704660893 conn(0x7f3290096120 msgr2=0x7f32900cb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:16.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.780+0000 7f329692e700 1 -- 172.21.15.125:0/2704660893 shutdown_connections 2023-10-06T03:05:16.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.780+0000 7f329692e700 1 -- 172.21.15.125:0/2704660893 wait complete. 2023-10-06T03:05:16.793 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:05:16.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.909+0000 7f9a0026e700 1 Processor -- start 2023-10-06T03:05:16.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.910+0000 7f9a0026e700 1 -- start start 2023-10-06T03:05:16.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.910+0000 7f9a0026e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f8069c10 0x7f99f80c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:16.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.911+0000 7f9a0026e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f99f80c2d80 0x7f99f80c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:16.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.911+0000 7f9a0026e700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f8069780 con 0x7f99f80cc730 2023-10-06T03:05:16.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.911+0000 7f9a0026e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f806a080 con 0x7f99f80c2d80 2023-10-06T03:05:16.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.911+0000 7f9a0026e700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f80c9270 con 0x7f99f8069c10 2023-10-06T03:05:16.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.911+0000 7f99fe80b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f99f80c2d80 0x7f99f80c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:16.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.911+0000 7f99fe80b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f99f80c2d80 0x7f99f80c3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52142/0 (socket says 172.21.15.125:52142) 2023-10-06T03:05:16.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.911+0000 7f99fe80b700 1 -- 172.21.15.125:0/1520025916 learned_addr learned my addr 172.21.15.125:0/1520025916 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:16.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.911+0000 7f99fd809700 1 --2- 172.21.15.125:0/1520025916 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f8069c10 0x7f99f80c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:16.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.911+0000 7f99fe80b700 1 -- 172.21.15.125:0/1520025916 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f8069c10 msgr2=0x7f99f80c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:16.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.911+0000 7f99fe80b700 1 --2- 172.21.15.125:0/1520025916 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f8069c10 0x7f99f80c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.911+0000 7f99fe80b700 1 -- 172.21.15.125:0/1520025916 >> v1:172.21.15.130:6789/0 conn(0x7f99f80cc730 legacy=0x7f99f80c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:16.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.911+0000 7f99fe80b700 1 -- 172.21.15.125:0/1520025916 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f80c4130 con 0x7f99f80c2d80 2023-10-06T03:05:16.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.911+0000 7f99fe80b700 1 --2- 172.21.15.125:0/1520025916 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99f80c2d80 0x7f99f80c3200 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f99f0009f20 tx=0x7f99f0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b90c0322a31d470 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:16.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.911+0000 7f99fd008700 1 -- 172.21.15.125:0/1520025916 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f000e070 con 0x7f99f80c2d80 2023-10-06T03:05:16.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.911+0000 7f99fd008700 1 -- 172.21.15.125:0/1520025916 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f000b9d0 con 0x7f99f80c2d80 2023-10-06T03:05:16.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.911+0000 7f99fd008700 1 -- 172.21.15.125:0/1520025916 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f00092e0 con 0x7f99f80c2d80 2023-10-06T03:05:16.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.912+0000 7f9a0026e700 1 -- 172.21.15.125:0/1520025916 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99f80c2d80 msgr2=0x7f99f80c3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:16.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.912+0000 7f9a0026e700 1 --2- 172.21.15.125:0/1520025916 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99f80c2d80 0x7f99f80c3200 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f99f0009f20 tx=0x7f99f0009840 comp rx=0 tx=0).stop 2023-10-06T03:05:16.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.912+0000 7f9a0026e700 1 -- 172.21.15.125:0/1520025916 shutdown_connections 2023-10-06T03:05:16.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.912+0000 7f9a0026e700 1 --2- 172.21.15.125:0/1520025916 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99f80c2d80 0x7f99f80c3200 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.912+0000 7f9a0026e700 1 --2- 172.21.15.125:0/1520025916 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f8069c10 0x7f99f80c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.912+0000 7f9a0026e700 1 -- 172.21.15.125:0/1520025916 >> 172.21.15.125:0/1520025916 conn(0x7f99f8067df0 msgr2=0x7f99f80cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:16.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.912+0000 7f9a0026e700 1 -- 172.21.15.125:0/1520025916 shutdown_connections 2023-10-06T03:05:16.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.912+0000 7f9a0026e700 1 -- 172.21.15.125:0/1520025916 wait complete. 2023-10-06T03:05:16.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.913+0000 7f9a0026e700 1 Processor -- start 2023-10-06T03:05:16.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.913+0000 7f9a0026e700 1 -- start start 2023-10-06T03:05:16.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.914+0000 7f9a0026e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99f8069c10 0x7f99f8157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:16.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.914+0000 7f9a0026e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f80c2d80 0x7f99f814fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:16.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.914+0000 7f9a0026e700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99f80cc730 0x7f99f815c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:16.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.914+0000 7f9a0026e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f80ac0c0 con 0x7f99f8069c10 2023-10-06T03:05:16.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.914+0000 7f9a0026e700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f80ac3a0 con 0x7f99f80cc730 2023-10-06T03:05:16.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.914+0000 7f9a0026e700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f814ff40 con 0x7f99f80c2d80 2023-10-06T03:05:16.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.914+0000 7f99fe00a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99f8069c10 0x7f99f8157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:16.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.914+0000 7f99fe00a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99f8069c10 0x7f99f8157dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52148/0 (socket says 172.21.15.125:52148) 2023-10-06T03:05:16.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.914+0000 7f99fe00a700 1 -- 172.21.15.125:0/1438600762 learned_addr learned my addr 172.21.15.125:0/1438600762 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:16.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.914+0000 7f99fe80b700 1 --2- 172.21.15.125:0/1438600762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99f80cc730 0x7f99f815c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:16.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.914+0000 7f99fd809700 1 --2- 172.21.15.125:0/1438600762 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f80c2d80 0x7f99f814fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:16.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.914+0000 7f99fe00a700 1 -- 172.21.15.125:0/1438600762 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f80c2d80 msgr2=0x7f99f814fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:16.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.914+0000 7f99fe00a700 1 --2- 172.21.15.125:0/1438600762 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f80c2d80 0x7f99f814fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.914+0000 7f99fe00a700 1 -- 172.21.15.125:0/1438600762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99f80cc730 msgr2=0x7f99f815c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:16.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.914+0000 7f99fe00a700 1 --2- 172.21.15.125:0/1438600762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99f80cc730 0x7f99f815c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:16.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.914+0000 7f99fe00a700 1 -- 172.21.15.125:0/1438600762 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f0009ae0 con 0x7f99f8069c10 2023-10-06T03:05:16.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.914+0000 7f99fd809700 1 --2- 172.21.15.125:0/1438600762 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f80c2d80 0x7f99f814fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:16.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.914+0000 7f99fe00a700 1 --2- 172.21.15.125:0/1438600762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99f8069c10 0x7f99f8157dc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f99f400c7c0 tx=0x7f99f4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:16.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.914+0000 7f99ee7fc700 1 -- 172.21.15.125:0/1438600762 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4011590 con 0x7f99f8069c10 2023-10-06T03:05:16.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.915+0000 7f99ee7fc700 1 -- 172.21.15.125:0/1438600762 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f4011710 con 0x7f99f8069c10 2023-10-06T03:05:16.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.915+0000 7f9a0026e700 1 -- 172.21.15.125:0/1438600762 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f80ac830 con 0x7f99f8069c10 2023-10-06T03:05:16.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.915+0000 7f99ee7fc700 1 -- 172.21.15.125:0/1438600762 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4011ad0 con 0x7f99f8069c10 2023-10-06T03:05:16.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.915+0000 7f9a0026e700 1 -- 172.21.15.125:0/1438600762 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f8159ea0 con 0x7f99f8069c10 2023-10-06T03:05:16.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.916+0000 7f9a0026e700 1 -- 172.21.15.125:0/1438600762 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f806f8a0 con 0x7f99f8069c10 2023-10-06T03:05:16.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.916+0000 7f99ee7fc700 1 -- 172.21.15.125:0/1438600762 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99f401a360 con 0x7f99f8069c10 2023-10-06T03:05:16.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.916+0000 7f99ee7fc700 1 --2- 172.21.15.125:0/1438600762 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f99dc066f30 0x7f99dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:16.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.916+0000 7f99ee7fc700 1 -- 172.21.15.125:0/1438600762 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f99f4083e00 con 0x7f99f8069c10 2023-10-06T03:05:16.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.916+0000 7f99fd809700 1 --2- 172.21.15.125:0/1438600762 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f99dc066f30 0x7f99dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:16.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.917+0000 7f99fd809700 1 --2- 172.21.15.125:0/1438600762 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f99dc066f30 0x7f99dc0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f99f80c84e0 tx=0x7f99e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:16.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:16.921+0000 7f99ee7fc700 1 -- 172.21.15.125:0/1438600762 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99f4050c90 con 0x7f99f8069c10 2023-10-06T03:05:17.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.146+0000 7f9a0026e700 1 -- 172.21.15.125:0/1438600762 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99f80ac680 con 0x7f99f8069c10 2023-10-06T03:05:17.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.146+0000 7f99ee7fc700 1 -- 172.21.15.125:0/1438600762 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f99f4017070 con 0x7f99f8069c10 2023-10-06T03:05:17.148 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:17.148 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/1260071130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1260071130},{"type":"v1","addr":"172.21.15.130:6834","nonce":1260071130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/63925154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":63925154},{"type":"v1","addr":"172.21.15.125:6836","nonce":63925154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/1057811891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1057811891},{"type":"v1","addr":"172.21.15.125:6837","nonce":1057811891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:04:29.211664+0000","modified":"2023-10-06T03:04:42.275374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/4004582354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":4004582354},{"type":"v1","addr":"172.21.15.130:6835","nonce":4004582354}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:05:17.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.148+0000 7f9a0026e700 1 -- 172.21.15.125:0/1438600762 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f99dc066f30 msgr2=0x7f99dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:17.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.148+0000 7f9a0026e700 1 --2- 172.21.15.125:0/1438600762 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f99dc066f30 0x7f99dc0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f99f80c84e0 tx=0x7f99e8008040 comp rx=0 tx=0).stop 2023-10-06T03:05:17.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.148+0000 7f9a0026e700 1 -- 172.21.15.125:0/1438600762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99f8069c10 msgr2=0x7f99f8157dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:17.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.148+0000 7f9a0026e700 1 --2- 172.21.15.125:0/1438600762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99f8069c10 0x7f99f8157dc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f99f400c7c0 tx=0x7f99f4007f70 comp rx=0 tx=0).stop 2023-10-06T03:05:17.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.148+0000 7f9a0026e700 1 -- 172.21.15.125:0/1438600762 shutdown_connections 2023-10-06T03:05:17.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.148+0000 7f9a0026e700 1 --2- 172.21.15.125:0/1438600762 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f99dc066f30 0x7f99dc0693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.148+0000 7f9a0026e700 1 --2- 172.21.15.125:0/1438600762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99f80cc730 0x7f99f815c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.148+0000 7f9a0026e700 1 --2- 172.21.15.125:0/1438600762 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99f8069c10 0x7f99f8157dc0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.148+0000 7f9a0026e700 1 --2- 172.21.15.125:0/1438600762 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f99f80c2d80 0x7f99f814fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.148+0000 7f9a0026e700 1 -- 172.21.15.125:0/1438600762 >> 172.21.15.125:0/1438600762 conn(0x7f99f8067df0 msgr2=0x7f99f80c9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:17.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.148+0000 7f9a0026e700 1 -- 172.21.15.125:0/1438600762 shutdown_connections 2023-10-06T03:05:17.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.148+0000 7f9a0026e700 1 -- 172.21.15.125:0/1438600762 wait complete. 2023-10-06T03:05:17.151 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 9 2023-10-06T03:05:17.161 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:05:17.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.280+0000 7f3982ecc700 1 Processor -- start 2023-10-06T03:05:17.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.280+0000 7f3982ecc700 1 -- start start 2023-10-06T03:05:17.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.280+0000 7f3982ecc700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f397c15d060 0x7f397c068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:17.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.280+0000 7f3982ecc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f397c0c9310 0x7f397c0c9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:17.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.280+0000 7f3982ecc700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f397c0cacc0 con 0x7f397c15d430 2023-10-06T03:05:17.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.280+0000 7f3982ecc700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f397c0c9cb0 con 0x7f397c0c9310 2023-10-06T03:05:17.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.280+0000 7f3982ecc700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f397c0caf90 con 0x7f397c15d060 2023-10-06T03:05:17.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.281+0000 7f3981469700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f397c0c9310 0x7f397c0c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:17.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.281+0000 7f397bfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f397c15d430 0x7f397c0ca5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40348/0 (socket says 172.21.15.125:40348) 2023-10-06T03:05:17.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.281+0000 7f397bfff700 1 -- 172.21.15.125:0/2645743343 learned_addr learned my addr 172.21.15.125:0/2645743343 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:17.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.281+0000 7f3980c68700 1 --2- 172.21.15.125:0/2645743343 >> v2:172.21.15.130:3300/0 conn(0x7f397c15d060 0x7f397c068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:17.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.281+0000 7f3981469700 1 -- 172.21.15.125:0/2645743343 >> v2:172.21.15.130:3300/0 conn(0x7f397c15d060 msgr2=0x7f397c068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:17.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.281+0000 7f3981469700 1 --2- 172.21.15.125:0/2645743343 >> v2:172.21.15.130:3300/0 conn(0x7f397c15d060 0x7f397c068d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.281+0000 7f3981469700 1 -- 172.21.15.125:0/2645743343 >> v1:172.21.15.125:6789/0 conn(0x7f397c15d430 legacy=0x7f397c0ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:17.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.281+0000 7f397b7fe700 1 -- 172.21.15.125:0/2645743343 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365777030 0 0) 0x7f397c0cacc0 con 0x7f397c15d430 2023-10-06T03:05:17.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.281+0000 7f3981469700 1 -- 172.21.15.125:0/2645743343 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f397c0cb270 con 0x7f397c0c9310 2023-10-06T03:05:17.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.281+0000 7f3980c68700 1 --2- 172.21.15.125:0/2645743343 >> v2:172.21.15.130:3300/0 conn(0x7f397c15d060 0x7f397c068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:17.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.281+0000 7f3981469700 1 --2- 172.21.15.125:0/2645743343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f397c0c9310 0x7f397c0c9770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f397c06acc0 tx=0x7f3974009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9a3a575c7169cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:17.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.281+0000 7f397b7fe700 1 -- 172.21.15.125:0/2645743343 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397400e070 con 0x7f397c0c9310 2023-10-06T03:05:17.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.281+0000 7f397b7fe700 1 -- 172.21.15.125:0/2645743343 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397400bc30 con 0x7f397c0c9310 2023-10-06T03:05:17.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.281+0000 7f397b7fe700 1 -- 172.21.15.125:0/2645743343 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3974012430 con 0x7f397c0c9310 2023-10-06T03:05:17.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.282+0000 7f3982ecc700 1 -- 172.21.15.125:0/2645743343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f397c0c9310 msgr2=0x7f397c0c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:17.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.282+0000 7f3982ecc700 1 --2- 172.21.15.125:0/2645743343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f397c0c9310 0x7f397c0c9770 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f397c06acc0 tx=0x7f3974009780 comp rx=0 tx=0).stop 2023-10-06T03:05:17.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.282+0000 7f3982ecc700 1 -- 172.21.15.125:0/2645743343 shutdown_connections 2023-10-06T03:05:17.285 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.282+0000 7f3982ecc700 1 --2- 172.21.15.125:0/2645743343 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f397c0c9310 0x7f397c0c9770 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.282+0000 7f3982ecc700 1 --2- 172.21.15.125:0/2645743343 >> v2:172.21.15.130:3300/0 conn(0x7f397c15d060 0x7f397c068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.282+0000 7f3982ecc700 1 -- 172.21.15.125:0/2645743343 >> 172.21.15.125:0/2645743343 conn(0x7f397c06c380 msgr2=0x7f397c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:17.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.282+0000 7f3982ecc700 1 -- 172.21.15.125:0/2645743343 shutdown_connections 2023-10-06T03:05:17.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.282+0000 7f3982ecc700 1 -- 172.21.15.125:0/2645743343 wait complete. 2023-10-06T03:05:17.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.283+0000 7f3982ecc700 1 Processor -- start 2023-10-06T03:05:17.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.283+0000 7f3982ecc700 1 -- start start 2023-10-06T03:05:17.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f3982ecc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f397c0c9310 0x7f397c15b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:17.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f3982ecc700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f397c15d060 0x7f397c0c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:17.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f3982ecc700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f397c15d430 0x7f397c0b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:17.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f3982ecc700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c0b1a80 con 0x7f397c0c9310 2023-10-06T03:05:17.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f3982ecc700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f397c1571d0 con 0x7f397c15d430 2023-10-06T03:05:17.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f3982ecc700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f397c1574b0 con 0x7f397c15d060 2023-10-06T03:05:17.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f3980c68700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f397c0c9310 0x7f397c15b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:17.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f3980c68700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f397c0c9310 0x7f397c15b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52162/0 (socket says 172.21.15.125:52162) 2023-10-06T03:05:17.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f3980c68700 1 -- 172.21.15.125:0/3434357602 learned_addr learned my addr 172.21.15.125:0/3434357602 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:17.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f397bfff700 1 --2- 172.21.15.125:0/3434357602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f397c15d060 0x7f397c0c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:17.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f3981469700 1 --2- 172.21.15.125:0/3434357602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f397c15d430 0x7f397c0b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:17.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f3980c68700 1 -- 172.21.15.125:0/3434357602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f397c15d060 msgr2=0x7f397c0c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:17.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f3980c68700 1 --2- 172.21.15.125:0/3434357602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f397c15d060 0x7f397c0c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f3980c68700 1 -- 172.21.15.125:0/3434357602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f397c15d430 msgr2=0x7f397c0b31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:17.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f3980c68700 1 --2- 172.21.15.125:0/3434357602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f397c15d430 0x7f397c0b31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f3980c68700 1 -- 172.21.15.125:0/3434357602 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3974009a20 con 0x7f397c0c9310 2023-10-06T03:05:17.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f397bfff700 1 --2- 172.21.15.125:0/3434357602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f397c15d060 0x7f397c0c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:17.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f3980c68700 1 --2- 172.21.15.125:0/3434357602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f397c0c9310 0x7f397c15b650 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f397000c830 tx=0x7f3970008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:17.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f3978ff9700 1 -- 172.21.15.125:0/3434357602 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3970011600 con 0x7f397c0c9310 2023-10-06T03:05:17.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f3978ff9700 1 -- 172.21.15.125:0/3434357602 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3970011760 con 0x7f397c0c9310 2023-10-06T03:05:17.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.284+0000 7f3978ff9700 1 -- 172.21.15.125:0/3434357602 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3970011b20 con 0x7f397c0c9310 2023-10-06T03:05:17.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.285+0000 7f3982ecc700 1 -- 172.21.15.125:0/3434357602 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f397c157790 con 0x7f397c0c9310 2023-10-06T03:05:17.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.285+0000 7f3982ecc700 1 -- 172.21.15.125:0/3434357602 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f397c157d50 con 0x7f397c0c9310 2023-10-06T03:05:17.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.285+0000 7f3982ecc700 1 -- 172.21.15.125:0/3434357602 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f397c066510 con 0x7f397c0c9310 2023-10-06T03:05:17.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.286+0000 7f3978ff9700 1 -- 172.21.15.125:0/3434357602 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f397000a3e0 con 0x7f397c0c9310 2023-10-06T03:05:17.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.286+0000 7f3978ff9700 1 --2- 172.21.15.125:0/3434357602 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3960066f30 0x7f39600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:17.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.286+0000 7f3978ff9700 1 -- 172.21.15.125:0/3434357602 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f3970084ab0 con 0x7f397c0c9310 2023-10-06T03:05:17.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.286+0000 7f397bfff700 1 --2- 172.21.15.125:0/3434357602 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3960066f30 0x7f39600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:17.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.287+0000 7f397bfff700 1 --2- 172.21.15.125:0/3434357602 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3960066f30 0x7f39600693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3968001890 tx=0x7f3968009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:17.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.290+0000 7f3978ff9700 1 -- 172.21.15.125:0/3434357602 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3970051890 con 0x7f397c0c9310 2023-10-06T03:05:17.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.472+0000 7f3982ecc700 1 -- 172.21.15.125:0/3434357602 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f397c0cb550 con 0x7f397c0c9310 2023-10-06T03:05:17.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.473+0000 7f3978ff9700 1 -- 172.21.15.125:0/3434357602 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18947 (secure 0 0 0) 0x7f3970054eb0 con 0x7f397c0c9310 2023-10-06T03:05:17.475 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:17.475 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":29,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:05:11.385603+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:04:26.828121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:04:28.179225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:04:31.256394+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:05:17.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.476+0000 7f3982ecc700 1 -- 172.21.15.125:0/3434357602 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3960066f30 msgr2=0x7f39600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:17.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.476+0000 7f3982ecc700 1 --2- 172.21.15.125:0/3434357602 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3960066f30 0x7f39600693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3968001890 tx=0x7f3968009040 comp rx=0 tx=0).stop 2023-10-06T03:05:17.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.476+0000 7f3982ecc700 1 -- 172.21.15.125:0/3434357602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f397c0c9310 msgr2=0x7f397c15b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:17.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.476+0000 7f3982ecc700 1 --2- 172.21.15.125:0/3434357602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f397c0c9310 0x7f397c15b650 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f397000c830 tx=0x7f3970008040 comp rx=0 tx=0).stop 2023-10-06T03:05:17.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.476+0000 7f3982ecc700 1 -- 172.21.15.125:0/3434357602 shutdown_connections 2023-10-06T03:05:17.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.476+0000 7f3982ecc700 1 --2- 172.21.15.125:0/3434357602 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3960066f30 0x7f39600693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.476+0000 7f3982ecc700 1 --2- 172.21.15.125:0/3434357602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f397c15d430 0x7f397c0b31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.476+0000 7f3982ecc700 1 --2- 172.21.15.125:0/3434357602 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f397c0c9310 0x7f397c15b650 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.476+0000 7f3982ecc700 1 --2- 172.21.15.125:0/3434357602 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f397c15d060 0x7f397c0c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.476+0000 7f3982ecc700 1 -- 172.21.15.125:0/3434357602 >> 172.21.15.125:0/3434357602 conn(0x7f397c06c380 msgr2=0x7f397c152870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:17.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.476+0000 7f3982ecc700 1 -- 172.21.15.125:0/3434357602 shutdown_connections 2023-10-06T03:05:17.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.476+0000 7f3982ecc700 1 -- 172.21.15.125:0/3434357602 wait complete. 2023-10-06T03:05:17.489 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:05:17.489 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:05:17.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.605+0000 7fb165df5700 1 Processor -- start 2023-10-06T03:05:17.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.605+0000 7fb165df5700 1 -- start start 2023-10-06T03:05:17.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.606+0000 7fb165df5700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb16006ab10 0x7fb1600c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:17.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.606+0000 7fb165df5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb1600ac670 0x7fb1600c7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:17.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.606+0000 7fb165df5700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1600c75c0 con 0x7fb16006aee0 2023-10-06T03:05:17.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.606+0000 7fb165df5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb160069110 con 0x7fb1600ac670 2023-10-06T03:05:17.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.606+0000 7fb165df5700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb160067c70 con 0x7fb16006ab10 2023-10-06T03:05:17.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.606+0000 7fb15effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb1600ac670 0x7fb1600c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:17.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.606+0000 7fb15ffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb16006aee0 0x7fb160158c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40364/0 (socket says 172.21.15.125:40364) 2023-10-06T03:05:17.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.606+0000 7fb15effd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb1600ac670 0x7fb1600c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52178/0 (socket says 172.21.15.125:52178) 2023-10-06T03:05:17.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.606+0000 7fb15ffff700 1 -- 172.21.15.125:0/3601608164 learned_addr learned my addr 172.21.15.125:0/3601608164 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:17.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.606+0000 7fb15f7fe700 1 --2- 172.21.15.125:0/3601608164 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb16006ab10 0x7fb1600c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:17.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.606+0000 7fb15effd700 1 -- 172.21.15.125:0/3601608164 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb16006ab10 msgr2=0x7fb1600c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:17.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.606+0000 7fb15effd700 1 --2- 172.21.15.125:0/3601608164 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb16006ab10 0x7fb1600c6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.606+0000 7fb15effd700 1 -- 172.21.15.125:0/3601608164 >> v1:172.21.15.125:6789/0 conn(0x7fb16006aee0 legacy=0x7fb160158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:17.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.606+0000 7fb15effd700 1 -- 172.21.15.125:0/3601608164 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1600c7800 con 0x7fb1600ac670 2023-10-06T03:05:17.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.606+0000 7fb15e7fc700 1 -- 172.21.15.125:0/3601608164 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208003170 0 0) 0x7fb158001490 con 0x7fb16006aee0 2023-10-06T03:05:17.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.606+0000 7fb15effd700 1 --2- 172.21.15.125:0/3601608164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1600ac670 0x7fb1600c7080 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb1500098e0 tx=0x7fb1500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35b043fab7bdd1ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:17.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.606+0000 7fb15e7fc700 1 -- 172.21.15.125:0/3601608164 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150009e80 con 0x7fb1600ac670 2023-10-06T03:05:17.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.606+0000 7fb15e7fc700 1 -- 172.21.15.125:0/3601608164 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15000b860 con 0x7fb1600ac670 2023-10-06T03:05:17.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.606+0000 7fb15e7fc700 1 -- 172.21.15.125:0/3601608164 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15000bbe0 con 0x7fb1600ac670 2023-10-06T03:05:17.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.607+0000 7fb165df5700 1 -- 172.21.15.125:0/3601608164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1600ac670 msgr2=0x7fb1600c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:17.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.607+0000 7fb165df5700 1 --2- 172.21.15.125:0/3601608164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1600ac670 0x7fb1600c7080 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb1500098e0 tx=0x7fb1500091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.607+0000 7fb165df5700 1 -- 172.21.15.125:0/3601608164 shutdown_connections 2023-10-06T03:05:17.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.607+0000 7fb165df5700 1 --2- 172.21.15.125:0/3601608164 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb16006ab10 0x7fb1600c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.607+0000 7fb165df5700 1 --2- 172.21.15.125:0/3601608164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1600ac670 0x7fb1600c7080 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.607+0000 7fb165df5700 1 -- 172.21.15.125:0/3601608164 >> 172.21.15.125:0/3601608164 conn(0x7fb1600cc5a0 msgr2=0x7fb1600cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:17.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.607+0000 7fb165df5700 1 -- 172.21.15.125:0/3601608164 shutdown_connections 2023-10-06T03:05:17.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.607+0000 7fb165df5700 1 -- 172.21.15.125:0/3601608164 wait complete. 2023-10-06T03:05:17.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.608+0000 7fb165df5700 1 Processor -- start 2023-10-06T03:05:17.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.608+0000 7fb165df5700 1 -- start start 2023-10-06T03:05:17.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.609+0000 7fb165df5700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb16006ab10 0x7fb160153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:17.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.609+0000 7fb165df5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb16006aee0 0x7fb160154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:17.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.609+0000 7fb165df5700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1600ac670 0x7fb1600c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:17.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.609+0000 7fb165df5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1600b04d0 con 0x7fb16006aee0 2023-10-06T03:05:17.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.609+0000 7fb165df5700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16016ad00 con 0x7fb1600ac670 2023-10-06T03:05:17.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.609+0000 7fb165df5700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1600c3eb0 con 0x7fb16006ab10 2023-10-06T03:05:17.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.609+0000 7fb15effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb16006aee0 0x7fb160154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:17.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.609+0000 7fb15effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb16006aee0 0x7fb160154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52194/0 (socket says 172.21.15.125:52194) 2023-10-06T03:05:17.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.609+0000 7fb15effd700 1 -- 172.21.15.125:0/1815487493 learned_addr learned my addr 172.21.15.125:0/1815487493 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:17.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.609+0000 7fb15f7fe700 1 --2- 172.21.15.125:0/1815487493 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb16006ab10 0x7fb160153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:17.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.609+0000 7fb15ffff700 1 --2- 172.21.15.125:0/1815487493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1600ac670 0x7fb1600c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:17.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.609+0000 7fb15effd700 1 -- 172.21.15.125:0/1815487493 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb16006ab10 msgr2=0x7fb160153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:17.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.609+0000 7fb15effd700 1 --2- 172.21.15.125:0/1815487493 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb16006ab10 0x7fb160153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.609+0000 7fb15effd700 1 -- 172.21.15.125:0/1815487493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1600ac670 msgr2=0x7fb1600c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:17.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.609+0000 7fb15effd700 1 --2- 172.21.15.125:0/1815487493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1600ac670 0x7fb1600c5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.609+0000 7fb15effd700 1 -- 172.21.15.125:0/1815487493 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb150009420 con 0x7fb16006aee0 2023-10-06T03:05:17.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.609+0000 7fb15f7fe700 1 --2- 172.21.15.125:0/1815487493 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb16006ab10 0x7fb160153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:17.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.610+0000 7fb15effd700 1 --2- 172.21.15.125:0/1815487493 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb16006aee0 0x7fb160154870 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb16006fa60 tx=0x7fb150017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:17.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.610+0000 7fb1477fe700 1 -- 172.21.15.125:0/1815487493 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15000b9d0 con 0x7fb16006aee0 2023-10-06T03:05:17.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.610+0000 7fb1477fe700 1 -- 172.21.15.125:0/1815487493 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15000bb50 con 0x7fb16006aee0 2023-10-06T03:05:17.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.610+0000 7fb1477fe700 1 -- 172.21.15.125:0/1815487493 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150025670 con 0x7fb16006aee0 2023-10-06T03:05:17.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.610+0000 7fb165df5700 1 -- 172.21.15.125:0/1815487493 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1600c4190 con 0x7fb16006aee0 2023-10-06T03:05:17.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.610+0000 7fb165df5700 1 -- 172.21.15.125:0/1815487493 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1600b0720 con 0x7fb16006aee0 2023-10-06T03:05:17.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.611+0000 7fb165df5700 1 -- 172.21.15.125:0/1815487493 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb160066510 con 0x7fb16006aee0 2023-10-06T03:05:17.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.611+0000 7fb1477fe700 1 -- 172.21.15.125:0/1815487493 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb150023070 con 0x7fb16006aee0 2023-10-06T03:05:17.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.611+0000 7fb1477fe700 1 --2- 172.21.15.125:0/1815487493 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb14c066f30 0x7fb14c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:17.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.612+0000 7fb1477fe700 1 -- 172.21.15.125:0/1815487493 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7fb150085fb0 con 0x7fb16006aee0 2023-10-06T03:05:17.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.612+0000 7fb15f7fe700 1 --2- 172.21.15.125:0/1815487493 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb14c066f30 0x7fb14c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:17.616 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.612+0000 7fb15f7fe700 1 --2- 172.21.15.125:0/1815487493 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb14c066f30 0x7fb14c0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb154006fd0 tx=0x7fb154008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:17.617 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.616+0000 7fb1477fe700 1 -- 172.21.15.125:0/1815487493 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1500b75a0 con 0x7fb16006aee0 2023-10-06T03:05:17.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.838+0000 7fb165df5700 1 -- 172.21.15.125:0/1815487493 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1600c7ae0 con 0x7fb16006aee0 2023-10-06T03:05:17.840 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.839+0000 7fb1477fe700 1 -- 172.21.15.125:0/1815487493 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7fb150052d90 con 0x7fb16006aee0 2023-10-06T03:05:17.840 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:17.841 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/1260071130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1260071130},{"type":"v1","addr":"172.21.15.130:6834","nonce":1260071130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/63925154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":63925154},{"type":"v1","addr":"172.21.15.125:6836","nonce":63925154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/1057811891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1057811891},{"type":"v1","addr":"172.21.15.125:6837","nonce":1057811891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:04:29.211664+0000","modified":"2023-10-06T03:04:42.275374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/4004582354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":4004582354},{"type":"v1","addr":"172.21.15.130:6835","nonce":4004582354}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:05:17.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.841+0000 7fb165df5700 1 -- 172.21.15.125:0/1815487493 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb14c066f30 msgr2=0x7fb14c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:17.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.841+0000 7fb165df5700 1 --2- 172.21.15.125:0/1815487493 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb14c066f30 0x7fb14c0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb154006fd0 tx=0x7fb154008040 comp rx=0 tx=0).stop 2023-10-06T03:05:17.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.841+0000 7fb165df5700 1 -- 172.21.15.125:0/1815487493 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb16006aee0 msgr2=0x7fb160154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:17.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.841+0000 7fb165df5700 1 --2- 172.21.15.125:0/1815487493 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb16006aee0 0x7fb160154870 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb16006fa60 tx=0x7fb150017000 comp rx=0 tx=0).stop 2023-10-06T03:05:17.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.841+0000 7fb165df5700 1 -- 172.21.15.125:0/1815487493 shutdown_connections 2023-10-06T03:05:17.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.841+0000 7fb165df5700 1 --2- 172.21.15.125:0/1815487493 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb14c066f30 0x7fb14c0693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.841+0000 7fb165df5700 1 --2- 172.21.15.125:0/1815487493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1600ac670 0x7fb1600c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.841+0000 7fb165df5700 1 --2- 172.21.15.125:0/1815487493 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb16006ab10 0x7fb160153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.841+0000 7fb165df5700 1 --2- 172.21.15.125:0/1815487493 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb16006aee0 0x7fb160154870 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.843 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.841+0000 7fb165df5700 1 -- 172.21.15.125:0/1815487493 >> 172.21.15.125:0/1815487493 conn(0x7fb1600cc5a0 msgr2=0x7fb1600aca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:17.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.841+0000 7fb165df5700 1 -- 172.21.15.125:0/1815487493 shutdown_connections 2023-10-06T03:05:17.844 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.841+0000 7fb165df5700 1 -- 172.21.15.125:0/1815487493 wait complete. 2023-10-06T03:05:17.844 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 9 2023-10-06T03:05:17.854 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:05:17.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.970+0000 7f115a5b8700 1 Processor -- start 2023-10-06T03:05:17.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.970+0000 7f115a5b8700 1 -- start start 2023-10-06T03:05:17.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.970+0000 7f115a5b8700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11540cc730 0x7f1154069c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:17.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.970+0000 7f115a5b8700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f11540c8620 0x7f11540c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:17.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.970+0000 7f115a5b8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11540c8fd0 0x7f11540ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:17.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.970+0000 7f115a5b8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1154069780 con 0x7f11540c8fd0 2023-10-06T03:05:17.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.970+0000 7f115a5b8700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11540c4130 con 0x7f11540c8620 2023-10-06T03:05:17.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.970+0000 7f115a5b8700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11540c4410 con 0x7f11540cc730 2023-10-06T03:05:17.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.971+0000 7f1158b55700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11540c8fd0 0x7f11540ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:17.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.971+0000 7f1158b55700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f11540c8fd0 0x7f11540ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52202/0 (socket says 172.21.15.125:52202) 2023-10-06T03:05:17.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.971+0000 7f1158b55700 1 -- 172.21.15.125:0/767995004 learned_addr learned my addr 172.21.15.125:0/767995004 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:17.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.971+0000 7f11537fe700 1 --2- 172.21.15.125:0/767995004 >> v2:172.21.15.130:3300/0 conn(0x7f11540c8620 0x7f11540c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:17.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.971+0000 7f1153fff700 1 --2- 172.21.15.125:0/767995004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11540cc730 0x7f1154069c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:17.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.971+0000 7f1158b55700 1 -- 172.21.15.125:0/767995004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11540cc730 msgr2=0x7f1154069c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.971+0000 7f1158b55700 1 --2- 172.21.15.125:0/767995004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11540cc730 0x7f1154069c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.971+0000 7f1158b55700 1 -- 172.21.15.125:0/767995004 >> v2:172.21.15.130:3300/0 conn(0x7f11540c8620 msgr2=0x7f11540c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.971+0000 7f1158b55700 1 --2- 172.21.15.125:0/767995004 >> v2:172.21.15.130:3300/0 conn(0x7f11540c8620 0x7f11540c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.971+0000 7f1158b55700 1 -- 172.21.15.125:0/767995004 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1154069410 con 0x7f11540c8fd0 2023-10-06T03:05:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.971+0000 7f1158b55700 1 --2- 172.21.15.125:0/767995004 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11540c8fd0 0x7f11540ccb00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f115406ed90 tx=0x7f114c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9924e58fa6257442 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.971+0000 7f1152ffd700 1 -- 172.21.15.125:0/767995004 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c00e070 con 0x7f11540c8fd0 2023-10-06T03:05:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.971+0000 7f1152ffd700 1 -- 172.21.15.125:0/767995004 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114c00b970 con 0x7f11540c8fd0 2023-10-06T03:05:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.971+0000 7f1152ffd700 1 -- 172.21.15.125:0/767995004 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c0092e0 con 0x7f11540c8fd0 2023-10-06T03:05:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.972+0000 7f115a5b8700 1 -- 172.21.15.125:0/767995004 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11540c8fd0 msgr2=0x7f11540ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.972+0000 7f115a5b8700 1 --2- 172.21.15.125:0/767995004 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11540c8fd0 0x7f11540ccb00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f115406ed90 tx=0x7f114c009840 comp rx=0 tx=0).stop 2023-10-06T03:05:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.972+0000 7f115a5b8700 1 -- 172.21.15.125:0/767995004 shutdown_connections 2023-10-06T03:05:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.972+0000 7f115a5b8700 1 --2- 172.21.15.125:0/767995004 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11540c8fd0 0x7f11540ccb00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.972+0000 7f115a5b8700 1 --2- 172.21.15.125:0/767995004 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11540cc730 0x7f1154069c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.972+0000 7f115a5b8700 1 --2- 172.21.15.125:0/767995004 >> v2:172.21.15.130:3300/0 conn(0x7f11540c8620 0x7f11540c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.972+0000 7f115a5b8700 1 -- 172.21.15.125:0/767995004 >> 172.21.15.125:0/767995004 conn(0x7f1154067df0 msgr2=0x7f11540cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:17.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.972+0000 7f115a5b8700 1 -- 172.21.15.125:0/767995004 shutdown_connections 2023-10-06T03:05:17.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.972+0000 7f115a5b8700 1 -- 172.21.15.125:0/767995004 wait complete. 2023-10-06T03:05:17.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.973+0000 7f115a5b8700 1 Processor -- start 2023-10-06T03:05:17.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.974+0000 7f115a5b8700 1 -- start start 2023-10-06T03:05:17.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.974+0000 7f115a5b8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11540c8620 0x7f11541560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:17.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.974+0000 7f115a5b8700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11540c8fd0 0x7f1154158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:17.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.974+0000 7f115a5b8700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11540cc730 0x7f11541577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:17.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.974+0000 7f115a5b8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11540abb80 con 0x7f11540c8620 2023-10-06T03:05:17.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.974+0000 7f115a5b8700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11540ac9e0 con 0x7f11540cc730 2023-10-06T03:05:17.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.974+0000 7f115a5b8700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1154156620 con 0x7f11540c8fd0 2023-10-06T03:05:17.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.975+0000 7f1153fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11540c8620 0x7f11541560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:17.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.975+0000 7f1153fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11540c8620 0x7f11541560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52218/0 (socket says 172.21.15.125:52218) 2023-10-06T03:05:17.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.975+0000 7f1153fff700 1 -- 172.21.15.125:0/362251564 learned_addr learned my addr 172.21.15.125:0/362251564 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:17.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.975+0000 7f11537fe700 1 --2- 172.21.15.125:0/362251564 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11540c8fd0 0x7f1154158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:17.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.975+0000 7f1158b55700 1 --2- 172.21.15.125:0/362251564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11540cc730 0x7f11541577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:17.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.975+0000 7f1153fff700 1 -- 172.21.15.125:0/362251564 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11540c8fd0 msgr2=0x7f1154158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:17.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.975+0000 7f1153fff700 1 --2- 172.21.15.125:0/362251564 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11540c8fd0 0x7f1154158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.975+0000 7f1153fff700 1 -- 172.21.15.125:0/362251564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11540cc730 msgr2=0x7f11541577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:17.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.975+0000 7f1153fff700 1 --2- 172.21.15.125:0/362251564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11540cc730 0x7f11541577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:17.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.975+0000 7f1153fff700 1 -- 172.21.15.125:0/362251564 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f114c009ae0 con 0x7f11540c8620 2023-10-06T03:05:17.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.975+0000 7f11537fe700 1 --2- 172.21.15.125:0/362251564 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11540c8fd0 0x7f1154158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:17.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.975+0000 7f1158b55700 1 --2- 172.21.15.125:0/362251564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11540cc730 0x7f11541577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:17.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.975+0000 7f1153fff700 1 --2- 172.21.15.125:0/362251564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11540c8620 0x7f11541560e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f114400ea00 tx=0x7f1144009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:17.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.975+0000 7f113bfff700 1 -- 172.21.15.125:0/362251564 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114400c850 con 0x7f11540c8620 2023-10-06T03:05:17.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.975+0000 7f113bfff700 1 -- 172.21.15.125:0/362251564 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114400c9b0 con 0x7f11540c8620 2023-10-06T03:05:17.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.975+0000 7f115a5b8700 1 -- 172.21.15.125:0/362251564 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11540b3810 con 0x7f11540c8620 2023-10-06T03:05:17.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.975+0000 7f113bfff700 1 -- 172.21.15.125:0/362251564 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114400cd30 con 0x7f11540c8620 2023-10-06T03:05:17.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.975+0000 7f115a5b8700 1 -- 172.21.15.125:0/362251564 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11540ac0b0 con 0x7f11540c8620 2023-10-06T03:05:17.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.976+0000 7f115a5b8700 1 -- 172.21.15.125:0/362251564 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11540accc0 con 0x7f11540c8620 2023-10-06T03:05:17.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.977+0000 7f113bfff700 1 -- 172.21.15.125:0/362251564 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1144013680 con 0x7f11540c8620 2023-10-06T03:05:17.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.977+0000 7f113bfff700 1 --2- 172.21.15.125:0/362251564 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1140066f30 0x7f11400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:17.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.977+0000 7f113bfff700 1 -- 172.21.15.125:0/362251564 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f1144085040 con 0x7f11540c8620 2023-10-06T03:05:17.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.977+0000 7f11537fe700 1 --2- 172.21.15.125:0/362251564 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1140066f30 0x7f11400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:17.981 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.977+0000 7f11537fe700 1 --2- 172.21.15.125:0/362251564 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1140066f30 0x7f11400693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f115416c740 tx=0x7f1148008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:17.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:17.981+0000 7f113bfff700 1 -- 172.21.15.125:0/362251564 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1144051e20 con 0x7f11540c8620 2023-10-06T03:05:18.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.204+0000 7f115a5b8700 1 -- 172.21.15.125:0/362251564 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1154066510 con 0x7f11540c8620 2023-10-06T03:05:18.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.205+0000 7f113bfff700 1 -- 172.21.15.125:0/362251564 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4599 (secure 0 0 0) 0x7f1144017090 con 0x7f11540c8620 2023-10-06T03:05:18.207 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:18.207 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/1260071130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1260071130},{"type":"v1","addr":"172.21.15.130:6834","nonce":1260071130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4254,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/63925154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":63925154},{"type":"v1","addr":"172.21.15.125:6836","nonce":63925154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4257,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/1057811891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1057811891},{"type":"v1","addr":"172.21.15.125:6837","nonce":1057811891}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:04:29.211664+0000","modified":"2023-10-06T03:04:42.275374+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4269},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4269":{"gid":4269,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.130:6835/4004582354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":4004582354},{"type":"v1","addr":"172.21.15.130:6835","nonce":4004582354}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T03:05:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.207+0000 7f115a5b8700 1 -- 172.21.15.125:0/362251564 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1140066f30 msgr2=0x7f11400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.207+0000 7f115a5b8700 1 --2- 172.21.15.125:0/362251564 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1140066f30 0x7f11400693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f115416c740 tx=0x7f1148008040 comp rx=0 tx=0).stop 2023-10-06T03:05:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.207+0000 7f115a5b8700 1 -- 172.21.15.125:0/362251564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11540c8620 msgr2=0x7f11541560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.207+0000 7f115a5b8700 1 --2- 172.21.15.125:0/362251564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11540c8620 0x7f11541560e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f114400ea00 tx=0x7f1144009120 comp rx=0 tx=0).stop 2023-10-06T03:05:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.207+0000 7f115a5b8700 1 -- 172.21.15.125:0/362251564 shutdown_connections 2023-10-06T03:05:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.207+0000 7f115a5b8700 1 --2- 172.21.15.125:0/362251564 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1140066f30 0x7f11400693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.207+0000 7f115a5b8700 1 --2- 172.21.15.125:0/362251564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f11540cc730 0x7f11541577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.209 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.207+0000 7f115a5b8700 1 --2- 172.21.15.125:0/362251564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f11540c8620 0x7f11541560e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.207+0000 7f115a5b8700 1 --2- 172.21.15.125:0/362251564 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f11540c8fd0 0x7f1154158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.207+0000 7f115a5b8700 1 -- 172.21.15.125:0/362251564 >> 172.21.15.125:0/362251564 conn(0x7f1154067df0 msgr2=0x7f115406daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:18.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.207+0000 7f115a5b8700 1 -- 172.21.15.125:0/362251564 shutdown_connections 2023-10-06T03:05:18.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.207+0000 7f115a5b8700 1 -- 172.21.15.125:0/362251564 wait complete. 2023-10-06T03:05:18.210 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 9 2023-10-06T03:05:18.221 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:05:18.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.336+0000 7f9f54d01700 1 Processor -- start 2023-10-06T03:05:18.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.336+0000 7f9f54d01700 1 -- start start 2023-10-06T03:05:18.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.337+0000 7f9f54d01700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f5006a8c0 0x7f9f5006ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:18.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.337+0000 7f9f54d01700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f500acdb0 con 0x7f9f500af370 2023-10-06T03:05:18.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.337+0000 7f9f54d01700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f50157420 con 0x7f9f50157050 2023-10-06T03:05:18.342 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.337+0000 7f9f54d01700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5006b2a0 con 0x7f9f5006a8c0 2023-10-06T03:05:18.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.337+0000 7f9f4ed9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9f500af370 0x7f9f500af7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40372/0 (socket says 172.21.15.125:40372) 2023-10-06T03:05:18.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4ed9d700 1 -- 172.21.15.125:0/1484945778 learned_addr learned my addr 172.21.15.125:0/1484945778 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:18.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4dd9b700 1 --2- 172.21.15.125:0/1484945778 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f5006a8c0 0x7f9f5006ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:18.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4d59a700 1 -- 172.21.15.125:0/1484945778 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011101742 0 0) 0x7f9f500acdb0 con 0x7f9f500af370 2023-10-06T03:05:18.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4d59a700 1 -- 172.21.15.125:0/1484945778 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f3c003570 con 0x7f9f500af370 2023-10-06T03:05:18.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4d59a700 1 -- 172.21.15.125:0/1484945778 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 993085946 0 0) 0x7f9f3c003570 con 0x7f9f500af370 2023-10-06T03:05:18.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4d59a700 1 -- 172.21.15.125:0/1484945778 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f5006a8c0 msgr2=0x7f9f5006ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:18.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4d59a700 1 --2- 172.21.15.125:0/1484945778 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f5006a8c0 0x7f9f5006ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4d59a700 1 -- 172.21.15.125:0/1484945778 >> v1:172.21.15.130:6789/0 conn(0x7f9f50157050 legacy=0x7f9f500ab7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:18.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4d59a700 1 -- 172.21.15.125:0/1484945778 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f500abed0 con 0x7f9f500af370 2023-10-06T03:05:18.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4d59a700 1 -- 172.21.15.125:0/1484945778 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f9f480017f0 con 0x7f9f500af370 2023-10-06T03:05:18.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4d59a700 1 -- 172.21.15.125:0/1484945778 >> v1:172.21.15.125:6789/0 conn(0x7f9f500af370 legacy=0x7f9f500af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:18.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4d59a700 1 --2- 172.21.15.125:0/1484945778 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f5006a8c0 0x7f9f3c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:18.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4d59a700 1 --2- 172.21.15.125:0/1484945778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f3c003fd0 0x7f9f3c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:18.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4d59a700 1 --2- 172.21.15.125:0/1484945778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f3c004d50 0x7f9f3c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:18.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4d59a700 1 -- 172.21.15.125:0/1484945778 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5006b2a0 con 0x7f9f3c004d50 2023-10-06T03:05:18.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4d59a700 1 -- 172.21.15.125:0/1484945778 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c00bb40 con 0x7f9f3c003fd0 2023-10-06T03:05:18.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4d59a700 1 -- 172.21.15.125:0/1484945778 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c00bd00 con 0x7f9f5006a8c0 2023-10-06T03:05:18.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4ed9d700 1 --2- 172.21.15.125:0/1484945778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f3c004d50 0x7f9f3c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:18.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4dd9b700 1 --2- 172.21.15.125:0/1484945778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f3c003fd0 0x7f9f3c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:18.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4e59c700 1 --2- 172.21.15.125:0/1484945778 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f5006a8c0 0x7f9f3c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:18.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4ed9d700 1 -- 172.21.15.125:0/1484945778 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f5006a8c0 msgr2=0x7f9f3c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:18.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4ed9d700 1 --2- 172.21.15.125:0/1484945778 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f5006a8c0 0x7f9f3c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4ed9d700 1 -- 172.21.15.125:0/1484945778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f3c003fd0 msgr2=0x7f9f3c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:18.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4ed9d700 1 --2- 172.21.15.125:0/1484945778 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f3c003fd0 0x7f9f3c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4ed9d700 1 -- 172.21.15.125:0/1484945778 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c003570 con 0x7f9f3c004d50 2023-10-06T03:05:18.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.338+0000 7f9f4e59c700 1 --2- 172.21.15.125:0/1484945778 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f5006a8c0 0x7f9f3c003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:18.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.339+0000 7f9f4ed9d700 1 --2- 172.21.15.125:0/1484945778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f3c004d50 0x7f9f3c0051c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9f4800a950 tx=0x7f9f480021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b947cd4f4cf7fb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:18.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.339+0000 7f9f4d59a700 1 -- 172.21.15.125:0/1484945778 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f480070d0 con 0x7f9f3c004d50 2023-10-06T03:05:18.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.339+0000 7f9f4d59a700 1 -- 172.21.15.125:0/1484945778 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f48007230 con 0x7f9f3c004d50 2023-10-06T03:05:18.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.339+0000 7f9f4d59a700 1 -- 172.21.15.125:0/1484945778 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f480075f0 con 0x7f9f3c004d50 2023-10-06T03:05:18.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.339+0000 7f9f54d01700 1 -- 172.21.15.125:0/1484945778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f3c004d50 msgr2=0x7f9f3c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:18.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.339+0000 7f9f54d01700 1 --2- 172.21.15.125:0/1484945778 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f3c004d50 0x7f9f3c0051c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9f4800a950 tx=0x7f9f480021f0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.339+0000 7f9f4ed9d700 1 -- 172.21.15.125:0/1484945778 reap_dead start 2023-10-06T03:05:18.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.339+0000 7f9f54d01700 1 -- 172.21.15.125:0/1484945778 shutdown_connections 2023-10-06T03:05:18.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.339+0000 7f9f54d01700 1 -- 172.21.15.125:0/1484945778 >> 172.21.15.125:0/1484945778 conn(0x7f9f500cc5a0 msgr2=0x7f9f500cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:18.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.339+0000 7f9f54d01700 1 -- 172.21.15.125:0/1484945778 shutdown_connections 2023-10-06T03:05:18.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.339+0000 7f9f54d01700 1 -- 172.21.15.125:0/1484945778 wait complete. 2023-10-06T03:05:18.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.341+0000 7f9f54d01700 1 Processor -- start 2023-10-06T03:05:18.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.341+0000 7f9f54d01700 1 -- start start 2023-10-06T03:05:18.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f54d01700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f3c004d50 0x7f9f5015a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f54d01700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f500c60b0 0x7f9f50153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f54d01700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f50157ff0 0x7f9f500b0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f54d01700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5015a050 con 0x7f9f50157ff0 2023-10-06T03:05:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f54d01700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f501540f0 con 0x7f9f3c004d50 2023-10-06T03:05:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f54d01700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f50157ca0 con 0x7f9f500c60b0 2023-10-06T03:05:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f4ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f50157ff0 0x7f9f500b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f4e59c700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f3c004d50 0x7f9f5015a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f4ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f50157ff0 0x7f9f500b0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52232/0 (socket says 172.21.15.125:52232) 2023-10-06T03:05:18.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f4ed9d700 1 -- 172.21.15.125:0/2410665647 learned_addr learned my addr 172.21.15.125:0/2410665647 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:18.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f4dd9b700 1 --2- 172.21.15.125:0/2410665647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f500c60b0 0x7f9f50153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:18.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f4ed9d700 1 -- 172.21.15.125:0/2410665647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f500c60b0 msgr2=0x7f9f50153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:18.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f4ed9d700 1 --2- 172.21.15.125:0/2410665647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f500c60b0 0x7f9f50153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f4ed9d700 1 -- 172.21.15.125:0/2410665647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f3c004d50 msgr2=0x7f9f5015a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:18.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f4ed9d700 1 --2- 172.21.15.125:0/2410665647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f3c004d50 0x7f9f5015a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f4ed9d700 1 -- 172.21.15.125:0/2410665647 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f501576e0 con 0x7f9f50157ff0 2023-10-06T03:05:18.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f4ed9d700 1 --2- 172.21.15.125:0/2410665647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f50157ff0 0x7f9f500b0710 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9f48002230 tx=0x7f9f48016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:18.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f467fc700 1 -- 172.21.15.125:0/2410665647 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f480073a0 con 0x7f9f50157ff0 2023-10-06T03:05:18.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f467fc700 1 -- 172.21.15.125:0/2410665647 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f48007520 con 0x7f9f50157ff0 2023-10-06T03:05:18.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f467fc700 1 -- 172.21.15.125:0/2410665647 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4801e680 con 0x7f9f50157ff0 2023-10-06T03:05:18.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.342+0000 7f9f54d01700 1 -- 172.21.15.125:0/2410665647 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f501579c0 con 0x7f9f50157ff0 2023-10-06T03:05:18.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.343+0000 7f9f54d01700 1 -- 172.21.15.125:0/2410665647 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f50158460 con 0x7f9f50157ff0 2023-10-06T03:05:18.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.343+0000 7f9f54d01700 1 -- 172.21.15.125:0/2410665647 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f50159ea0 con 0x7f9f50157ff0 2023-10-06T03:05:18.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.344+0000 7f9f467fc700 1 -- 172.21.15.125:0/2410665647 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f4801e9f0 con 0x7f9f50157ff0 2023-10-06T03:05:18.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.344+0000 7f9f467fc700 1 --2- 172.21.15.125:0/2410665647 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9f30066f30 0x7f9f300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:18.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.344+0000 7f9f467fc700 1 -- 172.21.15.125:0/2410665647 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f9f480860a0 con 0x7f9f50157ff0 2023-10-06T03:05:18.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.344+0000 7f9f4e59c700 1 --2- 172.21.15.125:0/2410665647 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9f30066f30 0x7f9f300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:18.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.345+0000 7f9f4e59c700 1 --2- 172.21.15.125:0/2410665647 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9f30066f30 0x7f9f300693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9f40007fd0 tx=0x7f9f4000c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:18.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.348+0000 7f9f467fc700 1 -- 172.21.15.125:0/2410665647 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f48052e80 con 0x7f9f50157ff0 2023-10-06T03:05:18.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.533+0000 7f9f54d01700 1 -- 172.21.15.125:0/2410665647 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f50159b40 con 0x7f9f50157ff0 2023-10-06T03:05:18.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.534+0000 7f9f467fc700 1 -- 172.21.15.125:0/2410665647 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18947 (secure 0 0 0) 0x7f9f50159b40 con 0x7f9f50157ff0 2023-10-06T03:05:18.536 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:18.536 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":29,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:05:11.385603+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:04:26.828121+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T03:04:28.179225+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-10-06T03:04:31.256394+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:05:18.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.536+0000 7f9f54d01700 1 -- 172.21.15.125:0/2410665647 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9f30066f30 msgr2=0x7f9f300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:18.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.536+0000 7f9f54d01700 1 --2- 172.21.15.125:0/2410665647 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9f30066f30 0x7f9f300693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9f40007fd0 tx=0x7f9f4000c040 comp rx=0 tx=0).stop 2023-10-06T03:05:18.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.536+0000 7f9f54d01700 1 -- 172.21.15.125:0/2410665647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f50157ff0 msgr2=0x7f9f500b0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:18.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.536+0000 7f9f54d01700 1 --2- 172.21.15.125:0/2410665647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f50157ff0 0x7f9f500b0710 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9f48002230 tx=0x7f9f48016000 comp rx=0 tx=0).stop 2023-10-06T03:05:18.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.536+0000 7f9f54d01700 1 -- 172.21.15.125:0/2410665647 shutdown_connections 2023-10-06T03:05:18.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.536+0000 7f9f54d01700 1 --2- 172.21.15.125:0/2410665647 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9f30066f30 0x7f9f300693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.536+0000 7f9f54d01700 1 --2- 172.21.15.125:0/2410665647 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9f50157ff0 0x7f9f500b0710 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.536+0000 7f9f54d01700 1 --2- 172.21.15.125:0/2410665647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f3c004d50 0x7f9f5015a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.536+0000 7f9f54d01700 1 --2- 172.21.15.125:0/2410665647 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9f500c60b0 0x7f9f50153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.536+0000 7f9f54d01700 1 -- 172.21.15.125:0/2410665647 >> 172.21.15.125:0/2410665647 conn(0x7f9f500cc5a0 msgr2=0x7f9f5006e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:18.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.537+0000 7f9f54d01700 1 -- 172.21.15.125:0/2410665647 shutdown_connections 2023-10-06T03:05:18.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.537+0000 7f9f54d01700 1 -- 172.21.15.125:0/2410665647 wait complete. 2023-10-06T03:05:18.550 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:05:18.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.668+0000 7f6f5b7e3700 1 Processor -- start 2023-10-06T03:05:18.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.668+0000 7f6f5b7e3700 1 -- start start 2023-10-06T03:05:18.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.669+0000 7f6f5b7e3700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6f54156de0 0x7f6f541571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:18.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.669+0000 7f6f5b7e3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6f540cd790 0x7f6f540ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:18.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.669+0000 7f6f5b7e3700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f540cd300 con 0x7f6f540cc060 2023-10-06T03:05:18.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.669+0000 7f6f5b7e3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f540cc4e0 con 0x7f6f540cd790 2023-10-06T03:05:18.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.669+0000 7f6f5b7e3700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f540cc6f0 con 0x7f6f54156de0 2023-10-06T03:05:18.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.669+0000 7f6f59d80700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6f540cd790 0x7f6f540ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:18.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.669+0000 7f6f59d80700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6f540cd790 0x7f6f540ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52248/0 (socket says 172.21.15.125:52248) 2023-10-06T03:05:18.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.669+0000 7f6f59d80700 1 -- 172.21.15.125:0/2447212221 learned_addr learned my addr 172.21.15.125:0/2447212221 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:18.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.669+0000 7f6f5957f700 1 --2- 172.21.15.125:0/2447212221 >> v2:172.21.15.130:3300/0 conn(0x7f6f54156de0 0x7f6f541571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:18.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.669+0000 7f6f59d80700 1 -- 172.21.15.125:0/2447212221 >> v2:172.21.15.130:3300/0 conn(0x7f6f54156de0 msgr2=0x7f6f541571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:18.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.669+0000 7f6f59d80700 1 --2- 172.21.15.125:0/2447212221 >> v2:172.21.15.130:3300/0 conn(0x7f6f54156de0 0x7f6f541571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.669+0000 7f6f59d80700 1 -- 172.21.15.125:0/2447212221 >> v1:172.21.15.130:6789/0 conn(0x7f6f540cc060 legacy=0x7f6f5415b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:18.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.669+0000 7f6f59d80700 1 -- 172.21.15.125:0/2447212221 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f540cc9d0 con 0x7f6f540cd790 2023-10-06T03:05:18.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.669+0000 7f6f5957f700 1 --2- 172.21.15.125:0/2447212221 >> v2:172.21.15.130:3300/0 conn(0x7f6f54156de0 0x7f6f541571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:18.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.670+0000 7f6f59d80700 1 --2- 172.21.15.125:0/2447212221 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f540cd790 0x7f6f540ca890 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6f540cbae0 tx=0x7f6f4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58457dda937e91cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:18.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.670+0000 7f6f4bfff700 1 -- 172.21.15.125:0/2447212221 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c00e070 con 0x7f6f540cd790 2023-10-06T03:05:18.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.670+0000 7f6f4bfff700 1 -- 172.21.15.125:0/2447212221 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c00ba10 con 0x7f6f540cd790 2023-10-06T03:05:18.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.670+0000 7f6f4bfff700 1 -- 172.21.15.125:0/2447212221 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c0092e0 con 0x7f6f540cd790 2023-10-06T03:05:18.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.670+0000 7f6f5b7e3700 1 -- 172.21.15.125:0/2447212221 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f540cd790 msgr2=0x7f6f540ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:18.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.670+0000 7f6f5b7e3700 1 --2- 172.21.15.125:0/2447212221 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f540cd790 0x7f6f540ca890 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6f540cbae0 tx=0x7f6f4c009840 comp rx=0 tx=0).stop 2023-10-06T03:05:18.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.670+0000 7f6f5b7e3700 1 -- 172.21.15.125:0/2447212221 shutdown_connections 2023-10-06T03:05:18.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.670+0000 7f6f5b7e3700 1 --2- 172.21.15.125:0/2447212221 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f540cd790 0x7f6f540ca890 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.670+0000 7f6f5b7e3700 1 --2- 172.21.15.125:0/2447212221 >> v2:172.21.15.130:3300/0 conn(0x7f6f54156de0 0x7f6f541571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.670+0000 7f6f5b7e3700 1 -- 172.21.15.125:0/2447212221 >> 172.21.15.125:0/2447212221 conn(0x7f6f540cdf80 msgr2=0x7f6f540ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:18.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.670+0000 7f6f5b7e3700 1 -- 172.21.15.125:0/2447212221 shutdown_connections 2023-10-06T03:05:18.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.670+0000 7f6f5b7e3700 1 -- 172.21.15.125:0/2447212221 wait complete. 2023-10-06T03:05:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.671+0000 7f6f5b7e3700 1 Processor -- start 2023-10-06T03:05:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.672+0000 7f6f5b7e3700 1 -- start start 2023-10-06T03:05:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.672+0000 7f6f5b7e3700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f540cc060 0x7f6f540c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.672+0000 7f6f5b7e3700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6f540cd790 0x7f6f54146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.672+0000 7f6f5b7e3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f54156de0 0x7f6f540b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.672+0000 7f6f5b7e3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f540c5a90 con 0x7f6f54156de0 2023-10-06T03:05:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.672+0000 7f6f5b7e3700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f540c5fc0 con 0x7f6f540cc060 2023-10-06T03:05:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.672+0000 7f6f5b7e3700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f540ae8a0 con 0x7f6f540cd790 2023-10-06T03:05:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.673+0000 7f6f59d80700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f54156de0 0x7f6f540b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:18.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.673+0000 7f6f59d80700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f54156de0 0x7f6f540b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52260/0 (socket says 172.21.15.125:52260) 2023-10-06T03:05:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.673+0000 7f6f59d80700 1 -- 172.21.15.125:0/991089244 learned_addr learned my addr 172.21.15.125:0/991089244 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.673+0000 7f6f5957f700 1 --2- 172.21.15.125:0/991089244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f540cc060 0x7f6f540c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.673+0000 7f6f58d7e700 1 --2- 172.21.15.125:0/991089244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6f540cd790 0x7f6f54146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.673+0000 7f6f59d80700 1 -- 172.21.15.125:0/991089244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6f540cd790 msgr2=0x7f6f54146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.673+0000 7f6f59d80700 1 --2- 172.21.15.125:0/991089244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6f540cd790 0x7f6f54146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.673+0000 7f6f59d80700 1 -- 172.21.15.125:0/991089244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f540cc060 msgr2=0x7f6f540c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.673+0000 7f6f59d80700 1 --2- 172.21.15.125:0/991089244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f540cc060 0x7f6f540c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.673+0000 7f6f59d80700 1 -- 172.21.15.125:0/991089244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c009ae0 con 0x7f6f54156de0 2023-10-06T03:05:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.673+0000 7f6f59d80700 1 --2- 172.21.15.125:0/991089244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f54156de0 0x7f6f540b0d20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009fd0 tx=0x7f6f4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.673+0000 7f6f497fa700 1 -- 172.21.15.125:0/991089244 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c0094e0 con 0x7f6f54156de0 2023-10-06T03:05:18.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.673+0000 7f6f497fa700 1 -- 172.21.15.125:0/991089244 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4c0032f0 con 0x7f6f54156de0 2023-10-06T03:05:18.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.673+0000 7f6f497fa700 1 -- 172.21.15.125:0/991089244 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4c01d420 con 0x7f6f54156de0 2023-10-06T03:05:18.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.673+0000 7f6f5b7e3700 1 -- 172.21.15.125:0/991089244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f540c7e80 con 0x7f6f54156de0 2023-10-06T03:05:18.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.673+0000 7f6f5b7e3700 1 -- 172.21.15.125:0/991089244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f540ae250 con 0x7f6f54156de0 2023-10-06T03:05:18.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.674+0000 7f6f5b7e3700 1 -- 172.21.15.125:0/991089244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f54066510 con 0x7f6f54156de0 2023-10-06T03:05:18.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.674+0000 7f6f497fa700 1 -- 172.21.15.125:0/991089244 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f4c01d850 con 0x7f6f54156de0 2023-10-06T03:05:18.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.675+0000 7f6f497fa700 1 --2- 172.21.15.125:0/991089244 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6f38066f30 0x7f6f380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:18.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.675+0000 7f6f497fa700 1 -- 172.21.15.125:0/991089244 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6867+0+0 (secure 0 0 0) 0x7f6f4c086150 con 0x7f6f54156de0 2023-10-06T03:05:18.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.675+0000 7f6f5957f700 1 --2- 172.21.15.125:0/991089244 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6f38066f30 0x7f6f380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:18.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.675+0000 7f6f5957f700 1 --2- 172.21.15.125:0/991089244 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6f38066f30 0x7f6f380693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6f44006fd0 tx=0x7f6f44008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:18.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.679+0000 7f6f497fa700 1 -- 172.21.15.125:0/991089244 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f4c052e90 con 0x7f6f54156de0 2023-10-06T03:05:18.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.904+0000 7f6f5b7e3700 1 -- 172.21.15.125:0/991089244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6f540cccb0 con 0x7f6f54156de0 2023-10-06T03:05:18.906 INFO:tasks.ceph.mon.a.smithi125.stderr:2023-10-06T03:05:18.905+0000 7f8a89245700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:05:18.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.913+0000 7f6f497fa700 1 -- 172.21.15.125:0/991089244 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6f4c0564b0 con 0x7f6f54156de0 2023-10-06T03:05:18.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.915+0000 7f6f5b7e3700 1 -- 172.21.15.125:0/991089244 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6f38066f30 msgr2=0x7f6f380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:18.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.915+0000 7f6f5b7e3700 1 --2- 172.21.15.125:0/991089244 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6f38066f30 0x7f6f380693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6f44006fd0 tx=0x7f6f44008040 comp rx=0 tx=0).stop 2023-10-06T03:05:18.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.915+0000 7f6f5b7e3700 1 -- 172.21.15.125:0/991089244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f54156de0 msgr2=0x7f6f540b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:18.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.915+0000 7f6f5b7e3700 1 --2- 172.21.15.125:0/991089244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f54156de0 0x7f6f540b0d20 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c009fd0 tx=0x7f6f4c017000 comp rx=0 tx=0).stop 2023-10-06T03:05:18.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.915+0000 7f6f5b7e3700 1 -- 172.21.15.125:0/991089244 shutdown_connections 2023-10-06T03:05:18.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.915+0000 7f6f5b7e3700 1 --2- 172.21.15.125:0/991089244 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6f38066f30 0x7f6f380693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.915+0000 7f6f5b7e3700 1 --2- 172.21.15.125:0/991089244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f54156de0 0x7f6f540b0d20 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.915+0000 7f6f5b7e3700 1 --2- 172.21.15.125:0/991089244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f540cc060 0x7f6f540c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.915+0000 7f6f5b7e3700 1 --2- 172.21.15.125:0/991089244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6f540cd790 0x7f6f54146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:18.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.915+0000 7f6f5b7e3700 1 -- 172.21.15.125:0/991089244 >> 172.21.15.125:0/991089244 conn(0x7f6f540cdf80 msgr2=0x7f6f540c4430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:18.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.915+0000 7f6f5b7e3700 1 -- 172.21.15.125:0/991089244 shutdown_connections 2023-10-06T03:05:18.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:18.915+0000 7f6f5b7e3700 1 -- 172.21.15.125:0/991089244 wait complete. 2023-10-06T03:05:18.918 INFO:tasks.ceph.mds.b.smithi130.stderr: -4070> 2023-10-06T03:04:34.923+0000 7f97f9f98700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:05:18.918 INFO:teuthology.orchestra.run.smithi125.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:05:18.928 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:05:18.943 INFO:tasks.ceph.mds.b.smithi130.stdout:starting mds.b at 2023-10-06T03:05:19.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.046+0000 7fef7123f700 1 Processor -- start 2023-10-06T03:05:19.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.046+0000 7fef7123f700 1 -- start start 2023-10-06T03:05:19.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.047+0000 7fef7123f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fef6c0af320 0x7fef6c0cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:19.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.047+0000 7fef7123f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fef6c0c8320 0x7fef6c0c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:19.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.047+0000 7fef7123f700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef6c0c9470 con 0x7fef6c0cb880 2023-10-06T03:05:19.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.047+0000 7fef7123f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6c0c9b40 con 0x7fef6c0af320 2023-10-06T03:05:19.050 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.047+0000 7fef7123f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0c8860 con 0x7fef6c0c8320 2023-10-06T03:05:19.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.047+0000 7fef6ad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fef6c0af320 0x7fef6c0cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:19.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.047+0000 7fef6ad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fef6c0af320 0x7fef6c0cb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52262/0 (socket says 172.21.15.125:52262) 2023-10-06T03:05:19.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.047+0000 7fef6ad9d700 1 -- 172.21.15.125:0/3749528457 learned_addr learned my addr 172.21.15.125:0/3749528457 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:19.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.047+0000 7fef6ad9d700 1 -- 172.21.15.125:0/3749528457 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fef6c0c8320 msgr2=0x7fef6c0c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:19.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.047+0000 7fef6b59e700 1 --2- 172.21.15.125:0/3749528457 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fef6c0c8320 0x7fef6c0c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:19.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.047+0000 7fef6ad9d700 1 --2- 172.21.15.125:0/3749528457 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fef6c0c8320 0x7fef6c0c1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:19.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.047+0000 7fef6ad9d700 1 -- 172.21.15.125:0/3749528457 >> v1:172.21.15.130:6789/0 conn(0x7fef6c0cb880 legacy=0x7fef6c0c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:19.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.047+0000 7fef6ad9d700 1 -- 172.21.15.125:0/3749528457 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c0cbcf0 con 0x7fef6c0af320 2023-10-06T03:05:19.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.048+0000 7fef6ad9d700 1 --2- 172.21.15.125:0/3749528457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef6c0af320 0x7fef6c0cb340 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fef60009990 tx=0x7fef60009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c4d11239e2f5db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:19.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.048+0000 7fef69d9b700 1 -- 172.21.15.125:0/3749528457 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60005c10 con 0x7fef6c0af320 2023-10-06T03:05:19.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.048+0000 7fef69d9b700 1 -- 172.21.15.125:0/3749528457 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef60005d70 con 0x7fef6c0af320 2023-10-06T03:05:19.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.048+0000 7fef69d9b700 1 -- 172.21.15.125:0/3749528457 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6000b840 con 0x7fef6c0af320 2023-10-06T03:05:19.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.048+0000 7fef7123f700 1 -- 172.21.15.125:0/3749528457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef6c0af320 msgr2=0x7fef6c0cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:19.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.048+0000 7fef7123f700 1 --2- 172.21.15.125:0/3749528457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef6c0af320 0x7fef6c0cb340 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fef60009990 tx=0x7fef60009220 comp rx=0 tx=0).stop 2023-10-06T03:05:19.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.048+0000 7fef7123f700 1 -- 172.21.15.125:0/3749528457 shutdown_connections 2023-10-06T03:05:19.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.048+0000 7fef7123f700 1 --2- 172.21.15.125:0/3749528457 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fef6c0c8320 0x7fef6c0c1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:19.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.048+0000 7fef7123f700 1 --2- 172.21.15.125:0/3749528457 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef6c0af320 0x7fef6c0cb340 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:19.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.048+0000 7fef7123f700 1 -- 172.21.15.125:0/3749528457 >> 172.21.15.125:0/3749528457 conn(0x7fef6c096120 msgr2=0x7fef6c068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:19.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.048+0000 7fef7123f700 1 -- 172.21.15.125:0/3749528457 shutdown_connections 2023-10-06T03:05:19.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.048+0000 7fef7123f700 1 -- 172.21.15.125:0/3749528457 wait complete. 2023-10-06T03:05:19.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.050+0000 7fef7123f700 1 Processor -- start 2023-10-06T03:05:19.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.050+0000 7fef7123f700 1 -- start start 2023-10-06T03:05:19.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.050+0000 7fef7123f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fef6c0af320 0x7fef6c169490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:19.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.050+0000 7fef7123f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef6c0c8320 0x7fef6c16c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:19.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.050+0000 7fef7123f700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef6c0cb880 0x7fef6c16d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:19.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.050+0000 7fef7123f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c16c840 con 0x7fef6c0c8320 2023-10-06T03:05:19.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.050+0000 7fef7123f700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c1411f0 con 0x7fef6c0cb880 2023-10-06T03:05:19.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.050+0000 7fef7123f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c142cf0 con 0x7fef6c0af320 2023-10-06T03:05:19.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.050+0000 7fef6a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef6c0c8320 0x7fef6c16c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:19.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.050+0000 7fef6a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef6c0c8320 0x7fef6c16c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52276/0 (socket says 172.21.15.125:52276) 2023-10-06T03:05:19.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.050+0000 7fef6a59c700 1 -- 172.21.15.125:0/1211427367 learned_addr learned my addr 172.21.15.125:0/1211427367 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:19.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.051+0000 7fef6ad9d700 1 --2- 172.21.15.125:0/1211427367 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fef6c0af320 0x7fef6c169490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:19.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.051+0000 7fef6b59e700 1 --2- 172.21.15.125:0/1211427367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef6c0cb880 0x7fef6c16d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:19.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.051+0000 7fef6a59c700 1 -- 172.21.15.125:0/1211427367 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fef6c0af320 msgr2=0x7fef6c169490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:19.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.051+0000 7fef6a59c700 1 --2- 172.21.15.125:0/1211427367 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fef6c0af320 0x7fef6c169490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:19.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.051+0000 7fef6a59c700 1 -- 172.21.15.125:0/1211427367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef6c0cb880 msgr2=0x7fef6c16d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:19.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.051+0000 7fef6a59c700 1 --2- 172.21.15.125:0/1211427367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef6c0cb880 0x7fef6c16d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:19.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.051+0000 7fef6a59c700 1 -- 172.21.15.125:0/1211427367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef60009480 con 0x7fef6c0c8320 2023-10-06T03:05:19.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.051+0000 7fef6a59c700 1 --2- 172.21.15.125:0/1211427367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef6c0c8320 0x7fef6c16c300 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00b5e0 tx=0x7fef5c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:19.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.051+0000 7fef52ffd700 1 -- 172.21.15.125:0/1211427367 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c00f510 con 0x7fef6c0c8320 2023-10-06T03:05:19.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.051+0000 7fef52ffd700 1 -- 172.21.15.125:0/1211427367 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5c00f670 con 0x7fef6c0c8320 2023-10-06T03:05:19.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.051+0000 7fef7123f700 1 -- 172.21.15.125:0/1211427367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6c142fd0 con 0x7fef6c0c8320 2023-10-06T03:05:19.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.051+0000 7fef52ffd700 1 -- 172.21.15.125:0/1211427367 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c00fa30 con 0x7fef6c0c8320 2023-10-06T03:05:19.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.051+0000 7fef7123f700 1 -- 172.21.15.125:0/1211427367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6c143590 con 0x7fef6c0c8320 2023-10-06T03:05:19.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.052+0000 7fef7123f700 1 -- 172.21.15.125:0/1211427367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6c1413b0 con 0x7fef6c0c8320 2023-10-06T03:05:19.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.052+0000 7fef52ffd700 1 -- 172.21.15.125:0/1211427367 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef5c01a400 con 0x7fef6c0c8320 2023-10-06T03:05:19.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.053+0000 7fef52ffd700 1 --2- 172.21.15.125:0/1211427367 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fef58066f30 0x7fef580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:19.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.053+0000 7fef52ffd700 1 -- 172.21.15.125:0/1211427367 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6953+0+0 (secure 0 0 0) 0x7fef5c084450 con 0x7fef6c0c8320 2023-10-06T03:05:19.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.053+0000 7fef6ad9d700 1 --2- 172.21.15.125:0/1211427367 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fef58066f30 0x7fef580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:19.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.053+0000 7fef6ad9d700 1 --2- 172.21.15.125:0/1211427367 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fef58066f30 0x7fef580693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fef600030c0 tx=0x7fef60015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:19.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.057+0000 7fef52ffd700 1 -- 172.21.15.125:0/1211427367 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef5c0511e0 con 0x7fef6c0c8320 2023-10-06T03:05:19.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.281+0000 7fef7123f700 1 -- 172.21.15.125:0/1211427367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fef6c066510 con 0x7fef6c0c8320 2023-10-06T03:05:19.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.912+0000 7fef52ffd700 1 -- 172.21.15.125:0/1211427367 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fef5c054800 con 0x7fef6c0c8320 2023-10-06T03:05:19.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.914+0000 7fef7123f700 1 -- 172.21.15.125:0/1211427367 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fef58066f30 msgr2=0x7fef580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:19.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.914+0000 7fef7123f700 1 --2- 172.21.15.125:0/1211427367 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fef58066f30 0x7fef580693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fef600030c0 tx=0x7fef60015000 comp rx=0 tx=0).stop 2023-10-06T03:05:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.914+0000 7fef7123f700 1 -- 172.21.15.125:0/1211427367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef6c0c8320 msgr2=0x7fef6c16c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.914+0000 7fef7123f700 1 --2- 172.21.15.125:0/1211427367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef6c0c8320 0x7fef6c16c300 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00b5e0 tx=0x7fef5c009120 comp rx=0 tx=0).stop 2023-10-06T03:05:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.914+0000 7fef7123f700 1 -- 172.21.15.125:0/1211427367 shutdown_connections 2023-10-06T03:05:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.914+0000 7fef7123f700 1 --2- 172.21.15.125:0/1211427367 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fef58066f30 0x7fef580693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.914+0000 7fef7123f700 1 --2- 172.21.15.125:0/1211427367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fef6c0cb880 0x7fef6c16d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.914+0000 7fef7123f700 1 --2- 172.21.15.125:0/1211427367 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fef6c0af320 0x7fef6c169490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.914+0000 7fef7123f700 1 --2- 172.21.15.125:0/1211427367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fef6c0c8320 0x7fef6c16c300 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.914+0000 7fef7123f700 1 -- 172.21.15.125:0/1211427367 >> 172.21.15.125:0/1211427367 conn(0x7fef6c096120 msgr2=0x7fef6c14fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.914+0000 7fef7123f700 1 -- 172.21.15.125:0/1211427367 shutdown_connections 2023-10-06T03:05:19.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:19.914+0000 7fef7123f700 1 -- 172.21.15.125:0/1211427367 wait complete. 2023-10-06T03:05:19.928 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:05:20.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.050+0000 7fdee6e68700 1 Processor -- start 2023-10-06T03:05:20.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.050+0000 7fdee6e68700 1 -- start start 2023-10-06T03:05:20.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.050+0000 7fdee6e68700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdee006eb20 0x7fdee0067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:20.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.050+0000 7fdee6e68700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee0067e60 con 0x7fdee00c7f40 2023-10-06T03:05:20.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.050+0000 7fdee6e68700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee0068140 con 0x7fdee006eef0 2023-10-06T03:05:20.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.050+0000 7fdee6e68700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee0068420 con 0x7fdee006eb20 2023-10-06T03:05:20.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.051+0000 7fdedffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdee00c7f40 0x7fdee0156af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40376/0 (socket says 172.21.15.125:40376) 2023-10-06T03:05:20.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.051+0000 7fdedffff700 1 -- 172.21.15.125:0/1992002440 learned_addr learned my addr 172.21.15.125:0/1992002440 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:20.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.051+0000 7fdee4c04700 1 --2- 172.21.15.125:0/1992002440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdee006eb20 0x7fdee0067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:20.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.051+0000 7fdedf7fe700 1 -- 172.21.15.125:0/1992002440 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3932881063 0 0) 0x7fdee0067e60 con 0x7fdee00c7f40 2023-10-06T03:05:20.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.051+0000 7fdedf7fe700 1 -- 172.21.15.125:0/1992002440 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fded0003570 con 0x7fdee00c7f40 2023-10-06T03:05:20.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.051+0000 7fdedf7fe700 1 -- 172.21.15.125:0/1992002440 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 733784963 0 0) 0x7fded0003570 con 0x7fdee00c7f40 2023-10-06T03:05:20.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.051+0000 7fdedf7fe700 1 -- 172.21.15.125:0/1992002440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdee006eb20 msgr2=0x7fdee0067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:20.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.051+0000 7fdedf7fe700 1 --2- 172.21.15.125:0/1992002440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdee006eb20 0x7fdee0067610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:20.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.051+0000 7fdedf7fe700 1 -- 172.21.15.125:0/1992002440 >> v1:172.21.15.130:6789/0 conn(0x7fdee006eef0 legacy=0x7fdee00ac7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:20.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.051+0000 7fdedf7fe700 1 -- 172.21.15.125:0/1992002440 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee0068700 con 0x7fdee00c7f40 2023-10-06T03:05:20.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.051+0000 7fdedf7fe700 1 -- 172.21.15.125:0/1992002440 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7fdecc001470 con 0x7fdee00c7f40 2023-10-06T03:05:20.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.051+0000 7fdedf7fe700 1 -- 172.21.15.125:0/1992002440 >> v1:172.21.15.125:6789/0 conn(0x7fdee00c7f40 legacy=0x7fdee0156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:20.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.051+0000 7fdedf7fe700 1 --2- 172.21.15.125:0/1992002440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fded0003a90 0x7fded0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:20.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.051+0000 7fdedf7fe700 1 --2- 172.21.15.125:0/1992002440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdee006eb20 0x7fded0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:20.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.051+0000 7fdedf7fe700 1 --2- 172.21.15.125:0/1992002440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fded0004da0 0x7fded00051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:20.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.051+0000 7fdedf7fe700 1 -- 172.21.15.125:0/1992002440 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee0068420 con 0x7fded0003a90 2023-10-06T03:05:20.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.051+0000 7fdedf7fe700 1 -- 172.21.15.125:0/1992002440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fded000bc20 con 0x7fded0004da0 2023-10-06T03:05:20.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.051+0000 7fdedf7fe700 1 -- 172.21.15.125:0/1992002440 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fded000bde0 con 0x7fdee006eb20 2023-10-06T03:05:20.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.051+0000 7fdee4c04700 1 --2- 172.21.15.125:0/1992002440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fded0003a90 0x7fded0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:20.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.052+0000 7fdee4c04700 1 -- 172.21.15.125:0/1992002440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdee006eb20 msgr2=0x7fded0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:20.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.052+0000 7fdee4c04700 1 --2- 172.21.15.125:0/1992002440 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdee006eb20 0x7fded0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:20.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.052+0000 7fdee4c04700 1 -- 172.21.15.125:0/1992002440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fded0004da0 msgr2=0x7fded00051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:20.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.052+0000 7fdee4c04700 1 --2- 172.21.15.125:0/1992002440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fded0004da0 0x7fded00051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:20.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.052+0000 7fdee4c04700 1 -- 172.21.15.125:0/1992002440 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded0003570 con 0x7fded0003a90 2023-10-06T03:05:20.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.052+0000 7fdee4c04700 1 --2- 172.21.15.125:0/1992002440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fded0003a90 0x7fded0003ea0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fded400bb60 tx=0x7fded4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681638997566a92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:20.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.052+0000 7fdedf7fe700 1 -- 172.21.15.125:0/1992002440 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded400d5d0 con 0x7fded0003a90 2023-10-06T03:05:20.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.052+0000 7fdedf7fe700 1 -- 172.21.15.125:0/1992002440 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded400d730 con 0x7fded0003a90 2023-10-06T03:05:20.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.052+0000 7fdedf7fe700 1 -- 172.21.15.125:0/1992002440 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded400daf0 con 0x7fded0003a90 2023-10-06T03:05:20.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.052+0000 7fdee6e68700 1 -- 172.21.15.125:0/1992002440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fded0003a90 msgr2=0x7fded0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:20.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.052+0000 7fdee6e68700 1 --2- 172.21.15.125:0/1992002440 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fded0003a90 0x7fded0003ea0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fded400bb60 tx=0x7fded4008040 comp rx=0 tx=0).stop 2023-10-06T03:05:20.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.052+0000 7fdee5405700 1 -- 172.21.15.125:0/1992002440 reap_dead start 2023-10-06T03:05:20.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.052+0000 7fdee6e68700 1 -- 172.21.15.125:0/1992002440 shutdown_connections 2023-10-06T03:05:20.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.052+0000 7fdee6e68700 1 -- 172.21.15.125:0/1992002440 >> 172.21.15.125:0/1992002440 conn(0x7fdee006b3b0 msgr2=0x7fdee00cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:20.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.053+0000 7fdee6e68700 1 -- 172.21.15.125:0/1992002440 shutdown_connections 2023-10-06T03:05:20.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.053+0000 7fdee6e68700 1 -- 172.21.15.125:0/1992002440 wait complete. 2023-10-06T03:05:20.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.054+0000 7fdee6e68700 1 Processor -- start 2023-10-06T03:05:20.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.054+0000 7fdee6e68700 1 -- start start 2023-10-06T03:05:20.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.055+0000 7fdee6e68700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fded0003a90 0x7fdee013f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:20.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.055+0000 7fdee6e68700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdee00b14e0 0x7fdee0150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:20.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.055+0000 7fdee6e68700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdee00b1950 0x7fdee0150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.055+0000 7fdee6e68700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee00b00c0 con 0x7fded0003a90 2023-10-06T03:05:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.055+0000 7fdee6e68700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee00af4b0 con 0x7fdee00b14e0 2023-10-06T03:05:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.055+0000 7fdee6e68700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee00af790 con 0x7fdee00b1950 2023-10-06T03:05:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.055+0000 7fdee4c04700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fded0003a90 0x7fdee013f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.055+0000 7fdee4c04700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fded0003a90 0x7fdee013f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52294/0 (socket says 172.21.15.125:52294) 2023-10-06T03:05:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.055+0000 7fdee4c04700 1 -- 172.21.15.125:0/1901793944 learned_addr learned my addr 172.21.15.125:0/1901793944 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.055+0000 7fdee4c04700 1 -- 172.21.15.125:0/1901793944 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdee00b1950 msgr2=0x7fdee0150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.055+0000 7fdee4c04700 1 --2- 172.21.15.125:0/1901793944 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdee00b1950 0x7fdee0150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.055+0000 7fdee4c04700 1 -- 172.21.15.125:0/1901793944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdee00b14e0 msgr2=0x7fdee0150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.055+0000 7fdee4c04700 1 --2- 172.21.15.125:0/1901793944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdee00b14e0 0x7fdee0150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:20.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.055+0000 7fdee4c04700 1 -- 172.21.15.125:0/1901793944 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee00afa70 con 0x7fded0003a90 2023-10-06T03:05:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.056+0000 7fdee4c04700 1 --2- 172.21.15.125:0/1901793944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fded0003a90 0x7fdee013f1d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fded400b600 tx=0x7fded401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.056+0000 7fdedcff9700 1 -- 172.21.15.125:0/1901793944 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded4014740 con 0x7fded0003a90 2023-10-06T03:05:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.056+0000 7fdedcff9700 1 -- 172.21.15.125:0/1901793944 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded40148c0 con 0x7fded0003a90 2023-10-06T03:05:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.056+0000 7fdee6e68700 1 -- 172.21.15.125:0/1901793944 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee00afd50 con 0x7fded0003a90 2023-10-06T03:05:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.056+0000 7fdedcff9700 1 -- 172.21.15.125:0/1901793944 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded4014c80 con 0x7fded0003a90 2023-10-06T03:05:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.056+0000 7fdee6e68700 1 -- 172.21.15.125:0/1901793944 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee00b0de0 con 0x7fded0003a90 2023-10-06T03:05:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.057+0000 7fdee6e68700 1 -- 172.21.15.125:0/1901793944 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee00b03a0 con 0x7fded0003a90 2023-10-06T03:05:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.057+0000 7fdedcff9700 1 -- 172.21.15.125:0/1901793944 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fded401d610 con 0x7fded0003a90 2023-10-06T03:05:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.057+0000 7fdedcff9700 1 --2- 172.21.15.125:0/1901793944 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdec4066f30 0x7fdec40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.058+0000 7fdedcff9700 1 -- 172.21.15.125:0/1901793944 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6953+0+0 (secure 0 0 0) 0x7fded40862a0 con 0x7fded0003a90 2023-10-06T03:05:20.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.058+0000 7fdedffff700 1 --2- 172.21.15.125:0/1901793944 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdec4066f30 0x7fdec40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:20.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.058+0000 7fdedffff700 1 --2- 172.21.15.125:0/1901793944 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdec4066f30 0x7fdec40693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdecc001ed0 tx=0x7fdecc000d80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:20.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.062+0000 7fdedcff9700 1 -- 172.21.15.125:0/1901793944 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fded4053030 con 0x7fded0003a90 2023-10-06T03:05:20.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.247+0000 7fdee6e68700 1 -- 172.21.15.125:0/1901793944 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdee00689e0 con 0x7fded0003a90 2023-10-06T03:05:20.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.913+0000 7fdedcff9700 1 -- 172.21.15.125:0/1901793944 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7fded4056650 con 0x7fded0003a90 2023-10-06T03:05:20.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.918+0000 7fdee6e68700 1 -- 172.21.15.125:0/1901793944 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdec4066f30 msgr2=0x7fdec40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:20.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.918+0000 7fdee6e68700 1 --2- 172.21.15.125:0/1901793944 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdec4066f30 0x7fdec40693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdecc001ed0 tx=0x7fdecc000d80 comp rx=0 tx=0).stop 2023-10-06T03:05:20.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.918+0000 7fdee6e68700 1 -- 172.21.15.125:0/1901793944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fded0003a90 msgr2=0x7fdee013f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:20.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.918+0000 7fdee6e68700 1 --2- 172.21.15.125:0/1901793944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fded0003a90 0x7fdee013f1d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fded400b600 tx=0x7fded401b000 comp rx=0 tx=0).stop 2023-10-06T03:05:20.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.918+0000 7fdee6e68700 1 -- 172.21.15.125:0/1901793944 shutdown_connections 2023-10-06T03:05:20.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.918+0000 7fdee6e68700 1 --2- 172.21.15.125:0/1901793944 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdec4066f30 0x7fdec40693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:20.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.918+0000 7fdee6e68700 1 --2- 172.21.15.125:0/1901793944 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdee00b1950 0x7fdee0150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:20.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.918+0000 7fdee6e68700 1 --2- 172.21.15.125:0/1901793944 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fded0003a90 0x7fdee013f1d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:20.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.918+0000 7fdee6e68700 1 --2- 172.21.15.125:0/1901793944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdee00b14e0 0x7fdee0150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:20.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.918+0000 7fdee6e68700 1 -- 172.21.15.125:0/1901793944 >> 172.21.15.125:0/1901793944 conn(0x7fdee006b3b0 msgr2=0x7fdee0152080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:20.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.918+0000 7fdee6e68700 1 -- 172.21.15.125:0/1901793944 shutdown_connections 2023-10-06T03:05:20.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:20.918+0000 7fdee6e68700 1 -- 172.21.15.125:0/1901793944 wait complete. 2023-10-06T03:05:20.921 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:05:20.934 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:05:21.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.061+0000 7f913b680700 1 Processor -- start 2023-10-06T03:05:21.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.061+0000 7f913b680700 1 -- start start 2023-10-06T03:05:21.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.062+0000 7f913b680700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f91341590a0 0x7f91340ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:21.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.062+0000 7f913b680700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9134159470 0x7f913406e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:21.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.062+0000 7f913b680700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91340cb7e0 con 0x7f91341598e0 2023-10-06T03:05:21.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.062+0000 7f913b680700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91340cabd0 con 0x7f91341590a0 2023-10-06T03:05:21.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.062+0000 7f913b680700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91340caeb0 con 0x7f9134159470 2023-10-06T03:05:21.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.062+0000 7f9139c1d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f91341598e0 0x7f913415ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40386/0 (socket says 172.21.15.125:40386) 2023-10-06T03:05:21.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.062+0000 7f9139c1d700 1 -- 172.21.15.125:0/1779074814 learned_addr learned my addr 172.21.15.125:0/1779074814 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:21.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.062+0000 7f9138c1b700 1 --2- 172.21.15.125:0/1779074814 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9134159470 0x7f913406e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:21.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.062+0000 7f912bfff700 1 -- 172.21.15.125:0/1779074814 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2903256443 0 0) 0x7f91340cb7e0 con 0x7f91341598e0 2023-10-06T03:05:21.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.062+0000 7f913941c700 1 --2- 172.21.15.125:0/1779074814 >> v2:172.21.15.130:3300/0 conn(0x7f91341590a0 0x7f91340ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:21.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.062+0000 7f912bfff700 1 -- 172.21.15.125:0/1779074814 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9120003570 con 0x7f91341598e0 2023-10-06T03:05:21.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.062+0000 7f912bfff700 1 -- 172.21.15.125:0/1779074814 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2827647971 0 0) 0x7f9120003570 con 0x7f91341598e0 2023-10-06T03:05:21.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.062+0000 7f912bfff700 1 -- 172.21.15.125:0/1779074814 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9134159470 msgr2=0x7f913406e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:21.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.062+0000 7f912bfff700 1 --2- 172.21.15.125:0/1779074814 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9134159470 0x7f913406e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:21.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.062+0000 7f912bfff700 1 -- 172.21.15.125:0/1779074814 >> v2:172.21.15.130:3300/0 conn(0x7f91341590a0 msgr2=0x7f91340ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:21.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.062+0000 7f912bfff700 1 --2- 172.21.15.125:0/1779074814 >> v2:172.21.15.130:3300/0 conn(0x7f91341590a0 0x7f91340ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:21.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f912bfff700 1 -- 172.21.15.125:0/1779074814 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91340cb190 con 0x7f91341598e0 2023-10-06T03:05:21.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f912bfff700 1 -- 172.21.15.125:0/1779074814 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f912c0017f0 con 0x7f91341598e0 2023-10-06T03:05:21.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f912bfff700 1 -- 172.21.15.125:0/1779074814 >> v1:172.21.15.125:6789/0 conn(0x7f91341598e0 legacy=0x7f913415ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:21.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f912bfff700 1 --2- 172.21.15.125:0/1779074814 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9134159470 0x7f9120003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:21.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f912bfff700 1 --2- 172.21.15.125:0/1779074814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9120003fe0 0x7f9120004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:21.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f912bfff700 1 --2- 172.21.15.125:0/1779074814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9120004d50 0x7f91200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:21.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f912bfff700 1 -- 172.21.15.125:0/1779074814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91340cabd0 con 0x7f9120004d50 2023-10-06T03:05:21.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f912bfff700 1 -- 172.21.15.125:0/1779074814 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91340caeb0 con 0x7f9120003fe0 2023-10-06T03:05:21.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f912bfff700 1 -- 172.21.15.125:0/1779074814 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912000ba90 con 0x7f9134159470 2023-10-06T03:05:21.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f9139c1d700 1 --2- 172.21.15.125:0/1779074814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9120004d50 0x7f91200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:21.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f9138c1b700 1 --2- 172.21.15.125:0/1779074814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9120003fe0 0x7f9120004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:21.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f913941c700 1 --2- 172.21.15.125:0/1779074814 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9134159470 0x7f9120003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f9139c1d700 1 -- 172.21.15.125:0/1779074814 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9134159470 msgr2=0x7f9120003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f9139c1d700 1 --2- 172.21.15.125:0/1779074814 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9134159470 0x7f9120003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f9139c1d700 1 -- 172.21.15.125:0/1779074814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9120003fe0 msgr2=0x7f9120004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f9139c1d700 1 --2- 172.21.15.125:0/1779074814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9120003fe0 0x7f9120004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f9139c1d700 1 -- 172.21.15.125:0/1779074814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9120003570 con 0x7f9120004d50 2023-10-06T03:05:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f9139c1d700 1 --2- 172.21.15.125:0/1779074814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9120004d50 0x7f91200051c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f912c00a970 tx=0x7f912c002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc39b34f2f72f5de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f912bfff700 1 -- 172.21.15.125:0/1779074814 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c012440 con 0x7f9120004d50 2023-10-06T03:05:21.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f912bfff700 1 -- 172.21.15.125:0/1779074814 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912c0125c0 con 0x7f9120004d50 2023-10-06T03:05:21.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.063+0000 7f912bfff700 1 -- 172.21.15.125:0/1779074814 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c012980 con 0x7f9120004d50 2023-10-06T03:05:21.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.064+0000 7f913b680700 1 -- 172.21.15.125:0/1779074814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9120004d50 msgr2=0x7f91200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:21.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.064+0000 7f913b680700 1 --2- 172.21.15.125:0/1779074814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9120004d50 0x7f91200051c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f912c00a970 tx=0x7f912c002210 comp rx=0 tx=0).stop 2023-10-06T03:05:21.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.064+0000 7f9139c1d700 1 -- 172.21.15.125:0/1779074814 reap_dead start 2023-10-06T03:05:21.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.064+0000 7f913b680700 1 -- 172.21.15.125:0/1779074814 shutdown_connections 2023-10-06T03:05:21.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.064+0000 7f913b680700 1 -- 172.21.15.125:0/1779074814 >> 172.21.15.125:0/1779074814 conn(0x7f913406b3b0 msgr2=0x7f91340cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:21.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.064+0000 7f913b680700 1 -- 172.21.15.125:0/1779074814 shutdown_connections 2023-10-06T03:05:21.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.064+0000 7f913b680700 1 -- 172.21.15.125:0/1779074814 wait complete. 2023-10-06T03:05:21.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.065+0000 7f913b680700 1 Processor -- start 2023-10-06T03:05:21.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.065+0000 7f913b680700 1 -- start start 2023-10-06T03:05:21.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.066+0000 7f913b680700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9120004d50 0x7f91340b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:21.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.066+0000 7f913b680700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9134156b10 0x7f9134156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:21.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.066+0000 7f913b680700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f913415cce0 0x7f913415d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:21.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.066+0000 7f913b680700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91341574c0 con 0x7f913415cce0 2023-10-06T03:05:21.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.066+0000 7f913b680700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913415e620 con 0x7f9134156b10 2023-10-06T03:05:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.066+0000 7f913b680700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913415da10 con 0x7f9120004d50 2023-10-06T03:05:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.066+0000 7f9139c1d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f913415cce0 0x7f913415d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.066+0000 7f9139c1d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f913415cce0 0x7f913415d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52324/0 (socket says 172.21.15.125:52324) 2023-10-06T03:05:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.066+0000 7f9139c1d700 1 -- 172.21.15.125:0/1042572367 learned_addr learned my addr 172.21.15.125:0/1042572367 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.066+0000 7f9138c1b700 1 --2- 172.21.15.125:0/1042572367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9134156b10 0x7f9134156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.066+0000 7f913941c700 1 --2- 172.21.15.125:0/1042572367 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9120004d50 0x7f91340b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.066+0000 7f9139c1d700 1 -- 172.21.15.125:0/1042572367 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9120004d50 msgr2=0x7f91340b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:21.083 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.066+0000 7f9139c1d700 1 --2- 172.21.15.125:0/1042572367 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9120004d50 0x7f91340b1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.066+0000 7f9139c1d700 1 -- 172.21.15.125:0/1042572367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9134156b10 msgr2=0x7f9134156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.066+0000 7f9139c1d700 1 --2- 172.21.15.125:0/1042572367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9134156b10 0x7f9134156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.066+0000 7f9139c1d700 1 -- 172.21.15.125:0/1042572367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913415dcf0 con 0x7f913415cce0 2023-10-06T03:05:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.066+0000 7f9138c1b700 1 --2- 172.21.15.125:0/1042572367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9134156b10 0x7f9134156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.066+0000 7f913941c700 1 --2- 172.21.15.125:0/1042572367 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9120004d50 0x7f91340b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.066+0000 7f9139c1d700 1 --2- 172.21.15.125:0/1042572367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f913415cce0 0x7f913415d180 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f912c000f80 tx=0x7f912c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:21.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.067+0000 7f91297fa700 1 -- 172.21.15.125:0/1042572367 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c012440 con 0x7f913415cce0 2023-10-06T03:05:21.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.067+0000 7f91297fa700 1 -- 172.21.15.125:0/1042572367 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f912c0017b0 con 0x7f913415cce0 2023-10-06T03:05:21.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.067+0000 7f91297fa700 1 -- 172.21.15.125:0/1042572367 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f912c012730 con 0x7f913415cce0 2023-10-06T03:05:21.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.067+0000 7f913b680700 1 -- 172.21.15.125:0/1042572367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913415dfd0 con 0x7f913415cce0 2023-10-06T03:05:21.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.067+0000 7f913b680700 1 -- 172.21.15.125:0/1042572367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913415eab0 con 0x7f913415cce0 2023-10-06T03:05:21.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.067+0000 7f913b680700 1 -- 172.21.15.125:0/1042572367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913415e470 con 0x7f913415cce0 2023-10-06T03:05:21.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.068+0000 7f91297fa700 1 -- 172.21.15.125:0/1042572367 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f912c019030 con 0x7f913415cce0 2023-10-06T03:05:21.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.068+0000 7f91297fa700 1 --2- 172.21.15.125:0/1042572367 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9118066f30 0x7f91180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:21.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.068+0000 7f91297fa700 1 -- 172.21.15.125:0/1042572367 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f912c086870 con 0x7f913415cce0 2023-10-06T03:05:21.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.068+0000 7f913941c700 1 --2- 172.21.15.125:0/1042572367 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9118066f30 0x7f91180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:21.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.069+0000 7f913941c700 1 --2- 172.21.15.125:0/1042572367 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9118066f30 0x7f91180693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9130006f00 tx=0x7f9130008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:21.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.073+0000 7f91297fa700 1 -- 172.21.15.125:0/1042572367 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f912c0537b0 con 0x7f913415cce0 2023-10-06T03:05:21.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.254+0000 7f913b680700 1 -- 172.21.15.125:0/1042572367 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f913415e790 con 0x7f913415cce0 2023-10-06T03:05:21.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.915+0000 7f91297fa700 1 -- 172.21.15.125:0/1042572367 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7f912c017020 con 0x7f913415cce0 2023-10-06T03:05:21.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.917+0000 7f913b680700 1 -- 172.21.15.125:0/1042572367 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9118066f30 msgr2=0x7f91180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:21.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.917+0000 7f913b680700 1 --2- 172.21.15.125:0/1042572367 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9118066f30 0x7f91180693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9130006f00 tx=0x7f9130008040 comp rx=0 tx=0).stop 2023-10-06T03:05:21.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.917+0000 7f913b680700 1 -- 172.21.15.125:0/1042572367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f913415cce0 msgr2=0x7f913415d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:21.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.917+0000 7f913b680700 1 --2- 172.21.15.125:0/1042572367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f913415cce0 0x7f913415d180 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f912c000f80 tx=0x7f912c015000 comp rx=0 tx=0).stop 2023-10-06T03:05:21.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.917+0000 7f913b680700 1 -- 172.21.15.125:0/1042572367 shutdown_connections 2023-10-06T03:05:21.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.917+0000 7f913b680700 1 --2- 172.21.15.125:0/1042572367 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9118066f30 0x7f91180693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:21.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.917+0000 7f913b680700 1 --2- 172.21.15.125:0/1042572367 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f913415cce0 0x7f913415d180 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:21.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.917+0000 7f913b680700 1 --2- 172.21.15.125:0/1042572367 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9120004d50 0x7f91340b1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:21.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.917+0000 7f913b680700 1 --2- 172.21.15.125:0/1042572367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9134156b10 0x7f9134156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:21.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.918+0000 7f913b680700 1 -- 172.21.15.125:0/1042572367 >> 172.21.15.125:0/1042572367 conn(0x7f913406b3b0 msgr2=0x7f913406e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:21.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.918+0000 7f913b680700 1 -- 172.21.15.125:0/1042572367 shutdown_connections 2023-10-06T03:05:21.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:21.918+0000 7f913b680700 1 -- 172.21.15.125:0/1042572367 wait complete. 2023-10-06T03:05:21.921 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data' removed 2023-10-06T03:05:21.935 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-06T03:05:22.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.059+0000 7f97a7134700 1 Processor -- start 2023-10-06T03:05:22.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.060+0000 7f97a7134700 1 -- start start 2023-10-06T03:05:22.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.060+0000 7f97a7134700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97a013f810 0x7f97a00afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:22.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.060+0000 7f97a7134700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f97a013fbe0 0x7f97a00692f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:22.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.060+0000 7f97a7134700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97a00cab30 con 0x7f97a00c9100 2023-10-06T03:05:22.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.060+0000 7f97a7134700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97a00c75a0 con 0x7f97a013fbe0 2023-10-06T03:05:22.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.060+0000 7f97a7134700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00c7880 con 0x7f97a013f810 2023-10-06T03:05:22.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f97a56d1700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f97a00c9100 0x7f97a006c910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40396/0 (socket says 172.21.15.125:40396) 2023-10-06T03:05:22.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f97a56d1700 1 -- 172.21.15.125:0/3352808857 learned_addr learned my addr 172.21.15.125:0/3352808857 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:22.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979ffff700 1 --2- 172.21.15.125:0/3352808857 >> v2:172.21.15.130:3300/0 conn(0x7f97a013fbe0 0x7f97a00692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:22.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f97a4ed0700 1 --2- 172.21.15.125:0/3352808857 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97a013f810 0x7f97a00afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:22.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979f7fe700 1 -- 172.21.15.125:0/3352808857 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612023607 0 0) 0x7f97a00cab30 con 0x7f97a00c9100 2023-10-06T03:05:22.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979f7fe700 1 -- 172.21.15.125:0/3352808857 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9790003570 con 0x7f97a00c9100 2023-10-06T03:05:22.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979f7fe700 1 -- 172.21.15.125:0/3352808857 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2664689496 0 0) 0x7f9790003570 con 0x7f97a00c9100 2023-10-06T03:05:22.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979f7fe700 1 -- 172.21.15.125:0/3352808857 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97a013f810 msgr2=0x7f97a00afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:22.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979f7fe700 1 --2- 172.21.15.125:0/3352808857 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97a013f810 0x7f97a00afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:22.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979f7fe700 1 -- 172.21.15.125:0/3352808857 >> v2:172.21.15.130:3300/0 conn(0x7f97a013fbe0 msgr2=0x7f97a00692f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:22.067 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979f7fe700 1 --2- 172.21.15.125:0/3352808857 >> v2:172.21.15.130:3300/0 conn(0x7f97a013fbe0 0x7f97a00692f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:22.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979f7fe700 1 -- 172.21.15.125:0/3352808857 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a00cadd0 con 0x7f97a00c9100 2023-10-06T03:05:22.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979f7fe700 1 -- 172.21.15.125:0/3352808857 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f97980017f0 con 0x7f97a00c9100 2023-10-06T03:05:22.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979ffff700 1 --2- 172.21.15.125:0/3352808857 >> v2:172.21.15.130:3300/0 conn(0x7f97a013fbe0 0x7f97a00692f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:05:22.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979f7fe700 1 -- 172.21.15.125:0/3352808857 >> v1:172.21.15.125:6789/0 conn(0x7f97a00c9100 legacy=0x7f97a006c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:22.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979f7fe700 1 --2- 172.21.15.125:0/3352808857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9790003a60 0x7f9790003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:22.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979f7fe700 1 --2- 172.21.15.125:0/3352808857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9790004810 0x7f9790004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:22.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979f7fe700 1 --2- 172.21.15.125:0/3352808857 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97a013f810 0x7f97900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:22.068 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979f7fe700 1 -- 172.21.15.125:0/3352808857 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00c75a0 con 0x7f9790004810 2023-10-06T03:05:22.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979f7fe700 1 -- 172.21.15.125:0/3352808857 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00c7880 con 0x7f9790003a60 2023-10-06T03:05:22.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979f7fe700 1 -- 172.21.15.125:0/3352808857 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979000ba60 con 0x7f97a013f810 2023-10-06T03:05:22.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979ffff700 1 --2- 172.21.15.125:0/3352808857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9790004810 0x7f9790004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:22.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f97a4ed0700 1 --2- 172.21.15.125:0/3352808857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9790003a60 0x7f9790003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:22.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f97a56d1700 1 --2- 172.21.15.125:0/3352808857 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97a013f810 0x7f97900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:22.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979ffff700 1 -- 172.21.15.125:0/3352808857 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97a013f810 msgr2=0x7f97900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:22.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979ffff700 1 --2- 172.21.15.125:0/3352808857 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97a013f810 0x7f97900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:22.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979ffff700 1 -- 172.21.15.125:0/3352808857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9790003a60 msgr2=0x7f9790003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:22.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.061+0000 7f979ffff700 1 --2- 172.21.15.125:0/3352808857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9790003a60 0x7f9790003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:22.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.062+0000 7f979ffff700 1 -- 172.21.15.125:0/3352808857 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9790003570 con 0x7f9790004810 2023-10-06T03:05:22.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.062+0000 7f97a56d1700 1 --2- 172.21.15.125:0/3352808857 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97a013f810 0x7f97900051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:22.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.062+0000 7f979ffff700 1 --2- 172.21.15.125:0/3352808857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9790004810 0x7f9790004c80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f978c009df0 tx=0x7f978c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88d4193a16781df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:22.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.062+0000 7f979f7fe700 1 -- 172.21.15.125:0/3352808857 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c00e920 con 0x7f9790004810 2023-10-06T03:05:22.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.062+0000 7f979f7fe700 1 -- 172.21.15.125:0/3352808857 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c00ea80 con 0x7f9790004810 2023-10-06T03:05:22.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.062+0000 7f979f7fe700 1 -- 172.21.15.125:0/3352808857 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c00ee20 con 0x7f9790004810 2023-10-06T03:05:22.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.062+0000 7f97a7134700 1 -- 172.21.15.125:0/3352808857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9790004810 msgr2=0x7f9790004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:22.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.062+0000 7f97a7134700 1 --2- 172.21.15.125:0/3352808857 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9790004810 0x7f9790004c80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f978c009df0 tx=0x7f978c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:22.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.062+0000 7f97a56d1700 1 -- 172.21.15.125:0/3352808857 reap_dead start 2023-10-06T03:05:22.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.062+0000 7f97a7134700 1 -- 172.21.15.125:0/3352808857 shutdown_connections 2023-10-06T03:05:22.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.062+0000 7f97a7134700 1 -- 172.21.15.125:0/3352808857 >> 172.21.15.125:0/3352808857 conn(0x7f97a006b190 msgr2=0x7f97a006b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:22.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.062+0000 7f97a7134700 1 -- 172.21.15.125:0/3352808857 shutdown_connections 2023-10-06T03:05:22.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.062+0000 7f97a7134700 1 -- 172.21.15.125:0/3352808857 wait complete. 2023-10-06T03:05:22.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.063+0000 7f97a7134700 1 Processor -- start 2023-10-06T03:05:22.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.064+0000 7f97a7134700 1 -- start start 2023-10-06T03:05:22.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.064+0000 7f97a7134700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9790004810 0x7f97a00c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:22.074 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.064+0000 7f97a7134700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97a0167130 0x7f97a0155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:22.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.064+0000 7f97a7134700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97a00b22e0 0x7f97a00c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:22.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.064+0000 7f97a7134700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00c65c0 con 0x7f9790004810 2023-10-06T03:05:22.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.064+0000 7f97a7134700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00c5020 con 0x7f97a0167130 2023-10-06T03:05:22.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.064+0000 7f97a7134700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97a00c52c0 con 0x7f97a00b22e0 2023-10-06T03:05:22.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.064+0000 7f97a4ed0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9790004810 0x7f97a00c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:22.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.064+0000 7f97a4ed0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9790004810 0x7f97a00c6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52342/0 (socket says 172.21.15.125:52342) 2023-10-06T03:05:22.075 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.064+0000 7f97a4ed0700 1 -- 172.21.15.125:0/730547192 learned_addr learned my addr 172.21.15.125:0/730547192 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:22.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.065+0000 7f97a4ed0700 1 -- 172.21.15.125:0/730547192 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97a00b22e0 msgr2=0x7f97a00c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:22.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.065+0000 7f97a4ed0700 1 --2- 172.21.15.125:0/730547192 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97a00b22e0 0x7f97a00c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:22.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.065+0000 7f97a4ed0700 1 -- 172.21.15.125:0/730547192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97a0167130 msgr2=0x7f97a0155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:22.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.065+0000 7f979ffff700 1 --2- 172.21.15.125:0/730547192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97a0167130 0x7f97a0155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:22.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.065+0000 7f97a4ed0700 1 --2- 172.21.15.125:0/730547192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97a0167130 0x7f97a0155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:22.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.065+0000 7f97a4ed0700 1 -- 172.21.15.125:0/730547192 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a00c55a0 con 0x7f9790004810 2023-10-06T03:05:22.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.065+0000 7f97a4ed0700 1 --2- 172.21.15.125:0/730547192 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9790004810 0x7f97a00c6080 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9794011d40 tx=0x7f97940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:22.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.065+0000 7f979cff9700 1 -- 172.21.15.125:0/730547192 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979400fac0 con 0x7f9790004810 2023-10-06T03:05:22.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.065+0000 7f979cff9700 1 -- 172.21.15.125:0/730547192 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979400fc20 con 0x7f9790004810 2023-10-06T03:05:22.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.065+0000 7f97a7134700 1 -- 172.21.15.125:0/730547192 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97a00c5880 con 0x7f9790004810 2023-10-06T03:05:22.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.065+0000 7f979cff9700 1 -- 172.21.15.125:0/730547192 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9794014440 con 0x7f9790004810 2023-10-06T03:05:22.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.065+0000 7f97a7134700 1 -- 172.21.15.125:0/730547192 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97a0155ac0 con 0x7f9790004810 2023-10-06T03:05:22.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.066+0000 7f97a7134700 1 -- 172.21.15.125:0/730547192 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97a00c5da0 con 0x7f9790004810 2023-10-06T03:05:22.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.066+0000 7f979cff9700 1 -- 172.21.15.125:0/730547192 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9794014a80 con 0x7f9790004810 2023-10-06T03:05:22.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.067+0000 7f979cff9700 1 --2- 172.21.15.125:0/730547192 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9784066fb0 0x7f9784069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:22.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.067+0000 7f979cff9700 1 -- 172.21.15.125:0/730547192 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6043+0+0 (secure 0 0 0) 0x7f9794018030 con 0x7f9790004810 2023-10-06T03:05:22.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.067+0000 7f979ffff700 1 --2- 172.21.15.125:0/730547192 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9784066fb0 0x7f9784069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:22.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.067+0000 7f979ffff700 1 --2- 172.21.15.125:0/730547192 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9784066fb0 0x7f9784069460 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f978c0091e0 tx=0x7f978c01a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:22.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.071+0000 7f979cff9700 1 -- 172.21.15.125:0/730547192 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97a00c5da0 con 0x7f9790004810 2023-10-06T03:05:22.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.264+0000 7f97a7134700 1 -- 172.21.15.125:0/730547192 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f97a00c5da0 con 0x7f9790004810 2023-10-06T03:05:22.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.918+0000 7f979cff9700 1 -- 172.21.15.125:0/730547192 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7f97a00c5da0 con 0x7f9790004810 2023-10-06T03:05:22.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.922+0000 7f97a7134700 1 -- 172.21.15.125:0/730547192 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9784066fb0 msgr2=0x7f9784069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:22.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.922+0000 7f97a7134700 1 --2- 172.21.15.125:0/730547192 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9784066fb0 0x7f9784069460 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f978c0091e0 tx=0x7f978c01a000 comp rx=0 tx=0).stop 2023-10-06T03:05:22.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.922+0000 7f97a7134700 1 -- 172.21.15.125:0/730547192 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9790004810 msgr2=0x7f97a00c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:22.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.922+0000 7f97a7134700 1 --2- 172.21.15.125:0/730547192 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9790004810 0x7f97a00c6080 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9794011d40 tx=0x7f97940091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:22.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.922+0000 7f97a7134700 1 -- 172.21.15.125:0/730547192 shutdown_connections 2023-10-06T03:05:22.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.922+0000 7f97a7134700 1 --2- 172.21.15.125:0/730547192 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9784066fb0 0x7f9784069460 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:22.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.922+0000 7f97a7134700 1 --2- 172.21.15.125:0/730547192 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f97a00b22e0 0x7f97a00c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:22.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.922+0000 7f97a7134700 1 --2- 172.21.15.125:0/730547192 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9790004810 0x7f97a00c6080 secure :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9794011d40 tx=0x7f97940091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:22.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.922+0000 7f97a7134700 1 --2- 172.21.15.125:0/730547192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97a0167130 0x7f97a0155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:22.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.922+0000 7f97a7134700 1 -- 172.21.15.125:0/730547192 >> 172.21.15.125:0/730547192 conn(0x7f97a006b190 msgr2=0x7f97a00cb1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:22.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.923+0000 7f97a7134700 1 -- 172.21.15.125:0/730547192 shutdown_connections 2023-10-06T03:05:22.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:22.924+0000 7f97a7134700 1 -- 172.21.15.125:0/730547192 wait complete. 2023-10-06T03:05:22.927 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data_ec' removed 2023-10-06T03:05:22.941 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:05:22.941 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T03:05:22.942 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:05:22.942 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:05:22.942 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:05:22.942 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T03:05:22.942 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:05:22.942 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:05:22.943 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:05:22.943 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T03:05:22.943 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:05:22.943 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:05:22.943 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:05:22.943 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T03:05:22.944 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:05:22.944 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:05:22.952 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:05:22.953 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:05:22.953 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:05:22.954 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:05:22.955 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:05:22.955 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:05:22.955 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:05:22.956 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:05:22.996 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:05:22.996 DEBUG:teuthology.parallel:result is None 2023-10-06T03:05:22.997 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:05:22.998 DEBUG:teuthology.parallel:result is None 2023-10-06T03:05:22.998 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:05:23.001 DEBUG:teuthology.parallel:result is None 2023-10-06T03:05:23.001 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:05:23.002 DEBUG:teuthology.parallel:result is None 2023-10-06T03:05:23.002 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T03:05:23.075 INFO:tasks.ceph.mds.a.smithi125.stdout:starting mds.a at 2023-10-06T03:05:23.076 INFO:tasks.ceph.mds.c.smithi125.stdout:starting mds.c at 2023-10-06T03:05:23.080 INFO:tasks.ceph.mds.d.smithi130.stdout:starting mds.d at 2023-10-06T03:05:23.081 INFO:tasks.ceph.mds.b.smithi130.stdout:starting mds.b at 2023-10-06T03:05:23.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.129+0000 7f2acd95a700 1 Processor -- start 2023-10-06T03:05:23.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.129+0000 7f2acd95a700 1 -- start start 2023-10-06T03:05:23.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.130+0000 7f2acd95a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2ac806e740 0x7f2ac80abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:23.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.130+0000 7f2acd95a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac806afa0 con 0x7f2ac8156ef0 2023-10-06T03:05:23.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.130+0000 7f2acd95a700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac806a390 con 0x7f2ac81572c0 2023-10-06T03:05:23.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.130+0000 7f2acd95a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac806bb40 con 0x7f2ac806e740 2023-10-06T03:05:23.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.130+0000 7f2ac77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f2ac806e740 0x7f2ac80abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:23.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.130+0000 7f2ac6ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f2ac8156ef0 0x7f2ac806b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40434/0 (socket says 172.21.15.125:40434) 2023-10-06T03:05:23.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.130+0000 7f2ac6ffd700 1 -- 172.21.15.125:0/3628957145 learned_addr learned my addr 172.21.15.125:0/3628957145 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:23.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.130+0000 7f2ac77fe700 1 -- 172.21.15.125:0/3628957145 >> v1:172.21.15.130:6789/0 conn(0x7f2ac81572c0 legacy=0x7f2ac806e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:23.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.130+0000 7f2ac77fe700 1 -- 172.21.15.125:0/3628957145 >> v1:172.21.15.125:6789/0 conn(0x7f2ac8156ef0 legacy=0x7f2ac806b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:23.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.130+0000 7f2ac77fe700 1 -- 172.21.15.125:0/3628957145 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac806a670 con 0x7f2ac806e740 2023-10-06T03:05:23.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.130+0000 7f2ac5ffb700 1 -- 172.21.15.125:0/3628957145 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639457077 0 0) 0x7f2ac806afa0 con 0x7f2ac8156ef0 2023-10-06T03:05:23.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.131+0000 7f2ac77fe700 1 --2- 172.21.15.125:0/3628957145 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ac806e740 0x7f2ac80abef0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80098e0 tx=0x7f2ab80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561d8138fda8e468 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:23.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.131+0000 7f2ac5ffb700 1 -- 172.21.15.125:0/3628957145 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8009e80 con 0x7f2ac806e740 2023-10-06T03:05:23.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.131+0000 7f2ac5ffb700 1 -- 172.21.15.125:0/3628957145 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab800b860 con 0x7f2ac806e740 2023-10-06T03:05:23.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.131+0000 7f2ac5ffb700 1 -- 172.21.15.125:0/3628957145 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab800bbe0 con 0x7f2ac806e740 2023-10-06T03:05:23.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.131+0000 7f2acd95a700 1 -- 172.21.15.125:0/3628957145 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ac806e740 msgr2=0x7f2ac80abef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:23.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.131+0000 7f2acd95a700 1 --2- 172.21.15.125:0/3628957145 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ac806e740 0x7f2ac80abef0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2ab80098e0 tx=0x7f2ab80091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:23.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.131+0000 7f2acd95a700 1 -- 172.21.15.125:0/3628957145 shutdown_connections 2023-10-06T03:05:23.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.131+0000 7f2acd95a700 1 --2- 172.21.15.125:0/3628957145 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ac806e740 0x7f2ac80abef0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:23.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.131+0000 7f2acd95a700 1 -- 172.21.15.125:0/3628957145 >> 172.21.15.125:0/3628957145 conn(0x7f2ac80680e0 msgr2=0x7f2ac80cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:23.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.131+0000 7f2acd95a700 1 -- 172.21.15.125:0/3628957145 shutdown_connections 2023-10-06T03:05:23.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.131+0000 7f2acd95a700 1 -- 172.21.15.125:0/3628957145 wait complete. 2023-10-06T03:05:23.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.133+0000 7f2acd95a700 1 Processor -- start 2023-10-06T03:05:23.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.133+0000 7f2acd95a700 1 -- start start 2023-10-06T03:05:23.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.133+0000 7f2acd95a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ac806e740 0x7f2ac8140080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:23.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.133+0000 7f2acd95a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ac8156ef0 0x7f2ac80afba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:23.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.133+0000 7f2acd95a700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ac81572c0 0x7f2ac80b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:23.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.133+0000 7f2acd95a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac80c3d10 con 0x7f2ac806e740 2023-10-06T03:05:23.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.133+0000 7f2acd95a700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac8159910 con 0x7f2ac81572c0 2023-10-06T03:05:23.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.133+0000 7f2acd95a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac816b860 con 0x7f2ac8156ef0 2023-10-06T03:05:23.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.133+0000 7f2ac6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ac806e740 0x7f2ac8140080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:23.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.134+0000 7f2ac6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ac806e740 0x7f2ac8140080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52402/0 (socket says 172.21.15.125:52402) 2023-10-06T03:05:23.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.134+0000 7f2ac6ffd700 1 -- 172.21.15.125:0/3677413381 learned_addr learned my addr 172.21.15.125:0/3677413381 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:23.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.134+0000 7f2ac77fe700 1 --2- 172.21.15.125:0/3677413381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ac81572c0 0x7f2ac80b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:23.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.134+0000 7f2ac67fc700 1 --2- 172.21.15.125:0/3677413381 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ac8156ef0 0x7f2ac80afba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:23.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.134+0000 7f2ac6ffd700 1 -- 172.21.15.125:0/3677413381 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ac8156ef0 msgr2=0x7f2ac80afba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:23.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.134+0000 7f2ac6ffd700 1 --2- 172.21.15.125:0/3677413381 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ac8156ef0 0x7f2ac80afba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:23.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.134+0000 7f2ac6ffd700 1 -- 172.21.15.125:0/3677413381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ac81572c0 msgr2=0x7f2ac80b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:23.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.134+0000 7f2ac6ffd700 1 --2- 172.21.15.125:0/3677413381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ac81572c0 0x7f2ac80b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:23.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.134+0000 7f2ac6ffd700 1 -- 172.21.15.125:0/3677413381 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab8009420 con 0x7f2ac806e740 2023-10-06T03:05:23.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.134+0000 7f2ac6ffd700 1 --2- 172.21.15.125:0/3677413381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ac806e740 0x7f2ac8140080 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000ccc0 tx=0x7f2ac0001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:23.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.134+0000 7f2abeffd700 1 -- 172.21.15.125:0/3677413381 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac000a8e0 con 0x7f2ac806e740 2023-10-06T03:05:23.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.134+0000 7f2abeffd700 1 -- 172.21.15.125:0/3677413381 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac000aa40 con 0x7f2ac806e740 2023-10-06T03:05:23.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.134+0000 7f2acd95a700 1 -- 172.21.15.125:0/3677413381 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac81592c0 con 0x7f2ac806e740 2023-10-06T03:05:23.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.134+0000 7f2abeffd700 1 -- 172.21.15.125:0/3677413381 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac000ae00 con 0x7f2ac806e740 2023-10-06T03:05:23.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.134+0000 7f2acd95a700 1 -- 172.21.15.125:0/3677413381 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac81405c0 con 0x7f2ac806e740 2023-10-06T03:05:23.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.135+0000 7f2acd95a700 1 -- 172.21.15.125:0/3677413381 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac8159120 con 0x7f2ac806e740 2023-10-06T03:05:23.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.135+0000 7f2abeffd700 1 -- 172.21.15.125:0/3677413381 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ac0007300 con 0x7f2ac806e740 2023-10-06T03:05:23.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.136+0000 7f2abeffd700 1 --2- 172.21.15.125:0/3677413381 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2aa8066f30 0x7f2aa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.136+0000 7f2abeffd700 1 -- 172.21.15.125:0/3677413381 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f2ac0084860 con 0x7f2ac806e740 2023-10-06T03:05:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.136+0000 7f2ac67fc700 1 --2- 172.21.15.125:0/3677413381 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2aa8066f30 0x7f2aa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:23.140 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.136+0000 7f2ac67fc700 1 --2- 172.21.15.125:0/3677413381 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2aa8066f30 0x7f2aa80693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80b0980 tx=0x7f2ab0007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:23.141 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.140+0000 7f2abeffd700 1 -- 172.21.15.125:0/3677413381 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ac8159120 con 0x7f2ac806e740 2023-10-06T03:05:23.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.335+0000 7f2acd95a700 1 -- 172.21.15.125:0/3677413381 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2ac8159120 con 0x7f2ac806e740 2023-10-06T03:05:23.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.944+0000 7f2abeffd700 1 -- 172.21.15.125:0/3677413381 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2ac8159120 con 0x7f2ac806e740 2023-10-06T03:05:23.948 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.947+0000 7f2acd95a700 1 -- 172.21.15.125:0/3677413381 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2aa8066f30 msgr2=0x7f2aa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:23.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.947+0000 7f2acd95a700 1 --2- 172.21.15.125:0/3677413381 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2aa8066f30 0x7f2aa80693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80b0980 tx=0x7f2ab0007ec0 comp rx=0 tx=0).stop 2023-10-06T03:05:23.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.947+0000 7f2acd95a700 1 -- 172.21.15.125:0/3677413381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ac806e740 msgr2=0x7f2ac8140080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:23.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.947+0000 7f2acd95a700 1 --2- 172.21.15.125:0/3677413381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ac806e740 0x7f2ac8140080 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000ccc0 tx=0x7f2ac0001a80 comp rx=0 tx=0).stop 2023-10-06T03:05:23.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.947+0000 7f2acd95a700 1 -- 172.21.15.125:0/3677413381 shutdown_connections 2023-10-06T03:05:23.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.947+0000 7f2acd95a700 1 --2- 172.21.15.125:0/3677413381 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2aa8066f30 0x7f2aa80693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:23.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.947+0000 7f2acd95a700 1 --2- 172.21.15.125:0/3677413381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ac81572c0 0x7f2ac80b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:23.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.947+0000 7f2acd95a700 1 --2- 172.21.15.125:0/3677413381 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2ac806e740 0x7f2ac8140080 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:23.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.947+0000 7f2acd95a700 1 --2- 172.21.15.125:0/3677413381 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2ac8156ef0 0x7f2ac80afba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:23.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.947+0000 7f2acd95a700 1 -- 172.21.15.125:0/3677413381 >> 172.21.15.125:0/3677413381 conn(0x7f2ac80680e0 msgr2=0x7f2ac8155f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:23.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.947+0000 7f2acd95a700 1 -- 172.21.15.125:0/3677413381 shutdown_connections 2023-10-06T03:05:23.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:23.947+0000 7f2acd95a700 1 -- 172.21.15.125:0/3677413381 wait complete. 2023-10-06T03:05:23.950 INFO:teuthology.orchestra.run.smithi125.stderr: removed all blocklist entries 2023-10-06T03:05:23.963 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T03:05:24.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.080+0000 7efde65e4700 1 Processor -- start 2023-10-06T03:05:24.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.080+0000 7efde65e4700 1 -- start start 2023-10-06T03:05:24.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.081+0000 7efde65e4700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efde015d060 0x7efde0068d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:24.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.081+0000 7efde65e4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efde015d430 0x7efde00ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:24.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.081+0000 7efde65e4700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde00caf90 con 0x7efde00caaf0 2023-10-06T03:05:24.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.081+0000 7efde65e4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde00cb270 con 0x7efde015d430 2023-10-06T03:05:24.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.081+0000 7efde65e4700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde00cb550 con 0x7efde015d060 2023-10-06T03:05:24.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.081+0000 7efddf7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efde015d430 0x7efde00ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:24.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.081+0000 7efddf7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7efde015d430 0x7efde00ca5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52412/0 (socket says 172.21.15.125:52412) 2023-10-06T03:05:24.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.081+0000 7efddf7fe700 1 -- 172.21.15.125:0/3977293560 learned_addr learned my addr 172.21.15.125:0/3977293560 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:24.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.081+0000 7efddffff700 1 --2- 172.21.15.125:0/3977293560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efde015d060 0x7efde0068d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:24.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.081+0000 7efddf7fe700 1 -- 172.21.15.125:0/3977293560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efde015d060 msgr2=0x7efde0068d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:24.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.081+0000 7efddf7fe700 1 --2- 172.21.15.125:0/3977293560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efde015d060 0x7efde0068d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.081+0000 7efddf7fe700 1 -- 172.21.15.125:0/3977293560 >> v1:172.21.15.130:6789/0 conn(0x7efde00caaf0 legacy=0x7efde00c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:24.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.081+0000 7efddf7fe700 1 -- 172.21.15.125:0/3977293560 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde00c8b10 con 0x7efde015d430 2023-10-06T03:05:24.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.081+0000 7efddffff700 1 --2- 172.21.15.125:0/3977293560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efde015d060 0x7efde0068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:24.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.082+0000 7efddf7fe700 1 --2- 172.21.15.125:0/3977293560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efde015d430 0x7efde00ca5b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efdd00099b0 tx=0x7efdd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771c05c8451107e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:24.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.082+0000 7efddeffd700 1 -- 172.21.15.125:0/3977293560 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd000b820 con 0x7efde015d430 2023-10-06T03:05:24.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.082+0000 7efddeffd700 1 -- 172.21.15.125:0/3977293560 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd000b980 con 0x7efde015d430 2023-10-06T03:05:24.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.082+0000 7efddeffd700 1 -- 172.21.15.125:0/3977293560 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd000bd20 con 0x7efde015d430 2023-10-06T03:05:24.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.082+0000 7efde65e4700 1 -- 172.21.15.125:0/3977293560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efde015d430 msgr2=0x7efde00ca5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:24.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.082+0000 7efde65e4700 1 --2- 172.21.15.125:0/3977293560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efde015d430 0x7efde00ca5b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7efdd00099b0 tx=0x7efdd0009250 comp rx=0 tx=0).stop 2023-10-06T03:05:24.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.082+0000 7efde65e4700 1 -- 172.21.15.125:0/3977293560 shutdown_connections 2023-10-06T03:05:24.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.082+0000 7efde65e4700 1 --2- 172.21.15.125:0/3977293560 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efde015d060 0x7efde0068d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.082+0000 7efde65e4700 1 --2- 172.21.15.125:0/3977293560 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efde015d430 0x7efde00ca5b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.082+0000 7efde65e4700 1 -- 172.21.15.125:0/3977293560 >> 172.21.15.125:0/3977293560 conn(0x7efde006c380 msgr2=0x7efde006c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:24.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.082+0000 7efde65e4700 1 -- 172.21.15.125:0/3977293560 shutdown_connections 2023-10-06T03:05:24.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.082+0000 7efde65e4700 1 -- 172.21.15.125:0/3977293560 wait complete. 2023-10-06T03:05:24.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.083+0000 7efde65e4700 1 Processor -- start 2023-10-06T03:05:24.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.084+0000 7efde65e4700 1 -- start start 2023-10-06T03:05:24.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.084+0000 7efde65e4700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efde00caaf0 0x7efde016aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:24.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.084+0000 7efde65e4700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efde015d060 0x7efde0152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:24.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.084+0000 7efde65e4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efde015d430 0x7efde00c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:24.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.084+0000 7efde65e4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde0153120 con 0x7efde015d430 2023-10-06T03:05:24.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.084+0000 7efde65e4700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde00b3660 con 0x7efde015d060 2023-10-06T03:05:24.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.084+0000 7efde65e4700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde00c5000 con 0x7efde00caaf0 2023-10-06T03:05:24.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.084+0000 7efde4b81700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efde015d430 0x7efde00c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:24.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.084+0000 7efde4b81700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efde015d430 0x7efde00c7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52414/0 (socket says 172.21.15.125:52414) 2023-10-06T03:05:24.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.084+0000 7efde4b81700 1 -- 172.21.15.125:0/1146650800 learned_addr learned my addr 172.21.15.125:0/1146650800 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:24.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.085+0000 7efddffff700 1 --2- 172.21.15.125:0/1146650800 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efde00caaf0 0x7efde016aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:24.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.085+0000 7efddf7fe700 1 --2- 172.21.15.125:0/1146650800 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efde015d060 0x7efde0152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:24.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.085+0000 7efde4b81700 1 -- 172.21.15.125:0/1146650800 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efde00caaf0 msgr2=0x7efde016aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:24.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.085+0000 7efde4b81700 1 --2- 172.21.15.125:0/1146650800 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efde00caaf0 0x7efde016aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.085+0000 7efde4b81700 1 -- 172.21.15.125:0/1146650800 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efde015d060 msgr2=0x7efde0152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:24.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.085+0000 7efde4b81700 1 --2- 172.21.15.125:0/1146650800 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efde015d060 0x7efde0152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.085+0000 7efde4b81700 1 -- 172.21.15.125:0/1146650800 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd00094f0 con 0x7efde015d430 2023-10-06T03:05:24.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.085+0000 7efddf7fe700 1 --2- 172.21.15.125:0/1146650800 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efde015d060 0x7efde0152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:24.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.085+0000 7efde4b81700 1 --2- 172.21.15.125:0/1146650800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efde015d430 0x7efde00c7420 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efdd800c930 tx=0x7efdd80026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:24.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.085+0000 7efdc7fff700 1 -- 172.21.15.125:0/1146650800 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd800ce70 con 0x7efde015d430 2023-10-06T03:05:24.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.085+0000 7efdc7fff700 1 -- 172.21.15.125:0/1146650800 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd800a7e0 con 0x7efde015d430 2023-10-06T03:05:24.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.085+0000 7efde65e4700 1 -- 172.21.15.125:0/1146650800 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde00c5860 con 0x7efde015d430 2023-10-06T03:05:24.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.085+0000 7efdc7fff700 1 -- 172.21.15.125:0/1146650800 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd800aba0 con 0x7efde015d430 2023-10-06T03:05:24.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.085+0000 7efde65e4700 1 -- 172.21.15.125:0/1146650800 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde00c5210 con 0x7efde015d430 2023-10-06T03:05:24.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.086+0000 7efde65e4700 1 -- 172.21.15.125:0/1146650800 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde00c9f90 con 0x7efde015d430 2023-10-06T03:05:24.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.086+0000 7efdc7fff700 1 -- 172.21.15.125:0/1146650800 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efdd8012420 con 0x7efde015d430 2023-10-06T03:05:24.092 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.087+0000 7efdc7fff700 1 --2- 172.21.15.125:0/1146650800 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efdcc066f30 0x7efdcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:24.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.087+0000 7efdc7fff700 1 -- 172.21.15.125:0/1146650800 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7efdd8084850 con 0x7efde015d430 2023-10-06T03:05:24.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.087+0000 7efddffff700 1 --2- 172.21.15.125:0/1146650800 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efdcc066f30 0x7efdcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:24.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.087+0000 7efddffff700 1 --2- 172.21.15.125:0/1146650800 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efdcc066f30 0x7efdcc0693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efde0158a80 tx=0x7efdd4006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:24.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.091+0000 7efdc7fff700 1 -- 172.21.15.125:0/1146650800 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdd80556b0 con 0x7efde015d430 2023-10-06T03:05:24.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.346+0000 7efde65e4700 1 -- 172.21.15.125:0/1146650800 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7efde006ed30 con 0x7efde015d430 2023-10-06T03:05:24.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.347+0000 7efdc7fff700 1 -- 172.21.15.125:0/1146650800 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7efdd8055240 con 0x7efde015d430 2023-10-06T03:05:24.348 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:24.348 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:05:24.349 INFO:teuthology.orchestra.run.smithi125.stdout: "auth_dump": [ 2023-10-06T03:05:24.349 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.349 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.a", 2023-10-06T03:05:24.349 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQACeR9lloXSNBAAkd4p8EX8hsbmaj2RtvpTfQ==", 2023-10-06T03:05:24.349 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.349 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-06T03:05:24.349 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-10-06T03:05:24.349 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-10-06T03:05:24.349 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:05:24.349 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.350 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.350 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.350 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.b", 2023-10-06T03:05:24.350 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQADeR9laBRSBRAAz9jzUg+VFVG1z9PAO0Bcpw==", 2023-10-06T03:05:24.350 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.350 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-06T03:05:24.350 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-10-06T03:05:24.350 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-10-06T03:05:24.350 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:05:24.350 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.350 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.351 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.351 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.c", 2023-10-06T03:05:24.351 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQADeR9lBnBUABAA2iux/fQycX1zhICh6deYGw==", 2023-10-06T03:05:24.351 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.351 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-06T03:05:24.351 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-10-06T03:05:24.351 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-10-06T03:05:24.351 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:05:24.351 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.351 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.351 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.351 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.d", 2023-10-06T03:05:24.352 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQADeR9l9PCGDBAAl8luWnwki83v799sqGJFDA==", 2023-10-06T03:05:24.352 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.352 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-06T03:05:24.352 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-10-06T03:05:24.352 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-10-06T03:05:24.352 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:05:24.352 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.352 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.352 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.352 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.0", 2023-10-06T03:05:24.352 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAGeR9lUBtFJBAAFWDaLc1yPAPAiE/b9XQz6Q==", 2023-10-06T03:05:24.352 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.352 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-06T03:05:24.353 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-06T03:05:24.353 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:05:24.353 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.353 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.353 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.353 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.1", 2023-10-06T03:05:24.353 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAJeR9lzLNAIxAAZvAeW1kgSS22S2ODNu9t5g==", 2023-10-06T03:05:24.353 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.353 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-06T03:05:24.353 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-06T03:05:24.353 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:05:24.353 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.354 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.354 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.354 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.2", 2023-10-06T03:05:24.354 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAMeR9lzW7lIRAAoTH53SsCdqg2Eqa6usyNsw==", 2023-10-06T03:05:24.354 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.354 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-06T03:05:24.354 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-06T03:05:24.354 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:05:24.354 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.354 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.354 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.355 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.3", 2023-10-06T03:05:24.355 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAPeR9lMHoBIBAABNg2tnpIkx1vAzE5Kyu2RA==", 2023-10-06T03:05:24.355 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.355 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-06T03:05:24.355 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-06T03:05:24.355 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:05:24.355 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.355 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.355 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.355 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.4", 2023-10-06T03:05:24.355 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAVeR9lprxMIRAA15Qi61mgKUyCpIS1XsYQRQ==", 2023-10-06T03:05:24.355 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.356 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-06T03:05:24.356 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-06T03:05:24.356 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:05:24.356 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.356 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.356 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.356 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.5", 2023-10-06T03:05:24.356 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAYeR9lk5hfIBAAI/Z6Z6sckq0MUvmXtEqCXg==", 2023-10-06T03:05:24.356 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.356 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-06T03:05:24.356 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-06T03:05:24.356 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:05:24.357 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.357 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.357 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.357 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.6", 2023-10-06T03:05:24.357 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAbeR9l8yLBHhAARHwk/X1wTrgZILmOilO4Zw==", 2023-10-06T03:05:24.357 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.357 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-06T03:05:24.357 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-06T03:05:24.357 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:05:24.357 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.357 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.357 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.358 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.7", 2023-10-06T03:05:24.358 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAeeR9l9oGIHRAAtNRSqb/lHdSUjkTc+8iCOw==", 2023-10-06T03:05:24.358 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.358 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-06T03:05:24.358 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-06T03:05:24.358 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:05:24.358 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.358 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.358 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.358 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.0", 2023-10-06T03:05:24.358 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQADeR9lYyykEBAAbm74uo9KpHwsa7BJ80s73Q==", 2023-10-06T03:05:24.359 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.359 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-06T03:05:24.359 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-10-06T03:05:24.359 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-10-06T03:05:24.359 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-10-06T03:05:24.359 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.359 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.359 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.359 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.1", 2023-10-06T03:05:24.359 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQADeR9lyE1DGRAA6/HFA4rX/Gas70IcoIieBw==", 2023-10-06T03:05:24.359 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.360 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-06T03:05:24.360 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-10-06T03:05:24.360 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-10-06T03:05:24.360 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-10-06T03:05:24.360 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.360 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.360 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.360 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.2", 2023-10-06T03:05:24.360 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQADeR9lugwkFhAABBonfXirjsQIY76fNW79Uw==", 2023-10-06T03:05:24.360 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.360 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-06T03:05:24.360 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-10-06T03:05:24.361 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-10-06T03:05:24.361 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-10-06T03:05:24.361 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.361 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.361 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.361 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.3", 2023-10-06T03:05:24.361 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQADeR9lnA7NHhAAfuAxtddpoSbQzk57JvpbuQ==", 2023-10-06T03:05:24.361 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.361 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-06T03:05:24.361 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-10-06T03:05:24.361 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-10-06T03:05:24.362 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-10-06T03:05:24.362 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.362 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.362 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.362 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.admin", 2023-10-06T03:05:24.362 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQACeR9lXYu3FRAA08TQNHv7b235IJ0IT51DdQ==", 2023-10-06T03:05:24.362 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.362 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow *", 2023-10-06T03:05:24.362 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-10-06T03:05:24.362 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-10-06T03:05:24.362 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:05:24.362 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.363 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.363 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.363 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.bootstrap-mds", 2023-10-06T03:05:24.363 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAkeR9lOeurGBAA7FfcpCfyvRhemvy808aw2A==", 2023-10-06T03:05:24.363 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.363 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T03:05:24.363 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.363 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.363 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.363 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T03:05:24.363 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAkeR9lRfarGBAAoPQdm+//ThT/TWObsAYCVg==", 2023-10-06T03:05:24.363 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.364 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T03:05:24.364 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.364 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.364 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.364 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.bootstrap-osd", 2023-10-06T03:05:24.364 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAkeR9l7f2rGBAANKiiBvNJPGlUyOVeGk9reQ==", 2023-10-06T03:05:24.364 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.364 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T03:05:24.364 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.364 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.364 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.365 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T03:05:24.365 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAkeR9lhwasGBAA2pXTyQiHBaj4bU3bsTv7Mw==", 2023-10-06T03:05:24.365 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.365 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T03:05:24.365 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.365 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.365 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.365 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T03:05:24.365 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAkeR9lIw6sGBAAPaxN/IpWPlht9XLH5aRyvw==", 2023-10-06T03:05:24.365 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.365 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T03:05:24.366 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.366 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.366 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.366 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T03:05:24.366 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAkeR9lzxWsGBAAjpNF745E0YAKwrMjgnaIYg==", 2023-10-06T03:05:24.366 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.366 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T03:05:24.366 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.366 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.366 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.366 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mgr.x", 2023-10-06T03:05:24.366 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQACeR9lEgqqMRAANWCEvP6tlNAHrd170s3xTw==", 2023-10-06T03:05:24.366 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.367 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow *", 2023-10-06T03:05:24.367 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile mgr", 2023-10-06T03:05:24.367 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:05:24.367 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.367 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:24.367 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:24.367 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mgr.y", 2023-10-06T03:05:24.367 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQACeR9lMBVuKxAA79aCZvxIP8SQ0uAHUhMoTw==", 2023-10-06T03:05:24.367 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:05:24.367 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow *", 2023-10-06T03:05:24.367 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile mgr", 2023-10-06T03:05:24.368 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:05:24.368 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.368 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:24.368 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-06T03:05:24.368 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:05:24.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.349+0000 7efde65e4700 1 -- 172.21.15.125:0/1146650800 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efdcc066f30 msgr2=0x7efdcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:24.369 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.349+0000 7efde65e4700 1 --2- 172.21.15.125:0/1146650800 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efdcc066f30 0x7efdcc0693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efde0158a80 tx=0x7efdd4006f90 comp rx=0 tx=0).stop 2023-10-06T03:05:24.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.349+0000 7efde65e4700 1 -- 172.21.15.125:0/1146650800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efde015d430 msgr2=0x7efde00c7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:24.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.349+0000 7efde65e4700 1 --2- 172.21.15.125:0/1146650800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efde015d430 0x7efde00c7420 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efdd800c930 tx=0x7efdd80026e0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.349+0000 7efde65e4700 1 -- 172.21.15.125:0/1146650800 shutdown_connections 2023-10-06T03:05:24.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.349+0000 7efde65e4700 1 --2- 172.21.15.125:0/1146650800 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efdcc066f30 0x7efdcc0693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.349+0000 7efde65e4700 1 --2- 172.21.15.125:0/1146650800 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efde015d430 0x7efde00c7420 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.349+0000 7efde65e4700 1 --2- 172.21.15.125:0/1146650800 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efde00caaf0 0x7efde016aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.349+0000 7efde65e4700 1 --2- 172.21.15.125:0/1146650800 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efde015d060 0x7efde0152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.349+0000 7efde65e4700 1 -- 172.21.15.125:0/1146650800 >> 172.21.15.125:0/1146650800 conn(0x7efde006c380 msgr2=0x7efde0153360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:24.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.349+0000 7efde65e4700 1 -- 172.21.15.125:0/1146650800 shutdown_connections 2023-10-06T03:05:24.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.349+0000 7efde65e4700 1 -- 172.21.15.125:0/1146650800 wait complete. 2023-10-06T03:05:24.371 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T03:05:24.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.489+0000 7f5a53c72700 1 Processor -- start 2023-10-06T03:05:24.490 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.489+0000 7f5a53c72700 1 -- start start 2023-10-06T03:05:24.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a53c72700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a4c0af320 0x7f5a4c0cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:24.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a53c72700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4c0c9470 con 0x7f5a4c0c8320 2023-10-06T03:05:24.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a53c72700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4c0cbcf0 con 0x7f5a4c0cb880 2023-10-06T03:05:24.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a53c72700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c0c9b40 con 0x7f5a4c0af320 2023-10-06T03:05:24.494 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a5220f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f5a4c0c8320 0x7f5a4c0c1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40444/0 (socket says 172.21.15.125:40444) 2023-10-06T03:05:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a5220f700 1 -- 172.21.15.125:0/42431233 learned_addr learned my addr 172.21.15.125:0/42431233 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a50a0c700 1 -- 172.21.15.125:0/42431233 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3517101042 0 0) 0x7f5a4c0c9470 con 0x7f5a4c0c8320 2023-10-06T03:05:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a50a0c700 1 -- 172.21.15.125:0/42431233 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a38003570 con 0x7f5a4c0c8320 2023-10-06T03:05:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a51a0e700 1 --2- 172.21.15.125:0/42431233 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a4c0af320 0x7f5a4c0cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a50a0c700 1 -- 172.21.15.125:0/42431233 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 813559479 0 0) 0x7f5a38003570 con 0x7f5a4c0c8320 2023-10-06T03:05:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a50a0c700 1 -- 172.21.15.125:0/42431233 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a4c0af320 msgr2=0x7f5a4c0cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a50a0c700 1 --2- 172.21.15.125:0/42431233 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a4c0af320 0x7f5a4c0cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a50a0c700 1 -- 172.21.15.125:0/42431233 >> v1:172.21.15.130:6789/0 conn(0x7f5a4c0cb880 legacy=0x7f5a4c0c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a50a0c700 1 -- 172.21.15.125:0/42431233 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c0c8860 con 0x7f5a4c0c8320 2023-10-06T03:05:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a50a0c700 1 -- 172.21.15.125:0/42431233 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f5a440017f0 con 0x7f5a4c0c8320 2023-10-06T03:05:24.495 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a50a0c700 1 -- 172.21.15.125:0/42431233 >> v1:172.21.15.125:6789/0 conn(0x7f5a4c0c8320 legacy=0x7f5a4c0c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a50a0c700 1 --2- 172.21.15.125:0/42431233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a38003a90 0x7f5a38003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a50a0c700 1 --2- 172.21.15.125:0/42431233 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a4c0af320 0x7f5a38004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a50a0c700 1 --2- 172.21.15.125:0/42431233 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a38004d50 0x7f5a380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a50a0c700 1 -- 172.21.15.125:0/42431233 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c0c9b40 con 0x7f5a38004d50 2023-10-06T03:05:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a50a0c700 1 -- 172.21.15.125:0/42431233 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3800bb70 con 0x7f5a38003a90 2023-10-06T03:05:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.490+0000 7f5a50a0c700 1 -- 172.21.15.125:0/42431233 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3800bd30 con 0x7f5a4c0af320 2023-10-06T03:05:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.491+0000 7f5a5220f700 1 --2- 172.21.15.125:0/42431233 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a38004d50 0x7f5a380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.491+0000 7f5a51a0e700 1 --2- 172.21.15.125:0/42431233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a38003a90 0x7f5a38003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.491+0000 7f5a5120d700 1 --2- 172.21.15.125:0/42431233 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a4c0af320 0x7f5a38004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.491+0000 7f5a5220f700 1 -- 172.21.15.125:0/42431233 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a4c0af320 msgr2=0x7f5a38004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.491+0000 7f5a5220f700 1 --2- 172.21.15.125:0/42431233 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a4c0af320 0x7f5a38004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.496 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.491+0000 7f5a5220f700 1 -- 172.21.15.125:0/42431233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a38003a90 msgr2=0x7f5a38003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:24.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.491+0000 7f5a5220f700 1 --2- 172.21.15.125:0/42431233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a38003a90 0x7f5a38003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.491+0000 7f5a5220f700 1 -- 172.21.15.125:0/42431233 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a38003570 con 0x7f5a38004d50 2023-10-06T03:05:24.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.491+0000 7f5a5220f700 1 --2- 172.21.15.125:0/42431233 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a38004d50 0x7f5a380051c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5a4400a930 tx=0x7f5a440021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f537b192654c6e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:24.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.491+0000 7f5a50a0c700 1 -- 172.21.15.125:0/42431233 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a440070d0 con 0x7f5a38004d50 2023-10-06T03:05:24.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.491+0000 7f5a50a0c700 1 -- 172.21.15.125:0/42431233 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a44007230 con 0x7f5a38004d50 2023-10-06T03:05:24.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.491+0000 7f5a50a0c700 1 -- 172.21.15.125:0/42431233 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a440075d0 con 0x7f5a38004d50 2023-10-06T03:05:24.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.492+0000 7f5a53c72700 1 -- 172.21.15.125:0/42431233 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a38004d50 msgr2=0x7f5a380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:24.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.492+0000 7f5a53c72700 1 --2- 172.21.15.125:0/42431233 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a38004d50 0x7f5a380051c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5a4400a930 tx=0x7f5a440021d0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.492+0000 7f5a5220f700 1 -- 172.21.15.125:0/42431233 reap_dead start 2023-10-06T03:05:24.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.492+0000 7f5a53c72700 1 -- 172.21.15.125:0/42431233 shutdown_connections 2023-10-06T03:05:24.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.492+0000 7f5a53c72700 1 -- 172.21.15.125:0/42431233 >> 172.21.15.125:0/42431233 conn(0x7f5a4c096120 msgr2=0x7f5a4c068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:24.497 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.492+0000 7f5a53c72700 1 -- 172.21.15.125:0/42431233 shutdown_connections 2023-10-06T03:05:24.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.492+0000 7f5a53c72700 1 -- 172.21.15.125:0/42431233 wait complete. 2023-10-06T03:05:24.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.493+0000 7f5a53c72700 1 Processor -- start 2023-10-06T03:05:24.498 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.493+0000 7f5a53c72700 1 -- start start 2023-10-06T03:05:24.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.493+0000 7f5a53c72700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a38004d50 0x7f5a4c13b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:24.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a53c72700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a4c0c7050 0x7f5a4c0c3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:24.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a53c72700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a4c13c330 0x7f5a4c13c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:24.500 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a53c72700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c13bc50 con 0x7f5a4c0c7050 2023-10-06T03:05:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a53c72700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c0c5a20 con 0x7f5a38004d50 2023-10-06T03:05:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a53c72700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c0afc70 con 0x7f5a4c13c330 2023-10-06T03:05:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a5120d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a4c0c7050 0x7f5a4c0c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a5120d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a4c0c7050 0x7f5a4c0c3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52438/0 (socket says 172.21.15.125:52438) 2023-10-06T03:05:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a5120d700 1 -- 172.21.15.125:0/4136148655 learned_addr learned my addr 172.21.15.125:0/4136148655 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a5220f700 1 --2- 172.21.15.125:0/4136148655 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a4c13c330 0x7f5a4c13c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a51a0e700 1 --2- 172.21.15.125:0/4136148655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a38004d50 0x7f5a4c13b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a5120d700 1 -- 172.21.15.125:0/4136148655 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a4c13c330 msgr2=0x7f5a4c13c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a5120d700 1 --2- 172.21.15.125:0/4136148655 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a4c13c330 0x7f5a4c13c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a5120d700 1 -- 172.21.15.125:0/4136148655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a38004d50 msgr2=0x7f5a4c13b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a5120d700 1 --2- 172.21.15.125:0/4136148655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a38004d50 0x7f5a4c13b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.501 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a5120d700 1 -- 172.21.15.125:0/4136148655 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c0aff50 con 0x7f5a4c0c7050 2023-10-06T03:05:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a5120d700 1 --2- 172.21.15.125:0/4136148655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a4c0c7050 0x7f5a4c0c3370 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c002a00 tx=0x7f5a3c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a41ffb700 1 -- 172.21.15.125:0/4136148655 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c00f6f0 con 0x7f5a4c0c7050 2023-10-06T03:05:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a41ffb700 1 -- 172.21.15.125:0/4136148655 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c00f850 con 0x7f5a4c0c7050 2023-10-06T03:05:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a53c72700 1 -- 172.21.15.125:0/4136148655 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4c0c40d0 con 0x7f5a4c0c7050 2023-10-06T03:05:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.494+0000 7f5a41ffb700 1 -- 172.21.15.125:0/4136148655 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c00fc10 con 0x7f5a4c0c7050 2023-10-06T03:05:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.495+0000 7f5a53c72700 1 -- 172.21.15.125:0/4136148655 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4c0c69e0 con 0x7f5a4c0c7050 2023-10-06T03:05:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.495+0000 7f5a53c72700 1 -- 172.21.15.125:0/4136148655 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4c063540 con 0x7f5a4c0c7050 2023-10-06T03:05:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.496+0000 7f5a41ffb700 1 -- 172.21.15.125:0/4136148655 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a3c0133f0 con 0x7f5a4c0c7050 2023-10-06T03:05:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.496+0000 7f5a41ffb700 1 --2- 172.21.15.125:0/4136148655 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5a30066f30 0x7f5a300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.496+0000 7f5a41ffb700 1 -- 172.21.15.125:0/4136148655 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f5a3c084230 con 0x7f5a4c0c7050 2023-10-06T03:05:24.502 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.496+0000 7f5a51a0e700 1 --2- 172.21.15.125:0/4136148655 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5a30066f30 0x7f5a300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:24.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.497+0000 7f5a51a0e700 1 --2- 172.21.15.125:0/4136148655 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5a30066f30 0x7f5a300693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5a48006e50 tx=0x7f5a48009120 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:24.503 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.500+0000 7f5a41ffb700 1 -- 172.21.15.125:0/4136148655 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a3c051550 con 0x7f5a4c0c7050 2023-10-06T03:05:24.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.754+0000 7f5a53c72700 1 -- 172.21.15.125:0/4136148655 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f5a4c0b00e0 con 0x7f5a4c0c7050 2023-10-06T03:05:24.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.758+0000 7f5a41ffb700 1 -- 172.21.15.125:0/4136148655 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5a3c054b70 con 0x7f5a4c0c7050 2023-10-06T03:05:24.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.760+0000 7f5a53c72700 1 -- 172.21.15.125:0/4136148655 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5a30066f30 msgr2=0x7f5a300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:24.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.760+0000 7f5a53c72700 1 --2- 172.21.15.125:0/4136148655 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5a30066f30 0x7f5a300693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5a48006e50 tx=0x7f5a48009120 comp rx=0 tx=0).stop 2023-10-06T03:05:24.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.760+0000 7f5a53c72700 1 -- 172.21.15.125:0/4136148655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a4c0c7050 msgr2=0x7f5a4c0c3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:24.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.760+0000 7f5a53c72700 1 --2- 172.21.15.125:0/4136148655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a4c0c7050 0x7f5a4c0c3370 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c002a00 tx=0x7f5a3c007d30 comp rx=0 tx=0).stop 2023-10-06T03:05:24.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.760+0000 7f5a53c72700 1 -- 172.21.15.125:0/4136148655 shutdown_connections 2023-10-06T03:05:24.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.760+0000 7f5a53c72700 1 --2- 172.21.15.125:0/4136148655 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5a30066f30 0x7f5a300693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.760+0000 7f5a53c72700 1 --2- 172.21.15.125:0/4136148655 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5a4c13c330 0x7f5a4c13c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.760+0000 7f5a53c72700 1 --2- 172.21.15.125:0/4136148655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a38004d50 0x7f5a4c13b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.760+0000 7f5a53c72700 1 --2- 172.21.15.125:0/4136148655 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5a4c0c7050 0x7f5a4c0c3370 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.760+0000 7f5a53c72700 1 -- 172.21.15.125:0/4136148655 >> 172.21.15.125:0/4136148655 conn(0x7f5a4c096120 msgr2=0x7f5a4c0cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:24.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.760+0000 7f5a53c72700 1 -- 172.21.15.125:0/4136148655 shutdown_connections 2023-10-06T03:05:24.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.760+0000 7f5a53c72700 1 -- 172.21.15.125:0/4136148655 wait complete. 2023-10-06T03:05:24.773 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T03:05:24.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.891+0000 7f702731b700 1 Processor -- start 2023-10-06T03:05:24.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.891+0000 7f702731b700 1 -- start start 2023-10-06T03:05:24.895 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.892+0000 7f702731b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7020067860 0x7f70200b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:24.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.892+0000 7f702731b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70200c6eb0 con 0x7f7020161930 2023-10-06T03:05:24.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.892+0000 7f702731b700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70200c7190 con 0x7f7020067c30 2023-10-06T03:05:24.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.892+0000 7f702731b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70200c37c0 con 0x7f7020067860 2023-10-06T03:05:24.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.892+0000 7f70258b8700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7020161930 0x7f7020161db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40448/0 (socket says 172.21.15.125:40448) 2023-10-06T03:05:24.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.892+0000 7f70258b8700 1 -- 172.21.15.125:0/648065197 learned_addr learned my addr 172.21.15.125:0/648065197 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:24.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.892+0000 7f70250b7700 1 --2- 172.21.15.125:0/648065197 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7020067860 0x7f70200b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:24.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.893+0000 7f7017fff700 1 -- 172.21.15.125:0/648065197 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692259051 0 0) 0x7f70200c6eb0 con 0x7f7020161930 2023-10-06T03:05:24.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.893+0000 7f7017fff700 1 -- 172.21.15.125:0/648065197 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f700c003570 con 0x7f7020161930 2023-10-06T03:05:24.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.893+0000 7f7017fff700 1 -- 172.21.15.125:0/648065197 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2829535082 0 0) 0x7f70200c7190 con 0x7f7020067c30 2023-10-06T03:05:24.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.893+0000 7f7017fff700 1 -- 172.21.15.125:0/648065197 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70200c6eb0 con 0x7f7020067c30 2023-10-06T03:05:24.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.893+0000 7f7017fff700 1 -- 172.21.15.125:0/648065197 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 79364572 0 0) 0x7f700c003570 con 0x7f7020161930 2023-10-06T03:05:24.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.893+0000 7f70250b7700 1 -- 172.21.15.125:0/648065197 >> v1:172.21.15.130:6789/0 conn(0x7f7020067c30 legacy=0x7f7020068080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:24.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.893+0000 7f70250b7700 1 -- 172.21.15.125:0/648065197 >> v1:172.21.15.125:6789/0 conn(0x7f7020161930 legacy=0x7f7020161db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:24.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.893+0000 7f70250b7700 1 -- 172.21.15.125:0/648065197 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7020068890 con 0x7f7020067860 2023-10-06T03:05:24.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.893+0000 7f70250b7700 1 --2- 172.21.15.125:0/648065197 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7020067860 0x7f70200b0240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7010009900 tx=0x7f7010009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=519212a853c6f87a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:24.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.893+0000 7f7017fff700 1 -- 172.21.15.125:0/648065197 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70180017f0 con 0x7f7020067860 2023-10-06T03:05:24.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.893+0000 7f7017fff700 1 -- 172.21.15.125:0/648065197 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7010011420 con 0x7f7020067860 2023-10-06T03:05:24.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.893+0000 7f7017fff700 1 -- 172.21.15.125:0/648065197 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70100117c0 con 0x7f7020067860 2023-10-06T03:05:24.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.894+0000 7f702731b700 1 -- 172.21.15.125:0/648065197 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7020067860 msgr2=0x7f70200b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:24.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.894+0000 7f702731b700 1 --2- 172.21.15.125:0/648065197 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7020067860 0x7f70200b0240 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7010009900 tx=0x7f7010009120 comp rx=0 tx=0).stop 2023-10-06T03:05:24.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.894+0000 7f702731b700 1 -- 172.21.15.125:0/648065197 shutdown_connections 2023-10-06T03:05:24.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.894+0000 7f702731b700 1 --2- 172.21.15.125:0/648065197 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7020067860 0x7f70200b0240 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.894+0000 7f702731b700 1 -- 172.21.15.125:0/648065197 >> 172.21.15.125:0/648065197 conn(0x7f70200af730 msgr2=0x7f70200afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:24.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.894+0000 7f702731b700 1 -- 172.21.15.125:0/648065197 shutdown_connections 2023-10-06T03:05:24.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.894+0000 7f702731b700 1 -- 172.21.15.125:0/648065197 wait complete. 2023-10-06T03:05:24.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.895+0000 7f702731b700 1 Processor -- start 2023-10-06T03:05:24.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.895+0000 7f702731b700 1 -- start start 2023-10-06T03:05:24.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.896+0000 7f702731b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7020067860 0x7f7020151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:24.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.896+0000 7f702731b700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7020067c30 0x7f7020126250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:24.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.896+0000 7f702731b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7020161930 0x7f7020170fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:24.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.896+0000 7f702731b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7020171e50 con 0x7f7020067860 2023-10-06T03:05:24.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.896+0000 7f702731b700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7020152500 con 0x7f7020067c30 2023-10-06T03:05:24.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.896+0000 7f702731b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70200cb330 con 0x7f7020161930 2023-10-06T03:05:24.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.896+0000 7f70250b7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7020067860 0x7f7020151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:24.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.896+0000 7f70250b7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7020067860 0x7f7020151fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:52446/0 (socket says 172.21.15.125:52446) 2023-10-06T03:05:24.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.896+0000 7f70250b7700 1 -- 172.21.15.125:0/2490444289 learned_addr learned my addr 172.21.15.125:0/2490444289 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:24.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.896+0000 7f70250b7700 1 -- 172.21.15.125:0/2490444289 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7020161930 msgr2=0x7f7020170fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:24.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.896+0000 7f70250b7700 1 --2- 172.21.15.125:0/2490444289 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7020161930 0x7f7020170fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.896+0000 7f70250b7700 1 -- 172.21.15.125:0/2490444289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7020067c30 msgr2=0x7f7020126250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:24.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.896+0000 7f70250b7700 1 --2- 172.21.15.125:0/2490444289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7020067c30 0x7f7020126250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:24.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.896+0000 7f70250b7700 1 -- 172.21.15.125:0/2490444289 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70100093c0 con 0x7f7020067860 2023-10-06T03:05:24.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.896+0000 7f70250b7700 1 --2- 172.21.15.125:0/2490444289 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7020067860 0x7f7020151fc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f702006dbf0 tx=0x7f7010016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:24.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.896+0000 7f70157fa700 1 -- 172.21.15.125:0/2490444289 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701001cc50 con 0x7f7020067860 2023-10-06T03:05:24.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.896+0000 7f70157fa700 1 -- 172.21.15.125:0/2490444289 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701001cdb0 con 0x7f7020067860 2023-10-06T03:05:24.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.896+0000 7f70157fa700 1 -- 172.21.15.125:0/2490444289 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701001a6a0 con 0x7f7020067860 2023-10-06T03:05:24.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.897+0000 7f702731b700 1 -- 172.21.15.125:0/2490444289 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7020128c90 con 0x7f7020067860 2023-10-06T03:05:24.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.897+0000 7f702731b700 1 -- 172.21.15.125:0/2490444289 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7020129250 con 0x7f7020067860 2023-10-06T03:05:24.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.897+0000 7f702731b700 1 -- 172.21.15.125:0/2490444289 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7020066510 con 0x7f7020067860 2023-10-06T03:05:24.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.898+0000 7f70157fa700 1 -- 172.21.15.125:0/2490444289 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f701001aa50 con 0x7f7020067860 2023-10-06T03:05:24.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.898+0000 7f70157fa700 1 --2- 172.21.15.125:0/2490444289 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7004066f30 0x7f70040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:24.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.898+0000 7f70157fa700 1 -- 172.21.15.125:0/2490444289 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f7010085ef0 con 0x7f7020067860 2023-10-06T03:05:24.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.898+0000 7f70248b6700 1 --2- 172.21.15.125:0/2490444289 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7004066f30 0x7f70040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:24.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.899+0000 7f70248b6700 1 --2- 172.21.15.125:0/2490444289 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7004066f30 0x7f70040693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f70200ccf90 tx=0x7f701c0079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:24.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:24.902+0000 7f70157fa700 1 -- 172.21.15.125:0/2490444289 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7010053250 con 0x7f7020067860 2023-10-06T03:05:25.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.162+0000 7f702731b700 1 -- 172.21.15.125:0/2490444289 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f7020068b70 con 0x7f7020067860 2023-10-06T03:05:25.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.165+0000 7f70157fa700 1 -- 172.21.15.125:0/2490444289 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f701005ae60 con 0x7f7020067860 2023-10-06T03:05:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.167+0000 7f702731b700 1 -- 172.21.15.125:0/2490444289 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7004066f30 msgr2=0x7f70040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.167+0000 7f702731b700 1 --2- 172.21.15.125:0/2490444289 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7004066f30 0x7f70040693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f70200ccf90 tx=0x7f701c0079d0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.167+0000 7f702731b700 1 -- 172.21.15.125:0/2490444289 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7020067860 msgr2=0x7f7020151fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.167+0000 7f702731b700 1 --2- 172.21.15.125:0/2490444289 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7020067860 0x7f7020151fc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f702006dbf0 tx=0x7f7010016000 comp rx=0 tx=0).stop 2023-10-06T03:05:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.167+0000 7f702731b700 1 -- 172.21.15.125:0/2490444289 shutdown_connections 2023-10-06T03:05:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.167+0000 7f702731b700 1 --2- 172.21.15.125:0/2490444289 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7004066f30 0x7f70040693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.167+0000 7f702731b700 1 --2- 172.21.15.125:0/2490444289 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7020161930 0x7f7020170fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.167+0000 7f702731b700 1 --2- 172.21.15.125:0/2490444289 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7020067860 0x7f7020151fc0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.167+0000 7f702731b700 1 --2- 172.21.15.125:0/2490444289 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7020067c30 0x7f7020126250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.167+0000 7f702731b700 1 -- 172.21.15.125:0/2490444289 >> 172.21.15.125:0/2490444289 conn(0x7f70200af730 msgr2=0x7f7020160520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:25.169 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.167+0000 7f702731b700 1 -- 172.21.15.125:0/2490444289 shutdown_connections 2023-10-06T03:05:25.170 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.167+0000 7f702731b700 1 -- 172.21.15.125:0/2490444289 wait complete. 2023-10-06T03:05:25.180 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T03:05:25.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.299+0000 7f4e271cb700 1 Processor -- start 2023-10-06T03:05:25.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.299+0000 7f4e271cb700 1 -- start start 2023-10-06T03:05:25.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.300+0000 7f4e271cb700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4e201574b0 0x7f4e20067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:25.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.300+0000 7f4e271cb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e200c6eb0 0x7f4e200c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:25.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.300+0000 7f4e271cb700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e20067b50 con 0x7f4e200b0240 2023-10-06T03:05:25.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.300+0000 7f4e271cb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e200c7f70 con 0x7f4e200c6eb0 2023-10-06T03:05:25.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.300+0000 7f4e271cb700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e200c8210 con 0x7f4e201574b0 2023-10-06T03:05:25.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.300+0000 7f4e25768700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e200c6eb0 0x7f4e200c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:25.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.300+0000 7f4e25768700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4e200c6eb0 0x7f4e200c95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50306/0 (socket says 172.21.15.125:50306) 2023-10-06T03:05:25.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.300+0000 7f4e25768700 1 -- 172.21.15.125:0/1388911740 learned_addr learned my addr 172.21.15.125:0/1388911740 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:25.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.300+0000 7f4e24f67700 1 --2- 172.21.15.125:0/1388911740 >> v2:172.21.15.130:3300/0 conn(0x7f4e201574b0 0x7f4e20067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:25.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.300+0000 7f4e25768700 1 -- 172.21.15.125:0/1388911740 >> v2:172.21.15.130:3300/0 conn(0x7f4e201574b0 msgr2=0x7f4e20067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:25.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.300+0000 7f4e25768700 1 --2- 172.21.15.125:0/1388911740 >> v2:172.21.15.130:3300/0 conn(0x7f4e201574b0 0x7f4e20067610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.300+0000 7f4e25768700 1 -- 172.21.15.125:0/1388911740 >> v1:172.21.15.130:6789/0 conn(0x7f4e200b0240 legacy=0x7f4e200cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:25.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.300+0000 7f4e25768700 1 -- 172.21.15.125:0/1388911740 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e200c8b00 con 0x7f4e200c6eb0 2023-10-06T03:05:25.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.300+0000 7f4e24f67700 1 --2- 172.21.15.125:0/1388911740 >> v2:172.21.15.130:3300/0 conn(0x7f4e201574b0 0x7f4e20067610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:25.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.301+0000 7f4e25768700 1 --2- 172.21.15.125:0/1388911740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e200c6eb0 0x7f4e200c95e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4e2006fdf0 tx=0x7f4e18009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773fbeed97227bb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:25.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.301+0000 7f4e1f7fe700 1 -- 172.21.15.125:0/1388911740 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1800e070 con 0x7f4e200c6eb0 2023-10-06T03:05:25.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.301+0000 7f4e1f7fe700 1 -- 172.21.15.125:0/1388911740 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1800ba50 con 0x7f4e200c6eb0 2023-10-06T03:05:25.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.301+0000 7f4e1f7fe700 1 -- 172.21.15.125:0/1388911740 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e180092e0 con 0x7f4e200c6eb0 2023-10-06T03:05:25.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.301+0000 7f4e271cb700 1 -- 172.21.15.125:0/1388911740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e200c6eb0 msgr2=0x7f4e200c95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:25.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.301+0000 7f4e271cb700 1 --2- 172.21.15.125:0/1388911740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e200c6eb0 0x7f4e200c95e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4e2006fdf0 tx=0x7f4e18009840 comp rx=0 tx=0).stop 2023-10-06T03:05:25.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.301+0000 7f4e271cb700 1 -- 172.21.15.125:0/1388911740 shutdown_connections 2023-10-06T03:05:25.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.301+0000 7f4e271cb700 1 --2- 172.21.15.125:0/1388911740 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e200c6eb0 0x7f4e200c95e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.301+0000 7f4e271cb700 1 --2- 172.21.15.125:0/1388911740 >> v2:172.21.15.130:3300/0 conn(0x7f4e201574b0 0x7f4e20067610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.301+0000 7f4e271cb700 1 -- 172.21.15.125:0/1388911740 >> 172.21.15.125:0/1388911740 conn(0x7f4e200af730 msgr2=0x7f4e200afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:25.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.301+0000 7f4e271cb700 1 -- 172.21.15.125:0/1388911740 shutdown_connections 2023-10-06T03:05:25.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.301+0000 7f4e271cb700 1 -- 172.21.15.125:0/1388911740 wait complete. 2023-10-06T03:05:25.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.302+0000 7f4e271cb700 1 Processor -- start 2023-10-06T03:05:25.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.303+0000 7f4e271cb700 1 -- start start 2023-10-06T03:05:25.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.303+0000 7f4e271cb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e200b0240 0x7f4e2014cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:25.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.303+0000 7f4e271cb700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e200c6eb0 0x7f4e200c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:25.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.303+0000 7f4e271cb700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e201574b0 0x7f4e2015c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:25.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.303+0000 7f4e271cb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e200aea40 con 0x7f4e200b0240 2023-10-06T03:05:25.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.303+0000 7f4e271cb700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2014d2b0 con 0x7f4e200c6eb0 2023-10-06T03:05:25.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.303+0000 7f4e271cb700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e200c35e0 con 0x7f4e201574b0 2023-10-06T03:05:25.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.303+0000 7f4e24f67700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e200b0240 0x7f4e2014cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:25.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.304+0000 7f4e24f67700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e200b0240 0x7f4e2014cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50318/0 (socket says 172.21.15.125:50318) 2023-10-06T03:05:25.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.304+0000 7f4e24f67700 1 -- 172.21.15.125:0/3299282755 learned_addr learned my addr 172.21.15.125:0/3299282755 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:25.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.304+0000 7f4e1ffff700 1 --2- 172.21.15.125:0/3299282755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e200c6eb0 0x7f4e200c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:25.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.304+0000 7f4e25768700 1 --2- 172.21.15.125:0/3299282755 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e201574b0 0x7f4e2015c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:25.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.304+0000 7f4e24f67700 1 -- 172.21.15.125:0/3299282755 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e201574b0 msgr2=0x7f4e2015c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:25.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.304+0000 7f4e24f67700 1 --2- 172.21.15.125:0/3299282755 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e201574b0 0x7f4e2015c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.304+0000 7f4e24f67700 1 -- 172.21.15.125:0/3299282755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e200c6eb0 msgr2=0x7f4e200c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:25.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.304+0000 7f4e24f67700 1 --2- 172.21.15.125:0/3299282755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e200c6eb0 0x7f4e200c2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.304+0000 7f4e24f67700 1 -- 172.21.15.125:0/3299282755 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e18009ae0 con 0x7f4e200b0240 2023-10-06T03:05:25.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.304+0000 7f4e24f67700 1 --2- 172.21.15.125:0/3299282755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e200b0240 0x7f4e2014cd70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400d890 tx=0x7f4e14008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:25.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.304+0000 7f4e1cff9700 1 -- 172.21.15.125:0/3299282755 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e14005a00 con 0x7f4e200b0240 2023-10-06T03:05:25.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.304+0000 7f4e1cff9700 1 -- 172.21.15.125:0/3299282755 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e14005b60 con 0x7f4e200b0240 2023-10-06T03:05:25.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.304+0000 7f4e271cb700 1 -- 172.21.15.125:0/3299282755 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e200ae110 con 0x7f4e200b0240 2023-10-06T03:05:25.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.304+0000 7f4e1cff9700 1 -- 172.21.15.125:0/3299282755 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e140125f0 con 0x7f4e200b0240 2023-10-06T03:05:25.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.304+0000 7f4e271cb700 1 -- 172.21.15.125:0/3299282755 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e200ae6d0 con 0x7f4e200b0240 2023-10-06T03:05:25.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.305+0000 7f4e271cb700 1 -- 172.21.15.125:0/3299282755 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e20066510 con 0x7f4e200b0240 2023-10-06T03:05:25.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.305+0000 7f4e1cff9700 1 -- 172.21.15.125:0/3299282755 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e140129a0 con 0x7f4e200b0240 2023-10-06T03:05:25.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.306+0000 7f4e1cff9700 1 --2- 172.21.15.125:0/3299282755 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4e04066f30 0x7f4e040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:25.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.306+0000 7f4e1cff9700 1 -- 172.21.15.125:0/3299282755 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f4e14084560 con 0x7f4e200b0240 2023-10-06T03:05:25.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.306+0000 7f4e1ffff700 1 --2- 172.21.15.125:0/3299282755 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4e04066f30 0x7f4e040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:25.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.306+0000 7f4e1ffff700 1 --2- 172.21.15.125:0/3299282755 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4e04066f30 0x7f4e040693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4e2014b1b0 tx=0x7f4e0c007ec0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:25.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.310+0000 7f4e1cff9700 1 -- 172.21.15.125:0/3299282755 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e14051930 con 0x7f4e200b0240 2023-10-06T03:05:25.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.568+0000 7f4e271cb700 1 -- 172.21.15.125:0/3299282755 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f4e200646d0 con 0x7f4e200b0240 2023-10-06T03:05:25.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.573+0000 7f4e1cff9700 1 -- 172.21.15.125:0/3299282755 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4e14054f50 con 0x7f4e200b0240 2023-10-06T03:05:25.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.575+0000 7f4e271cb700 1 -- 172.21.15.125:0/3299282755 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4e04066f30 msgr2=0x7f4e040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:25.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.575+0000 7f4e271cb700 1 --2- 172.21.15.125:0/3299282755 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4e04066f30 0x7f4e040693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4e2014b1b0 tx=0x7f4e0c007ec0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.575+0000 7f4e271cb700 1 -- 172.21.15.125:0/3299282755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e200b0240 msgr2=0x7f4e2014cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:25.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.575+0000 7f4e271cb700 1 --2- 172.21.15.125:0/3299282755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e200b0240 0x7f4e2014cd70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4e1400d890 tx=0x7f4e14008040 comp rx=0 tx=0).stop 2023-10-06T03:05:25.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.575+0000 7f4e271cb700 1 -- 172.21.15.125:0/3299282755 shutdown_connections 2023-10-06T03:05:25.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.575+0000 7f4e271cb700 1 --2- 172.21.15.125:0/3299282755 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4e04066f30 0x7f4e040693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.575+0000 7f4e271cb700 1 --2- 172.21.15.125:0/3299282755 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4e201574b0 0x7f4e2015c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.575+0000 7f4e271cb700 1 --2- 172.21.15.125:0/3299282755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4e200b0240 0x7f4e2014cd70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.575+0000 7f4e271cb700 1 --2- 172.21.15.125:0/3299282755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e200c6eb0 0x7f4e200c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.575+0000 7f4e271cb700 1 -- 172.21.15.125:0/3299282755 >> 172.21.15.125:0/3299282755 conn(0x7f4e200af730 msgr2=0x7f4e200cd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:25.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.575+0000 7f4e271cb700 1 -- 172.21.15.125:0/3299282755 shutdown_connections 2023-10-06T03:05:25.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.575+0000 7f4e271cb700 1 -- 172.21.15.125:0/3299282755 wait complete. 2023-10-06T03:05:25.588 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T03:05:25.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.704+0000 7f2441e13700 1 Processor -- start 2023-10-06T03:05:25.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.704+0000 7f2441e13700 1 -- start start 2023-10-06T03:05:25.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.705+0000 7f2441e13700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f243c0c7f40 0x7f243c1595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:25.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.705+0000 7f2441e13700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f243c06c910 0x7f243c06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:25.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.705+0000 7f2441e13700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243c0c9130 con 0x7f243c1591d0 2023-10-06T03:05:25.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.705+0000 7f2441e13700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243c06d270 con 0x7f243c06c910 2023-10-06T03:05:25.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.705+0000 7f2441e13700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243c0c8520 con 0x7f243c0c7f40 2023-10-06T03:05:25.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.705+0000 7f243bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f243c06c910 0x7f243c06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:25.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.705+0000 7f243bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f243c06c910 0x7f243c06cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50326/0 (socket says 172.21.15.125:50326) 2023-10-06T03:05:25.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.705+0000 7f243bfff700 1 -- 172.21.15.125:0/1260445543 learned_addr learned my addr 172.21.15.125:0/1260445543 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:25.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.705+0000 7f243affd700 1 --2- 172.21.15.125:0/1260445543 >> v2:172.21.15.130:3300/0 conn(0x7f243c0c7f40 0x7f243c1595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:25.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.705+0000 7f243bfff700 1 -- 172.21.15.125:0/1260445543 >> v2:172.21.15.130:3300/0 conn(0x7f243c0c7f40 msgr2=0x7f243c1595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:25.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.705+0000 7f243bfff700 1 --2- 172.21.15.125:0/1260445543 >> v2:172.21.15.130:3300/0 conn(0x7f243c0c7f40 0x7f243c1595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.705+0000 7f243bfff700 1 -- 172.21.15.125:0/1260445543 >> v1:172.21.15.130:6789/0 conn(0x7f243c1591d0 legacy=0x7f243c0caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:25.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.705+0000 7f243bfff700 1 -- 172.21.15.125:0/1260445543 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243c0c8800 con 0x7f243c06c910 2023-10-06T03:05:25.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.705+0000 7f243bfff700 1 --2- 172.21.15.125:0/1260445543 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f243c06c910 0x7f243c06cd30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f243c06eb90 tx=0x7f2434009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf4abd8e8ab6eb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:25.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.705+0000 7f243a7fc700 1 -- 172.21.15.125:0/1260445543 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243400e070 con 0x7f243c06c910 2023-10-06T03:05:25.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.706+0000 7f243a7fc700 1 -- 172.21.15.125:0/1260445543 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243400ba10 con 0x7f243c06c910 2023-10-06T03:05:25.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.706+0000 7f243a7fc700 1 -- 172.21.15.125:0/1260445543 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24340092e0 con 0x7f243c06c910 2023-10-06T03:05:25.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.706+0000 7f2441e13700 1 -- 172.21.15.125:0/1260445543 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f243c06c910 msgr2=0x7f243c06cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:25.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.706+0000 7f2441e13700 1 --2- 172.21.15.125:0/1260445543 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f243c06c910 0x7f243c06cd30 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f243c06eb90 tx=0x7f2434009840 comp rx=0 tx=0).stop 2023-10-06T03:05:25.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.706+0000 7f2441e13700 1 -- 172.21.15.125:0/1260445543 shutdown_connections 2023-10-06T03:05:25.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.706+0000 7f2441e13700 1 --2- 172.21.15.125:0/1260445543 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f243c06c910 0x7f243c06cd30 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.706+0000 7f2441e13700 1 --2- 172.21.15.125:0/1260445543 >> v2:172.21.15.130:3300/0 conn(0x7f243c0c7f40 0x7f243c1595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.706+0000 7f2441e13700 1 -- 172.21.15.125:0/1260445543 >> 172.21.15.125:0/1260445543 conn(0x7f243c06b190 msgr2=0x7f243c06b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:25.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.706+0000 7f2441e13700 1 -- 172.21.15.125:0/1260445543 shutdown_connections 2023-10-06T03:05:25.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.706+0000 7f2441e13700 1 -- 172.21.15.125:0/1260445543 wait complete. 2023-10-06T03:05:25.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.707+0000 7f2441e13700 1 Processor -- start 2023-10-06T03:05:25.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.707+0000 7f2441e13700 1 -- start start 2023-10-06T03:05:25.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.708+0000 7f2441e13700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f243c06c910 0x7f243c16a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:25.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.708+0000 7f2441e13700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f243c0c7f40 0x7f243c16c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:25.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.708+0000 7f2441e13700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f243c1591d0 0x7f243c0a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:25.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.708+0000 7f2441e13700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243c16dd70 con 0x7f243c06c910 2023-10-06T03:05:25.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.708+0000 7f2441e13700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243c154ba0 con 0x7f243c1591d0 2023-10-06T03:05:25.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.708+0000 7f2441e13700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243c16cb20 con 0x7f243c0c7f40 2023-10-06T03:05:25.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.708+0000 7f243b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f243c06c910 0x7f243c16a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:25.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.708+0000 7f243b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f243c06c910 0x7f243c16a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50342/0 (socket says 172.21.15.125:50342) 2023-10-06T03:05:25.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.708+0000 7f243b7fe700 1 -- 172.21.15.125:0/1776743594 learned_addr learned my addr 172.21.15.125:0/1776743594 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:25.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.708+0000 7f243bfff700 1 --2- 172.21.15.125:0/1776743594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f243c1591d0 0x7f243c0a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:25.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.708+0000 7f243b7fe700 1 -- 172.21.15.125:0/1776743594 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f243c0c7f40 msgr2=0x7f243c16c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:25.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.708+0000 7f243b7fe700 1 --2- 172.21.15.125:0/1776743594 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f243c0c7f40 0x7f243c16c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.708+0000 7f243b7fe700 1 -- 172.21.15.125:0/1776743594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f243c1591d0 msgr2=0x7f243c0a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:25.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.708+0000 7f243b7fe700 1 --2- 172.21.15.125:0/1776743594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f243c1591d0 0x7f243c0a88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.708+0000 7f243b7fe700 1 -- 172.21.15.125:0/1776743594 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2434009ae0 con 0x7f243c06c910 2023-10-06T03:05:25.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.709+0000 7f243b7fe700 1 --2- 172.21.15.125:0/1776743594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f243c06c910 0x7f243c16a970 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f242c00b5e0 tx=0x7f242c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:25.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.709+0000 7f24337fe700 1 -- 172.21.15.125:0/1776743594 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c00f510 con 0x7f243c06c910 2023-10-06T03:05:25.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.709+0000 7f24337fe700 1 -- 172.21.15.125:0/1776743594 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242c00f6b0 con 0x7f243c06c910 2023-10-06T03:05:25.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.709+0000 7f2441e13700 1 -- 172.21.15.125:0/1776743594 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243c16da90 con 0x7f243c06c910 2023-10-06T03:05:25.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.709+0000 7f24337fe700 1 -- 172.21.15.125:0/1776743594 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c00fa70 con 0x7f243c06c910 2023-10-06T03:05:25.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.709+0000 7f2441e13700 1 -- 172.21.15.125:0/1776743594 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f243c154830 con 0x7f243c06c910 2023-10-06T03:05:25.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.710+0000 7f2441e13700 1 -- 172.21.15.125:0/1776743594 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f243c1543b0 con 0x7f243c06c910 2023-10-06T03:05:25.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.710+0000 7f24337fe700 1 -- 172.21.15.125:0/1776743594 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f242c01a400 con 0x7f243c06c910 2023-10-06T03:05:25.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.710+0000 7f24337fe700 1 --2- 172.21.15.125:0/1776743594 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f241c067000 0x7f241c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:25.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.710+0000 7f24337fe700 1 -- 172.21.15.125:0/1776743594 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f242c083ec0 con 0x7f243c06c910 2023-10-06T03:05:25.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.711+0000 7f243affd700 1 --2- 172.21.15.125:0/1776743594 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f241c067000 0x7f241c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:25.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.711+0000 7f243affd700 1 --2- 172.21.15.125:0/1776743594 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f241c067000 0x7f241c0694b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f243c0685c0 tx=0x7f2424008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:25.716 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.715+0000 7f24337fe700 1 -- 172.21.15.125:0/1776743594 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f243c1543b0 con 0x7f243c06c910 2023-10-06T03:05:25.974 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.972+0000 7f2441e13700 1 -- 172.21.15.125:0/1776743594 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f243c1543b0 con 0x7f243c06c910 2023-10-06T03:05:25.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.975+0000 7f24337fe700 1 -- 172.21.15.125:0/1776743594 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f243c1543b0 con 0x7f243c06c910 2023-10-06T03:05:25.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.977+0000 7f2441e13700 1 -- 172.21.15.125:0/1776743594 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f241c067000 msgr2=0x7f241c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:25.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.977+0000 7f2441e13700 1 --2- 172.21.15.125:0/1776743594 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f241c067000 0x7f241c0694b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f243c0685c0 tx=0x7f2424008040 comp rx=0 tx=0).stop 2023-10-06T03:05:25.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.977+0000 7f2441e13700 1 -- 172.21.15.125:0/1776743594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f243c06c910 msgr2=0x7f243c16a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:25.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.977+0000 7f2441e13700 1 --2- 172.21.15.125:0/1776743594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f243c06c910 0x7f243c16a970 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f242c00b5e0 tx=0x7f242c009120 comp rx=0 tx=0).stop 2023-10-06T03:05:25.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.977+0000 7f2441e13700 1 -- 172.21.15.125:0/1776743594 shutdown_connections 2023-10-06T03:05:25.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.977+0000 7f2441e13700 1 --2- 172.21.15.125:0/1776743594 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f241c067000 0x7f241c0694b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.977+0000 7f2441e13700 1 --2- 172.21.15.125:0/1776743594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f243c1591d0 0x7f243c0a88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.977+0000 7f2441e13700 1 --2- 172.21.15.125:0/1776743594 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f243c06c910 0x7f243c16a970 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.977+0000 7f2441e13700 1 --2- 172.21.15.125:0/1776743594 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f243c0c7f40 0x7f243c16c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:25.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.978+0000 7f2441e13700 1 -- 172.21.15.125:0/1776743594 >> 172.21.15.125:0/1776743594 conn(0x7f243c06b190 msgr2=0x7f243c156800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:25.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.978+0000 7f2441e13700 1 -- 172.21.15.125:0/1776743594 shutdown_connections 2023-10-06T03:05:25.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:25.978+0000 7f2441e13700 1 -- 172.21.15.125:0/1776743594 wait complete. 2023-10-06T03:05:25.991 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T03:05:26.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.108+0000 7f4bca3d0700 1 Processor -- start 2023-10-06T03:05:26.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.108+0000 7f4bca3d0700 1 -- start start 2023-10-06T03:05:26.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.109+0000 7f4bca3d0700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4bc4067610 0x7f4bc40b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.109+0000 7f4bca3d0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc40ca670 con 0x7f4bc415cb00 2023-10-06T03:05:26.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.109+0000 7f4bca3d0700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc4067a80 con 0x7f4bc4068ba0 2023-10-06T03:05:26.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.109+0000 7f4bca3d0700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc4068320 con 0x7f4bc4067610 2023-10-06T03:05:26.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.109+0000 7f4bc3fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4bc415cb00 0x7f4bc4068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40024/0 (socket says 172.21.15.125:40024) 2023-10-06T03:05:26.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.109+0000 7f4bc3fff700 1 -- 172.21.15.125:0/3217504555 learned_addr learned my addr 172.21.15.125:0/3217504555 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:26.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.109+0000 7f4bc37fe700 1 --2- 172.21.15.125:0/3217504555 >> v2:172.21.15.130:3300/0 conn(0x7f4bc4067610 0x7f4bc40b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.109+0000 7f4bc2ffd700 1 -- 172.21.15.125:0/3217504555 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008538515 0 0) 0x7f4bc40ca670 con 0x7f4bc415cb00 2023-10-06T03:05:26.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.109+0000 7f4bc2ffd700 1 -- 172.21.15.125:0/3217504555 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bac003570 con 0x7f4bc415cb00 2023-10-06T03:05:26.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc2ffd700 1 -- 172.21.15.125:0/3217504555 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3280449674 0 0) 0x7f4bac003570 con 0x7f4bc415cb00 2023-10-06T03:05:26.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc2ffd700 1 -- 172.21.15.125:0/3217504555 >> v2:172.21.15.130:3300/0 conn(0x7f4bc4067610 msgr2=0x7f4bc40b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:26.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc2ffd700 1 --2- 172.21.15.125:0/3217504555 >> v2:172.21.15.130:3300/0 conn(0x7f4bc4067610 0x7f4bc40b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc2ffd700 1 -- 172.21.15.125:0/3217504555 >> v1:172.21.15.130:6789/0 conn(0x7f4bc4068ba0 legacy=0x7f4bc40cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:26.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc2ffd700 1 -- 172.21.15.125:0/3217504555 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc4067d60 con 0x7f4bc415cb00 2023-10-06T03:05:26.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc2ffd700 1 -- 172.21.15.125:0/3217504555 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f4bb80015f0 con 0x7f4bc415cb00 2023-10-06T03:05:26.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc2ffd700 1 -- 172.21.15.125:0/3217504555 >> v1:172.21.15.125:6789/0 conn(0x7f4bc415cb00 legacy=0x7f4bc4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:26.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc2ffd700 1 --2- 172.21.15.125:0/3217504555 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bac003a60 0x7f4bac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc2ffd700 1 --2- 172.21.15.125:0/3217504555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bac004810 0x7f4bac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc2ffd700 1 --2- 172.21.15.125:0/3217504555 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4bac0051c0 0x7f4bac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc2ffd700 1 -- 172.21.15.125:0/3217504555 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc4068320 con 0x7f4bac004810 2023-10-06T03:05:26.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc2ffd700 1 -- 172.21.15.125:0/3217504555 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac00c0d0 con 0x7f4bac003a60 2023-10-06T03:05:26.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc2ffd700 1 -- 172.21.15.125:0/3217504555 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac00c290 con 0x7f4bac0051c0 2023-10-06T03:05:26.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc37fe700 1 --2- 172.21.15.125:0/3217504555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bac004810 0x7f4bac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc3fff700 1 --2- 172.21.15.125:0/3217504555 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bac003a60 0x7f4bac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc896d700 1 --2- 172.21.15.125:0/3217504555 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4bac0051c0 0x7f4bac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc37fe700 1 -- 172.21.15.125:0/3217504555 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4bac0051c0 msgr2=0x7f4bac00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:26.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc37fe700 1 --2- 172.21.15.125:0/3217504555 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4bac0051c0 0x7f4bac00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc37fe700 1 -- 172.21.15.125:0/3217504555 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bac003a60 msgr2=0x7f4bac003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:26.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc37fe700 1 --2- 172.21.15.125:0/3217504555 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bac003a60 0x7f4bac003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc37fe700 1 -- 172.21.15.125:0/3217504555 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac003570 con 0x7f4bac004810 2023-10-06T03:05:26.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc896d700 1 -- 172.21.15.125:0/3217504555 reap_dead start 2023-10-06T03:05:26.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc37fe700 1 --2- 172.21.15.125:0/3217504555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bac004810 0x7f4bac004c80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009c00 tx=0x7f4bb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d70edd74c5a66a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:26.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc2ffd700 1 -- 172.21.15.125:0/3217504555 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb400e710 con 0x7f4bac004810 2023-10-06T03:05:26.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc2ffd700 1 -- 172.21.15.125:0/3217504555 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb400e870 con 0x7f4bac004810 2023-10-06T03:05:26.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.110+0000 7f4bc2ffd700 1 -- 172.21.15.125:0/3217504555 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb400ec30 con 0x7f4bac004810 2023-10-06T03:05:26.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.111+0000 7f4bca3d0700 1 -- 172.21.15.125:0/3217504555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bac004810 msgr2=0x7f4bac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:26.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.111+0000 7f4bca3d0700 1 --2- 172.21.15.125:0/3217504555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bac004810 0x7f4bac004c80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4009c00 tx=0x7f4bb40091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.111+0000 7f4bca3d0700 1 -- 172.21.15.125:0/3217504555 shutdown_connections 2023-10-06T03:05:26.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.111+0000 7f4bca3d0700 1 --2- 172.21.15.125:0/3217504555 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bac004810 0x7f4bac004c80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.111+0000 7f4bca3d0700 1 -- 172.21.15.125:0/3217504555 >> 172.21.15.125:0/3217504555 conn(0x7f4bc40af730 msgr2=0x7f4bc40afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:26.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.111+0000 7f4bca3d0700 1 -- 172.21.15.125:0/3217504555 shutdown_connections 2023-10-06T03:05:26.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.111+0000 7f4bca3d0700 1 -- 172.21.15.125:0/3217504555 wait complete. 2023-10-06T03:05:26.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.112+0000 7f4bca3d0700 1 Processor -- start 2023-10-06T03:05:26.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.112+0000 7f4bca3d0700 1 -- start start 2023-10-06T03:05:26.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.113+0000 7f4bca3d0700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bac004810 0x7f4bc40c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.113+0000 7f4bca3d0700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4bc4156440 0x7f4bc40c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.113+0000 7f4bca3d0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bc40c8f40 0x7f4bc40c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.113+0000 7f4bca3d0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40c5ce0 con 0x7f4bc40c8f40 2023-10-06T03:05:26.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.113+0000 7f4bca3d0700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40c50d0 con 0x7f4bac004810 2023-10-06T03:05:26.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.113+0000 7f4bca3d0700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc40c53b0 con 0x7f4bc4156440 2023-10-06T03:05:26.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.113+0000 7f4bc896d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bc40c8f40 0x7f4bc40c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.113+0000 7f4bc896d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bc40c8f40 0x7f4bc40c93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50362/0 (socket says 172.21.15.125:50362) 2023-10-06T03:05:26.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.113+0000 7f4bc896d700 1 -- 172.21.15.125:0/4007812188 learned_addr learned my addr 172.21.15.125:0/4007812188 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:26.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.113+0000 7f4bc37fe700 1 --2- 172.21.15.125:0/4007812188 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4bc4156440 0x7f4bc40c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.113+0000 7f4bc3fff700 1 --2- 172.21.15.125:0/4007812188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bac004810 0x7f4bc40c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.113+0000 7f4bc896d700 1 -- 172.21.15.125:0/4007812188 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4bc4156440 msgr2=0x7f4bc40c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:26.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.113+0000 7f4bc896d700 1 --2- 172.21.15.125:0/4007812188 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4bc4156440 0x7f4bc40c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.113+0000 7f4bc896d700 1 -- 172.21.15.125:0/4007812188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bac004810 msgr2=0x7f4bc40c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:26.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.113+0000 7f4bc896d700 1 --2- 172.21.15.125:0/4007812188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bac004810 0x7f4bc40c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.113+0000 7f4bc896d700 1 -- 172.21.15.125:0/4007812188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc40c5690 con 0x7f4bc40c8f40 2023-10-06T03:05:26.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.113+0000 7f4bc37fe700 1 --2- 172.21.15.125:0/4007812188 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4bc4156440 0x7f4bc40c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:26.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.113+0000 7f4bc896d700 1 --2- 172.21.15.125:0/4007812188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bc40c8f40 0x7f4bc40c93a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4bc40b2960 tx=0x7f4bbc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:26.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.114+0000 7f4babfff700 1 -- 172.21.15.125:0/4007812188 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc0032e0 con 0x7f4bc40c8f40 2023-10-06T03:05:26.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.114+0000 7f4babfff700 1 -- 172.21.15.125:0/4007812188 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bbc001580 con 0x7f4bc40c8f40 2023-10-06T03:05:26.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.114+0000 7f4bca3d0700 1 -- 172.21.15.125:0/4007812188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc40c5970 con 0x7f4bc40c8f40 2023-10-06T03:05:26.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.114+0000 7f4babfff700 1 -- 172.21.15.125:0/4007812188 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc001940 con 0x7f4bc40c8f40 2023-10-06T03:05:26.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.114+0000 7f4bca3d0700 1 -- 172.21.15.125:0/4007812188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc40c98e0 con 0x7f4bc40c8f40 2023-10-06T03:05:26.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.114+0000 7f4bca3d0700 1 -- 172.21.15.125:0/4007812188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc4066510 con 0x7f4bc40c8f40 2023-10-06T03:05:26.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.115+0000 7f4babfff700 1 -- 172.21.15.125:0/4007812188 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4bbc001cf0 con 0x7f4bc40c8f40 2023-10-06T03:05:26.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.115+0000 7f4babfff700 1 --2- 172.21.15.125:0/4007812188 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4bb0066f30 0x7f4bb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.115+0000 7f4babfff700 1 -- 172.21.15.125:0/4007812188 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f4bbc083ea0 con 0x7f4bc40c8f40 2023-10-06T03:05:26.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.115+0000 7f4bc3fff700 1 --2- 172.21.15.125:0/4007812188 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4bb0066f30 0x7f4bb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.116+0000 7f4bc3fff700 1 --2- 172.21.15.125:0/4007812188 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4bb0066f30 0x7f4bb00693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8002e70 tx=0x7f4bb8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:26.123 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.120+0000 7f4babfff700 1 -- 172.21.15.125:0/4007812188 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4bbc0511c0 con 0x7f4bc40c8f40 2023-10-06T03:05:26.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.376+0000 7f4bca3d0700 1 -- 172.21.15.125:0/4007812188 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f4bc40c5e20 con 0x7f4bc40c8f40 2023-10-06T03:05:26.381 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.380+0000 7f4babfff700 1 -- 172.21.15.125:0/4007812188 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4bbc0190a0 con 0x7f4bc40c8f40 2023-10-06T03:05:26.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.382+0000 7f4bca3d0700 1 -- 172.21.15.125:0/4007812188 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4bb0066f30 msgr2=0x7f4bb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:26.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.382+0000 7f4bca3d0700 1 --2- 172.21.15.125:0/4007812188 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4bb0066f30 0x7f4bb00693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8002e70 tx=0x7f4bb8009040 comp rx=0 tx=0).stop 2023-10-06T03:05:26.383 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.382+0000 7f4bca3d0700 1 -- 172.21.15.125:0/4007812188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bc40c8f40 msgr2=0x7f4bc40c93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:26.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.382+0000 7f4bca3d0700 1 --2- 172.21.15.125:0/4007812188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bc40c8f40 0x7f4bc40c93a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4bc40b2960 tx=0x7f4bbc009040 comp rx=0 tx=0).stop 2023-10-06T03:05:26.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.382+0000 7f4bca3d0700 1 -- 172.21.15.125:0/4007812188 shutdown_connections 2023-10-06T03:05:26.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.382+0000 7f4bca3d0700 1 --2- 172.21.15.125:0/4007812188 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4bb0066f30 0x7f4bb00693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.382+0000 7f4bca3d0700 1 --2- 172.21.15.125:0/4007812188 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4bc40c8f40 0x7f4bc40c93a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.382+0000 7f4bca3d0700 1 --2- 172.21.15.125:0/4007812188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4bac004810 0x7f4bc40c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.382+0000 7f4bca3d0700 1 --2- 172.21.15.125:0/4007812188 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4bc4156440 0x7f4bc40c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.382+0000 7f4bca3d0700 1 -- 172.21.15.125:0/4007812188 >> 172.21.15.125:0/4007812188 conn(0x7f4bc40af730 msgr2=0x7f4bc41584a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:26.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.382+0000 7f4bca3d0700 1 -- 172.21.15.125:0/4007812188 shutdown_connections 2023-10-06T03:05:26.384 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.382+0000 7f4bca3d0700 1 -- 172.21.15.125:0/4007812188 wait complete. 2023-10-06T03:05:26.395 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T03:05:26.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.512+0000 7f42ca09f700 1 Processor -- start 2023-10-06T03:05:26.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.513+0000 7f42ca09f700 1 -- start start 2023-10-06T03:05:26.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.513+0000 7f42ca09f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42c4140c50 0x7f42c40cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.513+0000 7f42ca09f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c4158570 con 0x7f42c40c9fb0 2023-10-06T03:05:26.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.513+0000 7f42ca09f700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c4158920 con 0x7f42c40cc9b0 2023-10-06T03:05:26.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.513+0000 7f42ca09f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c4157770 con 0x7f42c4140c50 2023-10-06T03:05:26.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.513+0000 7f42c37fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42c4140c50 0x7f42c40cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.513+0000 7f42c3fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f42c40c9fb0 0x7f42c40caba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40040/0 (socket says 172.21.15.125:40040) 2023-10-06T03:05:26.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.513+0000 7f42c3fff700 1 -- 172.21.15.125:0/1296598725 learned_addr learned my addr 172.21.15.125:0/1296598725 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:26.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.514+0000 7f42c37fe700 1 -- 172.21.15.125:0/1296598725 >> v1:172.21.15.130:6789/0 conn(0x7f42c40cc9b0 legacy=0x7f42c40c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:26.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.514+0000 7f42c37fe700 1 -- 172.21.15.125:0/1296598725 >> v1:172.21.15.125:6789/0 conn(0x7f42c40c9fb0 legacy=0x7f42c40caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:26.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.514+0000 7f42c37fe700 1 -- 172.21.15.125:0/1296598725 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c4157960 con 0x7f42c4140c50 2023-10-06T03:05:26.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.514+0000 7f42c27fc700 1 -- 172.21.15.125:0/1296598725 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95380005 0 0) 0x7f42c4158570 con 0x7f42c40c9fb0 2023-10-06T03:05:26.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.514+0000 7f42c37fe700 1 --2- 172.21.15.125:0/1296598725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42c4140c50 0x7f42c40cc470 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0098d0 tx=0x7f42ac009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3454a269ef93e99e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:26.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.514+0000 7f42c27fc700 1 -- 172.21.15.125:0/1296598725 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac009e70 con 0x7f42c4140c50 2023-10-06T03:05:26.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.514+0000 7f42c27fc700 1 -- 172.21.15.125:0/1296598725 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac005c10 con 0x7f42c4140c50 2023-10-06T03:05:26.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.514+0000 7f42c27fc700 1 -- 172.21.15.125:0/1296598725 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac00b650 con 0x7f42c4140c50 2023-10-06T03:05:26.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.515+0000 7f42ca09f700 1 -- 172.21.15.125:0/1296598725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42c4140c50 msgr2=0x7f42c40cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:26.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.515+0000 7f42ca09f700 1 --2- 172.21.15.125:0/1296598725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42c4140c50 0x7f42c40cc470 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f42ac0098d0 tx=0x7f42ac009120 comp rx=0 tx=0).stop 2023-10-06T03:05:26.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.515+0000 7f42ca09f700 1 -- 172.21.15.125:0/1296598725 shutdown_connections 2023-10-06T03:05:26.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.515+0000 7f42ca09f700 1 --2- 172.21.15.125:0/1296598725 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42c4140c50 0x7f42c40cc470 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.515+0000 7f42ca09f700 1 -- 172.21.15.125:0/1296598725 >> 172.21.15.125:0/1296598725 conn(0x7f42c4096120 msgr2=0x7f42c4068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:26.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.515+0000 7f42ca09f700 1 -- 172.21.15.125:0/1296598725 shutdown_connections 2023-10-06T03:05:26.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.515+0000 7f42ca09f700 1 -- 172.21.15.125:0/1296598725 wait complete. 2023-10-06T03:05:26.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.516+0000 7f42ca09f700 1 Processor -- start 2023-10-06T03:05:26.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.516+0000 7f42ca09f700 1 -- start start 2023-10-06T03:05:26.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42ca09f700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42c40c9fb0 0x7f42c4156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42ca09f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42c40cc9b0 0x7f42c40b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42ca09f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42c4140c50 0x7f42c40c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42ca09f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c40c72d0 con 0x7f42c4140c50 2023-10-06T03:05:26.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42ca09f700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c40b1300 con 0x7f42c40c9fb0 2023-10-06T03:05:26.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42ca09f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c40b15e0 con 0x7f42c40cc9b0 2023-10-06T03:05:26.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42c3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42c4140c50 0x7f42c40c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42c3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42c4140c50 0x7f42c40c6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50380/0 (socket says 172.21.15.125:50380) 2023-10-06T03:05:26.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42c3fff700 1 -- 172.21.15.125:0/1300707142 learned_addr learned my addr 172.21.15.125:0/1300707142 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:26.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42c37fe700 1 --2- 172.21.15.125:0/1300707142 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42c40c9fb0 0x7f42c4156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42c2ffd700 1 --2- 172.21.15.125:0/1300707142 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42c40cc9b0 0x7f42c40b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42c3fff700 1 -- 172.21.15.125:0/1300707142 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42c40cc9b0 msgr2=0x7f42c40b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:26.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42c3fff700 1 --2- 172.21.15.125:0/1300707142 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42c40cc9b0 0x7f42c40b0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42c3fff700 1 -- 172.21.15.125:0/1300707142 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42c40c9fb0 msgr2=0x7f42c4156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:26.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42c3fff700 1 --2- 172.21.15.125:0/1300707142 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42c40c9fb0 0x7f42c4156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42c3fff700 1 -- 172.21.15.125:0/1300707142 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ac0093c0 con 0x7f42c4140c50 2023-10-06T03:05:26.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42c3fff700 1 --2- 172.21.15.125:0/1300707142 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42c4140c50 0x7f42c40c6d90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00cc90 tx=0x7f42bc001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:26.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42bb7fe700 1 -- 172.21.15.125:0/1300707142 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc00cea0 con 0x7f42c4140c50 2023-10-06T03:05:26.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42bb7fe700 1 -- 172.21.15.125:0/1300707142 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc00ab30 con 0x7f42c4140c50 2023-10-06T03:05:26.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42ca09f700 1 -- 172.21.15.125:0/1300707142 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c40b18c0 con 0x7f42c4140c50 2023-10-06T03:05:26.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42bb7fe700 1 -- 172.21.15.125:0/1300707142 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0070f0 con 0x7f42c4140c50 2023-10-06T03:05:26.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.517+0000 7f42ca09f700 1 -- 172.21.15.125:0/1300707142 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c40c1c70 con 0x7f42c4140c50 2023-10-06T03:05:26.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.518+0000 7f42ca09f700 1 -- 172.21.15.125:0/1300707142 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c4066510 con 0x7f42c4140c50 2023-10-06T03:05:26.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.519+0000 7f42bb7fe700 1 -- 172.21.15.125:0/1300707142 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f42bc0074a0 con 0x7f42c4140c50 2023-10-06T03:05:26.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.519+0000 7f42bb7fe700 1 --2- 172.21.15.125:0/1300707142 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f42a4066f30 0x7f42a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.519+0000 7f42bb7fe700 1 -- 172.21.15.125:0/1300707142 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f42bc084980 con 0x7f42c4140c50 2023-10-06T03:05:26.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.519+0000 7f42c37fe700 1 --2- 172.21.15.125:0/1300707142 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f42a4066f30 0x7f42a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.519+0000 7f42c37fe700 1 --2- 172.21.15.125:0/1300707142 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f42a4066f30 0x7f42a40693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009160 tx=0x7f42ac015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:26.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.523+0000 7f42bb7fe700 1 -- 172.21.15.125:0/1300707142 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42bc051c90 con 0x7f42c4140c50 2023-10-06T03:05:26.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.777+0000 7f42ca09f700 1 -- 172.21.15.125:0/1300707142 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f42c4157c40 con 0x7f42c4140c50 2023-10-06T03:05:26.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.781+0000 7f42bb7fe700 1 -- 172.21.15.125:0/1300707142 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f42bc0552b0 con 0x7f42c4140c50 2023-10-06T03:05:26.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.783+0000 7f42ca09f700 1 -- 172.21.15.125:0/1300707142 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f42a4066f30 msgr2=0x7f42a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:26.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.783+0000 7f42ca09f700 1 --2- 172.21.15.125:0/1300707142 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f42a4066f30 0x7f42a40693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009160 tx=0x7f42ac015000 comp rx=0 tx=0).stop 2023-10-06T03:05:26.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.783+0000 7f42ca09f700 1 -- 172.21.15.125:0/1300707142 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42c4140c50 msgr2=0x7f42c40c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:26.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.783+0000 7f42ca09f700 1 --2- 172.21.15.125:0/1300707142 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42c4140c50 0x7f42c40c6d90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00cc90 tx=0x7f42bc001a20 comp rx=0 tx=0).stop 2023-10-06T03:05:26.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.783+0000 7f42ca09f700 1 -- 172.21.15.125:0/1300707142 shutdown_connections 2023-10-06T03:05:26.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.783+0000 7f42ca09f700 1 --2- 172.21.15.125:0/1300707142 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f42a4066f30 0x7f42a40693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.783+0000 7f42ca09f700 1 --2- 172.21.15.125:0/1300707142 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42c4140c50 0x7f42c40c6d90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.783+0000 7f42ca09f700 1 --2- 172.21.15.125:0/1300707142 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42c40c9fb0 0x7f42c4156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.783+0000 7f42ca09f700 1 --2- 172.21.15.125:0/1300707142 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42c40cc9b0 0x7f42c40b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.783+0000 7f42ca09f700 1 -- 172.21.15.125:0/1300707142 >> 172.21.15.125:0/1300707142 conn(0x7f42c4096120 msgr2=0x7f42c413c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:26.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.783+0000 7f42ca09f700 1 -- 172.21.15.125:0/1300707142 shutdown_connections 2023-10-06T03:05:26.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.783+0000 7f42ca09f700 1 -- 172.21.15.125:0/1300707142 wait complete. 2023-10-06T03:05:26.796 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:05:26.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.912+0000 7f43b9cb0700 1 Processor -- start 2023-10-06T03:05:26.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.912+0000 7f43b9cb0700 1 -- start start 2023-10-06T03:05:26.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.913+0000 7f43b9cb0700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f43b406afd0 0x7f43b4164200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.913+0000 7f43b9cb0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b4069110 con 0x7f43b40ac670 2023-10-06T03:05:26.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.913+0000 7f43b9cb0700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b4067c70 con 0x7f43b41590d0 2023-10-06T03:05:26.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.913+0000 7f43b9cb0700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b40c77e0 con 0x7f43b406afd0 2023-10-06T03:05:26.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.913+0000 7f43b2ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f43b40ac670 0x7f43b40c6b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40050/0 (socket says 172.21.15.125:40050) 2023-10-06T03:05:26.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.913+0000 7f43b2ffd700 1 -- 172.21.15.125:0/2327998205 learned_addr learned my addr 172.21.15.125:0/2327998205 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:26.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b27fc700 1 -- 172.21.15.125:0/2327998205 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806854518 0 0) 0x7f43b4069110 con 0x7f43b40ac670 2023-10-06T03:05:26.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b3fff700 1 --2- 172.21.15.125:0/2327998205 >> v2:172.21.15.130:3300/0 conn(0x7f43b406afd0 0x7f43b4164200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b27fc700 1 -- 172.21.15.125:0/2327998205 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f439c003570 con 0x7f43b40ac670 2023-10-06T03:05:26.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b27fc700 1 -- 172.21.15.125:0/2327998205 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 6521414 0 0) 0x7f439c003570 con 0x7f43b40ac670 2023-10-06T03:05:26.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b27fc700 1 -- 172.21.15.125:0/2327998205 >> v2:172.21.15.130:3300/0 conn(0x7f43b406afd0 msgr2=0x7f43b4164200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:26.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b27fc700 1 --2- 172.21.15.125:0/2327998205 >> v2:172.21.15.130:3300/0 conn(0x7f43b406afd0 0x7f43b4164200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b27fc700 1 -- 172.21.15.125:0/2327998205 >> v1:172.21.15.130:6789/0 conn(0x7f43b41590d0 legacy=0x7f43b406a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:26.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b27fc700 1 -- 172.21.15.125:0/2327998205 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b40c7ac0 con 0x7f43b40ac670 2023-10-06T03:05:26.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b27fc700 1 -- 172.21.15.125:0/2327998205 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f43a4001470 con 0x7f43b40ac670 2023-10-06T03:05:26.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b27fc700 1 -- 172.21.15.125:0/2327998205 >> v1:172.21.15.125:6789/0 conn(0x7f43b40ac670 legacy=0x7f43b40c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:26.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b27fc700 1 --2- 172.21.15.125:0/2327998205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f439c003a60 0x7f439c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b27fc700 1 --2- 172.21.15.125:0/2327998205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f439c004810 0x7f439c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b27fc700 1 --2- 172.21.15.125:0/2327998205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f439c0051c0 0x7f439c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b27fc700 1 -- 172.21.15.125:0/2327998205 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b40c77e0 con 0x7f439c004810 2023-10-06T03:05:26.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b27fc700 1 -- 172.21.15.125:0/2327998205 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c00c0d0 con 0x7f439c003a60 2023-10-06T03:05:26.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b27fc700 1 -- 172.21.15.125:0/2327998205 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439c00c290 con 0x7f439c0051c0 2023-10-06T03:05:26.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b2ffd700 1 --2- 172.21.15.125:0/2327998205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f439c004810 0x7f439c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b37fe700 1 --2- 172.21.15.125:0/2327998205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f439c003a60 0x7f439c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b3fff700 1 --2- 172.21.15.125:0/2327998205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f439c0051c0 0x7f439c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b2ffd700 1 -- 172.21.15.125:0/2327998205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f439c0051c0 msgr2=0x7f439c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:26.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b2ffd700 1 --2- 172.21.15.125:0/2327998205 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f439c0051c0 0x7f439c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b2ffd700 1 -- 172.21.15.125:0/2327998205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f439c003a60 msgr2=0x7f439c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:26.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b2ffd700 1 --2- 172.21.15.125:0/2327998205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f439c003a60 0x7f439c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b2ffd700 1 -- 172.21.15.125:0/2327998205 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c003570 con 0x7f439c004810 2023-10-06T03:05:26.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b3fff700 1 -- 172.21.15.125:0/2327998205 reap_dead start 2023-10-06T03:05:26.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.914+0000 7f43b37fe700 1 --2- 172.21.15.125:0/2327998205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f439c003a60 0x7f439c003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:26.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.915+0000 7f43b2ffd700 1 --2- 172.21.15.125:0/2327998205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f439c004810 0x7f439c004c80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f43a400c390 tx=0x7f43a4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6050cf4ab170b613 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:26.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.915+0000 7f43b27fc700 1 -- 172.21.15.125:0/2327998205 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a400cc20 con 0x7f439c004810 2023-10-06T03:05:26.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.915+0000 7f43b27fc700 1 -- 172.21.15.125:0/2327998205 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a400cd80 con 0x7f439c004810 2023-10-06T03:05:26.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.915+0000 7f43b27fc700 1 -- 172.21.15.125:0/2327998205 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4005b50 con 0x7f439c004810 2023-10-06T03:05:26.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.915+0000 7f43b9cb0700 1 -- 172.21.15.125:0/2327998205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f439c004810 msgr2=0x7f439c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:26.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.915+0000 7f43b9cb0700 1 --2- 172.21.15.125:0/2327998205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f439c004810 0x7f439c004c80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f43a400c390 tx=0x7f43a4001e50 comp rx=0 tx=0).stop 2023-10-06T03:05:26.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.915+0000 7f43b9cb0700 1 -- 172.21.15.125:0/2327998205 shutdown_connections 2023-10-06T03:05:26.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.915+0000 7f43b9cb0700 1 --2- 172.21.15.125:0/2327998205 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f439c004810 0x7f439c004c80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.915+0000 7f43b9cb0700 1 -- 172.21.15.125:0/2327998205 >> 172.21.15.125:0/2327998205 conn(0x7f43b40cc5a0 msgr2=0x7f43b40cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:26.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.915+0000 7f43b9cb0700 1 -- 172.21.15.125:0/2327998205 shutdown_connections 2023-10-06T03:05:26.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.915+0000 7f43b9cb0700 1 -- 172.21.15.125:0/2327998205 wait complete. 2023-10-06T03:05:26.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.916+0000 7f43b9cb0700 1 Processor -- start 2023-10-06T03:05:26.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.917+0000 7f43b9cb0700 1 -- start start 2023-10-06T03:05:26.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.917+0000 7f43b9cb0700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f439c004810 0x7f43b4159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.917+0000 7f43b9cb0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43b40a8990 0x7f43b4153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.917+0000 7f43b9cb0700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43b416cbd0 0x7f43b416d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.917+0000 7f43b9cb0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b416d590 con 0x7f43b40a8990 2023-10-06T03:05:26.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.917+0000 7f43b9cb0700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b40aa130 con 0x7f439c004810 2023-10-06T03:05:26.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.917+0000 7f43b9cb0700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b415bc70 con 0x7f43b416cbd0 2023-10-06T03:05:26.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.917+0000 7f43b2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43b40a8990 0x7f43b4153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.917+0000 7f43b2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43b40a8990 0x7f43b4153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50394/0 (socket says 172.21.15.125:50394) 2023-10-06T03:05:26.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.917+0000 7f43b2ffd700 1 -- 172.21.15.125:0/3058884694 learned_addr learned my addr 172.21.15.125:0/3058884694 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:26.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.917+0000 7f43b37fe700 1 --2- 172.21.15.125:0/3058884694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f439c004810 0x7f43b4159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.917+0000 7f43b3fff700 1 --2- 172.21.15.125:0/3058884694 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43b416cbd0 0x7f43b416d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.918+0000 7f43b2ffd700 1 -- 172.21.15.125:0/3058884694 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43b416cbd0 msgr2=0x7f43b416d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:26.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.918+0000 7f43b2ffd700 1 --2- 172.21.15.125:0/3058884694 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43b416cbd0 0x7f43b416d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.918+0000 7f43b2ffd700 1 -- 172.21.15.125:0/3058884694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f439c004810 msgr2=0x7f43b4159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:26.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.918+0000 7f43b2ffd700 1 --2- 172.21.15.125:0/3058884694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f439c004810 0x7f43b4159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:26.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.918+0000 7f43b2ffd700 1 -- 172.21.15.125:0/3058884694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b415bf50 con 0x7f43b40a8990 2023-10-06T03:05:26.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.918+0000 7f43b2ffd700 1 --2- 172.21.15.125:0/3058884694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43b40a8990 0x7f43b4153a20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f439c00c0a0 tx=0x7f43a4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:26.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.918+0000 7f439b7fe700 1 -- 172.21.15.125:0/3058884694 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a400cc20 con 0x7f43b40a8990 2023-10-06T03:05:26.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.918+0000 7f439b7fe700 1 -- 172.21.15.125:0/3058884694 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a4004e50 con 0x7f43b40a8990 2023-10-06T03:05:26.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.918+0000 7f439b7fe700 1 -- 172.21.15.125:0/3058884694 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4007300 con 0x7f43b40a8990 2023-10-06T03:05:26.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.918+0000 7f43b9cb0700 1 -- 172.21.15.125:0/3058884694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b415c230 con 0x7f43b40a8990 2023-10-06T03:05:26.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.918+0000 7f43b9cb0700 1 -- 172.21.15.125:0/3058884694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b40af7d0 con 0x7f43b40a8990 2023-10-06T03:05:26.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.919+0000 7f43b9cb0700 1 -- 172.21.15.125:0/3058884694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b4066510 con 0x7f43b40a8990 2023-10-06T03:05:26.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.919+0000 7f439b7fe700 1 -- 172.21.15.125:0/3058884694 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43a4007670 con 0x7f43b40a8990 2023-10-06T03:05:26.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.920+0000 7f439b7fe700 1 --2- 172.21.15.125:0/3058884694 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f43a0066f30 0x7f43a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:26.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.920+0000 7f439b7fe700 1 -- 172.21.15.125:0/3058884694 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f43a4084dc0 con 0x7f43b40a8990 2023-10-06T03:05:26.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.920+0000 7f43b37fe700 1 --2- 172.21.15.125:0/3058884694 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f43a0066f30 0x7f43a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:26.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.920+0000 7f43b37fe700 1 --2- 172.21.15.125:0/3058884694 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f43a0066f30 0x7f43a00693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f43a8007bc0 tx=0x7f43a8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:26.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:26.924+0000 7f439b7fe700 1 -- 172.21.15.125:0/3058884694 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43a40520e0 con 0x7f43b40a8990 2023-10-06T03:05:27.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.107+0000 7f43b9cb0700 1 -- 172.21.15.125:0/3058884694 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43b40c7da0 con 0x7f43b40a8990 2023-10-06T03:05:27.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.108+0000 7f439b7fe700 1 -- 172.21.15.125:0/3058884694 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+13999 (secure 0 0 0) 0x7f43a4023090 con 0x7f43b40a8990 2023-10-06T03:05:27.109 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:27.110 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":37,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:05:23.951874+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:05:27.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.110+0000 7f43b9cb0700 1 -- 172.21.15.125:0/3058884694 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f43a0066f30 msgr2=0x7f43a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:27.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.110+0000 7f43b9cb0700 1 --2- 172.21.15.125:0/3058884694 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f43a0066f30 0x7f43a00693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f43a8007bc0 tx=0x7f43a8009040 comp rx=0 tx=0).stop 2023-10-06T03:05:27.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.110+0000 7f43b9cb0700 1 -- 172.21.15.125:0/3058884694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43b40a8990 msgr2=0x7f43b4153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:27.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.110+0000 7f43b9cb0700 1 --2- 172.21.15.125:0/3058884694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43b40a8990 0x7f43b4153a20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f439c00c0a0 tx=0x7f43a4015000 comp rx=0 tx=0).stop 2023-10-06T03:05:27.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.110+0000 7f43b9cb0700 1 -- 172.21.15.125:0/3058884694 shutdown_connections 2023-10-06T03:05:27.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.110+0000 7f43b9cb0700 1 --2- 172.21.15.125:0/3058884694 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f43a0066f30 0x7f43a00693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.110+0000 7f43b9cb0700 1 --2- 172.21.15.125:0/3058884694 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f43b416cbd0 0x7f43b416d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.110+0000 7f43b9cb0700 1 --2- 172.21.15.125:0/3058884694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f439c004810 0x7f43b4159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.110+0000 7f43b9cb0700 1 --2- 172.21.15.125:0/3058884694 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f43b40a8990 0x7f43b4153a20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.110+0000 7f43b9cb0700 1 -- 172.21.15.125:0/3058884694 >> 172.21.15.125:0/3058884694 conn(0x7f43b40cc5a0 msgr2=0x7f43b415c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:27.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.110+0000 7f43b9cb0700 1 -- 172.21.15.125:0/3058884694 shutdown_connections 2023-10-06T03:05:27.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.110+0000 7f43b9cb0700 1 -- 172.21.15.125:0/3058884694 wait complete. 2023-10-06T03:05:27.124 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:04:15.845430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:04:22.729795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T03:05:27.124 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:05:27.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.242+0000 7f7222330700 1 Processor -- start 2023-10-06T03:05:27.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.242+0000 7f7222330700 1 -- start start 2023-10-06T03:05:27.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.243+0000 7f7222330700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f721c140c50 0x7f721c0cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:27.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.243+0000 7f7222330700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f721c0cc9b0 0x7f721c0c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:27.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.243+0000 7f7222330700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721c158570 con 0x7f721c0c9de0 2023-10-06T03:05:27.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.243+0000 7f7222330700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721c157770 con 0x7f721c0cc9b0 2023-10-06T03:05:27.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.243+0000 7f7222330700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721c0ca220 con 0x7f721c140c50 2023-10-06T03:05:27.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.243+0000 7f721b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f721c0cc9b0 0x7f721c0c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:27.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.243+0000 7f721b7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f721c0cc9b0 0x7f721c0c98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50404/0 (socket says 172.21.15.125:50404) 2023-10-06T03:05:27.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.243+0000 7f721b7fe700 1 -- 172.21.15.125:0/921533918 learned_addr learned my addr 172.21.15.125:0/921533918 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:27.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.243+0000 7f721b7fe700 1 -- 172.21.15.125:0/921533918 >> v2:172.21.15.130:3300/0 conn(0x7f721c140c50 msgr2=0x7f721c0cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:27.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.243+0000 7f721bfff700 1 --2- 172.21.15.125:0/921533918 >> v2:172.21.15.130:3300/0 conn(0x7f721c140c50 0x7f721c0cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:27.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.243+0000 7f721b7fe700 1 --2- 172.21.15.125:0/921533918 >> v2:172.21.15.130:3300/0 conn(0x7f721c140c50 0x7f721c0cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.243+0000 7f721b7fe700 1 -- 172.21.15.125:0/921533918 >> v1:172.21.15.130:6789/0 conn(0x7f721c0c9de0 legacy=0x7f721c067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:27.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.243+0000 7f721b7fe700 1 -- 172.21.15.125:0/921533918 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c158920 con 0x7f721c0cc9b0 2023-10-06T03:05:27.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.243+0000 7f721bfff700 1 --2- 172.21.15.125:0/921533918 >> v2:172.21.15.130:3300/0 conn(0x7f721c140c50 0x7f721c0cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:27.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.244+0000 7f721b7fe700 1 --2- 172.21.15.125:0/921533918 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f721c0cc9b0 0x7f721c0c98a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f721c06aaf0 tx=0x7f720c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d020827ccfe5f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:27.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.244+0000 7f721affd700 1 -- 172.21.15.125:0/921533918 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c00b820 con 0x7f721c0cc9b0 2023-10-06T03:05:27.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.244+0000 7f721affd700 1 -- 172.21.15.125:0/921533918 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c00b980 con 0x7f721c0cc9b0 2023-10-06T03:05:27.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.244+0000 7f721affd700 1 -- 172.21.15.125:0/921533918 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c00bd20 con 0x7f721c0cc9b0 2023-10-06T03:05:27.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.244+0000 7f7222330700 1 -- 172.21.15.125:0/921533918 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f721c0cc9b0 msgr2=0x7f721c0c98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:27.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.244+0000 7f7222330700 1 --2- 172.21.15.125:0/921533918 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f721c0cc9b0 0x7f721c0c98a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f721c06aaf0 tx=0x7f720c009250 comp rx=0 tx=0).stop 2023-10-06T03:05:27.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.244+0000 7f7222330700 1 -- 172.21.15.125:0/921533918 shutdown_connections 2023-10-06T03:05:27.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.244+0000 7f7222330700 1 --2- 172.21.15.125:0/921533918 >> v2:172.21.15.130:3300/0 conn(0x7f721c140c50 0x7f721c0cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.244+0000 7f7222330700 1 --2- 172.21.15.125:0/921533918 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f721c0cc9b0 0x7f721c0c98a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.244+0000 7f7222330700 1 -- 172.21.15.125:0/921533918 >> 172.21.15.125:0/921533918 conn(0x7f721c096120 msgr2=0x7f721c068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:27.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.244+0000 7f7222330700 1 -- 172.21.15.125:0/921533918 shutdown_connections 2023-10-06T03:05:27.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.244+0000 7f7222330700 1 -- 172.21.15.125:0/921533918 wait complete. 2023-10-06T03:05:27.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.245+0000 7f7222330700 1 Processor -- start 2023-10-06T03:05:27.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.246+0000 7f7222330700 1 -- start start 2023-10-06T03:05:27.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.246+0000 7f7222330700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f721c0c9de0 0x7f721c15ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:27.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.246+0000 7f7222330700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f721c0cc9b0 0x7f721c13d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:27.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.246+0000 7f7222330700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f721c140c50 0x7f721c0ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:27.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.246+0000 7f7222330700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c0c3cb0 con 0x7f721c0cc9b0 2023-10-06T03:05:27.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.246+0000 7f7222330700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c15b220 con 0x7f721c0c9de0 2023-10-06T03:05:27.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.246+0000 7f7222330700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721c15c060 con 0x7f721c140c50 2023-10-06T03:05:27.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.247+0000 7f721b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f721c0cc9b0 0x7f721c13d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:27.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.247+0000 7f721b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f721c0cc9b0 0x7f721c13d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50408/0 (socket says 172.21.15.125:50408) 2023-10-06T03:05:27.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.247+0000 7f721b7fe700 1 -- 172.21.15.125:0/3773612734 learned_addr learned my addr 172.21.15.125:0/3773612734 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:27.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.247+0000 7f721bfff700 1 --2- 172.21.15.125:0/3773612734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f721c0c9de0 0x7f721c15ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:27.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.247+0000 7f72208cd700 1 --2- 172.21.15.125:0/3773612734 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f721c140c50 0x7f721c0ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:27.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.247+0000 7f721b7fe700 1 -- 172.21.15.125:0/3773612734 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f721c140c50 msgr2=0x7f721c0ade30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:27.252 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.247+0000 7f721b7fe700 1 --2- 172.21.15.125:0/3773612734 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f721c140c50 0x7f721c0ade30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.247+0000 7f721b7fe700 1 -- 172.21.15.125:0/3773612734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f721c0c9de0 msgr2=0x7f721c15ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:27.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.247+0000 7f721b7fe700 1 --2- 172.21.15.125:0/3773612734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f721c0c9de0 0x7f721c15ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.247+0000 7f721b7fe700 1 -- 172.21.15.125:0/3773612734 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f720c0094f0 con 0x7f721c0cc9b0 2023-10-06T03:05:27.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.247+0000 7f721bfff700 1 --2- 172.21.15.125:0/3773612734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f721c0c9de0 0x7f721c15ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:27.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.247+0000 7f721b7fe700 1 --2- 172.21.15.125:0/3773612734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f721c0cc9b0 0x7f721c13d870 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f720c009880 tx=0x7f720c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:27.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.247+0000 7f7203fff700 1 -- 172.21.15.125:0/3773612734 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c011c60 con 0x7f721c0cc9b0 2023-10-06T03:05:27.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.247+0000 7f7203fff700 1 -- 172.21.15.125:0/3773612734 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720c020070 con 0x7f721c0cc9b0 2023-10-06T03:05:27.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.247+0000 7f7222330700 1 -- 172.21.15.125:0/3773612734 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721c15b450 con 0x7f721c0cc9b0 2023-10-06T03:05:27.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.247+0000 7f7203fff700 1 -- 172.21.15.125:0/3773612734 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720c01b6a0 con 0x7f721c0cc9b0 2023-10-06T03:05:27.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.247+0000 7f7222330700 1 -- 172.21.15.125:0/3773612734 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721c15ba10 con 0x7f721c0cc9b0 2023-10-06T03:05:27.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.248+0000 7f7222330700 1 -- 172.21.15.125:0/3773612734 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721c066510 con 0x7f721c0cc9b0 2023-10-06T03:05:27.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.248+0000 7f7203fff700 1 -- 172.21.15.125:0/3773612734 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f720c022030 con 0x7f721c0cc9b0 2023-10-06T03:05:27.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.249+0000 7f7203fff700 1 --2- 172.21.15.125:0/3773612734 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7208066f30 0x7f72080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:27.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.249+0000 7f7203fff700 1 -- 172.21.15.125:0/3773612734 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f720c0863d0 con 0x7f721c0cc9b0 2023-10-06T03:05:27.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.249+0000 7f721bfff700 1 --2- 172.21.15.125:0/3773612734 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7208066f30 0x7f72080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:27.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.249+0000 7f721bfff700 1 --2- 172.21.15.125:0/3773612734 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7208066f30 0x7f72080693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f721c16c770 tx=0x7f7210008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:27.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.253+0000 7f7203fff700 1 -- 172.21.15.125:0/3773612734 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f720c0536f0 con 0x7f721c0cc9b0 2023-10-06T03:05:27.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.435+0000 7f7222330700 1 -- 172.21.15.125:0/3773612734 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f721c066510 con 0x7f721c0cc9b0 2023-10-06T03:05:27.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.435+0000 7f7203fff700 1 -- 172.21.15.125:0/3773612734 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f720c056d10 con 0x7f721c0cc9b0 2023-10-06T03:05:27.437 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-06T03:05:27.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.437+0000 7f7222330700 1 -- 172.21.15.125:0/3773612734 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7208066f30 msgr2=0x7f72080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:27.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.437+0000 7f7222330700 1 --2- 172.21.15.125:0/3773612734 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7208066f30 0x7f72080693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f721c16c770 tx=0x7f7210008040 comp rx=0 tx=0).stop 2023-10-06T03:05:27.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.437+0000 7f7222330700 1 -- 172.21.15.125:0/3773612734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f721c0cc9b0 msgr2=0x7f721c13d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:27.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.437+0000 7f7222330700 1 --2- 172.21.15.125:0/3773612734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f721c0cc9b0 0x7f721c13d870 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f720c009880 tx=0x7f720c016000 comp rx=0 tx=0).stop 2023-10-06T03:05:27.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.437+0000 7f7222330700 1 -- 172.21.15.125:0/3773612734 shutdown_connections 2023-10-06T03:05:27.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.437+0000 7f7222330700 1 --2- 172.21.15.125:0/3773612734 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7208066f30 0x7f72080693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.437+0000 7f7222330700 1 --2- 172.21.15.125:0/3773612734 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f721c140c50 0x7f721c0ade30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.437+0000 7f7222330700 1 --2- 172.21.15.125:0/3773612734 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f721c0c9de0 0x7f721c15ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.437+0000 7f7222330700 1 --2- 172.21.15.125:0/3773612734 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f721c0cc9b0 0x7f721c13d870 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.437+0000 7f7222330700 1 -- 172.21.15.125:0/3773612734 >> 172.21.15.125:0/3773612734 conn(0x7f721c096120 msgr2=0x7f721c0c8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:27.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.437+0000 7f7222330700 1 -- 172.21.15.125:0/3773612734 shutdown_connections 2023-10-06T03:05:27.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.437+0000 7f7222330700 1 -- 172.21.15.125:0/3773612734 wait complete. 2023-10-06T03:05:27.450 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:05:27.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.569+0000 7fdd2fb82700 1 Processor -- start 2023-10-06T03:05:27.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.569+0000 7fdd2fb82700 1 -- start start 2023-10-06T03:05:27.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.570+0000 7fdd2fb82700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd280cba50 0x7fdd280c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:27.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.570+0000 7fdd2fb82700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdd280c8150 0x7fdd280c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:27.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.570+0000 7fdd2fb82700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd280c9470 con 0x7fdd280af320 2023-10-06T03:05:27.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.570+0000 7fdd2fb82700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd280c9b40 con 0x7fdd280c8150 2023-10-06T03:05:27.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.570+0000 7fdd2fb82700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd280c85a0 con 0x7fdd280cba50 2023-10-06T03:05:27.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.570+0000 7fdd2e11f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdd280c8150 0x7fdd280c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:27.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.570+0000 7fdd2e11f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fdd280c8150 0x7fdd280c1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50414/0 (socket says 172.21.15.125:50414) 2023-10-06T03:05:27.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.570+0000 7fdd2e11f700 1 -- 172.21.15.125:0/865165407 learned_addr learned my addr 172.21.15.125:0/865165407 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:27.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.570+0000 7fdd2d11d700 1 --2- 172.21.15.125:0/865165407 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd280cba50 0x7fdd280c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:27.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.570+0000 7fdd2e11f700 1 -- 172.21.15.125:0/865165407 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd280cba50 msgr2=0x7fdd280c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:27.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.570+0000 7fdd2e11f700 1 --2- 172.21.15.125:0/865165407 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd280cba50 0x7fdd280c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.570+0000 7fdd2e11f700 1 -- 172.21.15.125:0/865165407 >> v1:172.21.15.130:6789/0 conn(0x7fdd280af320 legacy=0x7fdd280cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:27.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.570+0000 7fdd2e11f700 1 -- 172.21.15.125:0/865165407 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd280c8860 con 0x7fdd280c8150 2023-10-06T03:05:27.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.570+0000 7fdd2e11f700 1 --2- 172.21.15.125:0/865165407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd280c8150 0x7fdd280c1e20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdd2000d1a0 tx=0x7fdd2000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813ebc09765d45b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:27.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.570+0000 7fdd2c91c700 1 -- 172.21.15.125:0/865165407 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd20010070 con 0x7fdd280c8150 2023-10-06T03:05:27.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.571+0000 7fdd2c91c700 1 -- 172.21.15.125:0/865165407 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2000de80 con 0x7fdd280c8150 2023-10-06T03:05:27.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.571+0000 7fdd2c91c700 1 -- 172.21.15.125:0/865165407 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2000b320 con 0x7fdd280c8150 2023-10-06T03:05:27.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.571+0000 7fdd2fb82700 1 -- 172.21.15.125:0/865165407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd280c8150 msgr2=0x7fdd280c1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:27.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.571+0000 7fdd2fb82700 1 --2- 172.21.15.125:0/865165407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd280c8150 0x7fdd280c1e20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdd2000d1a0 tx=0x7fdd2000ba50 comp rx=0 tx=0).stop 2023-10-06T03:05:27.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.571+0000 7fdd2fb82700 1 -- 172.21.15.125:0/865165407 shutdown_connections 2023-10-06T03:05:27.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.571+0000 7fdd2fb82700 1 --2- 172.21.15.125:0/865165407 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd280c8150 0x7fdd280c1e20 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.571+0000 7fdd2fb82700 1 --2- 172.21.15.125:0/865165407 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd280cba50 0x7fdd280c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.571+0000 7fdd2fb82700 1 -- 172.21.15.125:0/865165407 >> 172.21.15.125:0/865165407 conn(0x7fdd28096120 msgr2=0x7fdd28068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:27.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.571+0000 7fdd2fb82700 1 -- 172.21.15.125:0/865165407 shutdown_connections 2023-10-06T03:05:27.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.571+0000 7fdd2fb82700 1 -- 172.21.15.125:0/865165407 wait complete. 2023-10-06T03:05:27.577 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.573+0000 7fdd2fb82700 1 Processor -- start 2023-10-06T03:05:27.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.573+0000 7fdd2fb82700 1 -- start start 2023-10-06T03:05:27.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd2fb82700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd280af320 0x7fdd2814fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:27.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd2fb82700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd280c8150 0x7fdd280b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:27.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd2fb82700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd280cba50 0x7fdd280b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:27.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd2fb82700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd280b1b50 con 0x7fdd280cba50 2023-10-06T03:05:27.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd2fb82700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd280b1590 con 0x7fdd280af320 2023-10-06T03:05:27.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd2fb82700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd280b1870 con 0x7fdd280c8150 2023-10-06T03:05:27.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd2e11f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd280cba50 0x7fdd280b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:27.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd2e11f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd280cba50 0x7fdd280b2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50422/0 (socket says 172.21.15.125:50422) 2023-10-06T03:05:27.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd2e11f700 1 -- 172.21.15.125:0/612812092 learned_addr learned my addr 172.21.15.125:0/612812092 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:27.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd2d91e700 1 --2- 172.21.15.125:0/612812092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd280af320 0x7fdd2814fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:27.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd2d11d700 1 --2- 172.21.15.125:0/612812092 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd280c8150 0x7fdd280b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:27.579 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd2e11f700 1 -- 172.21.15.125:0/612812092 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd280c8150 msgr2=0x7fdd280b2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:27.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd2e11f700 1 --2- 172.21.15.125:0/612812092 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd280c8150 0x7fdd280b2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd2e11f700 1 -- 172.21.15.125:0/612812092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd280af320 msgr2=0x7fdd2814fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:27.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd2e11f700 1 --2- 172.21.15.125:0/612812092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd280af320 0x7fdd2814fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd2e11f700 1 -- 172.21.15.125:0/612812092 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2000bcf0 con 0x7fdd280cba50 2023-10-06T03:05:27.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd2e11f700 1 --2- 172.21.15.125:0/612812092 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd280cba50 0x7fdd280b2540 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdd2806df40 tx=0x7fdd20019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:27.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd1dffb700 1 -- 172.21.15.125:0/612812092 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd20009cb0 con 0x7fdd280cba50 2023-10-06T03:05:27.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd1dffb700 1 -- 172.21.15.125:0/612812092 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd20009e50 con 0x7fdd280cba50 2023-10-06T03:05:27.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd2fb82700 1 -- 172.21.15.125:0/612812092 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd28150d70 con 0x7fdd280cba50 2023-10-06T03:05:27.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.574+0000 7fdd1dffb700 1 -- 172.21.15.125:0/612812092 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd20020680 con 0x7fdd280cba50 2023-10-06T03:05:27.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.575+0000 7fdd2fb82700 1 -- 172.21.15.125:0/612812092 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd2814ff50 con 0x7fdd280cba50 2023-10-06T03:05:27.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.575+0000 7fdd2fb82700 1 -- 172.21.15.125:0/612812092 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd28151290 con 0x7fdd280cba50 2023-10-06T03:05:27.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.576+0000 7fdd1dffb700 1 -- 172.21.15.125:0/612812092 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd200209f0 con 0x7fdd280cba50 2023-10-06T03:05:27.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.576+0000 7fdd1dffb700 1 --2- 172.21.15.125:0/612812092 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdd0c066f30 0x7fdd0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:27.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.576+0000 7fdd2d91e700 1 --2- 172.21.15.125:0/612812092 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdd0c066f30 0x7fdd0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:27.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.576+0000 7fdd1dffb700 1 -- 172.21.15.125:0/612812092 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fdd200880c0 con 0x7fdd280cba50 2023-10-06T03:05:27.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.577+0000 7fdd2d91e700 1 --2- 172.21.15.125:0/612812092 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdd0c066f30 0x7fdd0c0693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdd24003a70 tx=0x7fdd24007ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:27.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.581+0000 7fdd1dffb700 1 -- 172.21.15.125:0/612812092 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd28151290 con 0x7fdd280cba50 2023-10-06T03:05:27.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.761+0000 7fdd2fb82700 1 -- 172.21.15.125:0/612812092 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdd28151290 con 0x7fdd280cba50 2023-10-06T03:05:27.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.761+0000 7fdd1dffb700 1 -- 172.21.15.125:0/612812092 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdd28151290 con 0x7fdd280cba50 2023-10-06T03:05:27.763 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-06T03:05:27.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.764+0000 7fdd2fb82700 1 -- 172.21.15.125:0/612812092 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdd0c066f30 msgr2=0x7fdd0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:27.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.764+0000 7fdd2fb82700 1 --2- 172.21.15.125:0/612812092 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdd0c066f30 0x7fdd0c0693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdd24003a70 tx=0x7fdd24007ef0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.764+0000 7fdd2fb82700 1 -- 172.21.15.125:0/612812092 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd280cba50 msgr2=0x7fdd280b2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:27.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.764+0000 7fdd2fb82700 1 --2- 172.21.15.125:0/612812092 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd280cba50 0x7fdd280b2540 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdd2806df40 tx=0x7fdd20019000 comp rx=0 tx=0).stop 2023-10-06T03:05:27.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.764+0000 7fdd2fb82700 1 -- 172.21.15.125:0/612812092 shutdown_connections 2023-10-06T03:05:27.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.764+0000 7fdd2fb82700 1 --2- 172.21.15.125:0/612812092 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdd0c066f30 0x7fdd0c0693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.764+0000 7fdd2fb82700 1 --2- 172.21.15.125:0/612812092 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdd280cba50 0x7fdd280b2540 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.764+0000 7fdd2fb82700 1 --2- 172.21.15.125:0/612812092 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd280af320 0x7fdd2814fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.764+0000 7fdd2fb82700 1 --2- 172.21.15.125:0/612812092 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdd280c8150 0x7fdd280b2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.764+0000 7fdd2fb82700 1 -- 172.21.15.125:0/612812092 >> 172.21.15.125:0/612812092 conn(0x7fdd28096120 msgr2=0x7fdd280c2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:27.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.764+0000 7fdd2fb82700 1 -- 172.21.15.125:0/612812092 shutdown_connections 2023-10-06T03:05:27.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.764+0000 7fdd2fb82700 1 -- 172.21.15.125:0/612812092 wait complete. 2023-10-06T03:05:27.777 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:05:27.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.893+0000 7fd90a5bd700 1 Processor -- start 2023-10-06T03:05:27.894 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.893+0000 7fd90a5bd700 1 -- start start 2023-10-06T03:05:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.894+0000 7fd90a5bd700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd904157050 0x7fd9040ab7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.894+0000 7fd90a5bd700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9040abd00 0x7fd90406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.894+0000 7fd90a5bd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9040acdb0 con 0x7fd90406ae00 2023-10-06T03:05:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.894+0000 7fd90a5bd700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd90406b280 con 0x7fd904157050 2023-10-06T03:05:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.894+0000 7fd90a5bd700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9040b0380 con 0x7fd9040abd00 2023-10-06T03:05:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.894+0000 7fd908b5a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd90406ae00 0x7fd90406e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40056/0 (socket says 172.21.15.125:40056) 2023-10-06T03:05:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.894+0000 7fd908b5a700 1 -- 172.21.15.125:0/936674449 learned_addr learned my addr 172.21.15.125:0/936674449 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.894+0000 7fd903fff700 1 --2- 172.21.15.125:0/936674449 >> v2:172.21.15.130:3300/0 conn(0x7fd904157050 0x7fd9040ab7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.894+0000 7fd9037fe700 1 --2- 172.21.15.125:0/936674449 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9040abd00 0x7fd90406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.894+0000 7fd902ffd700 1 -- 172.21.15.125:0/936674449 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008671980 0 0) 0x7fd9040acdb0 con 0x7fd90406ae00 2023-10-06T03:05:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.894+0000 7fd902ffd700 1 -- 172.21.15.125:0/936674449 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8ec003570 con 0x7fd90406ae00 2023-10-06T03:05:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.894+0000 7fd903fff700 1 -- 172.21.15.125:0/936674449 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9040abd00 msgr2=0x7fd90406a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.894+0000 7fd903fff700 1 --2- 172.21.15.125:0/936674449 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9040abd00 0x7fd90406a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.894+0000 7fd903fff700 1 -- 172.21.15.125:0/936674449 >> v1:172.21.15.125:6789/0 conn(0x7fd90406ae00 legacy=0x7fd90406e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.894+0000 7fd903fff700 1 -- 172.21.15.125:0/936674449 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd904157420 con 0x7fd904157050 2023-10-06T03:05:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.894+0000 7fd903fff700 1 --2- 172.21.15.125:0/936674449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd904157050 0x7fd9040ab7c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80098e0 tx=0x7fd8f80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6f36cd2d310eb61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.895+0000 7fd902ffd700 1 -- 172.21.15.125:0/936674449 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8011630 con 0x7fd904157050 2023-10-06T03:05:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.895+0000 7fd902ffd700 1 -- 172.21.15.125:0/936674449 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f8011790 con 0x7fd904157050 2023-10-06T03:05:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.895+0000 7fd902ffd700 1 -- 172.21.15.125:0/936674449 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8011b30 con 0x7fd904157050 2023-10-06T03:05:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.895+0000 7fd90a5bd700 1 -- 172.21.15.125:0/936674449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd904157050 msgr2=0x7fd9040ab7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.895+0000 7fd90a5bd700 1 --2- 172.21.15.125:0/936674449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd904157050 0x7fd9040ab7c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd8f80098e0 tx=0x7fd8f80091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.895+0000 7fd90a5bd700 1 -- 172.21.15.125:0/936674449 shutdown_connections 2023-10-06T03:05:27.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.895+0000 7fd90a5bd700 1 --2- 172.21.15.125:0/936674449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd904157050 0x7fd9040ab7c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.895+0000 7fd90a5bd700 1 --2- 172.21.15.125:0/936674449 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9040abd00 0x7fd90406a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.895+0000 7fd90a5bd700 1 -- 172.21.15.125:0/936674449 >> 172.21.15.125:0/936674449 conn(0x7fd9040cc5a0 msgr2=0x7fd9040cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:27.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.895+0000 7fd90a5bd700 1 -- 172.21.15.125:0/936674449 shutdown_connections 2023-10-06T03:05:27.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.895+0000 7fd90a5bd700 1 -- 172.21.15.125:0/936674449 wait complete. 2023-10-06T03:05:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.896+0000 7fd90a5bd700 1 Processor -- start 2023-10-06T03:05:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.897+0000 7fd90a5bd700 1 -- start start 2023-10-06T03:05:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.897+0000 7fd90a5bd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd90406ae00 0x7fd9040c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.897+0000 7fd90a5bd700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9040abd00 0x7fd9041536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.897+0000 7fd90a5bd700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd904157050 0x7fd9040c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.897+0000 7fd90a5bd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd904153c30 con 0x7fd90406ae00 2023-10-06T03:05:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.897+0000 7fd90a5bd700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90416a8a0 con 0x7fd904157050 2023-10-06T03:05:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.897+0000 7fd90a5bd700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90416ab80 con 0x7fd9040abd00 2023-10-06T03:05:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.897+0000 7fd903fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd90406ae00 0x7fd9040c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.897+0000 7fd903fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd90406ae00 0x7fd9040c7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50432/0 (socket says 172.21.15.125:50432) 2023-10-06T03:05:27.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.897+0000 7fd903fff700 1 -- 172.21.15.125:0/2159576202 learned_addr learned my addr 172.21.15.125:0/2159576202 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:27.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.898+0000 7fd908b5a700 1 --2- 172.21.15.125:0/2159576202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd904157050 0x7fd9040c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:27.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.898+0000 7fd903fff700 1 -- 172.21.15.125:0/2159576202 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9040abd00 msgr2=0x7fd9041536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:27.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.898+0000 7fd9037fe700 1 --2- 172.21.15.125:0/2159576202 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9040abd00 0x7fd9041536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:27.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.898+0000 7fd903fff700 1 --2- 172.21.15.125:0/2159576202 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9040abd00 0x7fd9041536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.898+0000 7fd903fff700 1 -- 172.21.15.125:0/2159576202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd904157050 msgr2=0x7fd9040c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:27.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.898+0000 7fd903fff700 1 --2- 172.21.15.125:0/2159576202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd904157050 0x7fd9040c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:27.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.898+0000 7fd903fff700 1 -- 172.21.15.125:0/2159576202 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f8009420 con 0x7fd90406ae00 2023-10-06T03:05:27.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.898+0000 7fd908b5a700 1 --2- 172.21.15.125:0/2159576202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd904157050 0x7fd9040c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:27.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.898+0000 7fd9037fe700 1 --2- 172.21.15.125:0/2159576202 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9040abd00 0x7fd9041536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:27.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.898+0000 7fd903fff700 1 --2- 172.21.15.125:0/2159576202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd90406ae00 0x7fd9040c7b50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009ed0 tx=0x7fd8f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:27.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.898+0000 7fd8ebfff700 1 -- 172.21.15.125:0/2159576202 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8011b10 con 0x7fd90406ae00 2023-10-06T03:05:27.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.898+0000 7fd8ebfff700 1 -- 172.21.15.125:0/2159576202 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f80253f0 con 0x7fd90406ae00 2023-10-06T03:05:27.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.898+0000 7fd90a5bd700 1 -- 172.21.15.125:0/2159576202 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9040c2230 con 0x7fd90406ae00 2023-10-06T03:05:27.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.898+0000 7fd8ebfff700 1 -- 172.21.15.125:0/2159576202 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8025790 con 0x7fd90406ae00 2023-10-06T03:05:27.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.898+0000 7fd90a5bd700 1 -- 172.21.15.125:0/2159576202 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9040c27f0 con 0x7fd90406ae00 2023-10-06T03:05:27.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.899+0000 7fd90a5bd700 1 -- 172.21.15.125:0/2159576202 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd904066510 con 0x7fd90406ae00 2023-10-06T03:05:27.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.899+0000 7fd8ebfff700 1 -- 172.21.15.125:0/2159576202 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8f8025b80 con 0x7fd90406ae00 2023-10-06T03:05:27.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.900+0000 7fd8ebfff700 1 --2- 172.21.15.125:0/2159576202 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd8f0066f30 0x7fd8f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:27.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.900+0000 7fd8ebfff700 1 -- 172.21.15.125:0/2159576202 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fd8f8085c20 con 0x7fd90406ae00 2023-10-06T03:05:27.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.900+0000 7fd9037fe700 1 --2- 172.21.15.125:0/2159576202 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd8f0066f30 0x7fd8f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:27.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.900+0000 7fd9037fe700 1 --2- 172.21.15.125:0/2159576202 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd8f0066f30 0x7fd8f00693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40093f0 tx=0x7fd8f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:27.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:27.904+0000 7fd8ebfff700 1 -- 172.21.15.125:0/2159576202 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8f8052f40 con 0x7fd90406ae00 2023-10-06T03:05:28.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.089+0000 7fd90a5bd700 1 -- 172.21.15.125:0/2159576202 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd9040ac1a0 con 0x7fd90406ae00 2023-10-06T03:05:28.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.090+0000 7fd8ebfff700 1 -- 172.21.15.125:0/2159576202 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+126 (secure 0 0 0) 0x7fd8f8015090 con 0x7fd90406ae00 2023-10-06T03:05:28.091 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:28.091 INFO:teuthology.orchestra.run.smithi125.stdout:[ 2023-10-06T03:05:28.092 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:28.092 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 1, 2023-10-06T03:05:28.092 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": ".mgr" 2023-10-06T03:05:28.092 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:28.092 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:05:28.092 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 2, 2023-10-06T03:05:28.092 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": "rbd" 2023-10-06T03:05:28.092 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:28.092 INFO:teuthology.orchestra.run.smithi125.stdout:] 2023-10-06T03:05:28.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.092+0000 7fd90a5bd700 1 -- 172.21.15.125:0/2159576202 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd8f0066f30 msgr2=0x7fd8f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:28.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.092+0000 7fd90a5bd700 1 --2- 172.21.15.125:0/2159576202 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd8f0066f30 0x7fd8f00693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40093f0 tx=0x7fd8f4008040 comp rx=0 tx=0).stop 2023-10-06T03:05:28.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.092+0000 7fd90a5bd700 1 -- 172.21.15.125:0/2159576202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd90406ae00 msgr2=0x7fd9040c7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:28.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.092+0000 7fd90a5bd700 1 --2- 172.21.15.125:0/2159576202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd90406ae00 0x7fd9040c7b50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8009ed0 tx=0x7fd8f8017000 comp rx=0 tx=0).stop 2023-10-06T03:05:28.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.092+0000 7fd90a5bd700 1 -- 172.21.15.125:0/2159576202 shutdown_connections 2023-10-06T03:05:28.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.092+0000 7fd90a5bd700 1 --2- 172.21.15.125:0/2159576202 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd8f0066f30 0x7fd8f00693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:28.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.092+0000 7fd90a5bd700 1 --2- 172.21.15.125:0/2159576202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd904157050 0x7fd9040c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:28.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.092+0000 7fd90a5bd700 1 --2- 172.21.15.125:0/2159576202 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd90406ae00 0x7fd9040c7b50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:28.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.092+0000 7fd90a5bd700 1 --2- 172.21.15.125:0/2159576202 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd9040abd00 0x7fd9041536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:28.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.092+0000 7fd90a5bd700 1 -- 172.21.15.125:0/2159576202 >> 172.21.15.125:0/2159576202 conn(0x7fd9040cc5a0 msgr2=0x7fd904156390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:28.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.092+0000 7fd90a5bd700 1 -- 172.21.15.125:0/2159576202 shutdown_connections 2023-10-06T03:05:28.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.092+0000 7fd90a5bd700 1 -- 172.21.15.125:0/2159576202 wait complete. 2023-10-06T03:05:28.105 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:05:28.105 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:05:28.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.224+0000 7f6faaa94700 1 Processor -- start 2023-10-06T03:05:28.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.224+0000 7f6faaa94700 1 -- start start 2023-10-06T03:05:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.225+0000 7f6faaa94700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6fa406e120 0x7f6fa4157d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.225+0000 7f6faaa94700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa40cbb90 con 0x7f6fa40ad450 2023-10-06T03:05:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.225+0000 7f6faaa94700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa4158420 con 0x7f6fa40ad080 2023-10-06T03:05:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.225+0000 7f6faaa94700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa40cbde0 con 0x7f6fa406e120 2023-10-06T03:05:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.225+0000 7f6fa3fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6fa40ad450 0x7f6fa4157670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40062/0 (socket says 172.21.15.125:40062) 2023-10-06T03:05:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.225+0000 7f6fa3fff700 1 -- 172.21.15.125:0/3595233833 learned_addr learned my addr 172.21.15.125:0/3595233833 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa37fe700 1 -- 172.21.15.125:0/3595233833 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2189139673 0 0) 0x7f6fa40cbb90 con 0x7f6fa40ad450 2023-10-06T03:05:28.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa9031700 1 --2- 172.21.15.125:0/3595233833 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6fa406e120 0x7f6fa4157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:28.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa37fe700 1 -- 172.21.15.125:0/3595233833 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f94003570 con 0x7f6fa40ad450 2023-10-06T03:05:28.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa37fe700 1 -- 172.21.15.125:0/3595233833 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2893330764 0 0) 0x7f6f94003570 con 0x7f6fa40ad450 2023-10-06T03:05:28.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa37fe700 1 -- 172.21.15.125:0/3595233833 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6fa406e120 msgr2=0x7f6fa4157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:28.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa37fe700 1 --2- 172.21.15.125:0/3595233833 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6fa406e120 0x7f6fa4157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:28.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa37fe700 1 -- 172.21.15.125:0/3595233833 >> v1:172.21.15.130:6789/0 conn(0x7f6fa40ad080 legacy=0x7f6fa406da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:28.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa37fe700 1 -- 172.21.15.125:0/3595233833 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa40cc0c0 con 0x7f6fa40ad450 2023-10-06T03:05:28.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa37fe700 1 -- 172.21.15.125:0/3595233833 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f6f90001470 con 0x7f6fa40ad450 2023-10-06T03:05:28.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa37fe700 1 -- 172.21.15.125:0/3595233833 >> v1:172.21.15.125:6789/0 conn(0x7f6fa40ad450 legacy=0x7f6fa4157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:28.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa37fe700 1 --2- 172.21.15.125:0/3595233833 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6fa406e120 0x7f6f94003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:28.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa37fe700 1 --2- 172.21.15.125:0/3595233833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f94003fd0 0x7f6f94004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:28.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa37fe700 1 --2- 172.21.15.125:0/3595233833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f94004d50 0x7f6f940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:28.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa37fe700 1 -- 172.21.15.125:0/3595233833 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa40cbde0 con 0x7f6f94003fd0 2023-10-06T03:05:28.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa37fe700 1 -- 172.21.15.125:0/3595233833 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9400bb40 con 0x7f6f94004d50 2023-10-06T03:05:28.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa37fe700 1 -- 172.21.15.125:0/3595233833 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9400bd00 con 0x7f6fa406e120 2023-10-06T03:05:28.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa3fff700 1 --2- 172.21.15.125:0/3595233833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f94003fd0 0x7f6f94004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:28.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa8830700 1 --2- 172.21.15.125:0/3595233833 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6fa406e120 0x7f6f94003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:28.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa9031700 1 --2- 172.21.15.125:0/3595233833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f94004d50 0x7f6f940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:28.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa3fff700 1 -- 172.21.15.125:0/3595233833 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6fa406e120 msgr2=0x7f6f94003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:28.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa3fff700 1 --2- 172.21.15.125:0/3595233833 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6fa406e120 0x7f6f94003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:28.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa3fff700 1 -- 172.21.15.125:0/3595233833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f94004d50 msgr2=0x7f6f940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:28.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa3fff700 1 --2- 172.21.15.125:0/3595233833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f94004d50 0x7f6f940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:28.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.226+0000 7f6fa3fff700 1 -- 172.21.15.125:0/3595233833 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f94003570 con 0x7f6f94003fd0 2023-10-06T03:05:28.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.227+0000 7f6fa3fff700 1 --2- 172.21.15.125:0/3595233833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f94003fd0 0x7f6f94004810 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000c390 tx=0x7f6f90001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4970f08d05bf01b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:28.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.227+0000 7f6fa37fe700 1 -- 172.21.15.125:0/3595233833 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9000cc60 con 0x7f6f94003fd0 2023-10-06T03:05:28.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.227+0000 7f6fa37fe700 1 -- 172.21.15.125:0/3595233833 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9000cdc0 con 0x7f6f94003fd0 2023-10-06T03:05:28.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.227+0000 7f6fa37fe700 1 -- 172.21.15.125:0/3595233833 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90005b70 con 0x7f6f94003fd0 2023-10-06T03:05:28.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.227+0000 7f6faaa94700 1 -- 172.21.15.125:0/3595233833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f94003fd0 msgr2=0x7f6f94004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:28.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.227+0000 7f6faaa94700 1 --2- 172.21.15.125:0/3595233833 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f94003fd0 0x7f6f94004810 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6f9000c390 tx=0x7f6f90001e70 comp rx=0 tx=0).stop 2023-10-06T03:05:28.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.227+0000 7f6fa9031700 1 -- 172.21.15.125:0/3595233833 reap_dead start 2023-10-06T03:05:28.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.227+0000 7f6faaa94700 1 -- 172.21.15.125:0/3595233833 shutdown_connections 2023-10-06T03:05:28.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.227+0000 7f6faaa94700 1 -- 172.21.15.125:0/3595233833 >> 172.21.15.125:0/3595233833 conn(0x7f6fa40cea90 msgr2=0x7f6fa406c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:28.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.227+0000 7f6faaa94700 1 -- 172.21.15.125:0/3595233833 shutdown_connections 2023-10-06T03:05:28.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.227+0000 7f6faaa94700 1 -- 172.21.15.125:0/3595233833 wait complete. 2023-10-06T03:05:28.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.228+0000 7f6faaa94700 1 Processor -- start 2023-10-06T03:05:28.236 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.229+0000 7f6faaa94700 1 -- start start 2023-10-06T03:05:28.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.229+0000 7f6faaa94700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f94003fd0 0x7f6fa4155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:28.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.229+0000 7f6faaa94700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6fa40b1690 0x7f6fa40cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:28.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.229+0000 7f6faaa94700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6fa40b1b00 0x7f6fa40ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:28.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.229+0000 7f6faaa94700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa40ab760 con 0x7f6f94003fd0 2023-10-06T03:05:28.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.229+0000 7f6faaa94700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa416d4e0 con 0x7f6fa40b1b00 2023-10-06T03:05:28.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.229+0000 7f6faaa94700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa40abef0 con 0x7f6fa40b1690 2023-10-06T03:05:28.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.229+0000 7f6fa8830700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f94003fd0 0x7f6fa4155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:28.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.229+0000 7f6fa8830700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f94003fd0 0x7f6fa4155700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50454/0 (socket says 172.21.15.125:50454) 2023-10-06T03:05:28.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.229+0000 7f6fa8830700 1 -- 172.21.15.125:0/894146600 learned_addr learned my addr 172.21.15.125:0/894146600 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:28.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.229+0000 7f6fa3fff700 1 --2- 172.21.15.125:0/894146600 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6fa40b1690 0x7f6fa40cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:28.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.229+0000 7f6fa9031700 1 --2- 172.21.15.125:0/894146600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6fa40b1b00 0x7f6fa40ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:28.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.230+0000 7f6fa8830700 1 -- 172.21.15.125:0/894146600 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6fa40b1690 msgr2=0x7f6fa40cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:28.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.230+0000 7f6fa8830700 1 --2- 172.21.15.125:0/894146600 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6fa40b1690 0x7f6fa40cc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:28.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.230+0000 7f6fa8830700 1 -- 172.21.15.125:0/894146600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6fa40b1b00 msgr2=0x7f6fa40ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:28.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.230+0000 7f6fa8830700 1 --2- 172.21.15.125:0/894146600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6fa40b1b00 0x7f6fa40ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:28.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.230+0000 7f6fa8830700 1 -- 172.21.15.125:0/894146600 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa40ac1d0 con 0x7f6f94003fd0 2023-10-06T03:05:28.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.230+0000 7f6fa8830700 1 --2- 172.21.15.125:0/894146600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f94003fd0 0x7f6fa4155700 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6f98002b30 tx=0x7f6f98007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:28.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.230+0000 7f6fa0ff9700 1 -- 172.21.15.125:0/894146600 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9800f850 con 0x7f6f94003fd0 2023-10-06T03:05:28.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.230+0000 7f6fa0ff9700 1 -- 172.21.15.125:0/894146600 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9800f9b0 con 0x7f6f94003fd0 2023-10-06T03:05:28.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.230+0000 7f6faaa94700 1 -- 172.21.15.125:0/894146600 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa416d170 con 0x7f6f94003fd0 2023-10-06T03:05:28.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.230+0000 7f6fa0ff9700 1 -- 172.21.15.125:0/894146600 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f9800fd70 con 0x7f6f94003fd0 2023-10-06T03:05:28.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.230+0000 7f6faaa94700 1 -- 172.21.15.125:0/894146600 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa4155c40 con 0x7f6f94003fd0 2023-10-06T03:05:28.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.231+0000 7f6faaa94700 1 -- 172.21.15.125:0/894146600 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa416cfd0 con 0x7f6f94003fd0 2023-10-06T03:05:28.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.231+0000 7f6fa0ff9700 1 -- 172.21.15.125:0/894146600 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f98013600 con 0x7f6f94003fd0 2023-10-06T03:05:28.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.232+0000 7f6fa0ff9700 1 --2- 172.21.15.125:0/894146600 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6f88066f30 0x7f6f880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:28.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.232+0000 7f6fa0ff9700 1 -- 172.21.15.125:0/894146600 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f6f98084320 con 0x7f6f94003fd0 2023-10-06T03:05:28.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.232+0000 7f6fa3fff700 1 --2- 172.21.15.125:0/894146600 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6f88066f30 0x7f6f880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:28.243 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.232+0000 7f6fa3fff700 1 --2- 172.21.15.125:0/894146600 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6f88066f30 0x7f6f880693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6f90007cf0 tx=0x7f6f90015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:28.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.236+0000 7f6fa0ff9700 1 -- 172.21.15.125:0/894146600 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fa416cfd0 con 0x7f6f94003fd0 2023-10-06T03:05:28.383 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:05:28.386 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:05:28.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.421+0000 7f6faaa94700 1 -- 172.21.15.125:0/894146600 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6fa416cfd0 con 0x7f6f94003fd0 2023-10-06T03:05:28.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.950+0000 7f6fa0ff9700 1 -- 172.21.15.125:0/894146600 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6fa416cfd0 con 0x7f6f94003fd0 2023-10-06T03:05:28.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.953+0000 7f6faaa94700 1 -- 172.21.15.125:0/894146600 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6f88066f30 msgr2=0x7f6f880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:28.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.953+0000 7f6faaa94700 1 --2- 172.21.15.125:0/894146600 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6f88066f30 0x7f6f880693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6f90007cf0 tx=0x7f6f90015000 comp rx=0 tx=0).stop 2023-10-06T03:05:28.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.954+0000 7f6faaa94700 1 -- 172.21.15.125:0/894146600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f94003fd0 msgr2=0x7f6fa4155700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:28.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.954+0000 7f6faaa94700 1 --2- 172.21.15.125:0/894146600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f94003fd0 0x7f6fa4155700 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6f98002b30 tx=0x7f6f98007d10 comp rx=0 tx=0).stop 2023-10-06T03:05:28.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.954+0000 7f6faaa94700 1 -- 172.21.15.125:0/894146600 shutdown_connections 2023-10-06T03:05:28.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.954+0000 7f6faaa94700 1 --2- 172.21.15.125:0/894146600 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6f88066f30 0x7f6f880693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:28.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.954+0000 7f6faaa94700 1 --2- 172.21.15.125:0/894146600 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6fa40b1b00 0x7f6fa40ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:28.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.954+0000 7f6faaa94700 1 --2- 172.21.15.125:0/894146600 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6f94003fd0 0x7f6fa4155700 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:28.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.954+0000 7f6faaa94700 1 --2- 172.21.15.125:0/894146600 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6fa40b1690 0x7f6fa40cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:28.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.954+0000 7f6faaa94700 1 -- 172.21.15.125:0/894146600 >> 172.21.15.125:0/894146600 conn(0x7f6fa40cea90 msgr2=0x7f6fa40c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:28.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.954+0000 7f6faaa94700 1 -- 172.21.15.125:0/894146600 shutdown_connections 2023-10-06T03:05:28.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:28.955+0000 7f6faaa94700 1 -- 172.21.15.125:0/894146600 wait complete. 2023-10-06T03:05:28.958 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_metadata' created 2023-10-06T03:05:28.971 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:05:29.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.096+0000 7f6ec66ac700 1 Processor -- start 2023-10-06T03:05:29.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.096+0000 7f6ec66ac700 1 -- start start 2023-10-06T03:05:29.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.097+0000 7f6ec66ac700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ec00af320 0x7f6ec00cb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:29.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.097+0000 7f6ec66ac700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6ec00cb880 0x7f6ec00c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:29.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.097+0000 7f6ec66ac700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec00c9470 con 0x7f6ec00c8150 2023-10-06T03:05:29.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.097+0000 7f6ec66ac700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec00c9b40 con 0x7f6ec00cb880 2023-10-06T03:05:29.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.097+0000 7f6ec66ac700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec00c85a0 con 0x7f6ec00af320 2023-10-06T03:05:29.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.097+0000 7f6ebf7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6ec00cb880 0x7f6ec00c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:29.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.097+0000 7f6ebf7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6ec00cb880 0x7f6ec00c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50464/0 (socket says 172.21.15.125:50464) 2023-10-06T03:05:29.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.097+0000 7f6ebf7fe700 1 -- 172.21.15.125:0/2331091607 learned_addr learned my addr 172.21.15.125:0/2331091607 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:29.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.097+0000 7f6ebffff700 1 --2- 172.21.15.125:0/2331091607 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ec00af320 0x7f6ec00cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:29.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.097+0000 7f6ebf7fe700 1 -- 172.21.15.125:0/2331091607 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ec00af320 msgr2=0x7f6ec00cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:29.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.097+0000 7f6ebf7fe700 1 --2- 172.21.15.125:0/2331091607 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ec00af320 0x7f6ec00cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:29.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.097+0000 7f6ebf7fe700 1 -- 172.21.15.125:0/2331091607 >> v1:172.21.15.130:6789/0 conn(0x7f6ec00c8150 legacy=0x7f6ec01565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:29.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.097+0000 7f6ebf7fe700 1 -- 172.21.15.125:0/2331091607 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec00cbcf0 con 0x7f6ec00cb880 2023-10-06T03:05:29.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.097+0000 7f6ebf7fe700 1 --2- 172.21.15.125:0/2331091607 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec00cb880 0x7f6ec00c7c10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00099b0 tx=0x7f6eb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0a53ab0fcf7c73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:29.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.098+0000 7f6ebeffd700 1 -- 172.21.15.125:0/2331091607 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb000b860 con 0x7f6ec00cb880 2023-10-06T03:05:29.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.098+0000 7f6ebeffd700 1 -- 172.21.15.125:0/2331091607 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb000b9c0 con 0x7f6ec00cb880 2023-10-06T03:05:29.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.098+0000 7f6ebeffd700 1 -- 172.21.15.125:0/2331091607 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb000bd60 con 0x7f6ec00cb880 2023-10-06T03:05:29.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.098+0000 7f6ec66ac700 1 -- 172.21.15.125:0/2331091607 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec00cb880 msgr2=0x7f6ec00c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:29.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.098+0000 7f6ec66ac700 1 --2- 172.21.15.125:0/2331091607 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec00cb880 0x7f6ec00c7c10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00099b0 tx=0x7f6eb0009250 comp rx=0 tx=0).stop 2023-10-06T03:05:29.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.098+0000 7f6ec66ac700 1 -- 172.21.15.125:0/2331091607 shutdown_connections 2023-10-06T03:05:29.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.098+0000 7f6ec66ac700 1 --2- 172.21.15.125:0/2331091607 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ec00af320 0x7f6ec00cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:29.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.098+0000 7f6ec66ac700 1 --2- 172.21.15.125:0/2331091607 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec00cb880 0x7f6ec00c7c10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:29.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.098+0000 7f6ec66ac700 1 -- 172.21.15.125:0/2331091607 >> 172.21.15.125:0/2331091607 conn(0x7f6ec0096120 msgr2=0x7f6ec0068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:29.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.098+0000 7f6ec66ac700 1 -- 172.21.15.125:0/2331091607 shutdown_connections 2023-10-06T03:05:29.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.098+0000 7f6ec66ac700 1 -- 172.21.15.125:0/2331091607 wait complete. 2023-10-06T03:05:29.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.099+0000 7f6ec66ac700 1 Processor -- start 2023-10-06T03:05:29.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.100+0000 7f6ec66ac700 1 -- start start 2023-10-06T03:05:29.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.100+0000 7f6ec66ac700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ec00af320 0x7f6ec016a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:29.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.100+0000 7f6ec66ac700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec00c8150 0x7f6ec00ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:29.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.100+0000 7f6ec66ac700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ec00cb880 0x7f6ec00ae370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:29.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.100+0000 7f6ec66ac700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec00b0c60 con 0x7f6ec00c8150 2023-10-06T03:05:29.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.100+0000 7f6ec66ac700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec016ae30 con 0x7f6ec00cb880 2023-10-06T03:05:29.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.100+0000 7f6ec66ac700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec0169ce0 con 0x7f6ec00af320 2023-10-06T03:05:29.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.100+0000 7f6ebf7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec00c8150 0x7f6ec00ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:29.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.100+0000 7f6ebf7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec00c8150 0x7f6ec00ade30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50474/0 (socket says 172.21.15.125:50474) 2023-10-06T03:05:29.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.100+0000 7f6ebf7fe700 1 -- 172.21.15.125:0/3187156761 learned_addr learned my addr 172.21.15.125:0/3187156761 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:29.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.101+0000 7f6ec4c49700 1 --2- 172.21.15.125:0/3187156761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ec00cb880 0x7f6ec00ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:29.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.101+0000 7f6ebffff700 1 --2- 172.21.15.125:0/3187156761 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ec00af320 0x7f6ec016a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:29.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.101+0000 7f6ebf7fe700 1 -- 172.21.15.125:0/3187156761 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ec00af320 msgr2=0x7f6ec016a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:29.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.101+0000 7f6ebf7fe700 1 --2- 172.21.15.125:0/3187156761 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ec00af320 0x7f6ec016a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:29.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.101+0000 7f6ebf7fe700 1 -- 172.21.15.125:0/3187156761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ec00cb880 msgr2=0x7f6ec00ae370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:29.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.101+0000 7f6ebf7fe700 1 --2- 172.21.15.125:0/3187156761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ec00cb880 0x7f6ec00ae370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:29.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.101+0000 7f6ebf7fe700 1 -- 172.21.15.125:0/3187156761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb00094f0 con 0x7f6ec00c8150 2023-10-06T03:05:29.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.101+0000 7f6ebf7fe700 1 --2- 172.21.15.125:0/3187156761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec00c8150 0x7f6ec00ade30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6ec006df40 tx=0x7f6eb0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:29.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.101+0000 7f6ea7fff700 1 -- 172.21.15.125:0/3187156761 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb0024440 con 0x7f6ec00c8150 2023-10-06T03:05:29.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.101+0000 7f6ea7fff700 1 -- 172.21.15.125:0/3187156761 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb00245c0 con 0x7f6ec00c8150 2023-10-06T03:05:29.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.101+0000 7f6ea7fff700 1 -- 172.21.15.125:0/3187156761 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb0024980 con 0x7f6ec00c8150 2023-10-06T03:05:29.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.101+0000 7f6ec66ac700 1 -- 172.21.15.125:0/3187156761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec0169fc0 con 0x7f6ec00c8150 2023-10-06T03:05:29.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.101+0000 7f6ec66ac700 1 -- 172.21.15.125:0/3187156761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec016a580 con 0x7f6ec00c8150 2023-10-06T03:05:29.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.102+0000 7f6ec66ac700 1 -- 172.21.15.125:0/3187156761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec016a710 con 0x7f6ec00c8150 2023-10-06T03:05:29.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.103+0000 7f6ea7fff700 1 -- 172.21.15.125:0/3187156761 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6eb001a420 con 0x7f6ec00c8150 2023-10-06T03:05:29.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.103+0000 7f6ea7fff700 1 --2- 172.21.15.125:0/3187156761 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6eac066f30 0x7f6eac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:29.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.103+0000 7f6ea7fff700 1 -- 172.21.15.125:0/3187156761 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f6eb00863e0 con 0x7f6ec00c8150 2023-10-06T03:05:29.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.103+0000 7f6ebffff700 1 --2- 172.21.15.125:0/3187156761 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6eac066f30 0x7f6eac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:29.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.103+0000 7f6ebffff700 1 --2- 172.21.15.125:0/3187156761 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6eac066f30 0x7f6eac0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4006aa0 tx=0x7f6eb4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:29.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.107+0000 7f6ea7fff700 1 -- 172.21.15.125:0/3187156761 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6eb0053590 con 0x7f6ec00c8150 2023-10-06T03:05:29.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.293+0000 7f6ec66ac700 1 -- 172.21.15.125:0/3187156761 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6ec00b0e10 con 0x7f6ec00c8150 2023-10-06T03:05:29.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.960+0000 7f6ea7fff700 1 -- 172.21.15.125:0/3187156761 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6ec00b0e10 con 0x7f6ec00c8150 2023-10-06T03:05:29.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.964+0000 7f6ec66ac700 1 -- 172.21.15.125:0/3187156761 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6eac066f30 msgr2=0x7f6eac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:29.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.964+0000 7f6ec66ac700 1 --2- 172.21.15.125:0/3187156761 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6eac066f30 0x7f6eac0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4006aa0 tx=0x7f6eb4008040 comp rx=0 tx=0).stop 2023-10-06T03:05:29.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.964+0000 7f6ec66ac700 1 -- 172.21.15.125:0/3187156761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec00c8150 msgr2=0x7f6ec00ade30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:29.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.964+0000 7f6ec66ac700 1 --2- 172.21.15.125:0/3187156761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec00c8150 0x7f6ec00ade30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6ec006df40 tx=0x7f6eb0017000 comp rx=0 tx=0).stop 2023-10-06T03:05:29.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.964+0000 7f6ec66ac700 1 -- 172.21.15.125:0/3187156761 shutdown_connections 2023-10-06T03:05:29.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.964+0000 7f6ec66ac700 1 --2- 172.21.15.125:0/3187156761 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6eac066f30 0x7f6eac0693e0 secure :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6eb4006aa0 tx=0x7f6eb4008040 comp rx=0 tx=0).stop 2023-10-06T03:05:29.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.964+0000 7f6ec66ac700 1 --2- 172.21.15.125:0/3187156761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ec00cb880 0x7f6ec00ae370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:29.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.964+0000 7f6ec66ac700 1 --2- 172.21.15.125:0/3187156761 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ec00af320 0x7f6ec016a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:29.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.964+0000 7f6ec66ac700 1 --2- 172.21.15.125:0/3187156761 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ec00c8150 0x7f6ec00ade30 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:29.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.964+0000 7f6ec66ac700 1 -- 172.21.15.125:0/3187156761 >> 172.21.15.125:0/3187156761 conn(0x7f6ec0096120 msgr2=0x7f6ec00c2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:29.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.966+0000 7f6ec66ac700 1 -- 172.21.15.125:0/3187156761 shutdown_connections 2023-10-06T03:05:29.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:29.966+0000 7f6ec66ac700 1 -- 172.21.15.125:0/3187156761 wait complete. 2023-10-06T03:05:29.971 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data' created 2023-10-06T03:05:29.988 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:05:30.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.107+0000 7f66ce75f700 1 Processor -- start 2023-10-06T03:05:30.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.107+0000 7f66ce75f700 1 -- start start 2023-10-06T03:05:30.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.108+0000 7f66ce75f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f66c8067610 0x7f66c80b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:30.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.108+0000 7f66ce75f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66c8068ba0 0x7f66c80cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:30.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.108+0000 7f66ce75f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66c80ca670 con 0x7f66c815cb00 2023-10-06T03:05:30.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.108+0000 7f66ce75f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66c8068320 con 0x7f66c8067610 2023-10-06T03:05:30.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.108+0000 7f66ce75f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c8067a80 con 0x7f66c8068ba0 2023-10-06T03:05:30.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.108+0000 7f66c77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f66c8067610 0x7f66c80b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:30.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.108+0000 7f66c77fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f66c8067610 0x7f66c80b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50478/0 (socket says 172.21.15.125:50478) 2023-10-06T03:05:30.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.108+0000 7f66c77fe700 1 -- 172.21.15.125:0/233657886 learned_addr learned my addr 172.21.15.125:0/233657886 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:30.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.108+0000 7f66c7fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f66c815cb00 0x7f66c8068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40076/0 (socket says 172.21.15.125:40076) 2023-10-06T03:05:30.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.108+0000 7f66c77fe700 1 -- 172.21.15.125:0/233657886 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66c8068ba0 msgr2=0x7f66c80cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:30.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.108+0000 7f66cccfc700 1 --2- 172.21.15.125:0/233657886 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66c8068ba0 0x7f66c80cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:30.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.108+0000 7f66c77fe700 1 --2- 172.21.15.125:0/233657886 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66c8068ba0 0x7f66c80cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:30.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.108+0000 7f66c77fe700 1 -- 172.21.15.125:0/233657886 >> v1:172.21.15.125:6789/0 conn(0x7f66c815cb00 legacy=0x7f66c8068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:30.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.108+0000 7f66c6ffd700 1 -- 172.21.15.125:0/233657886 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1317658773 0 0) 0x7f66c80ca670 con 0x7f66c815cb00 2023-10-06T03:05:30.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.108+0000 7f66c77fe700 1 -- 172.21.15.125:0/233657886 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c8067d60 con 0x7f66c8067610 2023-10-06T03:05:30.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.108+0000 7f66cccfc700 1 --2- 172.21.15.125:0/233657886 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66c8068ba0 0x7f66c80cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:30.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.108+0000 7f66c77fe700 1 --2- 172.21.15.125:0/233657886 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66c8067610 0x7f66c80b0240 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f66b80099b0 tx=0x7f66b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d0c1483f42c339 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:30.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.108+0000 7f66c6ffd700 1 -- 172.21.15.125:0/233657886 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b800b860 con 0x7f66c8067610 2023-10-06T03:05:30.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.109+0000 7f66c6ffd700 1 -- 172.21.15.125:0/233657886 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b800b9c0 con 0x7f66c8067610 2023-10-06T03:05:30.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.109+0000 7f66c6ffd700 1 -- 172.21.15.125:0/233657886 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b800bd60 con 0x7f66c8067610 2023-10-06T03:05:30.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.109+0000 7f66ce75f700 1 -- 172.21.15.125:0/233657886 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66c8067610 msgr2=0x7f66c80b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:30.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.109+0000 7f66ce75f700 1 --2- 172.21.15.125:0/233657886 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66c8067610 0x7f66c80b0240 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f66b80099b0 tx=0x7f66b8009250 comp rx=0 tx=0).stop 2023-10-06T03:05:30.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.109+0000 7f66ce75f700 1 -- 172.21.15.125:0/233657886 shutdown_connections 2023-10-06T03:05:30.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.109+0000 7f66ce75f700 1 --2- 172.21.15.125:0/233657886 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66c8068ba0 0x7f66c80cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:30.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.109+0000 7f66ce75f700 1 --2- 172.21.15.125:0/233657886 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66c8067610 0x7f66c80b0240 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:30.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.109+0000 7f66ce75f700 1 -- 172.21.15.125:0/233657886 >> 172.21.15.125:0/233657886 conn(0x7f66c80af730 msgr2=0x7f66c80afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:30.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.109+0000 7f66ce75f700 1 -- 172.21.15.125:0/233657886 shutdown_connections 2023-10-06T03:05:30.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.109+0000 7f66ce75f700 1 -- 172.21.15.125:0/233657886 wait complete. 2023-10-06T03:05:30.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.110+0000 7f66ce75f700 1 Processor -- start 2023-10-06T03:05:30.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.110+0000 7f66ce75f700 1 -- start start 2023-10-06T03:05:30.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.111+0000 7f66ce75f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66c8067610 0x7f66c8156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:30.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.111+0000 7f66ce75f700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66c8068ba0 0x7f66c815b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:30.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.111+0000 7f66ce75f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66c815cb00 0x7f66c815d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:30.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.111+0000 7f66ce75f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c815be70 con 0x7f66c815cb00 2023-10-06T03:05:30.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.111+0000 7f66ce75f700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66c815c150 con 0x7f66c8068ba0 2023-10-06T03:05:30.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.111+0000 7f66ce75f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66c80c7dc0 con 0x7f66c8067610 2023-10-06T03:05:30.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.111+0000 7f66cccfc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66c815cb00 0x7f66c815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:30.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.111+0000 7f66cccfc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66c815cb00 0x7f66c815d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50482/0 (socket says 172.21.15.125:50482) 2023-10-06T03:05:30.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.111+0000 7f66cccfc700 1 -- 172.21.15.125:0/2353889466 learned_addr learned my addr 172.21.15.125:0/2353889466 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:30.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.111+0000 7f66c7fff700 1 --2- 172.21.15.125:0/2353889466 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66c8067610 0x7f66c8156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:30.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.111+0000 7f66c77fe700 1 --2- 172.21.15.125:0/2353889466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66c8068ba0 0x7f66c815b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:30.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.111+0000 7f66cccfc700 1 -- 172.21.15.125:0/2353889466 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66c8067610 msgr2=0x7f66c8156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:30.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.111+0000 7f66cccfc700 1 --2- 172.21.15.125:0/2353889466 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66c8067610 0x7f66c8156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:30.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.111+0000 7f66cccfc700 1 -- 172.21.15.125:0/2353889466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66c8068ba0 msgr2=0x7f66c815b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:30.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.111+0000 7f66cccfc700 1 --2- 172.21.15.125:0/2353889466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66c8068ba0 0x7f66c815b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:30.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.112+0000 7f66cccfc700 1 -- 172.21.15.125:0/2353889466 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b80094f0 con 0x7f66c815cb00 2023-10-06T03:05:30.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.112+0000 7f66c77fe700 1 --2- 172.21.15.125:0/2353889466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66c8068ba0 0x7f66c815b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:30.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.112+0000 7f66cccfc700 1 --2- 172.21.15.125:0/2353889466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66c815cb00 0x7f66c815d870 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f66c000a380 tx=0x7f66c0007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:30.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.112+0000 7f66bffff700 1 -- 172.21.15.125:0/2353889466 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c000ae10 con 0x7f66c815cb00 2023-10-06T03:05:30.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.112+0000 7f66bffff700 1 -- 172.21.15.125:0/2353889466 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c000d650 con 0x7f66c815cb00 2023-10-06T03:05:30.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.112+0000 7f66ce75f700 1 -- 172.21.15.125:0/2353889466 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66c80c80a0 con 0x7f66c815cb00 2023-10-06T03:05:30.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.112+0000 7f66bffff700 1 -- 172.21.15.125:0/2353889466 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c000da10 con 0x7f66c815cb00 2023-10-06T03:05:30.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.112+0000 7f66ce75f700 1 -- 172.21.15.125:0/2353889466 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c8156a80 con 0x7f66c815cb00 2023-10-06T03:05:30.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.113+0000 7f66ce75f700 1 -- 172.21.15.125:0/2353889466 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66c80c82e0 con 0x7f66c815cb00 2023-10-06T03:05:30.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.113+0000 7f66bffff700 1 -- 172.21.15.125:0/2353889466 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f66c001e3b0 con 0x7f66c815cb00 2023-10-06T03:05:30.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.114+0000 7f66bffff700 1 --2- 172.21.15.125:0/2353889466 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f66a8066f30 0x7f66a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:30.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.114+0000 7f66bffff700 1 -- 172.21.15.125:0/2353889466 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6278+0+0 (secure 0 0 0) 0x7f66c0085260 con 0x7f66c815cb00 2023-10-06T03:05:30.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.114+0000 7f66c7fff700 1 --2- 172.21.15.125:0/2353889466 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f66a8066f30 0x7f66a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:30.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.114+0000 7f66c7fff700 1 --2- 172.21.15.125:0/2353889466 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f66a8066f30 0x7f66a80693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f66b00012a0 tx=0x7f66b0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:30.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.118+0000 7f66bffff700 1 -- 172.21.15.125:0/2353889466 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66c80c82e0 con 0x7f66c815cb00 2023-10-06T03:05:30.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:30.344+0000 7f66ce75f700 1 -- 172.21.15.125:0/2353889466 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f66c80c82e0 con 0x7f66c815cb00 2023-10-06T03:05:31.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.245+0000 7f66bffff700 1 -- 172.21.15.125:0/2353889466 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f66c80c82e0 con 0x7f66c815cb00 2023-10-06T03:05:31.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.251+0000 7f66ce75f700 1 -- 172.21.15.125:0/2353889466 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f66a8066f30 msgr2=0x7f66a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:31.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.251+0000 7f66ce75f700 1 --2- 172.21.15.125:0/2353889466 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f66a8066f30 0x7f66a80693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f66b00012a0 tx=0x7f66b0009040 comp rx=0 tx=0).stop 2023-10-06T03:05:31.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.251+0000 7f66ce75f700 1 -- 172.21.15.125:0/2353889466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66c815cb00 msgr2=0x7f66c815d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:31.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.251+0000 7f66ce75f700 1 --2- 172.21.15.125:0/2353889466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66c815cb00 0x7f66c815d870 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f66c000a380 tx=0x7f66c0007900 comp rx=0 tx=0).stop 2023-10-06T03:05:31.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.251+0000 7f66ce75f700 1 -- 172.21.15.125:0/2353889466 shutdown_connections 2023-10-06T03:05:31.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.251+0000 7f66ce75f700 1 --2- 172.21.15.125:0/2353889466 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f66a8066f30 0x7f66a80693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.251+0000 7f66ce75f700 1 --2- 172.21.15.125:0/2353889466 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f66c815cb00 0x7f66c815d870 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.251+0000 7f66ce75f700 1 --2- 172.21.15.125:0/2353889466 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f66c8067610 0x7f66c8156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.251+0000 7f66ce75f700 1 --2- 172.21.15.125:0/2353889466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f66c8068ba0 0x7f66c815b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.251+0000 7f66ce75f700 1 -- 172.21.15.125:0/2353889466 >> 172.21.15.125:0/2353889466 conn(0x7f66c80af730 msgr2=0x7f66c806bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:31.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.251+0000 7f66ce75f700 1 -- 172.21.15.125:0/2353889466 shutdown_connections 2023-10-06T03:05:31.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.251+0000 7f66ce75f700 1 -- 172.21.15.125:0/2353889466 wait complete. 2023-10-06T03:05:31.254 INFO:teuthology.orchestra.run.smithi125.stderr:new fs with metadata pool 6 and data pool 7 2023-10-06T03:05:31.269 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:05:31.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f02221d9700 1 Processor -- start 2023-10-06T03:05:31.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f02221d9700 1 -- start start 2023-10-06T03:05:31.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f02221d9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f021c159720 0x7f021c0684f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:31.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f02221d9700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f021c067610 0x7f021c0c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:31.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f02221d9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c068d80 con 0x7f021c159350 2023-10-06T03:05:31.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f02221d9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c0af8a0 con 0x7f021c159720 2023-10-06T03:05:31.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f02221d9700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0cb420 con 0x7f021c067610 2023-10-06T03:05:31.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f021affd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f021c159720 0x7f021c0684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:31.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f021b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f021c159350 0x7f021c0a88a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40078/0 (socket says 172.21.15.125:40078) 2023-10-06T03:05:31.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f021b7fe700 1 -- 172.21.15.125:0/4035483946 learned_addr learned my addr 172.21.15.125:0/4035483946 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:31.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f021bfff700 1 --2- 172.21.15.125:0/4035483946 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f021c067610 0x7f021c0c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:31.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f021affd700 1 -- 172.21.15.125:0/4035483946 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f021c067610 msgr2=0x7f021c0c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:31.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f021affd700 1 --2- 172.21.15.125:0/4035483946 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f021c067610 0x7f021c0c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f021affd700 1 -- 172.21.15.125:0/4035483946 >> v1:172.21.15.125:6789/0 conn(0x7f021c159350 legacy=0x7f021c0a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:31.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f021a7fc700 1 -- 172.21.15.125:0/4035483946 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652330454 0 0) 0x7f021c068d80 con 0x7f021c159350 2023-10-06T03:05:31.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f021affd700 1 -- 172.21.15.125:0/4035483946 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0caaf0 con 0x7f021c159720 2023-10-06T03:05:31.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f021affd700 1 --2- 172.21.15.125:0/4035483946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f021c159720 0x7f021c0684f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f02100098e0 tx=0x7f02100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e92feaceed17c34 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:31.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f021a7fc700 1 -- 172.21.15.125:0/4035483946 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0210009e80 con 0x7f021c159720 2023-10-06T03:05:31.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f021a7fc700 1 -- 172.21.15.125:0/4035483946 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021000b860 con 0x7f021c159720 2023-10-06T03:05:31.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.392+0000 7f021a7fc700 1 -- 172.21.15.125:0/4035483946 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021000bbe0 con 0x7f021c159720 2023-10-06T03:05:31.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.393+0000 7f02221d9700 1 -- 172.21.15.125:0/4035483946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f021c159720 msgr2=0x7f021c0684f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:31.396 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.393+0000 7f02221d9700 1 --2- 172.21.15.125:0/4035483946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f021c159720 0x7f021c0684f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f02100098e0 tx=0x7f02100091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.393+0000 7f02221d9700 1 -- 172.21.15.125:0/4035483946 shutdown_connections 2023-10-06T03:05:31.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.393+0000 7f02221d9700 1 --2- 172.21.15.125:0/4035483946 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f021c067610 0x7f021c0c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.393+0000 7f02221d9700 1 --2- 172.21.15.125:0/4035483946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f021c159720 0x7f021c0684f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.393+0000 7f02221d9700 1 -- 172.21.15.125:0/4035483946 >> 172.21.15.125:0/4035483946 conn(0x7f021c06b190 msgr2=0x7f021c06b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:31.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.393+0000 7f02221d9700 1 -- 172.21.15.125:0/4035483946 shutdown_connections 2023-10-06T03:05:31.397 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.393+0000 7f02221d9700 1 -- 172.21.15.125:0/4035483946 wait complete. 2023-10-06T03:05:31.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.394+0000 7f02221d9700 1 Processor -- start 2023-10-06T03:05:31.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.394+0000 7f02221d9700 1 -- start start 2023-10-06T03:05:31.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f02221d9700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f021c067610 0x7f021c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:31.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f02221d9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f021c159350 0x7f021c0ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:31.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f02221d9700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f021c159720 0x7f021c0c6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:31.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f02221d9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0b2270 con 0x7f021c159350 2023-10-06T03:05:31.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f02221d9700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0b14f0 con 0x7f021c067610 2023-10-06T03:05:31.400 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f02221d9700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0b24c0 con 0x7f021c159720 2023-10-06T03:05:31.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f021affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f021c159350 0x7f021c0ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:31.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f021affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f021c159350 0x7f021c0ab8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50498/0 (socket says 172.21.15.125:50498) 2023-10-06T03:05:31.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f021affd700 1 -- 172.21.15.125:0/2726105035 learned_addr learned my addr 172.21.15.125:0/2726105035 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:31.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f021b7fe700 1 --2- 172.21.15.125:0/2726105035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f021c067610 0x7f021c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:31.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f021bfff700 1 --2- 172.21.15.125:0/2726105035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f021c159720 0x7f021c0c6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:31.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f021affd700 1 -- 172.21.15.125:0/2726105035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f021c159720 msgr2=0x7f021c0c6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:31.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f021affd700 1 --2- 172.21.15.125:0/2726105035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f021c159720 0x7f021c0c6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f021affd700 1 -- 172.21.15.125:0/2726105035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f021c067610 msgr2=0x7f021c1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:31.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f021affd700 1 --2- 172.21.15.125:0/2726105035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f021c067610 0x7f021c1568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f021affd700 1 -- 172.21.15.125:0/2726105035 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0210009420 con 0x7f021c159350 2023-10-06T03:05:31.401 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f021b7fe700 1 --2- 172.21.15.125:0/2726105035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f021c067610 0x7f021c1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:31.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f021bfff700 1 --2- 172.21.15.125:0/2726105035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f021c159720 0x7f021c0c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:31.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f021affd700 1 --2- 172.21.15.125:0/2726105035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f021c159350 0x7f021c0ab8b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f021c06a550 tx=0x7f0210017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:31.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f02037fe700 1 -- 172.21.15.125:0/2726105035 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021001f070 con 0x7f021c159350 2023-10-06T03:05:31.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.395+0000 7f02037fe700 1 -- 172.21.15.125:0/2726105035 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0210000bc0 con 0x7f021c159350 2023-10-06T03:05:31.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.396+0000 7f02221d9700 1 -- 172.21.15.125:0/2726105035 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c0b27a0 con 0x7f021c159350 2023-10-06T03:05:31.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.396+0000 7f02037fe700 1 -- 172.21.15.125:0/2726105035 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0210025420 con 0x7f021c159350 2023-10-06T03:05:31.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.396+0000 7f02221d9700 1 -- 172.21.15.125:0/2726105035 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c14cdb0 con 0x7f021c159350 2023-10-06T03:05:31.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.397+0000 7f02221d9700 1 -- 172.21.15.125:0/2726105035 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021c066510 con 0x7f021c159350 2023-10-06T03:05:31.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.397+0000 7f02037fe700 1 -- 172.21.15.125:0/2726105035 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0210023070 con 0x7f021c159350 2023-10-06T03:05:31.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.397+0000 7f02037fe700 1 --2- 172.21.15.125:0/2726105035 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0208066f30 0x7f02080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:31.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.397+0000 7f02037fe700 1 -- 172.21.15.125:0/2726105035 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0210085c80 con 0x7f021c159350 2023-10-06T03:05:31.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.397+0000 7f021b7fe700 1 --2- 172.21.15.125:0/2726105035 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0208066f30 0x7f02080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:31.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.398+0000 7f021b7fe700 1 --2- 172.21.15.125:0/2726105035 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0208066f30 0x7f02080693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f020c0018d0 tx=0x7f020c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:31.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.402+0000 7f02037fe700 1 -- 172.21.15.125:0/2726105035 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0210052c50 con 0x7f021c159350 2023-10-06T03:05:31.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.586+0000 7f02221d9700 1 -- 172.21.15.125:0/2726105035 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f021c0cadd0 con 0x7f021c159350 2023-10-06T03:05:31.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.587+0000 7f02037fe700 1 -- 172.21.15.125:0/2726105035 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17228 (secure 0 0 0) 0x7f0210056270 con 0x7f021c159350 2023-10-06T03:05:31.588 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:31.589 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":40,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:05:30.345688+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:05:28.440579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T03:05:29.311703+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:05:31.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.590+0000 7f02221d9700 1 -- 172.21.15.125:0/2726105035 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0208066f30 msgr2=0x7f02080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:31.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.590+0000 7f02221d9700 1 --2- 172.21.15.125:0/2726105035 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0208066f30 0x7f02080693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f020c0018d0 tx=0x7f020c009040 comp rx=0 tx=0).stop 2023-10-06T03:05:31.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.590+0000 7f02221d9700 1 -- 172.21.15.125:0/2726105035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f021c159350 msgr2=0x7f021c0ab8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:31.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.590+0000 7f02221d9700 1 --2- 172.21.15.125:0/2726105035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f021c159350 0x7f021c0ab8b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f021c06a550 tx=0x7f0210017000 comp rx=0 tx=0).stop 2023-10-06T03:05:31.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.590+0000 7f02221d9700 1 -- 172.21.15.125:0/2726105035 shutdown_connections 2023-10-06T03:05:31.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.590+0000 7f02221d9700 1 --2- 172.21.15.125:0/2726105035 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0208066f30 0x7f02080693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.590+0000 7f02221d9700 1 --2- 172.21.15.125:0/2726105035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f021c159720 0x7f021c0c6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.590+0000 7f02221d9700 1 --2- 172.21.15.125:0/2726105035 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f021c067610 0x7f021c1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.590+0000 7f02221d9700 1 --2- 172.21.15.125:0/2726105035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f021c159350 0x7f021c0ab8b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.590+0000 7f02221d9700 1 -- 172.21.15.125:0/2726105035 >> 172.21.15.125:0/2726105035 conn(0x7f021c06b190 msgr2=0x7f021c0ab020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:31.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.590+0000 7f02221d9700 1 -- 172.21.15.125:0/2726105035 shutdown_connections 2023-10-06T03:05:31.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.590+0000 7f02221d9700 1 -- 172.21.15.125:0/2726105035 wait complete. 2023-10-06T03:05:31.602 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:05:31.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.719+0000 7fcf5611d700 1 Processor -- start 2023-10-06T03:05:31.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.719+0000 7fcf5611d700 1 -- start start 2023-10-06T03:05:31.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.720+0000 7fcf5611d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf500cbb10 0x7fcf50156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:31.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.720+0000 7fcf5611d700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcf500c9a60 0x7fcf500c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:31.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.720+0000 7fcf5611d700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf500c8720 con 0x7fcf50155d90 2023-10-06T03:05:31.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.720+0000 7fcf5611d700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf500c8990 con 0x7fcf500c9a60 2023-10-06T03:05:31.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.720+0000 7fcf5611d700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500c8c70 con 0x7fcf500cbb10 2023-10-06T03:05:31.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.720+0000 7fcf4effd700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf500cbb10 0x7fcf50156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:31.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.720+0000 7fcf4ffff700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcf500c9a60 0x7fcf500c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:31.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.720+0000 7fcf4effd700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf500cbb10 0x7fcf50156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:37762/0 (socket says 172.21.15.125:37762) 2023-10-06T03:05:31.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.720+0000 7fcf4effd700 1 -- 172.21.15.125:0/4146659390 learned_addr learned my addr 172.21.15.125:0/4146659390 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:31.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.721+0000 7fcf4effd700 1 -- 172.21.15.125:0/4146659390 >> v2:172.21.15.130:3300/0 conn(0x7fcf500c9a60 msgr2=0x7fcf500c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:31.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.721+0000 7fcf4effd700 1 --2- 172.21.15.125:0/4146659390 >> v2:172.21.15.130:3300/0 conn(0x7fcf500c9a60 0x7fcf500c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.721+0000 7fcf4effd700 1 -- 172.21.15.125:0/4146659390 >> v1:172.21.15.130:6789/0 conn(0x7fcf50155d90 legacy=0x7fcf500cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:31.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.721+0000 7fcf4effd700 1 -- 172.21.15.125:0/4146659390 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf500c8f50 con 0x7fcf500cbb10 2023-10-06T03:05:31.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.721+0000 7fcf4ffff700 1 --2- 172.21.15.125:0/4146659390 >> v2:172.21.15.130:3300/0 conn(0x7fcf500c9a60 0x7fcf500c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:05:31.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.721+0000 7fcf4effd700 1 --2- 172.21.15.125:0/4146659390 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf500cbb10 0x7fcf50156160 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcf380099b0 tx=0x7fcf38009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f30ca5a1be175f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:31.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.721+0000 7fcf4e7fc700 1 -- 172.21.15.125:0/4146659390 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf38009ea0 con 0x7fcf500cbb10 2023-10-06T03:05:31.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.721+0000 7fcf4e7fc700 1 -- 172.21.15.125:0/4146659390 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3800b860 con 0x7fcf500cbb10 2023-10-06T03:05:31.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.721+0000 7fcf4e7fc700 1 -- 172.21.15.125:0/4146659390 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3800bc00 con 0x7fcf500cbb10 2023-10-06T03:05:31.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.721+0000 7fcf5611d700 1 -- 172.21.15.125:0/4146659390 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf500cbb10 msgr2=0x7fcf50156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:31.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.721+0000 7fcf5611d700 1 --2- 172.21.15.125:0/4146659390 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf500cbb10 0x7fcf50156160 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcf380099b0 tx=0x7fcf38009250 comp rx=0 tx=0).stop 2023-10-06T03:05:31.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.721+0000 7fcf5611d700 1 -- 172.21.15.125:0/4146659390 shutdown_connections 2023-10-06T03:05:31.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.722+0000 7fcf5611d700 1 --2- 172.21.15.125:0/4146659390 >> v2:172.21.15.130:3300/0 conn(0x7fcf500c9a60 0x7fcf500c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.722+0000 7fcf5611d700 1 --2- 172.21.15.125:0/4146659390 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf500cbb10 0x7fcf50156160 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.722+0000 7fcf5611d700 1 -- 172.21.15.125:0/4146659390 >> 172.21.15.125:0/4146659390 conn(0x7fcf500961a0 msgr2=0x7fcf50068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:31.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.722+0000 7fcf5611d700 1 -- 172.21.15.125:0/4146659390 shutdown_connections 2023-10-06T03:05:31.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.722+0000 7fcf5611d700 1 -- 172.21.15.125:0/4146659390 wait complete. 2023-10-06T03:05:31.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.723+0000 7fcf5611d700 1 Processor -- start 2023-10-06T03:05:31.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.723+0000 7fcf5611d700 1 -- start start 2023-10-06T03:05:31.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf5611d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf500c9a60 0x7fcf5014f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:31.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf5611d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf500cbb10 0x7fcf5006c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:31.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf5611d700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf50155d90 0x7fcf5006c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:31.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf5611d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf500c60c0 con 0x7fcf500cbb10 2023-10-06T03:05:31.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf5611d700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf501694b0 con 0x7fcf50155d90 2023-10-06T03:05:31.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf5611d700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf50153820 con 0x7fcf500c9a60 2023-10-06T03:05:31.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf4effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf500cbb10 0x7fcf5006c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:31.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf4effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf500cbb10 0x7fcf5006c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50506/0 (socket says 172.21.15.125:50506) 2023-10-06T03:05:31.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf4effd700 1 -- 172.21.15.125:0/840930244 learned_addr learned my addr 172.21.15.125:0/840930244 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:31.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf4f7fe700 1 --2- 172.21.15.125:0/840930244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf500c9a60 0x7fcf5014f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:31.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf4ffff700 1 --2- 172.21.15.125:0/840930244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf50155d90 0x7fcf5006c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:31.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf4effd700 1 -- 172.21.15.125:0/840930244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf500c9a60 msgr2=0x7fcf5014f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:31.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf4effd700 1 --2- 172.21.15.125:0/840930244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf500c9a60 0x7fcf5014f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf4effd700 1 -- 172.21.15.125:0/840930244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf50155d90 msgr2=0x7fcf5006c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:31.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf4effd700 1 --2- 172.21.15.125:0/840930244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf50155d90 0x7fcf5006c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf4effd700 1 -- 172.21.15.125:0/840930244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf48009a20 con 0x7fcf500cbb10 2023-10-06T03:05:31.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf4effd700 1 --2- 172.21.15.125:0/840930244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf500cbb10 0x7fcf5006c290 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcf500c8db0 tx=0x7fcf38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:31.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf477fe700 1 -- 172.21.15.125:0/840930244 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3800bbe0 con 0x7fcf500cbb10 2023-10-06T03:05:31.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf477fe700 1 -- 172.21.15.125:0/840930244 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf38011420 con 0x7fcf500cbb10 2023-10-06T03:05:31.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf5611d700 1 -- 172.21.15.125:0/840930244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf380094f0 con 0x7fcf500cbb10 2023-10-06T03:05:31.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf477fe700 1 -- 172.21.15.125:0/840930244 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf380117c0 con 0x7fcf500cbb10 2023-10-06T03:05:31.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.724+0000 7fcf5611d700 1 -- 172.21.15.125:0/840930244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf50153de0 con 0x7fcf500cbb10 2023-10-06T03:05:31.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.725+0000 7fcf5611d700 1 -- 172.21.15.125:0/840930244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf50169650 con 0x7fcf500cbb10 2023-10-06T03:05:31.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.726+0000 7fcf477fe700 1 -- 172.21.15.125:0/840930244 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf38011b70 con 0x7fcf500cbb10 2023-10-06T03:05:31.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.726+0000 7fcf477fe700 1 --2- 172.21.15.125:0/840930244 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcf30066f30 0x7fcf300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:31.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.726+0000 7fcf4f7fe700 1 --2- 172.21.15.125:0/840930244 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcf30066f30 0x7fcf300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:31.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.726+0000 7fcf477fe700 1 -- 172.21.15.125:0/840930244 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fcf38086190 con 0x7fcf500cbb10 2023-10-06T03:05:31.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.727+0000 7fcf4f7fe700 1 --2- 172.21.15.125:0/840930244 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcf30066f30 0x7fcf300693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcf40000c00 tx=0x7fcf40009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:31.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.731+0000 7fcf477fe700 1 -- 172.21.15.125:0/840930244 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf50169650 con 0x7fcf500cbb10 2023-10-06T03:05:31.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.913+0000 7fcf5611d700 1 -- 172.21.15.125:0/840930244 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf50169650 con 0x7fcf500cbb10 2023-10-06T03:05:31.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.913+0000 7fcf477fe700 1 -- 172.21.15.125:0/840930244 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+17228 (secure 0 0 0) 0x7fcf50169650 con 0x7fcf500cbb10 2023-10-06T03:05:31.915 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:31.915 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":40,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:05:30.345688+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:05:28.440579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T03:05:29.311703+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:05:31.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.916+0000 7fcf5611d700 1 -- 172.21.15.125:0/840930244 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcf30066f30 msgr2=0x7fcf300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:31.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.916+0000 7fcf5611d700 1 --2- 172.21.15.125:0/840930244 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcf30066f30 0x7fcf300693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcf40000c00 tx=0x7fcf40009040 comp rx=0 tx=0).stop 2023-10-06T03:05:31.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.916+0000 7fcf5611d700 1 -- 172.21.15.125:0/840930244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf500cbb10 msgr2=0x7fcf5006c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:31.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.916+0000 7fcf5611d700 1 --2- 172.21.15.125:0/840930244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf500cbb10 0x7fcf5006c290 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcf500c8db0 tx=0x7fcf38017000 comp rx=0 tx=0).stop 2023-10-06T03:05:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.916+0000 7fcf5611d700 1 -- 172.21.15.125:0/840930244 shutdown_connections 2023-10-06T03:05:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.916+0000 7fcf5611d700 1 --2- 172.21.15.125:0/840930244 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcf30066f30 0x7fcf300693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.916+0000 7fcf5611d700 1 --2- 172.21.15.125:0/840930244 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf50155d90 0x7fcf5006c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.916+0000 7fcf5611d700 1 --2- 172.21.15.125:0/840930244 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcf500c9a60 0x7fcf5014f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.916+0000 7fcf5611d700 1 --2- 172.21.15.125:0/840930244 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcf500cbb10 0x7fcf5006c290 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.916+0000 7fcf5611d700 1 -- 172.21.15.125:0/840930244 >> 172.21.15.125:0/840930244 conn(0x7fcf500961a0 msgr2=0x7fcf50151540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.916+0000 7fcf5611d700 1 -- 172.21.15.125:0/840930244 shutdown_connections 2023-10-06T03:05:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:31.916+0000 7fcf5611d700 1 -- 172.21.15.125:0/840930244 wait complete. 2023-10-06T03:05:31.929 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:05:32.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.050+0000 7fd17bbd3700 1 Processor -- start 2023-10-06T03:05:32.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.051+0000 7fd17bbd3700 1 -- start start 2023-10-06T03:05:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.051+0000 7fd17bbd3700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1740cba50 0x7fd1740c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.051+0000 7fd17bbd3700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd1740c8150 0x7fd1740c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.051+0000 7fd17bbd3700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1740c9470 con 0x7fd1740af320 2023-10-06T03:05:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.051+0000 7fd17bbd3700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1740c9b40 con 0x7fd1740c8150 2023-10-06T03:05:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.051+0000 7fd17bbd3700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1740c85a0 con 0x7fd1740cba50 2023-10-06T03:05:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.052+0000 7fd17916e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1740cba50 0x7fd1740c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:32.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.052+0000 7fd17a170700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd1740c8150 0x7fd1740c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.052+0000 7fd17996f700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fd1740af320 0x7fd1740cb340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:54962/0 (socket says 172.21.15.125:54962) 2023-10-06T03:05:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.052+0000 7fd17996f700 1 -- 172.21.15.125:0/3477938438 learned_addr learned my addr 172.21.15.125:0/3477938438 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.052+0000 7fd17916e700 1 -- 172.21.15.125:0/3477938438 >> v2:172.21.15.130:3300/0 conn(0x7fd1740c8150 msgr2=0x7fd1740c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.052+0000 7fd17916e700 1 --2- 172.21.15.125:0/3477938438 >> v2:172.21.15.130:3300/0 conn(0x7fd1740c8150 0x7fd1740c1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.052+0000 7fd17916e700 1 -- 172.21.15.125:0/3477938438 >> v1:172.21.15.130:6789/0 conn(0x7fd1740af320 legacy=0x7fd1740cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.052+0000 7fd17916e700 1 -- 172.21.15.125:0/3477938438 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1740c8860 con 0x7fd1740cba50 2023-10-06T03:05:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.052+0000 7fd17a170700 1 --2- 172.21.15.125:0/3477938438 >> v2:172.21.15.130:3300/0 conn(0x7fd1740c8150 0x7fd1740c1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:05:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.052+0000 7fd17916e700 1 --2- 172.21.15.125:0/3477938438 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1740cba50 0x7fd1740c7c10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd1700098e0 tx=0x7fd1700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c51704b740145c8d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.052+0000 7fd17896d700 1 -- 172.21.15.125:0/3477938438 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17000b640 con 0x7fd1740cba50 2023-10-06T03:05:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.052+0000 7fd17896d700 1 -- 172.21.15.125:0/3477938438 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17000b7a0 con 0x7fd1740cba50 2023-10-06T03:05:32.055 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.052+0000 7fd17896d700 1 -- 172.21.15.125:0/3477938438 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17000bb40 con 0x7fd1740cba50 2023-10-06T03:05:32.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.053+0000 7fd17bbd3700 1 -- 172.21.15.125:0/3477938438 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1740cba50 msgr2=0x7fd1740c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:32.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.053+0000 7fd17bbd3700 1 --2- 172.21.15.125:0/3477938438 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1740cba50 0x7fd1740c7c10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd1700098e0 tx=0x7fd1700091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:32.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.053+0000 7fd17bbd3700 1 -- 172.21.15.125:0/3477938438 shutdown_connections 2023-10-06T03:05:32.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.053+0000 7fd17bbd3700 1 --2- 172.21.15.125:0/3477938438 >> v2:172.21.15.130:3300/0 conn(0x7fd1740c8150 0x7fd1740c1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:32.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.053+0000 7fd17bbd3700 1 --2- 172.21.15.125:0/3477938438 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1740cba50 0x7fd1740c7c10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:32.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.053+0000 7fd17bbd3700 1 -- 172.21.15.125:0/3477938438 >> 172.21.15.125:0/3477938438 conn(0x7fd174096120 msgr2=0x7fd174068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:32.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.053+0000 7fd17bbd3700 1 -- 172.21.15.125:0/3477938438 shutdown_connections 2023-10-06T03:05:32.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.053+0000 7fd17bbd3700 1 -- 172.21.15.125:0/3477938438 wait complete. 2023-10-06T03:05:32.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.054+0000 7fd17bbd3700 1 Processor -- start 2023-10-06T03:05:32.059 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.054+0000 7fd17bbd3700 1 -- start start 2023-10-06T03:05:32.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.055+0000 7fd17bbd3700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1740af320 0x7fd1741586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:32.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.055+0000 7fd17bbd3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1740c8150 0x7fd174168290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:32.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.055+0000 7fd17bbd3700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1740cba50 0x7fd174153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:32.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.055+0000 7fd17bbd3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1741687d0 con 0x7fd1740c8150 2023-10-06T03:05:32.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.055+0000 7fd17bbd3700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd174158dc0 con 0x7fd1740cba50 2023-10-06T03:05:32.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.055+0000 7fd17bbd3700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1741590a0 con 0x7fd1740af320 2023-10-06T03:05:32.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.055+0000 7fd17916e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1740c8150 0x7fd174168290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:32.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.055+0000 7fd17916e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1740c8150 0x7fd174168290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50518/0 (socket says 172.21.15.125:50518) 2023-10-06T03:05:32.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.055+0000 7fd17916e700 1 -- 172.21.15.125:0/1520036283 learned_addr learned my addr 172.21.15.125:0/1520036283 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:32.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.055+0000 7fd17996f700 1 --2- 172.21.15.125:0/1520036283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1740af320 0x7fd1741586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:32.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.055+0000 7fd17a170700 1 --2- 172.21.15.125:0/1520036283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1740cba50 0x7fd174153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:32.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.055+0000 7fd17916e700 1 -- 172.21.15.125:0/1520036283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1740af320 msgr2=0x7fd1741586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:32.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.055+0000 7fd17916e700 1 --2- 172.21.15.125:0/1520036283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1740af320 0x7fd1741586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:32.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.055+0000 7fd17916e700 1 -- 172.21.15.125:0/1520036283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1740cba50 msgr2=0x7fd174153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:32.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.055+0000 7fd17916e700 1 --2- 172.21.15.125:0/1520036283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1740cba50 0x7fd174153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:32.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.055+0000 7fd17916e700 1 -- 172.21.15.125:0/1520036283 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16c009a20 con 0x7fd1740c8150 2023-10-06T03:05:32.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.055+0000 7fd17916e700 1 --2- 172.21.15.125:0/1520036283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1740c8150 0x7fd174168290 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd17000a010 tx=0x7fd170017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:32.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.055+0000 7fd169ffb700 1 -- 172.21.15.125:0/1520036283 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17001f070 con 0x7fd1740c8150 2023-10-06T03:05:32.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.056+0000 7fd169ffb700 1 -- 172.21.15.125:0/1520036283 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17001aa00 con 0x7fd1740c8150 2023-10-06T03:05:32.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.056+0000 7fd17bbd3700 1 -- 172.21.15.125:0/1520036283 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd170009420 con 0x7fd1740c8150 2023-10-06T03:05:32.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.056+0000 7fd169ffb700 1 -- 172.21.15.125:0/1520036283 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17001ada0 con 0x7fd1740c8150 2023-10-06T03:05:32.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.056+0000 7fd17bbd3700 1 -- 172.21.15.125:0/1520036283 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd174159660 con 0x7fd1740c8150 2023-10-06T03:05:32.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.057+0000 7fd17bbd3700 1 -- 172.21.15.125:0/1520036283 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd174066510 con 0x7fd1740c8150 2023-10-06T03:05:32.061 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.057+0000 7fd169ffb700 1 -- 172.21.15.125:0/1520036283 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd170023070 con 0x7fd1740c8150 2023-10-06T03:05:32.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.057+0000 7fd169ffb700 1 --2- 172.21.15.125:0/1520036283 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd158066f30 0x7fd1580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:32.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.057+0000 7fd169ffb700 1 -- 172.21.15.125:0/1520036283 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd170085730 con 0x7fd1740c8150 2023-10-06T03:05:32.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.057+0000 7fd17996f700 1 --2- 172.21.15.125:0/1520036283 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd158066f30 0x7fd1580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:32.062 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.058+0000 7fd17996f700 1 --2- 172.21.15.125:0/1520036283 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd158066f30 0x7fd1580693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd1740c36f0 tx=0x7fd164009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:32.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.062+0000 7fd169ffb700 1 -- 172.21.15.125:0/1520036283 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1700527c0 con 0x7fd1740c8150 2023-10-06T03:05:32.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:32.289+0000 7fd17bbd3700 1 -- 172.21.15.125:0/1520036283 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd1740c8b40 con 0x7fd1740c8150 2023-10-06T03:05:33.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.261+0000 7fd169ffb700 1 -- 172.21.15.125:0/1520036283 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd170055de0 con 0x7fd1740c8150 2023-10-06T03:05:33.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.264+0000 7fd17bbd3700 1 -- 172.21.15.125:0/1520036283 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd158066f30 msgr2=0x7fd1580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:33.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.264+0000 7fd17bbd3700 1 --2- 172.21.15.125:0/1520036283 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd158066f30 0x7fd1580693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd1740c36f0 tx=0x7fd164009040 comp rx=0 tx=0).stop 2023-10-06T03:05:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.264+0000 7fd17bbd3700 1 -- 172.21.15.125:0/1520036283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1740c8150 msgr2=0x7fd174168290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.264+0000 7fd17bbd3700 1 --2- 172.21.15.125:0/1520036283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1740c8150 0x7fd174168290 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd17000a010 tx=0x7fd170017000 comp rx=0 tx=0).stop 2023-10-06T03:05:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.264+0000 7fd17bbd3700 1 -- 172.21.15.125:0/1520036283 shutdown_connections 2023-10-06T03:05:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.264+0000 7fd17bbd3700 1 --2- 172.21.15.125:0/1520036283 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd158066f30 0x7fd1580693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.264+0000 7fd17bbd3700 1 --2- 172.21.15.125:0/1520036283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1740cba50 0x7fd174153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.264+0000 7fd17bbd3700 1 --2- 172.21.15.125:0/1520036283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd1740af320 0x7fd1741586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.264+0000 7fd17bbd3700 1 --2- 172.21.15.125:0/1520036283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd1740c8150 0x7fd174168290 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.264+0000 7fd17bbd3700 1 -- 172.21.15.125:0/1520036283 >> 172.21.15.125:0/1520036283 conn(0x7fd174096120 msgr2=0x7fd1741568e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.264+0000 7fd17bbd3700 1 -- 172.21.15.125:0/1520036283 shutdown_connections 2023-10-06T03:05:33.265 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.264+0000 7fd17bbd3700 1 -- 172.21.15.125:0/1520036283 wait complete. 2023-10-06T03:05:33.279 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:05:33.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.404+0000 7f4fcc4e9700 1 Processor -- start 2023-10-06T03:05:33.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.404+0000 7f4fcc4e9700 1 -- start start 2023-10-06T03:05:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.405+0000 7f4fcc4e9700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4fc40b0240 0x7f4fc40cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.405+0000 7f4fcc4e9700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4fc40c6eb0 0x7f4fc40cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:33.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.405+0000 7f4fcc4e9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc40cc2e0 con 0x7f4fc41574b0 2023-10-06T03:05:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.405+0000 7f4fcc4e9700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc40c7f70 con 0x7f4fc40b0240 2023-10-06T03:05:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.405+0000 7f4fcc4e9700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc40c8210 con 0x7f4fc40c6eb0 2023-10-06T03:05:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fca285700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4fc41574b0 0x7f4fc4067610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40094/0 (socket says 172.21.15.125:40094) 2023-10-06T03:05:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fca285700 1 -- 172.21.15.125:0/1759332363 learned_addr learned my addr 172.21.15.125:0/1759332363 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fc9a84700 1 --2- 172.21.15.125:0/1759332363 >> v2:172.21.15.130:3300/0 conn(0x7f4fc40b0240 0x7f4fc40cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fcaa86700 1 --2- 172.21.15.125:0/1759332363 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4fc40c6eb0 0x7f4fc40cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fc9283700 1 -- 172.21.15.125:0/1759332363 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059449866 0 0) 0x7f4fc40cc2e0 con 0x7f4fc41574b0 2023-10-06T03:05:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fc9283700 1 -- 172.21.15.125:0/1759332363 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fb0003570 con 0x7f4fc41574b0 2023-10-06T03:05:33.413 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fc9283700 1 -- 172.21.15.125:0/1759332363 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 312813039 0 0) 0x7f4fb0003570 con 0x7f4fc41574b0 2023-10-06T03:05:33.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fc9283700 1 -- 172.21.15.125:0/1759332363 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4fc40c6eb0 msgr2=0x7f4fc40cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:33.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fc9283700 1 --2- 172.21.15.125:0/1759332363 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4fc40c6eb0 0x7f4fc40cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:33.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fc9283700 1 -- 172.21.15.125:0/1759332363 >> v2:172.21.15.130:3300/0 conn(0x7f4fc40b0240 msgr2=0x7f4fc40cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:33.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fc9283700 1 --2- 172.21.15.125:0/1759332363 >> v2:172.21.15.130:3300/0 conn(0x7f4fc40b0240 0x7f4fc40cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:33.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fc9283700 1 -- 172.21.15.125:0/1759332363 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc40c8b00 con 0x7f4fc41574b0 2023-10-06T03:05:33.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fc9283700 1 -- 172.21.15.125:0/1759332363 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f4fb40015f0 con 0x7f4fc41574b0 2023-10-06T03:05:33.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fcaa86700 1 --2- 172.21.15.125:0/1759332363 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4fc40c6eb0 0x7f4fc40cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:05:33.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fc9283700 1 -- 172.21.15.125:0/1759332363 >> v1:172.21.15.125:6789/0 conn(0x7f4fc41574b0 legacy=0x7f4fc4067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:33.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fc9283700 1 --2- 172.21.15.125:0/1759332363 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4fc40c6eb0 0x7f4fb0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:33.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fc9283700 1 --2- 172.21.15.125:0/1759332363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb0003fa0 0x7f4fb0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:33.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fc9283700 1 --2- 172.21.15.125:0/1759332363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fb0004d50 0x7f4fb00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:33.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fc9283700 1 -- 172.21.15.125:0/1759332363 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc40c7f70 con 0x7f4fb0004d50 2023-10-06T03:05:33.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fc9283700 1 -- 172.21.15.125:0/1759332363 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc40c8210 con 0x7f4fb0003fa0 2023-10-06T03:05:33.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fc9283700 1 -- 172.21.15.125:0/1759332363 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb000ba60 con 0x7f4fc40c6eb0 2023-10-06T03:05:33.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fc9a84700 1 --2- 172.21.15.125:0/1759332363 >> v2:172.21.15.130:3300/0 conn(0x7f4fc40b0240 0x7f4fc40cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:05:33.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fcaa86700 1 --2- 172.21.15.125:0/1759332363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fb0004d50 0x7f4fb00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:33.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fca285700 1 --2- 172.21.15.125:0/1759332363 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4fc40c6eb0 0x7f4fb0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:33.415 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.406+0000 7f4fc9a84700 1 --2- 172.21.15.125:0/1759332363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb0003fa0 0x7f4fb0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.407+0000 7f4fcaa86700 1 -- 172.21.15.125:0/1759332363 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4fc40c6eb0 msgr2=0x7f4fb0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.407+0000 7f4fcaa86700 1 --2- 172.21.15.125:0/1759332363 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4fc40c6eb0 0x7f4fb0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.407+0000 7f4fcaa86700 1 -- 172.21.15.125:0/1759332363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb0003fa0 msgr2=0x7f4fb0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.407+0000 7f4fcaa86700 1 --2- 172.21.15.125:0/1759332363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb0003fa0 0x7f4fb0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:33.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.407+0000 7f4fcaa86700 1 -- 172.21.15.125:0/1759332363 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc009a20 con 0x7f4fb0004d50 2023-10-06T03:05:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.407+0000 7f4fc9a84700 1 --2- 172.21.15.125:0/1759332363 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb0003fa0 0x7f4fb0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.407+0000 7f4fcaa86700 1 --2- 172.21.15.125:0/1759332363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fb0004d50 0x7f4fb00051c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00e3c0 tx=0x7f4fbc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfc0d5f91b45c1c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.407+0000 7f4fc9283700 1 -- 172.21.15.125:0/1759332363 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc009c50 con 0x7f4fb0004d50 2023-10-06T03:05:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.407+0000 7f4fc9283700 1 -- 172.21.15.125:0/1759332363 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fbc00f040 con 0x7f4fb0004d50 2023-10-06T03:05:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.407+0000 7f4fc9283700 1 -- 172.21.15.125:0/1759332363 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc00eea0 con 0x7f4fb0004d50 2023-10-06T03:05:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.407+0000 7f4fcc4e9700 1 -- 172.21.15.125:0/1759332363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fb0004d50 msgr2=0x7f4fb00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:33.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.407+0000 7f4fcc4e9700 1 --2- 172.21.15.125:0/1759332363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fb0004d50 0x7f4fb00051c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc00e3c0 tx=0x7f4fbc00b040 comp rx=0 tx=0).stop 2023-10-06T03:05:33.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.407+0000 7f4fcaa86700 1 -- 172.21.15.125:0/1759332363 reap_dead start 2023-10-06T03:05:33.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.407+0000 7f4fcc4e9700 1 -- 172.21.15.125:0/1759332363 shutdown_connections 2023-10-06T03:05:33.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.407+0000 7f4fcc4e9700 1 -- 172.21.15.125:0/1759332363 >> 172.21.15.125:0/1759332363 conn(0x7f4fc40af730 msgr2=0x7f4fc40afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:33.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.407+0000 7f4fcc4e9700 1 -- 172.21.15.125:0/1759332363 shutdown_connections 2023-10-06T03:05:33.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.408+0000 7f4fcc4e9700 1 -- 172.21.15.125:0/1759332363 wait complete. 2023-10-06T03:05:33.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.409+0000 7f4fcc4e9700 1 Processor -- start 2023-10-06T03:05:33.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.409+0000 7f4fcc4e9700 1 -- start start 2023-10-06T03:05:33.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.409+0000 7f4fcc4e9700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb0004d50 0x7f4fc415c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:33.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.409+0000 7f4fcc4e9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fc406c0f0 0x7f4fc40684e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:33.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.409+0000 7f4fcc4e9700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4fc416c380 0x7f4fc416c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:33.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.409+0000 7f4fcc4e9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc414cde0 con 0x7f4fc406c0f0 2023-10-06T03:05:33.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.409+0000 7f4fcc4e9700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc414cff0 con 0x7f4fb0004d50 2023-10-06T03:05:33.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.409+0000 7f4fcc4e9700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc414d2d0 con 0x7f4fc416c380 2023-10-06T03:05:33.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.409+0000 7f4fc9a84700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fc406c0f0 0x7f4fc40684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:33.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.409+0000 7f4fc9a84700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fc406c0f0 0x7f4fc40684e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50540/0 (socket says 172.21.15.125:50540) 2023-10-06T03:05:33.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.409+0000 7f4fc9a84700 1 -- 172.21.15.125:0/3658296169 learned_addr learned my addr 172.21.15.125:0/3658296169 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:33.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.409+0000 7f4fca285700 1 --2- 172.21.15.125:0/3658296169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb0004d50 0x7f4fc415c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:33.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.409+0000 7f4fcaa86700 1 --2- 172.21.15.125:0/3658296169 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4fc416c380 0x7f4fc416c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:33.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.410+0000 7f4fc9a84700 1 -- 172.21.15.125:0/3658296169 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4fc416c380 msgr2=0x7f4fc416c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:33.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.410+0000 7f4fc9a84700 1 --2- 172.21.15.125:0/3658296169 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4fc416c380 0x7f4fc416c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:33.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.410+0000 7f4fc9a84700 1 -- 172.21.15.125:0/3658296169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb0004d50 msgr2=0x7f4fc415c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:33.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.410+0000 7f4fc9a84700 1 --2- 172.21.15.125:0/3658296169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb0004d50 0x7f4fc415c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:33.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.410+0000 7f4fc9a84700 1 -- 172.21.15.125:0/3658296169 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc414d5b0 con 0x7f4fc406c0f0 2023-10-06T03:05:33.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.410+0000 7f4fc9a84700 1 --2- 172.21.15.125:0/3658296169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fc406c0f0 0x7f4fc40684e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0011960 tx=0x7f4fc0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:33.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.410+0000 7f4fba7fc700 1 -- 172.21.15.125:0/3658296169 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0015740 con 0x7f4fc406c0f0 2023-10-06T03:05:33.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.410+0000 7f4fba7fc700 1 -- 172.21.15.125:0/3658296169 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc00158a0 con 0x7f4fc406c0f0 2023-10-06T03:05:33.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.410+0000 7f4fcc4e9700 1 -- 172.21.15.125:0/3658296169 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc414d890 con 0x7f4fc406c0f0 2023-10-06T03:05:33.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.410+0000 7f4fba7fc700 1 -- 172.21.15.125:0/3658296169 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0015c20 con 0x7f4fc406c0f0 2023-10-06T03:05:33.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.410+0000 7f4fcc4e9700 1 -- 172.21.15.125:0/3658296169 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc416cd30 con 0x7f4fc406c0f0 2023-10-06T03:05:33.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.411+0000 7f4fcc4e9700 1 -- 172.21.15.125:0/3658296169 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc414dc00 con 0x7f4fc406c0f0 2023-10-06T03:05:33.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.411+0000 7f4fba7fc700 1 -- 172.21.15.125:0/3658296169 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4fc0013620 con 0x7f4fc406c0f0 2023-10-06T03:05:33.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.412+0000 7f4fba7fc700 1 --2- 172.21.15.125:0/3658296169 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4fa8066f30 0x7f4fa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:33.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.412+0000 7f4fba7fc700 1 -- 172.21.15.125:0/3658296169 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4fc0084ff0 con 0x7f4fc406c0f0 2023-10-06T03:05:33.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.412+0000 7f4fca285700 1 --2- 172.21.15.125:0/3658296169 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4fa8066f30 0x7f4fa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:33.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.412+0000 7f4fca285700 1 --2- 172.21.15.125:0/3658296169 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4fa8066f30 0x7f4fa80693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4002eb0 tx=0x7f4fb4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:33.422 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.416+0000 7f4fba7fc700 1 -- 172.21.15.125:0/3658296169 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4fc0051fc0 con 0x7f4fc406c0f0 2023-10-06T03:05:33.639 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:33.638+0000 7f4fcc4e9700 1 -- 172.21.15.125:0/3658296169 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4fc4066510 con 0x7f4fc406c0f0 2023-10-06T03:05:34.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.265+0000 7f4fba7fc700 1 -- 172.21.15.125:0/3658296169 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4fc00555e0 con 0x7f4fc406c0f0 2023-10-06T03:05:34.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.268+0000 7f4fcc4e9700 1 -- 172.21.15.125:0/3658296169 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4fa8066f30 msgr2=0x7f4fa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:34.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.268+0000 7f4fcc4e9700 1 --2- 172.21.15.125:0/3658296169 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4fa8066f30 0x7f4fa80693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4fb4002eb0 tx=0x7f4fb4009040 comp rx=0 tx=0).stop 2023-10-06T03:05:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.268+0000 7f4fcc4e9700 1 -- 172.21.15.125:0/3658296169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fc406c0f0 msgr2=0x7f4fc40684e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.268+0000 7f4fcc4e9700 1 --2- 172.21.15.125:0/3658296169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fc406c0f0 0x7f4fc40684e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0011960 tx=0x7f4fc0008040 comp rx=0 tx=0).stop 2023-10-06T03:05:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.268+0000 7f4fcc4e9700 1 -- 172.21.15.125:0/3658296169 shutdown_connections 2023-10-06T03:05:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.268+0000 7f4fcc4e9700 1 --2- 172.21.15.125:0/3658296169 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4fa8066f30 0x7f4fa80693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.268+0000 7f4fcc4e9700 1 --2- 172.21.15.125:0/3658296169 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4fc416c380 0x7f4fc416c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.268+0000 7f4fcc4e9700 1 --2- 172.21.15.125:0/3658296169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fb0004d50 0x7f4fc415c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.268+0000 7f4fcc4e9700 1 --2- 172.21.15.125:0/3658296169 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4fc406c0f0 0x7f4fc40684e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.268+0000 7f4fcc4e9700 1 -- 172.21.15.125:0/3658296169 >> 172.21.15.125:0/3658296169 conn(0x7f4fc40af730 msgr2=0x7f4fc4155d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.268+0000 7f4fcc4e9700 1 -- 172.21.15.125:0/3658296169 shutdown_connections 2023-10-06T03:05:34.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.268+0000 7f4fcc4e9700 1 -- 172.21.15.125:0/3658296169 wait complete. 2023-10-06T03:05:34.282 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:05:34.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.402+0000 7fb8b98c9700 1 Processor -- start 2023-10-06T03:05:34.403 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.402+0000 7fb8b98c9700 1 -- start start 2023-10-06T03:05:34.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.403+0000 7fb8b98c9700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fb8b4067860 0x7fb8b40c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:34.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.403+0000 7fb8b98c9700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b415a340 con 0x7fb8b40c6940 2023-10-06T03:05:34.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.403+0000 7fb8b98c9700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b415a620 con 0x7fb8b4067c30 2023-10-06T03:05:34.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.403+0000 7fb8b98c9700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b415a900 con 0x7fb8b4067860 2023-10-06T03:05:34.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.403+0000 7fb8b37fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb8b40c6940 0x7fb8b40ace40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40106/0 (socket says 172.21.15.125:40106) 2023-10-06T03:05:34.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.403+0000 7fb8b37fe700 1 -- 172.21.15.125:0/1240619083 learned_addr learned my addr 172.21.15.125:0/1240619083 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:34.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b2ffd700 1 --2- 172.21.15.125:0/1240619083 >> v2:172.21.15.130:3300/0 conn(0x7fb8b4067860 0x7fb8b40c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:34.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b1ffb700 1 -- 172.21.15.125:0/1240619083 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2713746312 0 0) 0x7fb8b415a340 con 0x7fb8b40c6940 2023-10-06T03:05:34.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b1ffb700 1 -- 172.21.15.125:0/1240619083 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb89c003570 con 0x7fb8b40c6940 2023-10-06T03:05:34.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b1ffb700 1 -- 172.21.15.125:0/1240619083 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2250392843 0 0) 0x7fb89c003570 con 0x7fb8b40c6940 2023-10-06T03:05:34.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b1ffb700 1 -- 172.21.15.125:0/1240619083 >> v2:172.21.15.130:3300/0 conn(0x7fb8b4067860 msgr2=0x7fb8b40c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:34.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b1ffb700 1 --2- 172.21.15.125:0/1240619083 >> v2:172.21.15.130:3300/0 conn(0x7fb8b4067860 0x7fb8b40c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b1ffb700 1 -- 172.21.15.125:0/1240619083 >> v1:172.21.15.130:6789/0 conn(0x7fb8b4067c30 legacy=0x7fb8b4159b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:34.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b1ffb700 1 -- 172.21.15.125:0/1240619083 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b40c6420 con 0x7fb8b40c6940 2023-10-06T03:05:34.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b1ffb700 1 -- 172.21.15.125:0/1240619083 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7fb8ac0017f0 con 0x7fb8b40c6940 2023-10-06T03:05:34.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b1ffb700 1 -- 172.21.15.125:0/1240619083 >> v1:172.21.15.125:6789/0 conn(0x7fb8b40c6940 legacy=0x7fb8b40ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:34.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b1ffb700 1 --2- 172.21.15.125:0/1240619083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb89c003a60 0x7fb89c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:34.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b1ffb700 1 --2- 172.21.15.125:0/1240619083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb89c004810 0x7fb89c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:34.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b1ffb700 1 --2- 172.21.15.125:0/1240619083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb89c0051c0 0x7fb89c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:34.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b1ffb700 1 -- 172.21.15.125:0/1240619083 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b415a900 con 0x7fb89c003a60 2023-10-06T03:05:34.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b1ffb700 1 -- 172.21.15.125:0/1240619083 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c00c0d0 con 0x7fb89c0051c0 2023-10-06T03:05:34.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b1ffb700 1 -- 172.21.15.125:0/1240619083 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89c00c290 con 0x7fb89c004810 2023-10-06T03:05:34.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b2ffd700 1 --2- 172.21.15.125:0/1240619083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb89c003a60 0x7fb89c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:34.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b37fe700 1 --2- 172.21.15.125:0/1240619083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb89c0051c0 0x7fb89c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:34.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b27fc700 1 --2- 172.21.15.125:0/1240619083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb89c004810 0x7fb89c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:34.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b2ffd700 1 -- 172.21.15.125:0/1240619083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb89c004810 msgr2=0x7fb89c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:34.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b2ffd700 1 --2- 172.21.15.125:0/1240619083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb89c004810 0x7fb89c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b2ffd700 1 -- 172.21.15.125:0/1240619083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb89c0051c0 msgr2=0x7fb89c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:34.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b2ffd700 1 --2- 172.21.15.125:0/1240619083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb89c0051c0 0x7fb89c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b2ffd700 1 -- 172.21.15.125:0/1240619083 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c003570 con 0x7fb89c003a60 2023-10-06T03:05:34.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b27fc700 1 --2- 172.21.15.125:0/1240619083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb89c004810 0x7fb89c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:34.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b37fe700 1 --2- 172.21.15.125:0/1240619083 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb89c0051c0 0x7fb89c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:34.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.404+0000 7fb8b37fe700 1 -- 172.21.15.125:0/1240619083 reap_dead start 2023-10-06T03:05:34.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.405+0000 7fb8b2ffd700 1 --2- 172.21.15.125:0/1240619083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb89c003a60 0x7fb89c003e70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009c00 tx=0x7fb8a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=888cacc77518f05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:34.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.405+0000 7fb8b1ffb700 1 -- 172.21.15.125:0/1240619083 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a800e710 con 0x7fb89c003a60 2023-10-06T03:05:34.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.405+0000 7fb8b1ffb700 1 -- 172.21.15.125:0/1240619083 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a800e870 con 0x7fb89c003a60 2023-10-06T03:05:34.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.405+0000 7fb8b1ffb700 1 -- 172.21.15.125:0/1240619083 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a800ec30 con 0x7fb89c003a60 2023-10-06T03:05:34.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.405+0000 7fb8b98c9700 1 -- 172.21.15.125:0/1240619083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb89c003a60 msgr2=0x7fb89c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:34.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.405+0000 7fb8b98c9700 1 --2- 172.21.15.125:0/1240619083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb89c003a60 0x7fb89c003e70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009c00 tx=0x7fb8a80091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.405+0000 7fb8b98c9700 1 -- 172.21.15.125:0/1240619083 shutdown_connections 2023-10-06T03:05:34.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.405+0000 7fb8b98c9700 1 --2- 172.21.15.125:0/1240619083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb89c003a60 0x7fb89c003e70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.405+0000 7fb8b98c9700 1 -- 172.21.15.125:0/1240619083 >> 172.21.15.125:0/1240619083 conn(0x7fb8b40cbd00 msgr2=0x7fb8b40cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:34.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.405+0000 7fb8b98c9700 1 -- 172.21.15.125:0/1240619083 shutdown_connections 2023-10-06T03:05:34.411 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.405+0000 7fb8b98c9700 1 -- 172.21.15.125:0/1240619083 wait complete. 2023-10-06T03:05:34.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.406+0000 7fb8b98c9700 1 Processor -- start 2023-10-06T03:05:34.412 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.407+0000 7fb8b98c9700 1 -- start start 2023-10-06T03:05:34.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.407+0000 7fb8b98c9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb89c003a60 0x7fb8b4154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:34.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.407+0000 7fb8b98c9700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8b40c9830 0x7fb8b40c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:34.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.407+0000 7fb8b98c9700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8b40a99b0 0x7fb8b40a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:34.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.407+0000 7fb8b98c9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40ca1e0 con 0x7fb89c003a60 2023-10-06T03:05:34.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.407+0000 7fb8b98c9700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40aa690 con 0x7fb8b40c9830 2023-10-06T03:05:34.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.407+0000 7fb8b98c9700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b40aa970 con 0x7fb8b40a99b0 2023-10-06T03:05:34.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.407+0000 7fb8b2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb89c003a60 0x7fb8b4154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:34.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.407+0000 7fb8b2ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb89c003a60 0x7fb8b4154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50568/0 (socket says 172.21.15.125:50568) 2023-10-06T03:05:34.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.407+0000 7fb8b2ffd700 1 -- 172.21.15.125:0/3050094711 learned_addr learned my addr 172.21.15.125:0/3050094711 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:34.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.407+0000 7fb8b27fc700 1 --2- 172.21.15.125:0/3050094711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8b40c9830 0x7fb8b40c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:34.417 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.407+0000 7fb8b37fe700 1 --2- 172.21.15.125:0/3050094711 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8b40a99b0 0x7fb8b40a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:34.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.408+0000 7fb8b2ffd700 1 -- 172.21.15.125:0/3050094711 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8b40a99b0 msgr2=0x7fb8b40a9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:34.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.408+0000 7fb8b2ffd700 1 --2- 172.21.15.125:0/3050094711 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8b40a99b0 0x7fb8b40a9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.408+0000 7fb8b2ffd700 1 -- 172.21.15.125:0/3050094711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8b40c9830 msgr2=0x7fb8b40c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:34.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.408+0000 7fb8b2ffd700 1 --2- 172.21.15.125:0/3050094711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8b40c9830 0x7fb8b40c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.408+0000 7fb8b2ffd700 1 -- 172.21.15.125:0/3050094711 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b40aac50 con 0x7fb89c003a60 2023-10-06T03:05:34.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.408+0000 7fb8b27fc700 1 --2- 172.21.15.125:0/3050094711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8b40c9830 0x7fb8b40c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:34.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.408+0000 7fb8b2ffd700 1 --2- 172.21.15.125:0/3050094711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb89c003a60 0x7fb8b4154200 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00c0a0 tx=0x7fb8a801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:34.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.408+0000 7fb89affd700 1 -- 172.21.15.125:0/3050094711 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8022070 con 0x7fb89c003a60 2023-10-06T03:05:34.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.408+0000 7fb89affd700 1 -- 172.21.15.125:0/3050094711 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a800ebf0 con 0x7fb89c003a60 2023-10-06T03:05:34.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.408+0000 7fb89affd700 1 -- 172.21.15.125:0/3050094711 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a801c6a0 con 0x7fb89c003a60 2023-10-06T03:05:34.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.408+0000 7fb8b98c9700 1 -- 172.21.15.125:0/3050094711 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b40aaf30 con 0x7fb89c003a60 2023-10-06T03:05:34.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.408+0000 7fb8b98c9700 1 -- 172.21.15.125:0/3050094711 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b40aa390 con 0x7fb89c003a60 2023-10-06T03:05:34.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.409+0000 7fb8b98c9700 1 -- 172.21.15.125:0/3050094711 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b40ca1e0 con 0x7fb89c003a60 2023-10-06T03:05:34.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.409+0000 7fb89affd700 1 -- 172.21.15.125:0/3050094711 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8a801ca50 con 0x7fb89c003a60 2023-10-06T03:05:34.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.410+0000 7fb89affd700 1 --2- 172.21.15.125:0/3050094711 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb8a0066f30 0x7fb8a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:34.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.410+0000 7fb89affd700 1 -- 172.21.15.125:0/3050094711 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fb8a8085ed0 con 0x7fb89c003a60 2023-10-06T03:05:34.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.410+0000 7fb8b27fc700 1 --2- 172.21.15.125:0/3050094711 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb8a0066f30 0x7fb8a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:34.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.410+0000 7fb8b27fc700 1 --2- 172.21.15.125:0/3050094711 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb8a0066f30 0x7fb8a00693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4007bc0 tx=0x7fb8a4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:34.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.414+0000 7fb89affd700 1 -- 172.21.15.125:0/3050094711 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8a8052ea0 con 0x7fb89c003a60 2023-10-06T03:05:34.637 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.637+0000 7fb8b98c9700 1 -- 172.21.15.125:0/3050094711 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8b4066510 con 0x7fb89c003a60 2023-10-06T03:05:34.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.637+0000 7fb89affd700 1 -- 172.21.15.125:0/3050094711 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4609 (secure 0 0 0) 0x7fb8a802b020 con 0x7fb89c003a60 2023-10-06T03:05:34.638 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:34.638 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3042542444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3042542444},{"type":"v1","addr":"172.21.15.130:6835","nonce":3042542444}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2110429483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2110429483},{"type":"v1","addr":"172.21.15.130:6833","nonce":2110429483}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/1710838785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1710838785},{"type":"v1","addr":"172.21.15.125:6836","nonce":1710838785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:05:30.346007+0000","modified":"2023-10-06T03:05:34.259823+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5085":{"gid":5085,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.125:6837/4027450913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":4027450913},{"type":"v1","addr":"172.21.15.125:6837","nonce":4027450913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:05:34.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.639+0000 7fb8b98c9700 1 -- 172.21.15.125:0/3050094711 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb8a0066f30 msgr2=0x7fb8a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:34.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.639+0000 7fb8b98c9700 1 --2- 172.21.15.125:0/3050094711 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb8a0066f30 0x7fb8a00693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4007bc0 tx=0x7fb8a4009040 comp rx=0 tx=0).stop 2023-10-06T03:05:34.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.639+0000 7fb8b98c9700 1 -- 172.21.15.125:0/3050094711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb89c003a60 msgr2=0x7fb8b4154200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:34.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.639+0000 7fb8b98c9700 1 --2- 172.21.15.125:0/3050094711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb89c003a60 0x7fb8b4154200 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00c0a0 tx=0x7fb8a801a000 comp rx=0 tx=0).stop 2023-10-06T03:05:34.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.639+0000 7fb8b98c9700 1 -- 172.21.15.125:0/3050094711 shutdown_connections 2023-10-06T03:05:34.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.639+0000 7fb8b98c9700 1 --2- 172.21.15.125:0/3050094711 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb8a0066f30 0x7fb8a00693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.639+0000 7fb8b98c9700 1 --2- 172.21.15.125:0/3050094711 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb8b40a99b0 0x7fb8b40a9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.639+0000 7fb8b98c9700 1 --2- 172.21.15.125:0/3050094711 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb89c003a60 0x7fb8b4154200 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.639+0000 7fb8b98c9700 1 --2- 172.21.15.125:0/3050094711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8b40c9830 0x7fb8b40c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.639+0000 7fb8b98c9700 1 -- 172.21.15.125:0/3050094711 >> 172.21.15.125:0/3050094711 conn(0x7fb8b40cbd00 msgr2=0x7fb8b40adb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:34.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.639+0000 7fb8b98c9700 1 -- 172.21.15.125:0/3050094711 shutdown_connections 2023-10-06T03:05:34.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.639+0000 7fb8b98c9700 1 -- 172.21.15.125:0/3050094711 wait complete. 2023-10-06T03:05:34.641 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 18 2023-10-06T03:05:34.652 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:05:34.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.769+0000 7f5fb863f700 1 Processor -- start 2023-10-06T03:05:34.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.769+0000 7f5fb863f700 1 -- start start 2023-10-06T03:05:34.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.770+0000 7f5fb863f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5fb006ab10 0x7f5fb00c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:34.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.770+0000 7f5fb863f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5fb00ac670 0x7f5fb00c7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:34.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.770+0000 7f5fb863f700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb00c75c0 con 0x7f5fb006aee0 2023-10-06T03:05:34.772 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.770+0000 7f5fb863f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb0069110 con 0x7f5fb006ab10 2023-10-06T03:05:34.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.770+0000 7f5fb863f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb0067c70 con 0x7f5fb00ac670 2023-10-06T03:05:34.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.770+0000 7f5fb63db700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5fb006ab10 0x7f5fb00c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:34.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.770+0000 7f5fb63db700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5fb006ab10 0x7f5fb00c6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50576/0 (socket says 172.21.15.125:50576) 2023-10-06T03:05:34.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.770+0000 7f5fb63db700 1 -- 172.21.15.125:0/4058762802 learned_addr learned my addr 172.21.15.125:0/4058762802 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:34.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.771+0000 7f5fb5bda700 1 --2- 172.21.15.125:0/4058762802 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5fb00ac670 0x7f5fb00c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:34.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.771+0000 7f5fb63db700 1 -- 172.21.15.125:0/4058762802 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5fb00ac670 msgr2=0x7f5fb00c7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:34.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.771+0000 7f5fb63db700 1 --2- 172.21.15.125:0/4058762802 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5fb00ac670 0x7f5fb00c7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.771+0000 7f5fb63db700 1 -- 172.21.15.125:0/4058762802 >> v1:172.21.15.130:6789/0 conn(0x7f5fb006aee0 legacy=0x7f5fb0158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:34.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.771+0000 7f5fb63db700 1 -- 172.21.15.125:0/4058762802 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb00c7800 con 0x7f5fb006ab10 2023-10-06T03:05:34.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.771+0000 7f5fb5bda700 1 --2- 172.21.15.125:0/4058762802 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5fb00ac670 0x7f5fb00c7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:34.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.771+0000 7f5fb63db700 1 --2- 172.21.15.125:0/4058762802 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fb006ab10 0x7f5fb00c6b40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00099b0 tx=0x7f5fa0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9a60acba1b46a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.771+0000 7f5fb53d9700 1 -- 172.21.15.125:0/4058762802 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa000b820 con 0x7f5fb006ab10 2023-10-06T03:05:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.771+0000 7f5fb53d9700 1 -- 172.21.15.125:0/4058762802 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa000b980 con 0x7f5fb006ab10 2023-10-06T03:05:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.771+0000 7f5fb53d9700 1 -- 172.21.15.125:0/4058762802 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa000bd20 con 0x7f5fb006ab10 2023-10-06T03:05:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.771+0000 7f5fb863f700 1 -- 172.21.15.125:0/4058762802 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fb006ab10 msgr2=0x7f5fb00c6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.772+0000 7f5fb863f700 1 --2- 172.21.15.125:0/4058762802 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fb006ab10 0x7f5fb00c6b40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00099b0 tx=0x7f5fa0009250 comp rx=0 tx=0).stop 2023-10-06T03:05:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.772+0000 7f5fb863f700 1 -- 172.21.15.125:0/4058762802 shutdown_connections 2023-10-06T03:05:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.772+0000 7f5fb863f700 1 --2- 172.21.15.125:0/4058762802 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fb006ab10 0x7f5fb00c6b40 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.772+0000 7f5fb863f700 1 --2- 172.21.15.125:0/4058762802 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5fb00ac670 0x7f5fb00c7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.772+0000 7f5fb863f700 1 -- 172.21.15.125:0/4058762802 >> 172.21.15.125:0/4058762802 conn(0x7f5fb00cc5a0 msgr2=0x7f5fb00cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.772+0000 7f5fb863f700 1 -- 172.21.15.125:0/4058762802 shutdown_connections 2023-10-06T03:05:34.774 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.772+0000 7f5fb863f700 1 -- 172.21.15.125:0/4058762802 wait complete. 2023-10-06T03:05:34.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.773+0000 7f5fb863f700 1 Processor -- start 2023-10-06T03:05:34.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.773+0000 7f5fb863f700 1 -- start start 2023-10-06T03:05:34.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.773+0000 7f5fb863f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5fb006ab10 0x7f5fb00aa030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:34.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.773+0000 7f5fb863f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fb006aee0 0x7f5fb0152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:34.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.773+0000 7f5fb863f700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fb00ac670 0x7f5fb00c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:34.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.773+0000 7f5fb863f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00a8d40 con 0x7f5fb006aee0 2023-10-06T03:05:34.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.773+0000 7f5fb863f700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00a9ba0 con 0x7f5fb00ac670 2023-10-06T03:05:34.777 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.773+0000 7f5fb863f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00a8f90 con 0x7f5fb006ab10 2023-10-06T03:05:34.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.774+0000 7f5fb5bda700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fb006aee0 0x7f5fb0152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:34.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.774+0000 7f5fb5bda700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fb006aee0 0x7f5fb0152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50586/0 (socket says 172.21.15.125:50586) 2023-10-06T03:05:34.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.774+0000 7f5fb5bda700 1 -- 172.21.15.125:0/1350210377 learned_addr learned my addr 172.21.15.125:0/1350210377 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:34.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.774+0000 7f5fb63db700 1 --2- 172.21.15.125:0/1350210377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5fb006ab10 0x7f5fb00aa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:34.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.774+0000 7f5fb5bda700 1 -- 172.21.15.125:0/1350210377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5fb006ab10 msgr2=0x7f5fb00aa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:34.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.774+0000 7f5fb6bdc700 1 --2- 172.21.15.125:0/1350210377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fb00ac670 0x7f5fb00c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:34.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.774+0000 7f5fb5bda700 1 --2- 172.21.15.125:0/1350210377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5fb006ab10 0x7f5fb00aa030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.774+0000 7f5fb5bda700 1 -- 172.21.15.125:0/1350210377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fb00ac670 msgr2=0x7f5fb00c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:34.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.774+0000 7f5fb5bda700 1 --2- 172.21.15.125:0/1350210377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fb00ac670 0x7f5fb00c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.774+0000 7f5fb5bda700 1 -- 172.21.15.125:0/1350210377 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa00094f0 con 0x7f5fb006aee0 2023-10-06T03:05:34.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.774+0000 7f5fb63db700 1 --2- 172.21.15.125:0/1350210377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5fb006ab10 0x7f5fb00aa030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:34.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.774+0000 7f5fb6bdc700 1 --2- 172.21.15.125:0/1350210377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fb00ac670 0x7f5fb00c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:34.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.774+0000 7f5fb5bda700 1 --2- 172.21.15.125:0/1350210377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fb006aee0 0x7f5fb0152910 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00c880 tx=0x7f5fac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:34.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.774+0000 7f5fa67fc700 1 -- 172.21.15.125:0/1350210377 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac011600 con 0x7f5fb006aee0 2023-10-06T03:05:34.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.774+0000 7f5fa67fc700 1 -- 172.21.15.125:0/1350210377 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fac011760 con 0x7f5fb006aee0 2023-10-06T03:05:34.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.774+0000 7f5fb863f700 1 -- 172.21.15.125:0/1350210377 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb00a9270 con 0x7f5fb006aee0 2023-10-06T03:05:34.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.774+0000 7f5fa67fc700 1 -- 172.21.15.125:0/1350210377 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac011b00 con 0x7f5fb006aee0 2023-10-06T03:05:34.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.774+0000 7f5fb863f700 1 -- 172.21.15.125:0/1350210377 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb00a9830 con 0x7f5fb006aee0 2023-10-06T03:05:34.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.775+0000 7f5fb863f700 1 -- 172.21.15.125:0/1350210377 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb0066510 con 0x7f5fb006aee0 2023-10-06T03:05:34.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.776+0000 7f5fa67fc700 1 -- 172.21.15.125:0/1350210377 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5fac023480 con 0x7f5fb006aee0 2023-10-06T03:05:34.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.776+0000 7f5fa67fc700 1 --2- 172.21.15.125:0/1350210377 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5f94066f30 0x7f5f940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:34.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.776+0000 7f5fa67fc700 1 -- 172.21.15.125:0/1350210377 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5fac084c80 con 0x7f5fb006aee0 2023-10-06T03:05:34.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.776+0000 7f5fb63db700 1 --2- 172.21.15.125:0/1350210377 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5f94066f30 0x7f5f940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:34.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.777+0000 7f5fb63db700 1 --2- 172.21.15.125:0/1350210377 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5f94066f30 0x7f5f940693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00099b0 tx=0x7f5fa0016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:34.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.780+0000 7f5fa67fc700 1 -- 172.21.15.125:0/1350210377 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fac051bb0 con 0x7f5fb006aee0 2023-10-06T03:05:34.940 INFO:tasks.ceph.mds.a.smithi125.stderr:2023-10-06T03:05:34.940+0000 7f6bc6f07700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:05:34.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.964+0000 7f5fb863f700 1 -- 172.21.15.125:0/1350210377 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fb00c7ae0 con 0x7f5fb006aee0 2023-10-06T03:05:34.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.965+0000 7f5fa67fc700 1 -- 172.21.15.125:0/1350210377 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+17215 (secure 0 0 0) 0x7f5fac01e090 con 0x7f5fb006aee0 2023-10-06T03:05:34.966 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:34.966 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":41,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:05:31.961651+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:05:28.440579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T03:05:29.311703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:05:34.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.967+0000 7f5fb863f700 1 -- 172.21.15.125:0/1350210377 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5f94066f30 msgr2=0x7f5f940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:34.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.967+0000 7f5fb863f700 1 --2- 172.21.15.125:0/1350210377 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5f94066f30 0x7f5f940693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5fa00099b0 tx=0x7f5fa0016000 comp rx=0 tx=0).stop 2023-10-06T03:05:34.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.967+0000 7f5fb863f700 1 -- 172.21.15.125:0/1350210377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fb006aee0 msgr2=0x7f5fb0152910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:34.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.967+0000 7f5fb863f700 1 --2- 172.21.15.125:0/1350210377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fb006aee0 0x7f5fb0152910 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00c880 tx=0x7f5fac008040 comp rx=0 tx=0).stop 2023-10-06T03:05:34.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.967+0000 7f5fb863f700 1 -- 172.21.15.125:0/1350210377 shutdown_connections 2023-10-06T03:05:34.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.967+0000 7f5fb863f700 1 --2- 172.21.15.125:0/1350210377 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5f94066f30 0x7f5f940693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.967+0000 7f5fb863f700 1 --2- 172.21.15.125:0/1350210377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5fb00ac670 0x7f5fb00c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.967+0000 7f5fb863f700 1 --2- 172.21.15.125:0/1350210377 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5fb006ab10 0x7f5fb00aa030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.967+0000 7f5fb863f700 1 --2- 172.21.15.125:0/1350210377 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5fb006aee0 0x7f5fb0152910 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:34.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.967+0000 7f5fb863f700 1 -- 172.21.15.125:0/1350210377 >> 172.21.15.125:0/1350210377 conn(0x7f5fb00cc5a0 msgr2=0x7f5fb00c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:34.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.967+0000 7f5fb863f700 1 -- 172.21.15.125:0/1350210377 shutdown_connections 2023-10-06T03:05:34.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:34.967+0000 7f5fb863f700 1 -- 172.21.15.125:0/1350210377 wait complete. 2023-10-06T03:05:34.980 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:05:34.980 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:05:35.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.097+0000 7ffaab156700 1 Processor -- start 2023-10-06T03:05:35.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.097+0000 7ffaab156700 1 -- start start 2023-10-06T03:05:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.098+0000 7ffaab156700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffaa40cc4b0 0x7ffaa40c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.098+0000 7ffaab156700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ffaa40ce8a0 0x7ffaa40cc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.099+0000 7ffaab156700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa40c4230 con 0x7ffaa40ccdc0 2023-10-06T03:05:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.099+0000 7ffaab156700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa40cd290 con 0x7ffaa40ce8a0 2023-10-06T03:05:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.099+0000 7ffaab156700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40cd570 con 0x7ffaa40cc4b0 2023-10-06T03:05:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.099+0000 7ffaa8ef2700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffaa40cc4b0 0x7ffaa40c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.099+0000 7ffaa8ef2700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffaa40cc4b0 0x7ffaa40c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:37870/0 (socket says 172.21.15.125:37870) 2023-10-06T03:05:35.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.099+0000 7ffaa3fff700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ffaa40ce8a0 0x7ffaa40cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:35.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.099+0000 7ffaa8ef2700 1 -- 172.21.15.125:0/1491853088 learned_addr learned my addr 172.21.15.125:0/1491853088 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:35.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.099+0000 7ffaa96f3700 1 --1- 172.21.15.125:0/1491853088 >> v1:172.21.15.130:6789/0 conn(0x7ffaa40ccdc0 0x7ffaa4069510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:54988/0 (socket says 172.21.15.125:54988) 2023-10-06T03:05:35.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.099+0000 7ffaa37fe700 1 -- 172.21.15.125:0/1491853088 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574197287 0 0) 0x7ffaa40c4230 con 0x7ffaa40ccdc0 2023-10-06T03:05:35.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.099+0000 7ffaa8ef2700 1 -- 172.21.15.125:0/1491853088 >> v2:172.21.15.130:3300/0 conn(0x7ffaa40ce8a0 msgr2=0x7ffaa40cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:35.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.099+0000 7ffaa8ef2700 1 --2- 172.21.15.125:0/1491853088 >> v2:172.21.15.130:3300/0 conn(0x7ffaa40ce8a0 0x7ffaa40cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.099+0000 7ffaa8ef2700 1 -- 172.21.15.125:0/1491853088 >> v1:172.21.15.130:6789/0 conn(0x7ffaa40ccdc0 legacy=0x7ffaa4069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:35.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.099+0000 7ffaa8ef2700 1 -- 172.21.15.125:0/1491853088 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa40ca720 con 0x7ffaa40cc4b0 2023-10-06T03:05:35.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.099+0000 7ffaa8ef2700 1 --2- 172.21.15.125:0/1491853088 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffaa40cc4b0 0x7ffaa40c85c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009f20 tx=0x7ffa9c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91a818099ee63032 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:35.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.100+0000 7ffaa37fe700 1 -- 172.21.15.125:0/1491853088 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c00e070 con 0x7ffaa40cc4b0 2023-10-06T03:05:35.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.100+0000 7ffaa37fe700 1 -- 172.21.15.125:0/1491853088 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c00b9d0 con 0x7ffaa40cc4b0 2023-10-06T03:05:35.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.100+0000 7ffaa37fe700 1 -- 172.21.15.125:0/1491853088 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c0092e0 con 0x7ffaa40cc4b0 2023-10-06T03:05:35.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.100+0000 7ffaab156700 1 -- 172.21.15.125:0/1491853088 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffaa40cc4b0 msgr2=0x7ffaa40c85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.100+0000 7ffaab156700 1 --2- 172.21.15.125:0/1491853088 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffaa40cc4b0 0x7ffaa40c85c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009f20 tx=0x7ffa9c009840 comp rx=0 tx=0).stop 2023-10-06T03:05:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.100+0000 7ffaab156700 1 -- 172.21.15.125:0/1491853088 shutdown_connections 2023-10-06T03:05:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.100+0000 7ffaab156700 1 --2- 172.21.15.125:0/1491853088 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffaa40cc4b0 0x7ffaa40c85c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.100+0000 7ffaab156700 1 --2- 172.21.15.125:0/1491853088 >> v2:172.21.15.130:3300/0 conn(0x7ffaa40ce8a0 0x7ffaa40cc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.100+0000 7ffaab156700 1 -- 172.21.15.125:0/1491853088 >> 172.21.15.125:0/1491853088 conn(0x7ffaa4067df0 msgr2=0x7ffaa40cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.100+0000 7ffaab156700 1 -- 172.21.15.125:0/1491853088 shutdown_connections 2023-10-06T03:05:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.100+0000 7ffaab156700 1 -- 172.21.15.125:0/1491853088 wait complete. 2023-10-06T03:05:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.101+0000 7ffaab156700 1 Processor -- start 2023-10-06T03:05:35.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.101+0000 7ffaab156700 1 -- start start 2023-10-06T03:05:35.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.102+0000 7ffaab156700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffaa40cc4b0 0x7ffaa40b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:35.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.102+0000 7ffaab156700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffaa40ccdc0 0x7ffaa40b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:35.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.102+0000 7ffaab156700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaa40ce8a0 0x7ffaa4099960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:35.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.102+0000 7ffaab156700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa409ada0 con 0x7ffaa40ce8a0 2023-10-06T03:05:35.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.102+0000 7ffaab156700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40b28d0 con 0x7ffaa40ccdc0 2023-10-06T03:05:35.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.102+0000 7ffaab156700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40b2bb0 con 0x7ffaa40cc4b0 2023-10-06T03:05:35.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.102+0000 7ffaa96f3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaa40ce8a0 0x7ffaa4099960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:35.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.102+0000 7ffaa96f3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaa40ce8a0 0x7ffaa4099960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:50590/0 (socket says 172.21.15.125:50590) 2023-10-06T03:05:35.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.102+0000 7ffaa96f3700 1 -- 172.21.15.125:0/1486624175 learned_addr learned my addr 172.21.15.125:0/1486624175 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:35.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.103+0000 7ffaa8ef2700 1 --2- 172.21.15.125:0/1486624175 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffaa40cc4b0 0x7ffaa40b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:35.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.103+0000 7ffaa3fff700 1 --2- 172.21.15.125:0/1486624175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffaa40ccdc0 0x7ffaa40b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:35.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.103+0000 7ffaa96f3700 1 -- 172.21.15.125:0/1486624175 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffaa40cc4b0 msgr2=0x7ffaa40b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:35.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.103+0000 7ffaa96f3700 1 --2- 172.21.15.125:0/1486624175 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffaa40cc4b0 0x7ffaa40b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.103+0000 7ffaa96f3700 1 -- 172.21.15.125:0/1486624175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffaa40ccdc0 msgr2=0x7ffaa40b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:35.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.103+0000 7ffaa96f3700 1 --2- 172.21.15.125:0/1486624175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffaa40ccdc0 0x7ffaa40b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.103+0000 7ffaa96f3700 1 -- 172.21.15.125:0/1486624175 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9c009ae0 con 0x7ffaa40ce8a0 2023-10-06T03:05:35.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.103+0000 7ffaa96f3700 1 --2- 172.21.15.125:0/1486624175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaa40ce8a0 0x7ffaa4099960 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ffa94007fd0 tx=0x7ffa94007cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:35.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.103+0000 7ffaa0ff9700 1 -- 172.21.15.125:0/1486624175 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94005a70 con 0x7ffaa40ce8a0 2023-10-06T03:05:35.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.103+0000 7ffaa0ff9700 1 -- 172.21.15.125:0/1486624175 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa94005bd0 con 0x7ffaa40ce8a0 2023-10-06T03:05:35.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.103+0000 7ffaa0ff9700 1 -- 172.21.15.125:0/1486624175 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa940070d0 con 0x7ffaa40ce8a0 2023-10-06T03:05:35.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.103+0000 7ffaab156700 1 -- 172.21.15.125:0/1486624175 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa40b2e90 con 0x7ffaa40ce8a0 2023-10-06T03:05:35.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.103+0000 7ffaab156700 1 -- 172.21.15.125:0/1486624175 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa40b3450 con 0x7ffaa40ce8a0 2023-10-06T03:05:35.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.104+0000 7ffaab156700 1 -- 172.21.15.125:0/1486624175 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa40b3670 con 0x7ffaa40ce8a0 2023-10-06T03:05:35.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.104+0000 7ffaa0ff9700 1 -- 172.21.15.125:0/1486624175 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa94007480 con 0x7ffaa40ce8a0 2023-10-06T03:05:35.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.105+0000 7ffaa0ff9700 1 --2- 172.21.15.125:0/1486624175 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ffa90066f30 0x7ffa900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:35.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.105+0000 7ffaa0ff9700 1 -- 172.21.15.125:0/1486624175 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7ffa94083b50 con 0x7ffaa40ce8a0 2023-10-06T03:05:35.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.105+0000 7ffaa8ef2700 1 --2- 172.21.15.125:0/1486624175 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ffa90066f30 0x7ffa900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:35.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.105+0000 7ffaa8ef2700 1 --2- 172.21.15.125:0/1486624175 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ffa90066f30 0x7ffa900693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009880 tx=0x7ffa9c018000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:35.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.109+0000 7ffaa0ff9700 1 -- 172.21.15.125:0/1486624175 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa9404b5a0 con 0x7ffaa40ce8a0 2023-10-06T03:05:35.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.289+0000 7ffaab156700 1 -- 172.21.15.125:0/1486624175 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffaa4066510 con 0x7ffa90066f30 2023-10-06T03:05:35.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.297+0000 7ffaa0ff9700 1 -- 172.21.15.125:0/1486624175 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307384 (secure 0 0 0) 0x7ffaa4066510 con 0x7ffa90066f30 2023-10-06T03:05:35.305 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:35.311 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.301+0000 7ffaab156700 1 -- 172.21.15.125:0/1486624175 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ffa90066f30 msgr2=0x7ffa900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:35.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.301+0000 7ffaab156700 1 --2- 172.21.15.125:0/1486624175 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ffa90066f30 0x7ffa900693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c009880 tx=0x7ffa9c018000 comp rx=0 tx=0).stop 2023-10-06T03:05:35.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.301+0000 7ffaab156700 1 -- 172.21.15.125:0/1486624175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaa40ce8a0 msgr2=0x7ffaa4099960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:35.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.301+0000 7ffaab156700 1 --2- 172.21.15.125:0/1486624175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaa40ce8a0 0x7ffaa4099960 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ffa94007fd0 tx=0x7ffa94007cf0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.301+0000 7ffaab156700 1 -- 172.21.15.125:0/1486624175 shutdown_connections 2023-10-06T03:05:35.312 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.301+0000 7ffaab156700 1 --2- 172.21.15.125:0/1486624175 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ffa90066f30 0x7ffa900693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.301+0000 7ffaab156700 1 --2- 172.21.15.125:0/1486624175 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ffaa40ce8a0 0x7ffaa4099960 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.301+0000 7ffaab156700 1 --2- 172.21.15.125:0/1486624175 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ffaa40cc4b0 0x7ffaa40b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.301+0000 7ffaab156700 1 --2- 172.21.15.125:0/1486624175 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffaa40ccdc0 0x7ffaa40b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.301+0000 7ffaab156700 1 -- 172.21.15.125:0/1486624175 >> 172.21.15.125:0/1486624175 conn(0x7ffaa4067df0 msgr2=0x7ffaa40c9010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:35.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.301+0000 7ffaab156700 1 -- 172.21.15.125:0/1486624175 shutdown_connections 2023-10-06T03:05:35.314 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.301+0000 7ffaab156700 1 -- 172.21.15.125:0/1486624175 wait complete. 2023-10-06T03:05:35.314 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-06T03:05:35.315 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-10-06T03:05:33.820729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382968,"kb_used_data":4664,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591752,"statfs":{"total":773094113280,"available":770653954048,"internally_reserved":0,"allocated":4775936,"data_stored":2754565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.870379"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.977120+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:09.648317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965909+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:43.140690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.971367+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:55.892723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970103+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:40.458075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965533+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:40.458075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.964382+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:27.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.978584+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:01.791955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.971609+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:20.015541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970572+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.883295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972711+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:49.871669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970926+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:09.648317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965140+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:04.527321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968578+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:11:43.857971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968492+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:38.629349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965205+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:30.642665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968417+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:59.140697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972557+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:20.868524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.973518+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:08.111584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.969526+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:20.123410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.966794+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:02.178769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.963978+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:48.052762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968003+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:55.274836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967331+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:29.787384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967851+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:45.882319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.969585+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:40:02.105572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967366+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:25.832521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970990+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:40.812378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.966935+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:09.648317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967440+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:23.219456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970924+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:06.331617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.964783+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:01.960298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967824+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:46.506948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965273+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:40.459403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.973435+0000","last_change":"2023-10-06T03:05:29.973435+0000","last_active":"2023-10-06T03:05:29.973435+0000","last_peered":"2023-10-06T03:05:29.973435+0000","last_clean":"2023-10-06T03:05:29.973435+0000","last_became_active":"2023-10-06T03:05:29.973213+0000","last_became_peered":"2023-10-06T03:05:29.973213+0000","last_unstale":"2023-10-06T03:05:29.973435+0000","last_undegraded":"2023-10-06T03:05:29.973435+0000","last_fullsized":"2023-10-06T03:05:29.973435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:42.135044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970472+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:20.204857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.983368+0000","last_change":"2023-10-06T03:05:29.983368+0000","last_active":"2023-10-06T03:05:29.983368+0000","last_peered":"2023-10-06T03:05:29.983368+0000","last_clean":"2023-10-06T03:05:29.983368+0000","last_became_active":"2023-10-06T03:05:29.983086+0000","last_became_peered":"2023-10-06T03:05:29.983086+0000","last_unstale":"2023-10-06T03:05:29.983368+0000","last_undegraded":"2023-10-06T03:05:29.983368+0000","last_fullsized":"2023-10-06T03:05:29.983368+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:51.040731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.966433+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.883295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.975058+0000","last_change":"2023-10-06T03:05:29.975058+0000","last_active":"2023-10-06T03:05:29.975058+0000","last_peered":"2023-10-06T03:05:29.975058+0000","last_clean":"2023-10-06T03:05:29.975058+0000","last_became_active":"2023-10-06T03:05:29.974839+0000","last_became_peered":"2023-10-06T03:05:29.974839+0000","last_unstale":"2023-10-06T03:05:29.975058+0000","last_undegraded":"2023-10-06T03:05:29.975058+0000","last_fullsized":"2023-10-06T03:05:29.975058+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:54.194868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965487+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:12.918300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.983896+0000","last_change":"2023-10-06T03:05:29.983896+0000","last_active":"2023-10-06T03:05:29.983896+0000","last_peered":"2023-10-06T03:05:29.983896+0000","last_clean":"2023-10-06T03:05:29.983896+0000","last_became_active":"2023-10-06T03:05:29.983586+0000","last_became_peered":"2023-10-06T03:05:29.983586+0000","last_unstale":"2023-10-06T03:05:29.983896+0000","last_undegraded":"2023-10-06T03:05:29.983896+0000","last_fullsized":"2023-10-06T03:05:29.983896+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:48.866023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970382+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:30.642665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.984468+0000","last_change":"2023-10-06T03:05:29.984468+0000","last_active":"2023-10-06T03:05:29.984468+0000","last_peered":"2023-10-06T03:05:29.984468+0000","last_clean":"2023-10-06T03:05:29.984468+0000","last_became_active":"2023-10-06T03:05:29.984216+0000","last_became_peered":"2023-10-06T03:05:29.984216+0000","last_unstale":"2023-10-06T03:05:29.984468+0000","last_undegraded":"2023-10-06T03:05:29.984468+0000","last_fullsized":"2023-10-06T03:05:29.984468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:10.613335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972004+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:04.527321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.978356+0000","last_change":"2023-10-06T03:05:29.978356+0000","last_active":"2023-10-06T03:05:29.978356+0000","last_peered":"2023-10-06T03:05:29.978356+0000","last_clean":"2023-10-06T03:05:29.978356+0000","last_became_active":"2023-10-06T03:05:29.978068+0000","last_became_peered":"2023-10-06T03:05:29.978068+0000","last_unstale":"2023-10-06T03:05:29.978356+0000","last_undegraded":"2023-10-06T03:05:29.978356+0000","last_fullsized":"2023-10-06T03:05:29.978356+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:13.299028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.971219+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:11.618981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.975560+0000","last_change":"2023-10-06T03:05:29.975560+0000","last_active":"2023-10-06T03:05:29.975560+0000","last_peered":"2023-10-06T03:05:29.975560+0000","last_clean":"2023-10-06T03:05:29.975560+0000","last_became_active":"2023-10-06T03:05:29.975146+0000","last_became_peered":"2023-10-06T03:05:29.975146+0000","last_unstale":"2023-10-06T03:05:29.975560+0000","last_undegraded":"2023-10-06T03:05:29.975560+0000","last_fullsized":"2023-10-06T03:05:29.975560+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:37.763634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968464+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:58.428726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.978576+0000","last_change":"2023-10-06T03:05:29.978576+0000","last_active":"2023-10-06T03:05:29.978576+0000","last_peered":"2023-10-06T03:05:29.978576+0000","last_clean":"2023-10-06T03:05:29.978576+0000","last_became_active":"2023-10-06T03:05:29.978314+0000","last_became_peered":"2023-10-06T03:05:29.978314+0000","last_unstale":"2023-10-06T03:05:29.978576+0000","last_undegraded":"2023-10-06T03:05:29.978576+0000","last_fullsized":"2023-10-06T03:05:29.978576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:25.902043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972141+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:13:06.401671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.976856+0000","last_change":"2023-10-06T03:05:29.976856+0000","last_active":"2023-10-06T03:05:29.976856+0000","last_peered":"2023-10-06T03:05:29.976856+0000","last_clean":"2023-10-06T03:05:29.976856+0000","last_became_active":"2023-10-06T03:05:29.976594+0000","last_became_peered":"2023-10-06T03:05:29.976594+0000","last_unstale":"2023-10-06T03:05:29.976856+0000","last_undegraded":"2023-10-06T03:05:29.976856+0000","last_fullsized":"2023-10-06T03:05:29.976856+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:51.165031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.975127+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:43.140690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.980481+0000","last_change":"2023-10-06T03:05:29.980481+0000","last_active":"2023-10-06T03:05:29.980481+0000","last_peered":"2023-10-06T03:05:29.980481+0000","last_clean":"2023-10-06T03:05:29.980481+0000","last_became_active":"2023-10-06T03:05:29.980279+0000","last_became_peered":"2023-10-06T03:05:29.980279+0000","last_unstale":"2023-10-06T03:05:29.980481+0000","last_undegraded":"2023-10-06T03:05:29.980481+0000","last_fullsized":"2023-10-06T03:05:29.980481+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:07.796869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.963684+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:14.304674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.984960+0000","last_change":"2023-10-06T03:05:29.984960+0000","last_active":"2023-10-06T03:05:29.984960+0000","last_peered":"2023-10-06T03:05:29.984960+0000","last_clean":"2023-10-06T03:05:29.984960+0000","last_became_active":"2023-10-06T03:05:29.984390+0000","last_became_peered":"2023-10-06T03:05:29.984390+0000","last_unstale":"2023-10-06T03:05:29.984960+0000","last_undegraded":"2023-10-06T03:05:29.984960+0000","last_fullsized":"2023-10-06T03:05:29.984960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:39.615480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.977218+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:11.618981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.981372+0000","last_change":"2023-10-06T03:05:29.981372+0000","last_active":"2023-10-06T03:05:29.981372+0000","last_peered":"2023-10-06T03:05:29.981372+0000","last_clean":"2023-10-06T03:05:29.981372+0000","last_became_active":"2023-10-06T03:05:29.981115+0000","last_became_peered":"2023-10-06T03:05:29.981115+0000","last_unstale":"2023-10-06T03:05:29.981372+0000","last_undegraded":"2023-10-06T03:05:29.981372+0000","last_fullsized":"2023-10-06T03:05:29.981372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:19.117764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967727+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:21.306429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.977336+0000","last_change":"2023-10-06T03:05:29.977336+0000","last_active":"2023-10-06T03:05:29.977336+0000","last_peered":"2023-10-06T03:05:29.977336+0000","last_clean":"2023-10-06T03:05:29.977336+0000","last_became_active":"2023-10-06T03:05:29.976614+0000","last_became_peered":"2023-10-06T03:05:29.976614+0000","last_unstale":"2023-10-06T03:05:29.977336+0000","last_undegraded":"2023-10-06T03:05:29.977336+0000","last_fullsized":"2023-10-06T03:05:29.977336+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:39.452429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972501+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:01.791955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.983120+0000","last_change":"2023-10-06T03:05:29.983120+0000","last_active":"2023-10-06T03:05:29.983120+0000","last_peered":"2023-10-06T03:05:29.983120+0000","last_clean":"2023-10-06T03:05:29.983120+0000","last_became_active":"2023-10-06T03:05:29.982850+0000","last_became_peered":"2023-10-06T03:05:29.982850+0000","last_unstale":"2023-10-06T03:05:29.983120+0000","last_undegraded":"2023-10-06T03:05:29.983120+0000","last_fullsized":"2023-10-06T03:05:29.983120+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:47.589791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.963374+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:52.046377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.976278+0000","last_change":"2023-10-06T03:05:29.976278+0000","last_active":"2023-10-06T03:05:29.976278+0000","last_peered":"2023-10-06T03:05:29.976278+0000","last_clean":"2023-10-06T03:05:29.976278+0000","last_became_active":"2023-10-06T03:05:29.976023+0000","last_became_peered":"2023-10-06T03:05:29.976023+0000","last_unstale":"2023-10-06T03:05:29.976278+0000","last_undegraded":"2023-10-06T03:05:29.976278+0000","last_fullsized":"2023-10-06T03:05:29.976278+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:03.521675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.978110+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:25.519827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.983223+0000","last_change":"2023-10-06T03:05:29.983223+0000","last_active":"2023-10-06T03:05:29.983223+0000","last_peered":"2023-10-06T03:05:29.983223+0000","last_clean":"2023-10-06T03:05:29.983223+0000","last_became_active":"2023-10-06T03:05:29.983009+0000","last_became_peered":"2023-10-06T03:05:29.983009+0000","last_unstale":"2023-10-06T03:05:29.983223+0000","last_undegraded":"2023-10-06T03:05:29.983223+0000","last_fullsized":"2023-10-06T03:05:29.983223+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:39.453757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.966931+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:20.204857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.971763+0000","last_change":"2023-10-06T03:05:29.971763+0000","last_active":"2023-10-06T03:05:29.971763+0000","last_peered":"2023-10-06T03:05:29.971763+0000","last_clean":"2023-10-06T03:05:29.971763+0000","last_became_active":"2023-10-06T03:05:29.971518+0000","last_became_peered":"2023-10-06T03:05:29.971518+0000","last_unstale":"2023-10-06T03:05:29.971763+0000","last_undegraded":"2023-10-06T03:05:29.971763+0000","last_fullsized":"2023-10-06T03:05:29.971763+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:44.816300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970168+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:43.140690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.980139+0000","last_change":"2023-10-06T03:05:29.980139+0000","last_active":"2023-10-06T03:05:29.980139+0000","last_peered":"2023-10-06T03:05:29.980139+0000","last_clean":"2023-10-06T03:05:29.980139+0000","last_became_active":"2023-10-06T03:05:29.979914+0000","last_became_peered":"2023-10-06T03:05:29.979914+0000","last_unstale":"2023-10-06T03:05:29.980139+0000","last_undegraded":"2023-10-06T03:05:29.980139+0000","last_fullsized":"2023-10-06T03:05:29.980139+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:47.047116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968557+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:54.082681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.974952+0000","last_change":"2023-10-06T03:05:29.974952+0000","last_active":"2023-10-06T03:05:29.974952+0000","last_peered":"2023-10-06T03:05:29.974952+0000","last_clean":"2023-10-06T03:05:29.974952+0000","last_became_active":"2023-10-06T03:05:29.974721+0000","last_became_peered":"2023-10-06T03:05:29.974721+0000","last_unstale":"2023-10-06T03:05:29.974952+0000","last_undegraded":"2023-10-06T03:05:29.974952+0000","last_fullsized":"2023-10-06T03:05:29.974952+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:47.589791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968980+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:45.821946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.972966+0000","last_change":"2023-10-06T03:05:29.972966+0000","last_active":"2023-10-06T03:05:29.972966+0000","last_peered":"2023-10-06T03:05:29.972966+0000","last_clean":"2023-10-06T03:05:29.972966+0000","last_became_active":"2023-10-06T03:05:29.972751+0000","last_became_peered":"2023-10-06T03:05:29.972751+0000","last_unstale":"2023-10-06T03:05:29.972966+0000","last_undegraded":"2023-10-06T03:05:29.972966+0000","last_fullsized":"2023-10-06T03:05:29.972966+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:54.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.963327+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:57.748161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.985021+0000","last_change":"2023-10-06T03:05:29.985021+0000","last_active":"2023-10-06T03:05:29.985021+0000","last_peered":"2023-10-06T03:05:29.985021+0000","last_clean":"2023-10-06T03:05:29.985021+0000","last_became_active":"2023-10-06T03:05:29.984799+0000","last_became_peered":"2023-10-06T03:05:29.984799+0000","last_unstale":"2023-10-06T03:05:29.985021+0000","last_undegraded":"2023-10-06T03:05:29.985021+0000","last_fullsized":"2023-10-06T03:05:29.985021+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:08.642671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965199+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:26.907689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.974630+0000","last_change":"2023-10-06T03:05:29.974630+0000","last_active":"2023-10-06T03:05:29.974630+0000","last_peered":"2023-10-06T03:05:29.974630+0000","last_clean":"2023-10-06T03:05:29.974630+0000","last_became_active":"2023-10-06T03:05:29.974231+0000","last_became_peered":"2023-10-06T03:05:29.974231+0000","last_unstale":"2023-10-06T03:05:29.974630+0000","last_undegraded":"2023-10-06T03:05:29.974630+0000","last_fullsized":"2023-10-06T03:05:29.974630+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:54.269190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968267+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:05.824734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.984580+0000","last_change":"2023-10-06T03:05:29.984580+0000","last_active":"2023-10-06T03:05:29.984580+0000","last_peered":"2023-10-06T03:05:29.984580+0000","last_clean":"2023-10-06T03:05:29.984580+0000","last_became_active":"2023-10-06T03:05:29.984339+0000","last_became_peered":"2023-10-06T03:05:29.984339+0000","last_unstale":"2023-10-06T03:05:29.984580+0000","last_undegraded":"2023-10-06T03:05:29.984580+0000","last_fullsized":"2023-10-06T03:05:29.984580+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:54.194868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968842+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:38.769280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.984844+0000","last_change":"2023-10-06T03:05:29.984844+0000","last_active":"2023-10-06T03:05:29.984844+0000","last_peered":"2023-10-06T03:05:29.984844+0000","last_clean":"2023-10-06T03:05:29.984844+0000","last_became_active":"2023-10-06T03:05:29.984231+0000","last_became_peered":"2023-10-06T03:05:29.984231+0000","last_unstale":"2023-10-06T03:05:29.984844+0000","last_undegraded":"2023-10-06T03:05:29.984844+0000","last_fullsized":"2023-10-06T03:05:29.984844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:37.623703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.969618+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:01.960298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.975732+0000","last_change":"2023-10-06T03:05:29.975732+0000","last_active":"2023-10-06T03:05:29.975732+0000","last_peered":"2023-10-06T03:05:29.975732+0000","last_clean":"2023-10-06T03:05:29.975732+0000","last_became_active":"2023-10-06T03:05:29.975382+0000","last_became_peered":"2023-10-06T03:05:29.975382+0000","last_unstale":"2023-10-06T03:05:29.975732+0000","last_undegraded":"2023-10-06T03:05:29.975732+0000","last_fullsized":"2023-10-06T03:05:29.975732+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:39.077978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.958591+0000","last_change":"2023-10-06T03:04:23.986472+0000","last_active":"2023-10-06T03:05:28.958591+0000","last_peered":"2023-10-06T03:05:28.958591+0000","last_clean":"2023-10-06T03:05:28.958591+0000","last_became_active":"2023-10-06T03:04:23.986228+0000","last_became_peered":"2023-10-06T03:04:23.986228+0000","last_unstale":"2023-10-06T03:05:28.958591+0000","last_undegraded":"2023-10-06T03:05:28.958591+0000","last_fullsized":"2023-10-06T03:05:28.958591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:08.739849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970004+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:02.178769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.976944+0000","last_change":"2023-10-06T03:05:29.976944+0000","last_active":"2023-10-06T03:05:29.976944+0000","last_peered":"2023-10-06T03:05:29.976944+0000","last_clean":"2023-10-06T03:05:29.976944+0000","last_became_active":"2023-10-06T03:05:29.976712+0000","last_became_peered":"2023-10-06T03:05:29.976712+0000","last_unstale":"2023-10-06T03:05:29.976944+0000","last_undegraded":"2023-10-06T03:05:29.976944+0000","last_fullsized":"2023-10-06T03:05:29.976944+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:19.009895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.959884+0000","last_change":"2023-10-06T03:04:23.814917+0000","last_active":"2023-10-06T03:05:28.959884+0000","last_peered":"2023-10-06T03:05:28.959884+0000","last_clean":"2023-10-06T03:05:28.959884+0000","last_became_active":"2023-10-06T03:04:23.814601+0000","last_became_peered":"2023-10-06T03:04:23.814601+0000","last_unstale":"2023-10-06T03:05:28.959884+0000","last_undegraded":"2023-10-06T03:05:28.959884+0000","last_fullsized":"2023-10-06T03:05:28.959884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.969001+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:40.621126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.985121+0000","last_change":"2023-10-06T03:05:29.985121+0000","last_active":"2023-10-06T03:05:29.985121+0000","last_peered":"2023-10-06T03:05:29.985121+0000","last_clean":"2023-10-06T03:05:29.985121+0000","last_became_active":"2023-10-06T03:05:29.984686+0000","last_became_peered":"2023-10-06T03:05:29.984686+0000","last_unstale":"2023-10-06T03:05:29.985121+0000","last_undegraded":"2023-10-06T03:05:29.985121+0000","last_fullsized":"2023-10-06T03:05:29.985121+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:54.269190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.955549+0000","last_change":"2023-10-06T03:04:24.314547+0000","last_active":"2023-10-06T03:05:28.955549+0000","last_peered":"2023-10-06T03:05:28.955549+0000","last_clean":"2023-10-06T03:05:28.955549+0000","last_became_active":"2023-10-06T03:04:24.314278+0000","last_became_peered":"2023-10-06T03:04:24.314278+0000","last_unstale":"2023-10-06T03:05:28.955549+0000","last_undegraded":"2023-10-06T03:05:28.955549+0000","last_fullsized":"2023-10-06T03:05:28.955549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:25.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968906+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:48.595437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.970357+0000","last_change":"2023-10-06T03:05:29.970357+0000","last_active":"2023-10-06T03:05:29.970357+0000","last_peered":"2023-10-06T03:05:29.970357+0000","last_clean":"2023-10-06T03:05:29.970357+0000","last_became_active":"2023-10-06T03:05:29.970053+0000","last_became_peered":"2023-10-06T03:05:29.970053+0000","last_unstale":"2023-10-06T03:05:29.970357+0000","last_undegraded":"2023-10-06T03:05:29.970357+0000","last_fullsized":"2023-10-06T03:05:29.970357+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:37.623703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.959758+0000","last_change":"2023-10-06T03:04:23.807972+0000","last_active":"2023-10-06T03:05:28.959758+0000","last_peered":"2023-10-06T03:05:28.959758+0000","last_clean":"2023-10-06T03:05:28.959758+0000","last_became_active":"2023-10-06T03:04:23.807723+0000","last_became_peered":"2023-10-06T03:04:23.807723+0000","last_unstale":"2023-10-06T03:05:28.959758+0000","last_undegraded":"2023-10-06T03:05:28.959758+0000","last_fullsized":"2023-10-06T03:05:28.959758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.955973+0000","last_change":"2023-10-06T03:04:17.779925+0000","last_active":"2023-10-06T03:05:28.955973+0000","last_peered":"2023-10-06T03:05:28.955973+0000","last_clean":"2023-10-06T03:05:28.955973+0000","last_became_active":"2023-10-06T03:04:17.778997+0000","last_became_peered":"2023-10-06T03:04:17.778997+0000","last_unstale":"2023-10-06T03:05:28.955973+0000","last_undegraded":"2023-10-06T03:05:28.955973+0000","last_fullsized":"2023-10-06T03:05:28.955973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_clean_scrub_stamp":"2023-10-06T03:04:16.761610+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.975557+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.883295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.975059+0000","last_change":"2023-10-06T03:05:29.975059+0000","last_active":"2023-10-06T03:05:29.975059+0000","last_peered":"2023-10-06T03:05:29.975059+0000","last_clean":"2023-10-06T03:05:29.975059+0000","last_became_active":"2023-10-06T03:05:29.974806+0000","last_became_peered":"2023-10-06T03:05:29.974806+0000","last_unstale":"2023-10-06T03:05:29.975059+0000","last_undegraded":"2023-10-06T03:05:29.975059+0000","last_fullsized":"2023-10-06T03:05:29.975059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:07.796869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.956071+0000","last_change":"2023-10-06T03:04:23.814887+0000","last_active":"2023-10-06T03:05:28.956071+0000","last_peered":"2023-10-06T03:05:28.956071+0000","last_clean":"2023-10-06T03:05:28.956071+0000","last_became_active":"2023-10-06T03:04:23.814581+0000","last_became_peered":"2023-10-06T03:04:23.814581+0000","last_unstale":"2023-10-06T03:05:28.956071+0000","last_undegraded":"2023-10-06T03:05:28.956071+0000","last_fullsized":"2023-10-06T03:05:28.956071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.964736+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:49.871669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.973917+0000","last_change":"2023-10-06T03:05:29.973917+0000","last_active":"2023-10-06T03:05:29.973917+0000","last_peered":"2023-10-06T03:05:29.973917+0000","last_clean":"2023-10-06T03:05:29.973917+0000","last_became_active":"2023-10-06T03:05:29.973667+0000","last_became_peered":"2023-10-06T03:05:29.973667+0000","last_unstale":"2023-10-06T03:05:29.973917+0000","last_undegraded":"2023-10-06T03:05:29.973917+0000","last_fullsized":"2023-10-06T03:05:29.973917+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:07.355752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.956204+0000","last_change":"2023-10-06T03:04:23.986771+0000","last_active":"2023-10-06T03:05:28.956204+0000","last_peered":"2023-10-06T03:05:28.956204+0000","last_clean":"2023-10-06T03:05:28.956204+0000","last_became_active":"2023-10-06T03:04:23.986552+0000","last_became_peered":"2023-10-06T03:04:23.986552+0000","last_unstale":"2023-10-06T03:05:28.956204+0000","last_undegraded":"2023-10-06T03:05:28.956204+0000","last_fullsized":"2023-10-06T03:05:28.956204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.962817+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:01.791955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.979529+0000","last_change":"2023-10-06T03:05:29.979529+0000","last_active":"2023-10-06T03:05:29.979529+0000","last_peered":"2023-10-06T03:05:29.979529+0000","last_clean":"2023-10-06T03:05:29.979529+0000","last_became_active":"2023-10-06T03:05:29.979281+0000","last_became_peered":"2023-10-06T03:05:29.979281+0000","last_unstale":"2023-10-06T03:05:29.979529+0000","last_undegraded":"2023-10-06T03:05:29.979529+0000","last_fullsized":"2023-10-06T03:05:29.979529+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:56.742515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.958623+0000","last_change":"2023-10-06T03:04:23.813862+0000","last_active":"2023-10-06T03:05:28.958623+0000","last_peered":"2023-10-06T03:05:28.958623+0000","last_clean":"2023-10-06T03:05:28.958623+0000","last_became_active":"2023-10-06T03:04:23.813584+0000","last_became_peered":"2023-10-06T03:04:23.813584+0000","last_unstale":"2023-10-06T03:05:28.958623+0000","last_undegraded":"2023-10-06T03:05:28.958623+0000","last_fullsized":"2023-10-06T03:05:28.958623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.962871+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:52.170677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.985492+0000","last_change":"2023-10-06T03:05:29.985492+0000","last_active":"2023-10-06T03:05:29.985492+0000","last_peered":"2023-10-06T03:05:29.985492+0000","last_clean":"2023-10-06T03:05:29.985492+0000","last_became_active":"2023-10-06T03:05:29.984212+0000","last_became_peered":"2023-10-06T03:05:29.984212+0000","last_unstale":"2023-10-06T03:05:29.985492+0000","last_undegraded":"2023-10-06T03:05:29.985492+0000","last_fullsized":"2023-10-06T03:05:29.985492+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:37.763634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.955160+0000","last_change":"2023-10-06T03:04:23.805874+0000","last_active":"2023-10-06T03:05:28.955160+0000","last_peered":"2023-10-06T03:05:28.955160+0000","last_clean":"2023-10-06T03:05:28.955160+0000","last_became_active":"2023-10-06T03:04:23.805551+0000","last_became_peered":"2023-10-06T03:04:23.805551+0000","last_unstale":"2023-10-06T03:05:28.955160+0000","last_undegraded":"2023-10-06T03:05:28.955160+0000","last_fullsized":"2023-10-06T03:05:28.955160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:21.250275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298308,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073532,"statfs":{"total":96636764160,"available":96331296768,"internally_reserved":0,"allocated":1044480,"data_stored":788089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":3.8860000000000001,"5min":3.8860000000000001,"15min":3.8860000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.988,"5min":3.988,"15min":3.988},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":3.9510000000000001,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.444,"5min":3.444,"15min":3.444},"last":0.65900000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":4.1429999999999998,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":3.903,"5min":3.903,"15min":3.903},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":3.9260000000000002,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":0.63200000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.45000000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.42099999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":6.8220000000000001,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":6.8330000000000002,"5min":6.8330000000000002,"15min":6.8330000000000002},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.8929999999999998,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.497},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.948,"5min":3.948,"15min":3.948},"last":0.51500000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.379},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":3.996,"5min":3.996,"15min":3.996},"last":0.56200000000000006}]},{"osd":3,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.622}]},{"osd":5,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.59699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":438272,"data_stored":190793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.314}]},{"osd":2,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":6.056,"5min":6.056,"15min":6.056},"last":0.254},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.29199999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.377},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.51500000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.49099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298304,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073536,"statfs":{"total":96636764160,"available":96331300864,"internally_reserved":0,"allocated":1040384,"data_stored":787078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.35399999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.31}]},{"osd":3,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.32700000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.61099999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":12.913,"5min":12.913,"15min":12.913},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.31900000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":3.8919999999999999,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.36399999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.28499999999999998},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":12.941000000000001,"5min":12.941000000000001,"15min":12.941000000000001},"last":0.30599999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":12.846,"5min":12.846,"15min":12.846},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.45200000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":12.884,"5min":12.884,"15min":12.884},"last":0.503}]},{"osd":6,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.48099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.30399999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.38300000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.32200000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.39300000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.41899999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.44600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.5}]},{"osd":1,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.439},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.42699999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.48699999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.56499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46600000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.51300000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.624}]},{"osd":6,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:05:35.326 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:05:35.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.473+0000 7f8626645700 1 Processor -- start 2023-10-06T03:05:35.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.473+0000 7f8626645700 1 -- start start 2023-10-06T03:05:35.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.474+0000 7f8626645700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86200cb150 0x7f86200c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:35.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.474+0000 7f8626645700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86200c2910 con 0x7f86200cbf20 2023-10-06T03:05:35.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.474+0000 7f8626645700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86200c1d40 con 0x7f86200cbb50 2023-10-06T03:05:35.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.474+0000 7f8626645700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86200aa0b0 con 0x7f86200cb150 2023-10-06T03:05:35.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.474+0000 7f8624be2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86200cb150 0x7f86200c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:35.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.474+0000 7f861f7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f86200cbf20 0x7f86200caa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35266/0 (socket says 172.21.15.125:35266) 2023-10-06T03:05:35.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.474+0000 7f8624be2700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f86200cb150 0x7f86200c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57808/0 (socket says 172.21.15.125:57808) 2023-10-06T03:05:35.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.474+0000 7f861f7fe700 1 -- 172.21.15.125:0/1891703704 learned_addr learned my addr 172.21.15.125:0/1891703704 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:35.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.474+0000 7f8624be2700 1 -- 172.21.15.125:0/1891703704 >> v1:172.21.15.130:6789/0 conn(0x7f86200cbb50 legacy=0x7f86200a99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:35.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.474+0000 7f8624be2700 1 -- 172.21.15.125:0/1891703704 >> v1:172.21.15.125:6789/0 conn(0x7f86200cbf20 legacy=0x7f86200caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:35.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.474+0000 7f8624be2700 1 -- 172.21.15.125:0/1891703704 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86200c1fe0 con 0x7f86200cb150 2023-10-06T03:05:35.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.474+0000 7f8624be2700 1 --2- 172.21.15.125:0/1891703704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86200cb150 0x7f86200c8cf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8618009e60 tx=0x7f8618009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e1618ed2157b2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:35.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.474+0000 7f861effd700 1 -- 172.21.15.125:0/1891703704 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861800e070 con 0x7f86200cb150 2023-10-06T03:05:35.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.474+0000 7f861effd700 1 -- 172.21.15.125:0/1891703704 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861800bbf0 con 0x7f86200cb150 2023-10-06T03:05:35.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.474+0000 7f861effd700 1 -- 172.21.15.125:0/1891703704 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8618012430 con 0x7f86200cb150 2023-10-06T03:05:35.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.475+0000 7f8626645700 1 -- 172.21.15.125:0/1891703704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86200cb150 msgr2=0x7f86200c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:35.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.475+0000 7f8626645700 1 --2- 172.21.15.125:0/1891703704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86200cb150 0x7f86200c8cf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8618009e60 tx=0x7f8618009780 comp rx=0 tx=0).stop 2023-10-06T03:05:35.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.475+0000 7f8626645700 1 -- 172.21.15.125:0/1891703704 shutdown_connections 2023-10-06T03:05:35.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.475+0000 7f8626645700 1 --2- 172.21.15.125:0/1891703704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86200cb150 0x7f86200c8cf0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.475+0000 7f8626645700 1 -- 172.21.15.125:0/1891703704 >> 172.21.15.125:0/1891703704 conn(0x7f8620068f00 msgr2=0x7f86200cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:35.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.475+0000 7f8626645700 1 -- 172.21.15.125:0/1891703704 shutdown_connections 2023-10-06T03:05:35.611 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.475+0000 7f8626645700 1 -- 172.21.15.125:0/1891703704 wait complete. 2023-10-06T03:05:35.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.476+0000 7f8626645700 1 Processor -- start 2023-10-06T03:05:35.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.476+0000 7f8626645700 1 -- start start 2023-10-06T03:05:35.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.477+0000 7f8626645700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86200cb150 0x7f8620166520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:35.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.477+0000 7f8626645700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86200cbb50 0x7f862016a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:35.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.477+0000 7f8626645700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86200cbf20 0x7f86200ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:35.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.477+0000 7f8626645700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86200b0de0 con 0x7f86200cbb50 2023-10-06T03:05:35.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.477+0000 7f8626645700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86201694a0 con 0x7f86200cbf20 2023-10-06T03:05:35.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.477+0000 7f8626645700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86200c9170 con 0x7f86200cb150 2023-10-06T03:05:35.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.477+0000 7f861f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86200cbb50 0x7f862016a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:35.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.477+0000 7f861f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86200cbb50 0x7f862016a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57812/0 (socket says 172.21.15.125:57812) 2023-10-06T03:05:35.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.477+0000 7f861f7fe700 1 -- 172.21.15.125:0/1983644755 learned_addr learned my addr 172.21.15.125:0/1983644755 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:35.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.477+0000 7f8624be2700 1 --2- 172.21.15.125:0/1983644755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86200cbf20 0x7f86200ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:35.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.477+0000 7f861ffff700 1 --2- 172.21.15.125:0/1983644755 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86200cb150 0x7f8620166520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:35.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.477+0000 7f861f7fe700 1 -- 172.21.15.125:0/1983644755 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86200cb150 msgr2=0x7f8620166520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:35.701 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.477+0000 7f861f7fe700 1 --2- 172.21.15.125:0/1983644755 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86200cb150 0x7f8620166520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.477+0000 7f861f7fe700 1 -- 172.21.15.125:0/1983644755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86200cbf20 msgr2=0x7f86200ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:35.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.477+0000 7f861f7fe700 1 --2- 172.21.15.125:0/1983644755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86200cbf20 0x7f86200ae600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.477+0000 7f861f7fe700 1 -- 172.21.15.125:0/1983644755 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8618009a20 con 0x7f86200cbb50 2023-10-06T03:05:35.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.477+0000 7f8624be2700 1 --2- 172.21.15.125:0/1983644755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86200cbf20 0x7f86200ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:35.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.477+0000 7f861ffff700 1 --2- 172.21.15.125:0/1983644755 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86200cb150 0x7f8620166520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:35.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.478+0000 7f861f7fe700 1 --2- 172.21.15.125:0/1983644755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86200cbb50 0x7f862016a250 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f861400c590 tx=0x7f8614001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:35.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.478+0000 7f8607fff700 1 -- 172.21.15.125:0/1983644755 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8614005b30 con 0x7f86200cbb50 2023-10-06T03:05:35.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.478+0000 7f8607fff700 1 -- 172.21.15.125:0/1983644755 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8614005cb0 con 0x7f86200cbb50 2023-10-06T03:05:35.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.478+0000 7f8626645700 1 -- 172.21.15.125:0/1983644755 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86200c9710 con 0x7f86200cbb50 2023-10-06T03:05:35.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.478+0000 7f8607fff700 1 -- 172.21.15.125:0/1983644755 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8614007320 con 0x7f86200cbb50 2023-10-06T03:05:35.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.478+0000 7f8626645700 1 -- 172.21.15.125:0/1983644755 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86200c93a0 con 0x7f86200cbb50 2023-10-06T03:05:35.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.479+0000 7f8626645700 1 -- 172.21.15.125:0/1983644755 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86200c98a0 con 0x7f86200cbb50 2023-10-06T03:05:35.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.479+0000 7f8607fff700 1 -- 172.21.15.125:0/1983644755 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f861401b3b0 con 0x7f86200cbb50 2023-10-06T03:05:35.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.479+0000 7f8607fff700 1 --2- 172.21.15.125:0/1983644755 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f860c066f30 0x7f860c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:35.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.480+0000 7f8607fff700 1 -- 172.21.15.125:0/1983644755 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f8614083cd0 con 0x7f86200cbb50 2023-10-06T03:05:35.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.480+0000 7f861ffff700 1 --2- 172.21.15.125:0/1983644755 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f860c066f30 0x7f860c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:35.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.480+0000 7f861ffff700 1 --2- 172.21.15.125:0/1983644755 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f860c066f30 0x7f860c0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f86100028b0 tx=0x7f8610009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:35.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.484+0000 7f8607fff700 1 -- 172.21.15.125:0/1983644755 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8614050ca0 con 0x7f86200cbb50 2023-10-06T03:05:35.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.659+0000 7f8626645700 1 -- 172.21.15.125:0/1983644755 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8620066510 con 0x7f860c066f30 2023-10-06T03:05:35.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.667+0000 7f8607fff700 1 -- 172.21.15.125:0/1983644755 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307384 (secure 0 0 0) 0x7f8620066510 con 0x7f860c066f30 2023-10-06T03:05:35.711 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:35.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.670+0000 7f8626645700 1 -- 172.21.15.125:0/1983644755 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f860c066f30 msgr2=0x7f860c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:35.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.670+0000 7f8626645700 1 --2- 172.21.15.125:0/1983644755 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f860c066f30 0x7f860c0693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f86100028b0 tx=0x7f8610009040 comp rx=0 tx=0).stop 2023-10-06T03:05:35.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.670+0000 7f8626645700 1 -- 172.21.15.125:0/1983644755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86200cbb50 msgr2=0x7f862016a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:35.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.670+0000 7f8626645700 1 --2- 172.21.15.125:0/1983644755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86200cbb50 0x7f862016a250 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f861400c590 tx=0x7f8614001020 comp rx=0 tx=0).stop 2023-10-06T03:05:35.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.670+0000 7f8626645700 1 -- 172.21.15.125:0/1983644755 shutdown_connections 2023-10-06T03:05:35.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.670+0000 7f8626645700 1 --2- 172.21.15.125:0/1983644755 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f860c066f30 0x7f860c0693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.670+0000 7f8626645700 1 --2- 172.21.15.125:0/1983644755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f86200cbf20 0x7f86200ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.670+0000 7f8626645700 1 --2- 172.21.15.125:0/1983644755 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f86200cb150 0x7f8620166520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.670+0000 7f8626645700 1 --2- 172.21.15.125:0/1983644755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f86200cbb50 0x7f862016a250 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.670+0000 7f8626645700 1 -- 172.21.15.125:0/1983644755 >> 172.21.15.125:0/1983644755 conn(0x7f8620068f00 msgr2=0x7f8620156bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:35.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.670+0000 7f8626645700 1 -- 172.21.15.125:0/1983644755 shutdown_connections 2023-10-06T03:05:35.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.670+0000 7f8626645700 1 -- 172.21.15.125:0/1983644755 wait complete. 2023-10-06T03:05:35.715 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-06T03:05:35.715 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-10-06T03:05:33.820729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382968,"kb_used_data":4664,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591752,"statfs":{"total":773094113280,"available":770653954048,"internally_reserved":0,"allocated":4775936,"data_stored":2754565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.870379"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.977120+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:09.648317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965909+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:43.140690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.971367+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:55.892723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970103+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:40.458075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965533+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:40.458075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.964382+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:27.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.978584+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:01.791955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.971609+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:20.015541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970572+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.883295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972711+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:49.871669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970926+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:09.648317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965140+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:04.527321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968578+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:11:43.857971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968492+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:38.629349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965205+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:30.642665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968417+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:59.140697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972557+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:20.868524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.973518+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:08.111584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.969526+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:20.123410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.966794+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:02.178769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.963978+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:48.052762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968003+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:55.274836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967331+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:29.787384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967851+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:45.882319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.969585+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:40:02.105572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967366+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:25.832521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970990+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:40.812378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.966935+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:09.648317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967440+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:23.219456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970924+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:06.331617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.964783+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:01.960298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967824+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:46.506948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965273+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:40.459403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.973435+0000","last_change":"2023-10-06T03:05:29.973435+0000","last_active":"2023-10-06T03:05:29.973435+0000","last_peered":"2023-10-06T03:05:29.973435+0000","last_clean":"2023-10-06T03:05:29.973435+0000","last_became_active":"2023-10-06T03:05:29.973213+0000","last_became_peered":"2023-10-06T03:05:29.973213+0000","last_unstale":"2023-10-06T03:05:29.973435+0000","last_undegraded":"2023-10-06T03:05:29.973435+0000","last_fullsized":"2023-10-06T03:05:29.973435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:42.135044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970472+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:20.204857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.983368+0000","last_change":"2023-10-06T03:05:29.983368+0000","last_active":"2023-10-06T03:05:29.983368+0000","last_peered":"2023-10-06T03:05:29.983368+0000","last_clean":"2023-10-06T03:05:29.983368+0000","last_became_active":"2023-10-06T03:05:29.983086+0000","last_became_peered":"2023-10-06T03:05:29.983086+0000","last_unstale":"2023-10-06T03:05:29.983368+0000","last_undegraded":"2023-10-06T03:05:29.983368+0000","last_fullsized":"2023-10-06T03:05:29.983368+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:51.040731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.966433+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.883295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.975058+0000","last_change":"2023-10-06T03:05:29.975058+0000","last_active":"2023-10-06T03:05:29.975058+0000","last_peered":"2023-10-06T03:05:29.975058+0000","last_clean":"2023-10-06T03:05:29.975058+0000","last_became_active":"2023-10-06T03:05:29.974839+0000","last_became_peered":"2023-10-06T03:05:29.974839+0000","last_unstale":"2023-10-06T03:05:29.975058+0000","last_undegraded":"2023-10-06T03:05:29.975058+0000","last_fullsized":"2023-10-06T03:05:29.975058+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:54.194868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965487+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:12.918300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.983896+0000","last_change":"2023-10-06T03:05:29.983896+0000","last_active":"2023-10-06T03:05:29.983896+0000","last_peered":"2023-10-06T03:05:29.983896+0000","last_clean":"2023-10-06T03:05:29.983896+0000","last_became_active":"2023-10-06T03:05:29.983586+0000","last_became_peered":"2023-10-06T03:05:29.983586+0000","last_unstale":"2023-10-06T03:05:29.983896+0000","last_undegraded":"2023-10-06T03:05:29.983896+0000","last_fullsized":"2023-10-06T03:05:29.983896+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:48.866023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970382+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:30.642665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.984468+0000","last_change":"2023-10-06T03:05:29.984468+0000","last_active":"2023-10-06T03:05:29.984468+0000","last_peered":"2023-10-06T03:05:29.984468+0000","last_clean":"2023-10-06T03:05:29.984468+0000","last_became_active":"2023-10-06T03:05:29.984216+0000","last_became_peered":"2023-10-06T03:05:29.984216+0000","last_unstale":"2023-10-06T03:05:29.984468+0000","last_undegraded":"2023-10-06T03:05:29.984468+0000","last_fullsized":"2023-10-06T03:05:29.984468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:10.613335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972004+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:04.527321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.978356+0000","last_change":"2023-10-06T03:05:29.978356+0000","last_active":"2023-10-06T03:05:29.978356+0000","last_peered":"2023-10-06T03:05:29.978356+0000","last_clean":"2023-10-06T03:05:29.978356+0000","last_became_active":"2023-10-06T03:05:29.978068+0000","last_became_peered":"2023-10-06T03:05:29.978068+0000","last_unstale":"2023-10-06T03:05:29.978356+0000","last_undegraded":"2023-10-06T03:05:29.978356+0000","last_fullsized":"2023-10-06T03:05:29.978356+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:13.299028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.971219+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:11.618981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.975560+0000","last_change":"2023-10-06T03:05:29.975560+0000","last_active":"2023-10-06T03:05:29.975560+0000","last_peered":"2023-10-06T03:05:29.975560+0000","last_clean":"2023-10-06T03:05:29.975560+0000","last_became_active":"2023-10-06T03:05:29.975146+0000","last_became_peered":"2023-10-06T03:05:29.975146+0000","last_unstale":"2023-10-06T03:05:29.975560+0000","last_undegraded":"2023-10-06T03:05:29.975560+0000","last_fullsized":"2023-10-06T03:05:29.975560+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:37.763634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968464+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:58.428726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.978576+0000","last_change":"2023-10-06T03:05:29.978576+0000","last_active":"2023-10-06T03:05:29.978576+0000","last_peered":"2023-10-06T03:05:29.978576+0000","last_clean":"2023-10-06T03:05:29.978576+0000","last_became_active":"2023-10-06T03:05:29.978314+0000","last_became_peered":"2023-10-06T03:05:29.978314+0000","last_unstale":"2023-10-06T03:05:29.978576+0000","last_undegraded":"2023-10-06T03:05:29.978576+0000","last_fullsized":"2023-10-06T03:05:29.978576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:25.902043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972141+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:13:06.401671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.976856+0000","last_change":"2023-10-06T03:05:29.976856+0000","last_active":"2023-10-06T03:05:29.976856+0000","last_peered":"2023-10-06T03:05:29.976856+0000","last_clean":"2023-10-06T03:05:29.976856+0000","last_became_active":"2023-10-06T03:05:29.976594+0000","last_became_peered":"2023-10-06T03:05:29.976594+0000","last_unstale":"2023-10-06T03:05:29.976856+0000","last_undegraded":"2023-10-06T03:05:29.976856+0000","last_fullsized":"2023-10-06T03:05:29.976856+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:51.165031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.975127+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:43.140690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.980481+0000","last_change":"2023-10-06T03:05:29.980481+0000","last_active":"2023-10-06T03:05:29.980481+0000","last_peered":"2023-10-06T03:05:29.980481+0000","last_clean":"2023-10-06T03:05:29.980481+0000","last_became_active":"2023-10-06T03:05:29.980279+0000","last_became_peered":"2023-10-06T03:05:29.980279+0000","last_unstale":"2023-10-06T03:05:29.980481+0000","last_undegraded":"2023-10-06T03:05:29.980481+0000","last_fullsized":"2023-10-06T03:05:29.980481+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:07.796869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.963684+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:14.304674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.984960+0000","last_change":"2023-10-06T03:05:29.984960+0000","last_active":"2023-10-06T03:05:29.984960+0000","last_peered":"2023-10-06T03:05:29.984960+0000","last_clean":"2023-10-06T03:05:29.984960+0000","last_became_active":"2023-10-06T03:05:29.984390+0000","last_became_peered":"2023-10-06T03:05:29.984390+0000","last_unstale":"2023-10-06T03:05:29.984960+0000","last_undegraded":"2023-10-06T03:05:29.984960+0000","last_fullsized":"2023-10-06T03:05:29.984960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:39.615480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.977218+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:11.618981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.981372+0000","last_change":"2023-10-06T03:05:29.981372+0000","last_active":"2023-10-06T03:05:29.981372+0000","last_peered":"2023-10-06T03:05:29.981372+0000","last_clean":"2023-10-06T03:05:29.981372+0000","last_became_active":"2023-10-06T03:05:29.981115+0000","last_became_peered":"2023-10-06T03:05:29.981115+0000","last_unstale":"2023-10-06T03:05:29.981372+0000","last_undegraded":"2023-10-06T03:05:29.981372+0000","last_fullsized":"2023-10-06T03:05:29.981372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:19.117764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967727+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:21.306429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.977336+0000","last_change":"2023-10-06T03:05:29.977336+0000","last_active":"2023-10-06T03:05:29.977336+0000","last_peered":"2023-10-06T03:05:29.977336+0000","last_clean":"2023-10-06T03:05:29.977336+0000","last_became_active":"2023-10-06T03:05:29.976614+0000","last_became_peered":"2023-10-06T03:05:29.976614+0000","last_unstale":"2023-10-06T03:05:29.977336+0000","last_undegraded":"2023-10-06T03:05:29.977336+0000","last_fullsized":"2023-10-06T03:05:29.977336+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:39.452429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972501+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:01.791955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.983120+0000","last_change":"2023-10-06T03:05:29.983120+0000","last_active":"2023-10-06T03:05:29.983120+0000","last_peered":"2023-10-06T03:05:29.983120+0000","last_clean":"2023-10-06T03:05:29.983120+0000","last_became_active":"2023-10-06T03:05:29.982850+0000","last_became_peered":"2023-10-06T03:05:29.982850+0000","last_unstale":"2023-10-06T03:05:29.983120+0000","last_undegraded":"2023-10-06T03:05:29.983120+0000","last_fullsized":"2023-10-06T03:05:29.983120+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:47.589791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.963374+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:52.046377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.976278+0000","last_change":"2023-10-06T03:05:29.976278+0000","last_active":"2023-10-06T03:05:29.976278+0000","last_peered":"2023-10-06T03:05:29.976278+0000","last_clean":"2023-10-06T03:05:29.976278+0000","last_became_active":"2023-10-06T03:05:29.976023+0000","last_became_peered":"2023-10-06T03:05:29.976023+0000","last_unstale":"2023-10-06T03:05:29.976278+0000","last_undegraded":"2023-10-06T03:05:29.976278+0000","last_fullsized":"2023-10-06T03:05:29.976278+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:03.521675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.978110+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:25.519827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.983223+0000","last_change":"2023-10-06T03:05:29.983223+0000","last_active":"2023-10-06T03:05:29.983223+0000","last_peered":"2023-10-06T03:05:29.983223+0000","last_clean":"2023-10-06T03:05:29.983223+0000","last_became_active":"2023-10-06T03:05:29.983009+0000","last_became_peered":"2023-10-06T03:05:29.983009+0000","last_unstale":"2023-10-06T03:05:29.983223+0000","last_undegraded":"2023-10-06T03:05:29.983223+0000","last_fullsized":"2023-10-06T03:05:29.983223+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:39.453757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.966931+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:20.204857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.971763+0000","last_change":"2023-10-06T03:05:29.971763+0000","last_active":"2023-10-06T03:05:29.971763+0000","last_peered":"2023-10-06T03:05:29.971763+0000","last_clean":"2023-10-06T03:05:29.971763+0000","last_became_active":"2023-10-06T03:05:29.971518+0000","last_became_peered":"2023-10-06T03:05:29.971518+0000","last_unstale":"2023-10-06T03:05:29.971763+0000","last_undegraded":"2023-10-06T03:05:29.971763+0000","last_fullsized":"2023-10-06T03:05:29.971763+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:44.816300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970168+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:43.140690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.980139+0000","last_change":"2023-10-06T03:05:29.980139+0000","last_active":"2023-10-06T03:05:29.980139+0000","last_peered":"2023-10-06T03:05:29.980139+0000","last_clean":"2023-10-06T03:05:29.980139+0000","last_became_active":"2023-10-06T03:05:29.979914+0000","last_became_peered":"2023-10-06T03:05:29.979914+0000","last_unstale":"2023-10-06T03:05:29.980139+0000","last_undegraded":"2023-10-06T03:05:29.980139+0000","last_fullsized":"2023-10-06T03:05:29.980139+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:47.047116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968557+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:54.082681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.974952+0000","last_change":"2023-10-06T03:05:29.974952+0000","last_active":"2023-10-06T03:05:29.974952+0000","last_peered":"2023-10-06T03:05:29.974952+0000","last_clean":"2023-10-06T03:05:29.974952+0000","last_became_active":"2023-10-06T03:05:29.974721+0000","last_became_peered":"2023-10-06T03:05:29.974721+0000","last_unstale":"2023-10-06T03:05:29.974952+0000","last_undegraded":"2023-10-06T03:05:29.974952+0000","last_fullsized":"2023-10-06T03:05:29.974952+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:47.589791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968980+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:45.821946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.972966+0000","last_change":"2023-10-06T03:05:29.972966+0000","last_active":"2023-10-06T03:05:29.972966+0000","last_peered":"2023-10-06T03:05:29.972966+0000","last_clean":"2023-10-06T03:05:29.972966+0000","last_became_active":"2023-10-06T03:05:29.972751+0000","last_became_peered":"2023-10-06T03:05:29.972751+0000","last_unstale":"2023-10-06T03:05:29.972966+0000","last_undegraded":"2023-10-06T03:05:29.972966+0000","last_fullsized":"2023-10-06T03:05:29.972966+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:54.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.963327+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:57.748161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.985021+0000","last_change":"2023-10-06T03:05:29.985021+0000","last_active":"2023-10-06T03:05:29.985021+0000","last_peered":"2023-10-06T03:05:29.985021+0000","last_clean":"2023-10-06T03:05:29.985021+0000","last_became_active":"2023-10-06T03:05:29.984799+0000","last_became_peered":"2023-10-06T03:05:29.984799+0000","last_unstale":"2023-10-06T03:05:29.985021+0000","last_undegraded":"2023-10-06T03:05:29.985021+0000","last_fullsized":"2023-10-06T03:05:29.985021+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:08.642671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965199+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:26.907689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.974630+0000","last_change":"2023-10-06T03:05:29.974630+0000","last_active":"2023-10-06T03:05:29.974630+0000","last_peered":"2023-10-06T03:05:29.974630+0000","last_clean":"2023-10-06T03:05:29.974630+0000","last_became_active":"2023-10-06T03:05:29.974231+0000","last_became_peered":"2023-10-06T03:05:29.974231+0000","last_unstale":"2023-10-06T03:05:29.974630+0000","last_undegraded":"2023-10-06T03:05:29.974630+0000","last_fullsized":"2023-10-06T03:05:29.974630+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:54.269190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968267+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:05.824734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.984580+0000","last_change":"2023-10-06T03:05:29.984580+0000","last_active":"2023-10-06T03:05:29.984580+0000","last_peered":"2023-10-06T03:05:29.984580+0000","last_clean":"2023-10-06T03:05:29.984580+0000","last_became_active":"2023-10-06T03:05:29.984339+0000","last_became_peered":"2023-10-06T03:05:29.984339+0000","last_unstale":"2023-10-06T03:05:29.984580+0000","last_undegraded":"2023-10-06T03:05:29.984580+0000","last_fullsized":"2023-10-06T03:05:29.984580+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:54.194868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968842+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:38.769280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.984844+0000","last_change":"2023-10-06T03:05:29.984844+0000","last_active":"2023-10-06T03:05:29.984844+0000","last_peered":"2023-10-06T03:05:29.984844+0000","last_clean":"2023-10-06T03:05:29.984844+0000","last_became_active":"2023-10-06T03:05:29.984231+0000","last_became_peered":"2023-10-06T03:05:29.984231+0000","last_unstale":"2023-10-06T03:05:29.984844+0000","last_undegraded":"2023-10-06T03:05:29.984844+0000","last_fullsized":"2023-10-06T03:05:29.984844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:37.623703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.969618+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:01.960298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.975732+0000","last_change":"2023-10-06T03:05:29.975732+0000","last_active":"2023-10-06T03:05:29.975732+0000","last_peered":"2023-10-06T03:05:29.975732+0000","last_clean":"2023-10-06T03:05:29.975732+0000","last_became_active":"2023-10-06T03:05:29.975382+0000","last_became_peered":"2023-10-06T03:05:29.975382+0000","last_unstale":"2023-10-06T03:05:29.975732+0000","last_undegraded":"2023-10-06T03:05:29.975732+0000","last_fullsized":"2023-10-06T03:05:29.975732+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:39.077978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.958591+0000","last_change":"2023-10-06T03:04:23.986472+0000","last_active":"2023-10-06T03:05:28.958591+0000","last_peered":"2023-10-06T03:05:28.958591+0000","last_clean":"2023-10-06T03:05:28.958591+0000","last_became_active":"2023-10-06T03:04:23.986228+0000","last_became_peered":"2023-10-06T03:04:23.986228+0000","last_unstale":"2023-10-06T03:05:28.958591+0000","last_undegraded":"2023-10-06T03:05:28.958591+0000","last_fullsized":"2023-10-06T03:05:28.958591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:08.739849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970004+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:02.178769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.976944+0000","last_change":"2023-10-06T03:05:29.976944+0000","last_active":"2023-10-06T03:05:29.976944+0000","last_peered":"2023-10-06T03:05:29.976944+0000","last_clean":"2023-10-06T03:05:29.976944+0000","last_became_active":"2023-10-06T03:05:29.976712+0000","last_became_peered":"2023-10-06T03:05:29.976712+0000","last_unstale":"2023-10-06T03:05:29.976944+0000","last_undegraded":"2023-10-06T03:05:29.976944+0000","last_fullsized":"2023-10-06T03:05:29.976944+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:19.009895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.959884+0000","last_change":"2023-10-06T03:04:23.814917+0000","last_active":"2023-10-06T03:05:28.959884+0000","last_peered":"2023-10-06T03:05:28.959884+0000","last_clean":"2023-10-06T03:05:28.959884+0000","last_became_active":"2023-10-06T03:04:23.814601+0000","last_became_peered":"2023-10-06T03:04:23.814601+0000","last_unstale":"2023-10-06T03:05:28.959884+0000","last_undegraded":"2023-10-06T03:05:28.959884+0000","last_fullsized":"2023-10-06T03:05:28.959884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.969001+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:40.621126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.985121+0000","last_change":"2023-10-06T03:05:29.985121+0000","last_active":"2023-10-06T03:05:29.985121+0000","last_peered":"2023-10-06T03:05:29.985121+0000","last_clean":"2023-10-06T03:05:29.985121+0000","last_became_active":"2023-10-06T03:05:29.984686+0000","last_became_peered":"2023-10-06T03:05:29.984686+0000","last_unstale":"2023-10-06T03:05:29.985121+0000","last_undegraded":"2023-10-06T03:05:29.985121+0000","last_fullsized":"2023-10-06T03:05:29.985121+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:54.269190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.955549+0000","last_change":"2023-10-06T03:04:24.314547+0000","last_active":"2023-10-06T03:05:28.955549+0000","last_peered":"2023-10-06T03:05:28.955549+0000","last_clean":"2023-10-06T03:05:28.955549+0000","last_became_active":"2023-10-06T03:04:24.314278+0000","last_became_peered":"2023-10-06T03:04:24.314278+0000","last_unstale":"2023-10-06T03:05:28.955549+0000","last_undegraded":"2023-10-06T03:05:28.955549+0000","last_fullsized":"2023-10-06T03:05:28.955549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:25.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968906+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:48.595437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.970357+0000","last_change":"2023-10-06T03:05:29.970357+0000","last_active":"2023-10-06T03:05:29.970357+0000","last_peered":"2023-10-06T03:05:29.970357+0000","last_clean":"2023-10-06T03:05:29.970357+0000","last_became_active":"2023-10-06T03:05:29.970053+0000","last_became_peered":"2023-10-06T03:05:29.970053+0000","last_unstale":"2023-10-06T03:05:29.970357+0000","last_undegraded":"2023-10-06T03:05:29.970357+0000","last_fullsized":"2023-10-06T03:05:29.970357+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:37.623703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.959758+0000","last_change":"2023-10-06T03:04:23.807972+0000","last_active":"2023-10-06T03:05:28.959758+0000","last_peered":"2023-10-06T03:05:28.959758+0000","last_clean":"2023-10-06T03:05:28.959758+0000","last_became_active":"2023-10-06T03:04:23.807723+0000","last_became_peered":"2023-10-06T03:04:23.807723+0000","last_unstale":"2023-10-06T03:05:28.959758+0000","last_undegraded":"2023-10-06T03:05:28.959758+0000","last_fullsized":"2023-10-06T03:05:28.959758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.955973+0000","last_change":"2023-10-06T03:04:17.779925+0000","last_active":"2023-10-06T03:05:28.955973+0000","last_peered":"2023-10-06T03:05:28.955973+0000","last_clean":"2023-10-06T03:05:28.955973+0000","last_became_active":"2023-10-06T03:04:17.778997+0000","last_became_peered":"2023-10-06T03:04:17.778997+0000","last_unstale":"2023-10-06T03:05:28.955973+0000","last_undegraded":"2023-10-06T03:05:28.955973+0000","last_fullsized":"2023-10-06T03:05:28.955973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_clean_scrub_stamp":"2023-10-06T03:04:16.761610+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.975557+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.883295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.975059+0000","last_change":"2023-10-06T03:05:29.975059+0000","last_active":"2023-10-06T03:05:29.975059+0000","last_peered":"2023-10-06T03:05:29.975059+0000","last_clean":"2023-10-06T03:05:29.975059+0000","last_became_active":"2023-10-06T03:05:29.974806+0000","last_became_peered":"2023-10-06T03:05:29.974806+0000","last_unstale":"2023-10-06T03:05:29.975059+0000","last_undegraded":"2023-10-06T03:05:29.975059+0000","last_fullsized":"2023-10-06T03:05:29.975059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:07.796869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.956071+0000","last_change":"2023-10-06T03:04:23.814887+0000","last_active":"2023-10-06T03:05:28.956071+0000","last_peered":"2023-10-06T03:05:28.956071+0000","last_clean":"2023-10-06T03:05:28.956071+0000","last_became_active":"2023-10-06T03:04:23.814581+0000","last_became_peered":"2023-10-06T03:04:23.814581+0000","last_unstale":"2023-10-06T03:05:28.956071+0000","last_undegraded":"2023-10-06T03:05:28.956071+0000","last_fullsized":"2023-10-06T03:05:28.956071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.964736+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:49.871669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.973917+0000","last_change":"2023-10-06T03:05:29.973917+0000","last_active":"2023-10-06T03:05:29.973917+0000","last_peered":"2023-10-06T03:05:29.973917+0000","last_clean":"2023-10-06T03:05:29.973917+0000","last_became_active":"2023-10-06T03:05:29.973667+0000","last_became_peered":"2023-10-06T03:05:29.973667+0000","last_unstale":"2023-10-06T03:05:29.973917+0000","last_undegraded":"2023-10-06T03:05:29.973917+0000","last_fullsized":"2023-10-06T03:05:29.973917+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:07.355752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.956204+0000","last_change":"2023-10-06T03:04:23.986771+0000","last_active":"2023-10-06T03:05:28.956204+0000","last_peered":"2023-10-06T03:05:28.956204+0000","last_clean":"2023-10-06T03:05:28.956204+0000","last_became_active":"2023-10-06T03:04:23.986552+0000","last_became_peered":"2023-10-06T03:04:23.986552+0000","last_unstale":"2023-10-06T03:05:28.956204+0000","last_undegraded":"2023-10-06T03:05:28.956204+0000","last_fullsized":"2023-10-06T03:05:28.956204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.962817+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:01.791955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.979529+0000","last_change":"2023-10-06T03:05:29.979529+0000","last_active":"2023-10-06T03:05:29.979529+0000","last_peered":"2023-10-06T03:05:29.979529+0000","last_clean":"2023-10-06T03:05:29.979529+0000","last_became_active":"2023-10-06T03:05:29.979281+0000","last_became_peered":"2023-10-06T03:05:29.979281+0000","last_unstale":"2023-10-06T03:05:29.979529+0000","last_undegraded":"2023-10-06T03:05:29.979529+0000","last_fullsized":"2023-10-06T03:05:29.979529+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:56.742515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.958623+0000","last_change":"2023-10-06T03:04:23.813862+0000","last_active":"2023-10-06T03:05:28.958623+0000","last_peered":"2023-10-06T03:05:28.958623+0000","last_clean":"2023-10-06T03:05:28.958623+0000","last_became_active":"2023-10-06T03:04:23.813584+0000","last_became_peered":"2023-10-06T03:04:23.813584+0000","last_unstale":"2023-10-06T03:05:28.958623+0000","last_undegraded":"2023-10-06T03:05:28.958623+0000","last_fullsized":"2023-10-06T03:05:28.958623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.962871+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:52.170677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.985492+0000","last_change":"2023-10-06T03:05:29.985492+0000","last_active":"2023-10-06T03:05:29.985492+0000","last_peered":"2023-10-06T03:05:29.985492+0000","last_clean":"2023-10-06T03:05:29.985492+0000","last_became_active":"2023-10-06T03:05:29.984212+0000","last_became_peered":"2023-10-06T03:05:29.984212+0000","last_unstale":"2023-10-06T03:05:29.985492+0000","last_undegraded":"2023-10-06T03:05:29.985492+0000","last_fullsized":"2023-10-06T03:05:29.985492+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:37.763634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.955160+0000","last_change":"2023-10-06T03:04:23.805874+0000","last_active":"2023-10-06T03:05:28.955160+0000","last_peered":"2023-10-06T03:05:28.955160+0000","last_clean":"2023-10-06T03:05:28.955160+0000","last_became_active":"2023-10-06T03:04:23.805551+0000","last_became_peered":"2023-10-06T03:04:23.805551+0000","last_unstale":"2023-10-06T03:05:28.955160+0000","last_undegraded":"2023-10-06T03:05:28.955160+0000","last_fullsized":"2023-10-06T03:05:28.955160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:21.250275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298308,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073532,"statfs":{"total":96636764160,"available":96331296768,"internally_reserved":0,"allocated":1044480,"data_stored":788089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":3.8860000000000001,"5min":3.8860000000000001,"15min":3.8860000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.988,"5min":3.988,"15min":3.988},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":3.9510000000000001,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.444,"5min":3.444,"15min":3.444},"last":0.65900000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":4.1429999999999998,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":3.903,"5min":3.903,"15min":3.903},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":3.9260000000000002,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":0.63200000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.45000000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.42099999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":6.8220000000000001,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":6.8330000000000002,"5min":6.8330000000000002,"15min":6.8330000000000002},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.8929999999999998,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.497},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.948,"5min":3.948,"15min":3.948},"last":0.51500000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.379},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":3.996,"5min":3.996,"15min":3.996},"last":0.56200000000000006}]},{"osd":3,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.622}]},{"osd":5,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.59699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":438272,"data_stored":190793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.314}]},{"osd":2,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":6.056,"5min":6.056,"15min":6.056},"last":0.254},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.29199999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.377},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.51500000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.49099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298304,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073536,"statfs":{"total":96636764160,"available":96331300864,"internally_reserved":0,"allocated":1040384,"data_stored":787078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.35399999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.31}]},{"osd":3,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.32700000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.61099999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":12.913,"5min":12.913,"15min":12.913},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.31900000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":3.8919999999999999,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.36399999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.28499999999999998},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":12.941000000000001,"5min":12.941000000000001,"15min":12.941000000000001},"last":0.30599999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":12.846,"5min":12.846,"15min":12.846},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.45200000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":12.884,"5min":12.884,"15min":12.884},"last":0.503}]},{"osd":6,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.48099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.30399999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.38300000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.32200000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.39300000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.41899999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.44600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.5}]},{"osd":1,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.439},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.42699999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.48699999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.56499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46600000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.51300000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.624}]},{"osd":6,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:05:35.797 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:05:35.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.916+0000 7f3152da0700 1 Processor -- start 2023-10-06T03:05:35.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.916+0000 7f3152da0700 1 -- start start 2023-10-06T03:05:35.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.916+0000 7f3152da0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f314c0cc730 0x7f314c069c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:35.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.916+0000 7f3152da0700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f314c0c2d80 0x7f314c0c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:35.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.917+0000 7f3152da0700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314c069780 con 0x7f314c0c8620 2023-10-06T03:05:35.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.917+0000 7f3152da0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314c0c4130 con 0x7f314c0cc730 2023-10-06T03:05:35.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.917+0000 7f3152da0700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314c0c4410 con 0x7f314c0c2d80 2023-10-06T03:05:35.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.917+0000 7f3150b3c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f314c0cc730 0x7f314c069c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:35.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.917+0000 7f314bfff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f314c0c8620 0x7f314c0c8ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35274/0 (socket says 172.21.15.125:35274) 2023-10-06T03:05:35.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.917+0000 7f314bfff700 1 -- 172.21.15.125:0/3799353092 learned_addr learned my addr 172.21.15.125:0/3799353092 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:35.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.917+0000 7f315133d700 1 --2- 172.21.15.125:0/3799353092 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f314c0c2d80 0x7f314c0c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:35.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.917+0000 7f3150b3c700 1 -- 172.21.15.125:0/3799353092 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f314c0c2d80 msgr2=0x7f314c0c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:35.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.917+0000 7f3150b3c700 1 --2- 172.21.15.125:0/3799353092 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f314c0c2d80 0x7f314c0c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.917+0000 7f3150b3c700 1 -- 172.21.15.125:0/3799353092 >> v1:172.21.15.125:6789/0 conn(0x7f314c0c8620 legacy=0x7f314c0c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:35.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.917+0000 7f3150b3c700 1 -- 172.21.15.125:0/3799353092 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c069410 con 0x7f314c0cc730 2023-10-06T03:05:35.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.917+0000 7f314b7fe700 1 -- 172.21.15.125:0/3799353092 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486775878 0 0) 0x7f314c069780 con 0x7f314c0c8620 2023-10-06T03:05:35.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.917+0000 7f315133d700 1 --2- 172.21.15.125:0/3799353092 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f314c0c2d80 0x7f314c0c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:35.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.917+0000 7f3150b3c700 1 --2- 172.21.15.125:0/3799353092 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f314c0cc730 0x7f314c069c10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3140009900 tx=0x7f3140009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e09b4ee267c0ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:35.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.917+0000 7f314b7fe700 1 -- 172.21.15.125:0/3799353092 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3140009ea0 con 0x7f314c0cc730 2023-10-06T03:05:35.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.917+0000 7f314b7fe700 1 -- 172.21.15.125:0/3799353092 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3140005c10 con 0x7f314c0cc730 2023-10-06T03:05:35.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.917+0000 7f314b7fe700 1 -- 172.21.15.125:0/3799353092 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314000b610 con 0x7f314c0cc730 2023-10-06T03:05:35.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.918+0000 7f3152da0700 1 -- 172.21.15.125:0/3799353092 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f314c0cc730 msgr2=0x7f314c069c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:35.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.918+0000 7f3152da0700 1 --2- 172.21.15.125:0/3799353092 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f314c0cc730 0x7f314c069c10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3140009900 tx=0x7f3140009120 comp rx=0 tx=0).stop 2023-10-06T03:05:35.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.918+0000 7f3152da0700 1 -- 172.21.15.125:0/3799353092 shutdown_connections 2023-10-06T03:05:35.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.918+0000 7f3152da0700 1 --2- 172.21.15.125:0/3799353092 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f314c0c2d80 0x7f314c0c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.918+0000 7f3152da0700 1 --2- 172.21.15.125:0/3799353092 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f314c0cc730 0x7f314c069c10 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.918+0000 7f3152da0700 1 -- 172.21.15.125:0/3799353092 >> 172.21.15.125:0/3799353092 conn(0x7f314c067df0 msgr2=0x7f314c0cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:35.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.918+0000 7f3152da0700 1 -- 172.21.15.125:0/3799353092 shutdown_connections 2023-10-06T03:05:35.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.918+0000 7f3152da0700 1 -- 172.21.15.125:0/3799353092 wait complete. 2023-10-06T03:05:35.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.919+0000 7f3152da0700 1 Processor -- start 2023-10-06T03:05:35.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.919+0000 7f3152da0700 1 -- start start 2023-10-06T03:05:35.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.920+0000 7f3152da0700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f314c0c2d80 0x7f314c14ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:35.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.920+0000 7f3152da0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f314c0c8620 0x7f314c0c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:35.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.920+0000 7f3152da0700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f314c0cc730 0x7f314c06d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:35.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.920+0000 7f3152da0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c0c5f10 con 0x7f314c0c8620 2023-10-06T03:05:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.920+0000 7f3152da0700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c0c61f0 con 0x7f314c0c2d80 2023-10-06T03:05:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.920+0000 7f3152da0700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314c0c64d0 con 0x7f314c0cc730 2023-10-06T03:05:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.920+0000 7f314bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f314c0c8620 0x7f314c0c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.920+0000 7f314bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f314c0c8620 0x7f314c0c7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57818/0 (socket says 172.21.15.125:57818) 2023-10-06T03:05:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.920+0000 7f314bfff700 1 -- 172.21.15.125:0/4132012946 learned_addr learned my addr 172.21.15.125:0/4132012946 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.920+0000 7f3150b3c700 1 --2- 172.21.15.125:0/4132012946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f314c0c2d80 0x7f314c14ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.920+0000 7f315133d700 1 --2- 172.21.15.125:0/4132012946 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f314c0cc730 0x7f314c06d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.920+0000 7f314bfff700 1 -- 172.21.15.125:0/4132012946 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f314c0cc730 msgr2=0x7f314c06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.920+0000 7f314bfff700 1 --2- 172.21.15.125:0/4132012946 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f314c0cc730 0x7f314c06d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.920+0000 7f314bfff700 1 -- 172.21.15.125:0/4132012946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f314c0c2d80 msgr2=0x7f314c14ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.920+0000 7f314bfff700 1 --2- 172.21.15.125:0/4132012946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f314c0c2d80 0x7f314c14ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:35.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.920+0000 7f314bfff700 1 -- 172.21.15.125:0/4132012946 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31400093c0 con 0x7f314c0c8620 2023-10-06T03:05:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.920+0000 7f3150b3c700 1 --2- 172.21.15.125:0/4132012946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f314c0c2d80 0x7f314c14ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.920+0000 7f315133d700 1 --2- 172.21.15.125:0/4132012946 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f314c0cc730 0x7f314c06d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.921+0000 7f314bfff700 1 --2- 172.21.15.125:0/4132012946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f314c0c8620 0x7f314c0c7630 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f313800c7e0 tx=0x7f3138007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.921+0000 7f3148ff9700 1 -- 172.21.15.125:0/4132012946 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3138005b30 con 0x7f314c0c8620 2023-10-06T03:05:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.921+0000 7f3148ff9700 1 -- 172.21.15.125:0/4132012946 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3138005c90 con 0x7f314c0c8620 2023-10-06T03:05:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.921+0000 7f3152da0700 1 -- 172.21.15.125:0/4132012946 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314c0c67b0 con 0x7f314c0c8620 2023-10-06T03:05:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.921+0000 7f3148ff9700 1 -- 172.21.15.125:0/4132012946 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3138007300 con 0x7f314c0c8620 2023-10-06T03:05:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.921+0000 7f3152da0700 1 -- 172.21.15.125:0/4132012946 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314c15d0f0 con 0x7f314c0c8620 2023-10-06T03:05:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.922+0000 7f3152da0700 1 -- 172.21.15.125:0/4132012946 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314c15d3a0 con 0x7f314c0c8620 2023-10-06T03:05:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.922+0000 7f3148ff9700 1 -- 172.21.15.125:0/4132012946 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f313801b400 con 0x7f314c0c8620 2023-10-06T03:05:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.922+0000 7f3148ff9700 1 --2- 172.21.15.125:0/4132012946 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3130066f30 0x7f31300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:35.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.923+0000 7f3148ff9700 1 -- 172.21.15.125:0/4132012946 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f31380842b0 con 0x7f314c0c8620 2023-10-06T03:05:35.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.923+0000 7f3150b3c700 1 --2- 172.21.15.125:0/4132012946 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3130066f30 0x7f31300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:35.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.923+0000 7f3150b3c700 1 --2- 172.21.15.125:0/4132012946 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3130066f30 0x7f31300693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3140009390 tx=0x7f3140016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:35.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:35.927+0000 7f3148ff9700 1 -- 172.21.15.125:0/4132012946 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f314c15d3a0 con 0x7f314c0c8620 2023-10-06T03:05:36.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.104+0000 7f3152da0700 1 -- 172.21.15.125:0/4132012946 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f314c0c6360 con 0x7f3130066f30 2023-10-06T03:05:36.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.112+0000 7f3148ff9700 1 -- 172.21.15.125:0/4132012946 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307384 (secure 0 0 0) 0x7f314c0c6360 con 0x7f3130066f30 2023-10-06T03:05:36.117 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:36.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.115+0000 7f3152da0700 1 -- 172.21.15.125:0/4132012946 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3130066f30 msgr2=0x7f31300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:36.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.115+0000 7f3152da0700 1 --2- 172.21.15.125:0/4132012946 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3130066f30 0x7f31300693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3140009390 tx=0x7f3140016000 comp rx=0 tx=0).stop 2023-10-06T03:05:36.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.115+0000 7f3152da0700 1 -- 172.21.15.125:0/4132012946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f314c0c8620 msgr2=0x7f314c0c7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:36.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.115+0000 7f3152da0700 1 --2- 172.21.15.125:0/4132012946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f314c0c8620 0x7f314c0c7630 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f313800c7e0 tx=0x7f3138007df0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.115+0000 7f3152da0700 1 -- 172.21.15.125:0/4132012946 shutdown_connections 2023-10-06T03:05:36.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.115+0000 7f3152da0700 1 --2- 172.21.15.125:0/4132012946 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3130066f30 0x7f31300693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.115+0000 7f3152da0700 1 --2- 172.21.15.125:0/4132012946 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f314c0cc730 0x7f314c06d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.115+0000 7f3152da0700 1 --2- 172.21.15.125:0/4132012946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f314c0c2d80 0x7f314c14ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.120 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.115+0000 7f3152da0700 1 --2- 172.21.15.125:0/4132012946 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f314c0c8620 0x7f314c0c7630 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.115+0000 7f3152da0700 1 -- 172.21.15.125:0/4132012946 >> 172.21.15.125:0/4132012946 conn(0x7f314c067df0 msgr2=0x7f314c158eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:36.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.115+0000 7f3152da0700 1 -- 172.21.15.125:0/4132012946 shutdown_connections 2023-10-06T03:05:36.121 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.115+0000 7f3152da0700 1 -- 172.21.15.125:0/4132012946 wait complete. 2023-10-06T03:05:36.121 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-06T03:05:36.128 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2023-10-06T03:05:35.821153+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382968,"kb_used_data":4664,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591752,"statfs":{"total":773094113280,"available":770653954048,"internally_reserved":0,"allocated":4775936,"data_stored":2754565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001101"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.977120+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:09.648317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965909+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:43.140690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.971367+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:55.892723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970103+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:40.458075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965533+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:40.458075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.964382+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:27.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.978584+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:01.791955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.971609+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:20.015541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970572+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.883295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972711+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:49.871669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970926+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:09.648317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965140+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:04.527321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968578+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:11:43.857971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968492+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:38.629349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965205+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:30.642665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968417+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:59.140697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972557+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:20.868524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.973518+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:08.111584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.969526+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:20.123410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.966794+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:02.178769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.963978+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:48.052762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968003+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:55.274836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967331+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:29.787384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967851+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:45.882319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.969585+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:40:02.105572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967366+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:25.832521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970990+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:40.812378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.966935+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:09.648317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967440+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:23.219456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970924+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:06.331617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.964783+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:01.960298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967824+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:46.506948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965273+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:40.459403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.973435+0000","last_change":"2023-10-06T03:05:29.973435+0000","last_active":"2023-10-06T03:05:29.973435+0000","last_peered":"2023-10-06T03:05:29.973435+0000","last_clean":"2023-10-06T03:05:29.973435+0000","last_became_active":"2023-10-06T03:05:29.973213+0000","last_became_peered":"2023-10-06T03:05:29.973213+0000","last_unstale":"2023-10-06T03:05:29.973435+0000","last_undegraded":"2023-10-06T03:05:29.973435+0000","last_fullsized":"2023-10-06T03:05:29.973435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:42.135044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970472+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:20.204857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.983368+0000","last_change":"2023-10-06T03:05:29.983368+0000","last_active":"2023-10-06T03:05:29.983368+0000","last_peered":"2023-10-06T03:05:29.983368+0000","last_clean":"2023-10-06T03:05:29.983368+0000","last_became_active":"2023-10-06T03:05:29.983086+0000","last_became_peered":"2023-10-06T03:05:29.983086+0000","last_unstale":"2023-10-06T03:05:29.983368+0000","last_undegraded":"2023-10-06T03:05:29.983368+0000","last_fullsized":"2023-10-06T03:05:29.983368+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:51.040731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.966433+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.883295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.975058+0000","last_change":"2023-10-06T03:05:29.975058+0000","last_active":"2023-10-06T03:05:29.975058+0000","last_peered":"2023-10-06T03:05:29.975058+0000","last_clean":"2023-10-06T03:05:29.975058+0000","last_became_active":"2023-10-06T03:05:29.974839+0000","last_became_peered":"2023-10-06T03:05:29.974839+0000","last_unstale":"2023-10-06T03:05:29.975058+0000","last_undegraded":"2023-10-06T03:05:29.975058+0000","last_fullsized":"2023-10-06T03:05:29.975058+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:54.194868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965487+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:12.918300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.983896+0000","last_change":"2023-10-06T03:05:29.983896+0000","last_active":"2023-10-06T03:05:29.983896+0000","last_peered":"2023-10-06T03:05:29.983896+0000","last_clean":"2023-10-06T03:05:29.983896+0000","last_became_active":"2023-10-06T03:05:29.983586+0000","last_became_peered":"2023-10-06T03:05:29.983586+0000","last_unstale":"2023-10-06T03:05:29.983896+0000","last_undegraded":"2023-10-06T03:05:29.983896+0000","last_fullsized":"2023-10-06T03:05:29.983896+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:48.866023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970382+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:30.642665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.984468+0000","last_change":"2023-10-06T03:05:29.984468+0000","last_active":"2023-10-06T03:05:29.984468+0000","last_peered":"2023-10-06T03:05:29.984468+0000","last_clean":"2023-10-06T03:05:29.984468+0000","last_became_active":"2023-10-06T03:05:29.984216+0000","last_became_peered":"2023-10-06T03:05:29.984216+0000","last_unstale":"2023-10-06T03:05:29.984468+0000","last_undegraded":"2023-10-06T03:05:29.984468+0000","last_fullsized":"2023-10-06T03:05:29.984468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:10.613335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972004+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:04.527321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.978356+0000","last_change":"2023-10-06T03:05:29.978356+0000","last_active":"2023-10-06T03:05:29.978356+0000","last_peered":"2023-10-06T03:05:29.978356+0000","last_clean":"2023-10-06T03:05:29.978356+0000","last_became_active":"2023-10-06T03:05:29.978068+0000","last_became_peered":"2023-10-06T03:05:29.978068+0000","last_unstale":"2023-10-06T03:05:29.978356+0000","last_undegraded":"2023-10-06T03:05:29.978356+0000","last_fullsized":"2023-10-06T03:05:29.978356+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:13.299028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.971219+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:11.618981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.975560+0000","last_change":"2023-10-06T03:05:29.975560+0000","last_active":"2023-10-06T03:05:29.975560+0000","last_peered":"2023-10-06T03:05:29.975560+0000","last_clean":"2023-10-06T03:05:29.975560+0000","last_became_active":"2023-10-06T03:05:29.975146+0000","last_became_peered":"2023-10-06T03:05:29.975146+0000","last_unstale":"2023-10-06T03:05:29.975560+0000","last_undegraded":"2023-10-06T03:05:29.975560+0000","last_fullsized":"2023-10-06T03:05:29.975560+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:37.763634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968464+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:58.428726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.978576+0000","last_change":"2023-10-06T03:05:29.978576+0000","last_active":"2023-10-06T03:05:29.978576+0000","last_peered":"2023-10-06T03:05:29.978576+0000","last_clean":"2023-10-06T03:05:29.978576+0000","last_became_active":"2023-10-06T03:05:29.978314+0000","last_became_peered":"2023-10-06T03:05:29.978314+0000","last_unstale":"2023-10-06T03:05:29.978576+0000","last_undegraded":"2023-10-06T03:05:29.978576+0000","last_fullsized":"2023-10-06T03:05:29.978576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:25.902043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972141+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:13:06.401671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.976856+0000","last_change":"2023-10-06T03:05:29.976856+0000","last_active":"2023-10-06T03:05:29.976856+0000","last_peered":"2023-10-06T03:05:29.976856+0000","last_clean":"2023-10-06T03:05:29.976856+0000","last_became_active":"2023-10-06T03:05:29.976594+0000","last_became_peered":"2023-10-06T03:05:29.976594+0000","last_unstale":"2023-10-06T03:05:29.976856+0000","last_undegraded":"2023-10-06T03:05:29.976856+0000","last_fullsized":"2023-10-06T03:05:29.976856+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:51.165031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.975127+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:43.140690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.980481+0000","last_change":"2023-10-06T03:05:29.980481+0000","last_active":"2023-10-06T03:05:29.980481+0000","last_peered":"2023-10-06T03:05:29.980481+0000","last_clean":"2023-10-06T03:05:29.980481+0000","last_became_active":"2023-10-06T03:05:29.980279+0000","last_became_peered":"2023-10-06T03:05:29.980279+0000","last_unstale":"2023-10-06T03:05:29.980481+0000","last_undegraded":"2023-10-06T03:05:29.980481+0000","last_fullsized":"2023-10-06T03:05:29.980481+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:07.796869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.963684+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:14.304674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.984960+0000","last_change":"2023-10-06T03:05:29.984960+0000","last_active":"2023-10-06T03:05:29.984960+0000","last_peered":"2023-10-06T03:05:29.984960+0000","last_clean":"2023-10-06T03:05:29.984960+0000","last_became_active":"2023-10-06T03:05:29.984390+0000","last_became_peered":"2023-10-06T03:05:29.984390+0000","last_unstale":"2023-10-06T03:05:29.984960+0000","last_undegraded":"2023-10-06T03:05:29.984960+0000","last_fullsized":"2023-10-06T03:05:29.984960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:39.615480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.977218+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:11.618981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.981372+0000","last_change":"2023-10-06T03:05:29.981372+0000","last_active":"2023-10-06T03:05:29.981372+0000","last_peered":"2023-10-06T03:05:29.981372+0000","last_clean":"2023-10-06T03:05:29.981372+0000","last_became_active":"2023-10-06T03:05:29.981115+0000","last_became_peered":"2023-10-06T03:05:29.981115+0000","last_unstale":"2023-10-06T03:05:29.981372+0000","last_undegraded":"2023-10-06T03:05:29.981372+0000","last_fullsized":"2023-10-06T03:05:29.981372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:19.117764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967727+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:21.306429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.977336+0000","last_change":"2023-10-06T03:05:29.977336+0000","last_active":"2023-10-06T03:05:29.977336+0000","last_peered":"2023-10-06T03:05:29.977336+0000","last_clean":"2023-10-06T03:05:29.977336+0000","last_became_active":"2023-10-06T03:05:29.976614+0000","last_became_peered":"2023-10-06T03:05:29.976614+0000","last_unstale":"2023-10-06T03:05:29.977336+0000","last_undegraded":"2023-10-06T03:05:29.977336+0000","last_fullsized":"2023-10-06T03:05:29.977336+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:39.452429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972501+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:01.791955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.983120+0000","last_change":"2023-10-06T03:05:29.983120+0000","last_active":"2023-10-06T03:05:29.983120+0000","last_peered":"2023-10-06T03:05:29.983120+0000","last_clean":"2023-10-06T03:05:29.983120+0000","last_became_active":"2023-10-06T03:05:29.982850+0000","last_became_peered":"2023-10-06T03:05:29.982850+0000","last_unstale":"2023-10-06T03:05:29.983120+0000","last_undegraded":"2023-10-06T03:05:29.983120+0000","last_fullsized":"2023-10-06T03:05:29.983120+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:47.589791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.963374+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:52.046377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.976278+0000","last_change":"2023-10-06T03:05:29.976278+0000","last_active":"2023-10-06T03:05:29.976278+0000","last_peered":"2023-10-06T03:05:29.976278+0000","last_clean":"2023-10-06T03:05:29.976278+0000","last_became_active":"2023-10-06T03:05:29.976023+0000","last_became_peered":"2023-10-06T03:05:29.976023+0000","last_unstale":"2023-10-06T03:05:29.976278+0000","last_undegraded":"2023-10-06T03:05:29.976278+0000","last_fullsized":"2023-10-06T03:05:29.976278+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:03.521675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.978110+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:25.519827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.983223+0000","last_change":"2023-10-06T03:05:29.983223+0000","last_active":"2023-10-06T03:05:29.983223+0000","last_peered":"2023-10-06T03:05:29.983223+0000","last_clean":"2023-10-06T03:05:29.983223+0000","last_became_active":"2023-10-06T03:05:29.983009+0000","last_became_peered":"2023-10-06T03:05:29.983009+0000","last_unstale":"2023-10-06T03:05:29.983223+0000","last_undegraded":"2023-10-06T03:05:29.983223+0000","last_fullsized":"2023-10-06T03:05:29.983223+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:39.453757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.966931+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:20.204857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.971763+0000","last_change":"2023-10-06T03:05:29.971763+0000","last_active":"2023-10-06T03:05:29.971763+0000","last_peered":"2023-10-06T03:05:29.971763+0000","last_clean":"2023-10-06T03:05:29.971763+0000","last_became_active":"2023-10-06T03:05:29.971518+0000","last_became_peered":"2023-10-06T03:05:29.971518+0000","last_unstale":"2023-10-06T03:05:29.971763+0000","last_undegraded":"2023-10-06T03:05:29.971763+0000","last_fullsized":"2023-10-06T03:05:29.971763+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:44.816300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970168+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:43.140690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.980139+0000","last_change":"2023-10-06T03:05:29.980139+0000","last_active":"2023-10-06T03:05:29.980139+0000","last_peered":"2023-10-06T03:05:29.980139+0000","last_clean":"2023-10-06T03:05:29.980139+0000","last_became_active":"2023-10-06T03:05:29.979914+0000","last_became_peered":"2023-10-06T03:05:29.979914+0000","last_unstale":"2023-10-06T03:05:29.980139+0000","last_undegraded":"2023-10-06T03:05:29.980139+0000","last_fullsized":"2023-10-06T03:05:29.980139+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:47.047116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968557+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:54.082681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.974952+0000","last_change":"2023-10-06T03:05:29.974952+0000","last_active":"2023-10-06T03:05:29.974952+0000","last_peered":"2023-10-06T03:05:29.974952+0000","last_clean":"2023-10-06T03:05:29.974952+0000","last_became_active":"2023-10-06T03:05:29.974721+0000","last_became_peered":"2023-10-06T03:05:29.974721+0000","last_unstale":"2023-10-06T03:05:29.974952+0000","last_undegraded":"2023-10-06T03:05:29.974952+0000","last_fullsized":"2023-10-06T03:05:29.974952+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:47.589791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968980+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:45.821946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.972966+0000","last_change":"2023-10-06T03:05:29.972966+0000","last_active":"2023-10-06T03:05:29.972966+0000","last_peered":"2023-10-06T03:05:29.972966+0000","last_clean":"2023-10-06T03:05:29.972966+0000","last_became_active":"2023-10-06T03:05:29.972751+0000","last_became_peered":"2023-10-06T03:05:29.972751+0000","last_unstale":"2023-10-06T03:05:29.972966+0000","last_undegraded":"2023-10-06T03:05:29.972966+0000","last_fullsized":"2023-10-06T03:05:29.972966+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:54.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.963327+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:57.748161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.985021+0000","last_change":"2023-10-06T03:05:29.985021+0000","last_active":"2023-10-06T03:05:29.985021+0000","last_peered":"2023-10-06T03:05:29.985021+0000","last_clean":"2023-10-06T03:05:29.985021+0000","last_became_active":"2023-10-06T03:05:29.984799+0000","last_became_peered":"2023-10-06T03:05:29.984799+0000","last_unstale":"2023-10-06T03:05:29.985021+0000","last_undegraded":"2023-10-06T03:05:29.985021+0000","last_fullsized":"2023-10-06T03:05:29.985021+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:08.642671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965199+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:26.907689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.974630+0000","last_change":"2023-10-06T03:05:29.974630+0000","last_active":"2023-10-06T03:05:29.974630+0000","last_peered":"2023-10-06T03:05:29.974630+0000","last_clean":"2023-10-06T03:05:29.974630+0000","last_became_active":"2023-10-06T03:05:29.974231+0000","last_became_peered":"2023-10-06T03:05:29.974231+0000","last_unstale":"2023-10-06T03:05:29.974630+0000","last_undegraded":"2023-10-06T03:05:29.974630+0000","last_fullsized":"2023-10-06T03:05:29.974630+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:54.269190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968267+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:05.824734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.984580+0000","last_change":"2023-10-06T03:05:29.984580+0000","last_active":"2023-10-06T03:05:29.984580+0000","last_peered":"2023-10-06T03:05:29.984580+0000","last_clean":"2023-10-06T03:05:29.984580+0000","last_became_active":"2023-10-06T03:05:29.984339+0000","last_became_peered":"2023-10-06T03:05:29.984339+0000","last_unstale":"2023-10-06T03:05:29.984580+0000","last_undegraded":"2023-10-06T03:05:29.984580+0000","last_fullsized":"2023-10-06T03:05:29.984580+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:54.194868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968842+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:38.769280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.984844+0000","last_change":"2023-10-06T03:05:29.984844+0000","last_active":"2023-10-06T03:05:29.984844+0000","last_peered":"2023-10-06T03:05:29.984844+0000","last_clean":"2023-10-06T03:05:29.984844+0000","last_became_active":"2023-10-06T03:05:29.984231+0000","last_became_peered":"2023-10-06T03:05:29.984231+0000","last_unstale":"2023-10-06T03:05:29.984844+0000","last_undegraded":"2023-10-06T03:05:29.984844+0000","last_fullsized":"2023-10-06T03:05:29.984844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:37.623703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.969618+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:01.960298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.975732+0000","last_change":"2023-10-06T03:05:29.975732+0000","last_active":"2023-10-06T03:05:29.975732+0000","last_peered":"2023-10-06T03:05:29.975732+0000","last_clean":"2023-10-06T03:05:29.975732+0000","last_became_active":"2023-10-06T03:05:29.975382+0000","last_became_peered":"2023-10-06T03:05:29.975382+0000","last_unstale":"2023-10-06T03:05:29.975732+0000","last_undegraded":"2023-10-06T03:05:29.975732+0000","last_fullsized":"2023-10-06T03:05:29.975732+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:39.077978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.958591+0000","last_change":"2023-10-06T03:04:23.986472+0000","last_active":"2023-10-06T03:05:28.958591+0000","last_peered":"2023-10-06T03:05:28.958591+0000","last_clean":"2023-10-06T03:05:28.958591+0000","last_became_active":"2023-10-06T03:04:23.986228+0000","last_became_peered":"2023-10-06T03:04:23.986228+0000","last_unstale":"2023-10-06T03:05:28.958591+0000","last_undegraded":"2023-10-06T03:05:28.958591+0000","last_fullsized":"2023-10-06T03:05:28.958591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:08.739849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970004+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:02.178769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.976944+0000","last_change":"2023-10-06T03:05:29.976944+0000","last_active":"2023-10-06T03:05:29.976944+0000","last_peered":"2023-10-06T03:05:29.976944+0000","last_clean":"2023-10-06T03:05:29.976944+0000","last_became_active":"2023-10-06T03:05:29.976712+0000","last_became_peered":"2023-10-06T03:05:29.976712+0000","last_unstale":"2023-10-06T03:05:29.976944+0000","last_undegraded":"2023-10-06T03:05:29.976944+0000","last_fullsized":"2023-10-06T03:05:29.976944+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:19.009895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.959884+0000","last_change":"2023-10-06T03:04:23.814917+0000","last_active":"2023-10-06T03:05:28.959884+0000","last_peered":"2023-10-06T03:05:28.959884+0000","last_clean":"2023-10-06T03:05:28.959884+0000","last_became_active":"2023-10-06T03:04:23.814601+0000","last_became_peered":"2023-10-06T03:04:23.814601+0000","last_unstale":"2023-10-06T03:05:28.959884+0000","last_undegraded":"2023-10-06T03:05:28.959884+0000","last_fullsized":"2023-10-06T03:05:28.959884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.969001+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:40.621126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.985121+0000","last_change":"2023-10-06T03:05:29.985121+0000","last_active":"2023-10-06T03:05:29.985121+0000","last_peered":"2023-10-06T03:05:29.985121+0000","last_clean":"2023-10-06T03:05:29.985121+0000","last_became_active":"2023-10-06T03:05:29.984686+0000","last_became_peered":"2023-10-06T03:05:29.984686+0000","last_unstale":"2023-10-06T03:05:29.985121+0000","last_undegraded":"2023-10-06T03:05:29.985121+0000","last_fullsized":"2023-10-06T03:05:29.985121+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:54.269190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.955549+0000","last_change":"2023-10-06T03:04:24.314547+0000","last_active":"2023-10-06T03:05:28.955549+0000","last_peered":"2023-10-06T03:05:28.955549+0000","last_clean":"2023-10-06T03:05:28.955549+0000","last_became_active":"2023-10-06T03:04:24.314278+0000","last_became_peered":"2023-10-06T03:04:24.314278+0000","last_unstale":"2023-10-06T03:05:28.955549+0000","last_undegraded":"2023-10-06T03:05:28.955549+0000","last_fullsized":"2023-10-06T03:05:28.955549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:25.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968906+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:48.595437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.970357+0000","last_change":"2023-10-06T03:05:29.970357+0000","last_active":"2023-10-06T03:05:29.970357+0000","last_peered":"2023-10-06T03:05:29.970357+0000","last_clean":"2023-10-06T03:05:29.970357+0000","last_became_active":"2023-10-06T03:05:29.970053+0000","last_became_peered":"2023-10-06T03:05:29.970053+0000","last_unstale":"2023-10-06T03:05:29.970357+0000","last_undegraded":"2023-10-06T03:05:29.970357+0000","last_fullsized":"2023-10-06T03:05:29.970357+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:37.623703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.959758+0000","last_change":"2023-10-06T03:04:23.807972+0000","last_active":"2023-10-06T03:05:28.959758+0000","last_peered":"2023-10-06T03:05:28.959758+0000","last_clean":"2023-10-06T03:05:28.959758+0000","last_became_active":"2023-10-06T03:04:23.807723+0000","last_became_peered":"2023-10-06T03:04:23.807723+0000","last_unstale":"2023-10-06T03:05:28.959758+0000","last_undegraded":"2023-10-06T03:05:28.959758+0000","last_fullsized":"2023-10-06T03:05:28.959758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.955973+0000","last_change":"2023-10-06T03:04:17.779925+0000","last_active":"2023-10-06T03:05:28.955973+0000","last_peered":"2023-10-06T03:05:28.955973+0000","last_clean":"2023-10-06T03:05:28.955973+0000","last_became_active":"2023-10-06T03:04:17.778997+0000","last_became_peered":"2023-10-06T03:04:17.778997+0000","last_unstale":"2023-10-06T03:05:28.955973+0000","last_undegraded":"2023-10-06T03:05:28.955973+0000","last_fullsized":"2023-10-06T03:05:28.955973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_clean_scrub_stamp":"2023-10-06T03:04:16.761610+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.975557+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.883295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.975059+0000","last_change":"2023-10-06T03:05:29.975059+0000","last_active":"2023-10-06T03:05:29.975059+0000","last_peered":"2023-10-06T03:05:29.975059+0000","last_clean":"2023-10-06T03:05:29.975059+0000","last_became_active":"2023-10-06T03:05:29.974806+0000","last_became_peered":"2023-10-06T03:05:29.974806+0000","last_unstale":"2023-10-06T03:05:29.975059+0000","last_undegraded":"2023-10-06T03:05:29.975059+0000","last_fullsized":"2023-10-06T03:05:29.975059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:07.796869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.956071+0000","last_change":"2023-10-06T03:04:23.814887+0000","last_active":"2023-10-06T03:05:28.956071+0000","last_peered":"2023-10-06T03:05:28.956071+0000","last_clean":"2023-10-06T03:05:28.956071+0000","last_became_active":"2023-10-06T03:04:23.814581+0000","last_became_peered":"2023-10-06T03:04:23.814581+0000","last_unstale":"2023-10-06T03:05:28.956071+0000","last_undegraded":"2023-10-06T03:05:28.956071+0000","last_fullsized":"2023-10-06T03:05:28.956071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.964736+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:49.871669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.973917+0000","last_change":"2023-10-06T03:05:29.973917+0000","last_active":"2023-10-06T03:05:29.973917+0000","last_peered":"2023-10-06T03:05:29.973917+0000","last_clean":"2023-10-06T03:05:29.973917+0000","last_became_active":"2023-10-06T03:05:29.973667+0000","last_became_peered":"2023-10-06T03:05:29.973667+0000","last_unstale":"2023-10-06T03:05:29.973917+0000","last_undegraded":"2023-10-06T03:05:29.973917+0000","last_fullsized":"2023-10-06T03:05:29.973917+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:07.355752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.956204+0000","last_change":"2023-10-06T03:04:23.986771+0000","last_active":"2023-10-06T03:05:28.956204+0000","last_peered":"2023-10-06T03:05:28.956204+0000","last_clean":"2023-10-06T03:05:28.956204+0000","last_became_active":"2023-10-06T03:04:23.986552+0000","last_became_peered":"2023-10-06T03:04:23.986552+0000","last_unstale":"2023-10-06T03:05:28.956204+0000","last_undegraded":"2023-10-06T03:05:28.956204+0000","last_fullsized":"2023-10-06T03:05:28.956204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.962817+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:01.791955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.979529+0000","last_change":"2023-10-06T03:05:29.979529+0000","last_active":"2023-10-06T03:05:29.979529+0000","last_peered":"2023-10-06T03:05:29.979529+0000","last_clean":"2023-10-06T03:05:29.979529+0000","last_became_active":"2023-10-06T03:05:29.979281+0000","last_became_peered":"2023-10-06T03:05:29.979281+0000","last_unstale":"2023-10-06T03:05:29.979529+0000","last_undegraded":"2023-10-06T03:05:29.979529+0000","last_fullsized":"2023-10-06T03:05:29.979529+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:56.742515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.958623+0000","last_change":"2023-10-06T03:04:23.813862+0000","last_active":"2023-10-06T03:05:28.958623+0000","last_peered":"2023-10-06T03:05:28.958623+0000","last_clean":"2023-10-06T03:05:28.958623+0000","last_became_active":"2023-10-06T03:04:23.813584+0000","last_became_peered":"2023-10-06T03:04:23.813584+0000","last_unstale":"2023-10-06T03:05:28.958623+0000","last_undegraded":"2023-10-06T03:05:28.958623+0000","last_fullsized":"2023-10-06T03:05:28.958623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.962871+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:52.170677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.985492+0000","last_change":"2023-10-06T03:05:29.985492+0000","last_active":"2023-10-06T03:05:29.985492+0000","last_peered":"2023-10-06T03:05:29.985492+0000","last_clean":"2023-10-06T03:05:29.985492+0000","last_became_active":"2023-10-06T03:05:29.984212+0000","last_became_peered":"2023-10-06T03:05:29.984212+0000","last_unstale":"2023-10-06T03:05:29.985492+0000","last_undegraded":"2023-10-06T03:05:29.985492+0000","last_fullsized":"2023-10-06T03:05:29.985492+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:37.763634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.955160+0000","last_change":"2023-10-06T03:04:23.805874+0000","last_active":"2023-10-06T03:05:28.955160+0000","last_peered":"2023-10-06T03:05:28.955160+0000","last_clean":"2023-10-06T03:05:28.955160+0000","last_became_active":"2023-10-06T03:04:23.805551+0000","last_became_peered":"2023-10-06T03:04:23.805551+0000","last_unstale":"2023-10-06T03:05:28.955160+0000","last_undegraded":"2023-10-06T03:05:28.955160+0000","last_fullsized":"2023-10-06T03:05:28.955160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:21.250275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298308,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073532,"statfs":{"total":96636764160,"available":96331296768,"internally_reserved":0,"allocated":1044480,"data_stored":788089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":3.8860000000000001,"5min":3.8860000000000001,"15min":3.8860000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.988,"5min":3.988,"15min":3.988},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":3.9510000000000001,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.444,"5min":3.444,"15min":3.444},"last":0.65900000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":4.1429999999999998,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":3.903,"5min":3.903,"15min":3.903},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":3.9260000000000002,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":0.63200000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.45000000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.42099999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":6.8220000000000001,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":6.8330000000000002,"5min":6.8330000000000002,"15min":6.8330000000000002},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.8929999999999998,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.497},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.948,"5min":3.948,"15min":3.948},"last":0.51500000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.379},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":3.996,"5min":3.996,"15min":3.996},"last":0.56200000000000006}]},{"osd":3,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.622}]},{"osd":5,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.59699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":438272,"data_stored":190793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.314}]},{"osd":2,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":6.056,"5min":6.056,"15min":6.056},"last":0.254},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.29199999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.377},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.51500000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.49099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298304,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073536,"statfs":{"total":96636764160,"available":96331300864,"internally_reserved":0,"allocated":1040384,"data_stored":787078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.35399999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.31}]},{"osd":3,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.32700000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.61099999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":12.913,"5min":12.913,"15min":12.913},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.31900000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":3.8919999999999999,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.36399999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.28499999999999998},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":12.941000000000001,"5min":12.941000000000001,"15min":12.941000000000001},"last":0.30599999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":12.846,"5min":12.846,"15min":12.846},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.45200000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":12.884,"5min":12.884,"15min":12.884},"last":0.503}]},{"osd":6,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.48099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.30399999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.38300000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.32200000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.39300000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.41899999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.44600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.5}]},{"osd":1,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.439},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.42699999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.48699999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.56499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46600000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.51300000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.624}]},{"osd":6,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:05:36.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-10-06T03:05:36.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.977120+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:10:09.648317+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:05:36.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2023-10-06T03:05:36.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.965909+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:34:43.140690+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T03:05:36.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-10-06T03:05:36.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.971367+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:08:55.892723+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:05:36.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-10-06T03:05:36.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.970103+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:14:40.458075+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:05:36.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-10-06T03:05:36.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.965533+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:14:40.458075+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T03:05:36.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2023-10-06T03:05:36.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.964382+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:33:27.920655+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:05:36.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-10-06T03:05:36.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.978584+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:19:01.791955+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:05:36.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-10-06T03:05:36.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.971609+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:35:20.015541+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:05:36.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-10-06T03:05:36.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.970572+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:21:55.883295+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:05:36.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-10-06T03:05:36.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.972711+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:40:49.871669+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:05:36.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-10-06T03:05:36.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.970926+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:10:09.648317+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:05:36.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2023-10-06T03:05:36.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.965140+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:53:04.527321+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T03:05:36.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2023-10-06T03:05:36.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.968578+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:11:43.857971+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T03:05:36.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-10-06T03:05:36.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.968492+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:59:38.629349+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:05:36.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2023-10-06T03:05:36.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.965205+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:49:30.642665+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:05:36.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-10-06T03:05:36.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.968417+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:00:59.140697+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:05:36.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-10-06T03:05:36.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.972557+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:56:20.868524+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:05:36.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-10-06T03:05:36.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.973518+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:50:08.111584+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:05:36.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-10-06T03:05:36.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.969526+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:39:20.123410+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:05:36.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-10-06T03:05:36.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.966794+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:58:02.178769+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T03:05:36.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2023-10-06T03:05:36.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.963978+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:16:48.052762+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:05:36.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-10-06T03:05:36.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.968003+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:09:55.274836+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:05:36.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-10-06T03:05:36.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.967331+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:12:29.787384+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:05:36.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-10-06T03:05:36.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.967851+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:17:45.882319+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:05:36.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-10-06T03:05:36.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.969585+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:40:02.105572+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:05:36.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2023-10-06T03:05:36.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.967366+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:12:25.832521+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T03:05:36.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-10-06T03:05:36.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.970990+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:45:40.812378+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:05:36.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-10-06T03:05:36.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.966935+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:10:09.648317+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T03:05:36.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-10-06T03:05:36.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.967440+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:59:23.219456+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:05:36.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-10-06T03:05:36.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.970924+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:04:06.331617+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:05:36.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2023-10-06T03:05:36.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.964783+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:23:01.960298+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:05:36.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2023-10-06T03:05:36.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.967824+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:07:46.506948+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T03:05:36.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-10-06T03:05:36.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.965273+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:09:40.459403+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T03:05:36.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-10-06T03:05:36.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.970472+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:40:20.204857+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:05:36.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-10-06T03:05:36.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.966433+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:21:55.883295+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T03:05:36.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-10-06T03:05:36.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.965487+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T04:53:12.918300+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T03:05:36.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-10-06T03:05:36.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.970382+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:49:30.642665+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:05:36.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-10-06T03:05:36.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.972004+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:53:04.527321+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:05:36.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-10-06T03:05:36.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.971219+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:45:11.618981+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:05:36.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-10-06T03:05:36.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.968464+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:15:58.428726+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:05:36.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-10-06T03:05:36.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.972141+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:13:06.401671+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:05:36.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-10-06T03:05:36.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.975127+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:34:43.140690+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:05:36.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-10-06T03:05:36.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.963684+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:40:14.304674+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:05:36.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-10-06T03:05:36.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.977218+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:45:11.618981+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:05:36.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-10-06T03:05:36.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.967727+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:34:21.306429+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:05:36.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-10-06T03:05:36.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.972501+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:19:01.791955+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:05:36.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-10-06T03:05:36.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.963374+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:53:52.046377+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:05:36.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-10-06T03:05:36.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.978110+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:45:25.519827+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:05:36.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-10-06T03:05:36.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.966931+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:40:20.204857+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T03:05:36.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-10-06T03:05:36.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.970168+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:34:43.140690+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:05:36.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-10-06T03:05:36.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.968557+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:18:54.082681+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:05:36.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-10-06T03:05:36.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.968980+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:40:45.821946+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:05:36.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-10-06T03:05:36.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.963327+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:37:57.748161+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:05:36.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-10-06T03:05:36.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.965199+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:19:26.907689+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T03:05:36.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-10-06T03:05:36.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.968267+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:45:05.824734+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T03:05:36.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-10-06T03:05:36.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.968842+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:41:38.769280+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:05:36.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-10-06T03:05:36.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.969618+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:23:01.960298+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T03:05:36.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-10-06T03:05:36.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.970004+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:58:02.178769+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T03:05:36.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-10-06T03:05:36.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.969001+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:07:40.621126+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:05:36.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-10-06T03:05:36.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.968906+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:40:48.595437+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:05:36.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-10-06T03:05:36.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.975557+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:21:55.883295+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:05:36.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-10-06T03:05:36.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.964736+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T08:40:49.871669+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T03:05:36.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-10-06T03:05:36.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.962817+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:19:01.791955+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:05:36.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-10-06T03:05:36.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:05:29.950435+0000', 'last_change': '2023-10-06T03:05:29.962871+0000', 'last_active': '2023-10-06T03:05:29.950435+0000', 'last_peered': '2023-10-06T03:05:29.950435+0000', 'last_clean': '2023-10-06T03:05:29.950435+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:05:29.950435+0000', 'last_undegraded': '2023-10-06T03:05:29.950435+0000', 'last_fullsized': '2023-10-06T03:05:29.950435+0000', 'mapping_epoch': 39, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 39, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'last_clean_scrub_stamp': '2023-10-06T03:05:29.950435+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:09:52.170677+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T03:05:36.151 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:05:36.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.285+0000 7f90b42bf700 1 Processor -- start 2023-10-06T03:05:36.286 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.285+0000 7f90b42bf700 1 -- start start 2023-10-06T03:05:36.288 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.286+0000 7f90b42bf700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f90ac0af320 0x7f90ac0c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:36.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.286+0000 7f90b42bf700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90ac0cc5a0 0x7f90ac067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:36.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.286+0000 7f90b42bf700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ac0caa40 con 0x7f90ac067b50 2023-10-06T03:05:36.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.286+0000 7f90b42bf700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ac067fd0 con 0x7f90ac0af320 2023-10-06T03:05:36.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.286+0000 7f90b42bf700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac0c1ca0 con 0x7f90ac0cc5a0 2023-10-06T03:05:36.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.287+0000 7f90b185a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90ac0cc5a0 0x7f90ac067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:36.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.287+0000 7f90b205b700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f90ac0af320 0x7f90ac0c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:36.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.287+0000 7f90b185a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90ac0cc5a0 0x7f90ac067610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:55442/0 (socket says 172.21.15.125:55442) 2023-10-06T03:05:36.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.287+0000 7f90b185a700 1 -- 172.21.15.125:0/1610284656 learned_addr learned my addr 172.21.15.125:0/1610284656 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:36.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.287+0000 7f90b285c700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f90ac067b50 0x7f90ac0c74b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:51182/0 (socket says 172.21.15.125:51182) 2023-10-06T03:05:36.289 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.287+0000 7f90b205b700 1 --2- 172.21.15.125:0/1610284656 >> v2:172.21.15.130:3300/0 conn(0x7f90ac0af320 0x7f90ac0c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:37676/0 (socket says 172.21.15.125:37676) 2023-10-06T03:05:36.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.287+0000 7f90b185a700 1 -- 172.21.15.125:0/1610284656 >> v2:172.21.15.130:3300/0 conn(0x7f90ac0af320 msgr2=0x7f90ac0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:36.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.287+0000 7f90b185a700 1 --2- 172.21.15.125:0/1610284656 >> v2:172.21.15.130:3300/0 conn(0x7f90ac0af320 0x7f90ac0c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.287+0000 7f90b185a700 1 -- 172.21.15.125:0/1610284656 >> v1:172.21.15.130:6789/0 conn(0x7f90ac067b50 legacy=0x7f90ac0c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:36.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.287+0000 7f90b185a700 1 -- 172.21.15.125:0/1610284656 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ac0cca60 con 0x7f90ac0cc5a0 2023-10-06T03:05:36.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.287+0000 7f90b205b700 1 --2- 172.21.15.125:0/1610284656 >> v2:172.21.15.130:3300/0 conn(0x7f90ac0af320 0x7f90ac0c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:05:36.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.287+0000 7f90b185a700 1 --2- 172.21.15.125:0/1610284656 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90ac0cc5a0 0x7f90ac067610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f90a80099b0 tx=0x7f90a8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca25f73edc82150e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:36.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.287+0000 7f90b1059700 1 -- 172.21.15.125:0/1610284656 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a8009ea0 con 0x7f90ac0cc5a0 2023-10-06T03:05:36.290 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.288+0000 7f90b1059700 1 -- 172.21.15.125:0/1610284656 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a800b860 con 0x7f90ac0cc5a0 2023-10-06T03:05:36.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.288+0000 7f90b1059700 1 -- 172.21.15.125:0/1610284656 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a800bc00 con 0x7f90ac0cc5a0 2023-10-06T03:05:36.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.288+0000 7f90b42bf700 1 -- 172.21.15.125:0/1610284656 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90ac0cc5a0 msgr2=0x7f90ac067610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:36.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.288+0000 7f90b42bf700 1 --2- 172.21.15.125:0/1610284656 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90ac0cc5a0 0x7f90ac067610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f90a80099b0 tx=0x7f90a8009250 comp rx=0 tx=0).stop 2023-10-06T03:05:36.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.288+0000 7f90b42bf700 1 -- 172.21.15.125:0/1610284656 shutdown_connections 2023-10-06T03:05:36.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.288+0000 7f90b42bf700 1 --2- 172.21.15.125:0/1610284656 >> v2:172.21.15.130:3300/0 conn(0x7f90ac0af320 0x7f90ac0c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.291 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.288+0000 7f90b42bf700 1 --2- 172.21.15.125:0/1610284656 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90ac0cc5a0 0x7f90ac067610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.288+0000 7f90b42bf700 1 -- 172.21.15.125:0/1610284656 >> 172.21.15.125:0/1610284656 conn(0x7f90ac068f00 msgr2=0x7f90ac0cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:36.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.288+0000 7f90b42bf700 1 -- 172.21.15.125:0/1610284656 shutdown_connections 2023-10-06T03:05:36.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.288+0000 7f90b42bf700 1 -- 172.21.15.125:0/1610284656 wait complete. 2023-10-06T03:05:36.294 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.289+0000 7f90b42bf700 1 Processor -- start 2023-10-06T03:05:36.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.289+0000 7f90b42bf700 1 -- start start 2023-10-06T03:05:36.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.290+0000 7f90b42bf700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90ac067b50 0x7f90ac150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:36.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.290+0000 7f90b42bf700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90ac0af320 0x7f90ac14f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:36.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.290+0000 7f90b42bf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90ac0cc5a0 0x7f90ac0b1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:36.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.290+0000 7f90b42bf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac14fe60 con 0x7f90ac0cc5a0 2023-10-06T03:05:36.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.290+0000 7f90b42bf700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac16d830 con 0x7f90ac067b50 2023-10-06T03:05:36.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.290+0000 7f90b42bf700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac0b1ba0 con 0x7f90ac0af320 2023-10-06T03:05:36.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.290+0000 7f90b285c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90ac0cc5a0 0x7f90ac0b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:36.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.290+0000 7f90b285c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90ac0cc5a0 0x7f90ac0b1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57820/0 (socket says 172.21.15.125:57820) 2023-10-06T03:05:36.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.290+0000 7f90b285c700 1 -- 172.21.15.125:0/3787915564 learned_addr learned my addr 172.21.15.125:0/3787915564 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:36.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.290+0000 7f90b205b700 1 --2- 172.21.15.125:0/3787915564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90ac067b50 0x7f90ac150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:36.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.290+0000 7f90b185a700 1 --2- 172.21.15.125:0/3787915564 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90ac0af320 0x7f90ac14f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:36.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.290+0000 7f90b285c700 1 -- 172.21.15.125:0/3787915564 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90ac0af320 msgr2=0x7f90ac14f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:36.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.290+0000 7f90b285c700 1 --2- 172.21.15.125:0/3787915564 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90ac0af320 0x7f90ac14f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.290+0000 7f90b285c700 1 -- 172.21.15.125:0/3787915564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90ac067b50 msgr2=0x7f90ac150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:36.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.290+0000 7f90b285c700 1 --2- 172.21.15.125:0/3787915564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90ac067b50 0x7f90ac150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.291+0000 7f90b285c700 1 -- 172.21.15.125:0/3787915564 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a00093c0 con 0x7f90ac0cc5a0 2023-10-06T03:05:36.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.291+0000 7f90b285c700 1 --2- 172.21.15.125:0/3787915564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90ac0cc5a0 0x7f90ac0b1660 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f90a400cca0 tx=0x7f90a4001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:36.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.291+0000 7f909e7fc700 1 -- 172.21.15.125:0/3787915564 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a4005df0 con 0x7f90ac0cc5a0 2023-10-06T03:05:36.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.291+0000 7f909e7fc700 1 -- 172.21.15.125:0/3787915564 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a400a5f0 con 0x7f90ac0cc5a0 2023-10-06T03:05:36.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.291+0000 7f90b42bf700 1 -- 172.21.15.125:0/3787915564 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a80094f0 con 0x7f90ac0cc5a0 2023-10-06T03:05:36.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.291+0000 7f909e7fc700 1 -- 172.21.15.125:0/3787915564 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a400a970 con 0x7f90ac0cc5a0 2023-10-06T03:05:36.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.291+0000 7f90b42bf700 1 -- 172.21.15.125:0/3787915564 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ac16d1e0 con 0x7f90ac0cc5a0 2023-10-06T03:05:36.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.292+0000 7f90b42bf700 1 -- 172.21.15.125:0/3787915564 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ac16d040 con 0x7f90ac0cc5a0 2023-10-06T03:05:36.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.292+0000 7f909e7fc700 1 -- 172.21.15.125:0/3787915564 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90a400ace0 con 0x7f90ac0cc5a0 2023-10-06T03:05:36.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.293+0000 7f909e7fc700 1 --2- 172.21.15.125:0/3787915564 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9090066f30 0x7f90900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:36.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.293+0000 7f909e7fc700 1 -- 172.21.15.125:0/3787915564 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f90a40846c0 con 0x7f90ac0cc5a0 2023-10-06T03:05:36.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.293+0000 7f90b205b700 1 --2- 172.21.15.125:0/3787915564 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9090066f30 0x7f90900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:36.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.293+0000 7f90b205b700 1 --2- 172.21.15.125:0/3787915564 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9090066f30 0x7f90900693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009e90 tx=0x7f90a0009120 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:36.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.297+0000 7f909e7fc700 1 -- 172.21.15.125:0/3787915564 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90ac16d040 con 0x7f90ac0cc5a0 2023-10-06T03:05:36.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.557+0000 7f90b42bf700 1 -- 172.21.15.125:0/3787915564 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f90ac16d040 con 0x7f90ac0cc5a0 2023-10-06T03:05:36.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.558+0000 7f909e7fc700 1 -- 172.21.15.125:0/3787915564 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1455 (secure 0 0 0) 0x7f90ac16d040 con 0x7f90ac0cc5a0 2023-10-06T03:05:36.558 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:36.558 INFO:teuthology.orchestra.run.smithi125.stdout:{"fsid":"c8556660-0880-4430-a03a-c140780d46e7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":92,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":41,"num_osds":8,"num_up_osds":8,"osd_up_since":1696561455,"num_in_osds":8,"osd_in_since":1696561446,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":2440159232,"bytes_avail":770653954048,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":18,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5085}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-10-06T03:05:19.818175+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:05:36.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.559+0000 7f90b42bf700 1 -- 172.21.15.125:0/3787915564 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9090066f30 msgr2=0x7f90900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:36.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.559+0000 7f90b42bf700 1 --2- 172.21.15.125:0/3787915564 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9090066f30 0x7f90900693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f90a0009e90 tx=0x7f90a0009120 comp rx=0 tx=0).stop 2023-10-06T03:05:36.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.560+0000 7f90b42bf700 1 -- 172.21.15.125:0/3787915564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90ac0cc5a0 msgr2=0x7f90ac0b1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:36.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.560+0000 7f90b42bf700 1 --2- 172.21.15.125:0/3787915564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90ac0cc5a0 0x7f90ac0b1660 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f90a400cca0 tx=0x7f90a4001a70 comp rx=0 tx=0).stop 2023-10-06T03:05:36.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.560+0000 7f90b42bf700 1 -- 172.21.15.125:0/3787915564 shutdown_connections 2023-10-06T03:05:36.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.560+0000 7f90b42bf700 1 --2- 172.21.15.125:0/3787915564 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9090066f30 0x7f90900693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.560+0000 7f90b42bf700 1 --2- 172.21.15.125:0/3787915564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f90ac0cc5a0 0x7f90ac0b1660 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.560+0000 7f90b42bf700 1 --2- 172.21.15.125:0/3787915564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90ac067b50 0x7f90ac150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.560+0000 7f90b42bf700 1 --2- 172.21.15.125:0/3787915564 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90ac0af320 0x7f90ac14f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.560+0000 7f90b42bf700 1 -- 172.21.15.125:0/3787915564 >> 172.21.15.125:0/3787915564 conn(0x7f90ac068f00 msgr2=0x7f90ac151d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:36.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.560+0000 7f90b42bf700 1 -- 172.21.15.125:0/3787915564 shutdown_connections 2023-10-06T03:05:36.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.560+0000 7f90b42bf700 1 -- 172.21.15.125:0/3787915564 wait complete. 2023-10-06T03:05:36.572 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T03:05:36.572 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:05:36.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.688+0000 7f82ec627700 1 Processor -- start 2023-10-06T03:05:36.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.689+0000 7f82ec627700 1 -- start start 2023-10-06T03:05:36.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.689+0000 7f82ec627700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f82e41590d0 0x7f82e406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:36.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.689+0000 7f82ec627700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82e40ac670 0x7f82e406ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:36.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.689+0000 7f82ec627700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e4067c70 con 0x7f82e41594a0 2023-10-06T03:05:36.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.689+0000 7f82ec627700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e4069110 con 0x7f82e41590d0 2023-10-06T03:05:36.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.689+0000 7f82ec627700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e40c77e0 con 0x7f82e40ac670 2023-10-06T03:05:36.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.690+0000 7f82ea3c3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f82e41590d0 0x7f82e406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:36.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.690+0000 7f82eabc4700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f82e41594a0 0x7f82e40c6b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35286/0 (socket says 172.21.15.125:35286) 2023-10-06T03:05:36.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.690+0000 7f82ea3c3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f82e41590d0 0x7f82e406a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57832/0 (socket says 172.21.15.125:57832) 2023-10-06T03:05:36.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.690+0000 7f82eabc4700 1 -- 172.21.15.125:0/2380408948 learned_addr learned my addr 172.21.15.125:0/2380408948 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:36.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.690+0000 7f82e9bc2700 1 --2- 172.21.15.125:0/2380408948 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82e40ac670 0x7f82e406ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:36.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.690+0000 7f82ea3c3700 1 -- 172.21.15.125:0/2380408948 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82e40ac670 msgr2=0x7f82e406ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:36.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.690+0000 7f82ea3c3700 1 --2- 172.21.15.125:0/2380408948 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82e40ac670 0x7f82e406ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.690+0000 7f82ea3c3700 1 -- 172.21.15.125:0/2380408948 >> v1:172.21.15.125:6789/0 conn(0x7f82e41594a0 legacy=0x7f82e40c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:36.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.690+0000 7f82ea3c3700 1 -- 172.21.15.125:0/2380408948 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e40c7ac0 con 0x7f82e41590d0 2023-10-06T03:05:36.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.690+0000 7f82e93c1700 1 -- 172.21.15.125:0/2380408948 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224555371 0 0) 0x7f82e4067c70 con 0x7f82e41594a0 2023-10-06T03:05:36.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.690+0000 7f82ea3c3700 1 --2- 172.21.15.125:0/2380408948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82e41590d0 0x7f82e406a8c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f82e00098e0 tx=0x7f82e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d159a02f60e40376 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:36.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.690+0000 7f82e93c1700 1 -- 172.21.15.125:0/2380408948 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e0009e80 con 0x7f82e41590d0 2023-10-06T03:05:36.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.690+0000 7f82e93c1700 1 -- 172.21.15.125:0/2380408948 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e000b860 con 0x7f82e41590d0 2023-10-06T03:05:36.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.690+0000 7f82e93c1700 1 -- 172.21.15.125:0/2380408948 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e000bbe0 con 0x7f82e41590d0 2023-10-06T03:05:36.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.691+0000 7f82ec627700 1 -- 172.21.15.125:0/2380408948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82e41590d0 msgr2=0x7f82e406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:36.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.691+0000 7f82ec627700 1 --2- 172.21.15.125:0/2380408948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82e41590d0 0x7f82e406a8c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f82e00098e0 tx=0x7f82e00091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.691+0000 7f82ec627700 1 -- 172.21.15.125:0/2380408948 shutdown_connections 2023-10-06T03:05:36.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.691+0000 7f82ec627700 1 --2- 172.21.15.125:0/2380408948 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82e41590d0 0x7f82e406a8c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.691+0000 7f82ec627700 1 --2- 172.21.15.125:0/2380408948 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82e40ac670 0x7f82e406ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.691+0000 7f82ec627700 1 -- 172.21.15.125:0/2380408948 >> 172.21.15.125:0/2380408948 conn(0x7f82e40cc5a0 msgr2=0x7f82e40cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:36.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.691+0000 7f82ec627700 1 -- 172.21.15.125:0/2380408948 shutdown_connections 2023-10-06T03:05:36.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.691+0000 7f82ec627700 1 -- 172.21.15.125:0/2380408948 wait complete. 2023-10-06T03:05:36.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.692+0000 7f82ec627700 1 Processor -- start 2023-10-06T03:05:36.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.692+0000 7f82ec627700 1 -- start start 2023-10-06T03:05:36.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.693+0000 7f82ec627700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82e40ac670 0x7f82e4150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:36.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.693+0000 7f82ec627700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82e41590d0 0x7f82e40a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:36.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.693+0000 7f82e9bc2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82e41590d0 0x7f82e40a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:36.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.693+0000 7f82e9bc2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82e41590d0 0x7f82e40a99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57834/0 (socket says 172.21.15.125:57834) 2023-10-06T03:05:36.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.693+0000 7f82ec627700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82e41594a0 0x7f82e40a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:36.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.693+0000 7f82e9bc2700 1 -- 172.21.15.125:0/1456910146 learned_addr learned my addr 172.21.15.125:0/1456910146 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:36.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.693+0000 7f82ec627700 1 -- 172.21.15.125:0/1456910146 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e40b0290 con 0x7f82e41590d0 2023-10-06T03:05:36.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.693+0000 7f82ec627700 1 -- 172.21.15.125:0/1456910146 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e40b0ee0 con 0x7f82e40ac670 2023-10-06T03:05:36.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.693+0000 7f82ec627700 1 -- 172.21.15.125:0/1456910146 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e41510f0 con 0x7f82e41594a0 2023-10-06T03:05:36.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.693+0000 7f82ea3c3700 1 --2- 172.21.15.125:0/1456910146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82e40ac670 0x7f82e4150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:36.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.693+0000 7f82eabc4700 1 --2- 172.21.15.125:0/1456910146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82e41594a0 0x7f82e40a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:36.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.693+0000 7f82e9bc2700 1 -- 172.21.15.125:0/1456910146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82e41594a0 msgr2=0x7f82e40a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:36.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.693+0000 7f82e9bc2700 1 --2- 172.21.15.125:0/1456910146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82e41594a0 0x7f82e40a9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.693+0000 7f82e9bc2700 1 -- 172.21.15.125:0/1456910146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82e40ac670 msgr2=0x7f82e4150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:36.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.693+0000 7f82e9bc2700 1 --2- 172.21.15.125:0/1456910146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82e40ac670 0x7f82e4150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.693+0000 7f82e9bc2700 1 -- 172.21.15.125:0/1456910146 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e0009420 con 0x7f82e41590d0 2023-10-06T03:05:36.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.693+0000 7f82eabc4700 1 --2- 172.21.15.125:0/1456910146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82e41594a0 0x7f82e40a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:36.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.693+0000 7f82e9bc2700 1 --2- 172.21.15.125:0/1456910146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82e41590d0 0x7f82e40a99a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f82d800d8f0 tx=0x7f82d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:36.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.694+0000 7f82d67fc700 1 -- 172.21.15.125:0/1456910146 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d80125f0 con 0x7f82e41590d0 2023-10-06T03:05:36.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.694+0000 7f82d67fc700 1 -- 172.21.15.125:0/1456910146 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d8012770 con 0x7f82e41590d0 2023-10-06T03:05:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.694+0000 7f82ec627700 1 -- 172.21.15.125:0/1456910146 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e40af4d0 con 0x7f82e41590d0 2023-10-06T03:05:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.694+0000 7f82d67fc700 1 -- 172.21.15.125:0/1456910146 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8012b30 con 0x7f82e41590d0 2023-10-06T03:05:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.694+0000 7f82ec627700 1 -- 172.21.15.125:0/1456910146 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e40afa90 con 0x7f82e41590d0 2023-10-06T03:05:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.694+0000 7f82ec627700 1 -- 172.21.15.125:0/1456910146 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e4066510 con 0x7f82e41590d0 2023-10-06T03:05:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.695+0000 7f82d67fc700 1 -- 172.21.15.125:0/1456910146 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82d801e460 con 0x7f82e41590d0 2023-10-06T03:05:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.695+0000 7f82d67fc700 1 --2- 172.21.15.125:0/1456910146 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f82c8066f30 0x7f82c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.695+0000 7f82d67fc700 1 -- 172.21.15.125:0/1456910146 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f82d8084e40 con 0x7f82e41590d0 2023-10-06T03:05:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.695+0000 7f82ea3c3700 1 --2- 172.21.15.125:0/1456910146 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f82c8066f30 0x7f82c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:36.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.696+0000 7f82ea3c3700 1 --2- 172.21.15.125:0/1456910146 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f82c8066f30 0x7f82c80693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f82e00091e0 tx=0x7f82e0017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:36.700 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.699+0000 7f82d67fc700 1 -- 172.21.15.125:0/1456910146 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82d8051d70 con 0x7f82e41590d0 2023-10-06T03:05:36.878 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.877+0000 7f82ec627700 1 -- 172.21.15.125:0/1456910146 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f82e40c7da0 con 0x7f82c8066f30 2023-10-06T03:05:36.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.885+0000 7f82d67fc700 1 -- 172.21.15.125:0/1456910146 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307384 (secure 0 0 0) 0x7f82e40c7da0 con 0x7f82c8066f30 2023-10-06T03:05:36.889 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:36.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.888+0000 7f82ec627700 1 -- 172.21.15.125:0/1456910146 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f82c8066f30 msgr2=0x7f82c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:36.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.888+0000 7f82ec627700 1 --2- 172.21.15.125:0/1456910146 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f82c8066f30 0x7f82c80693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f82e00091e0 tx=0x7f82e0017000 comp rx=0 tx=0).stop 2023-10-06T03:05:36.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.888+0000 7f82ec627700 1 -- 172.21.15.125:0/1456910146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82e41590d0 msgr2=0x7f82e40a99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:36.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.888+0000 7f82ec627700 1 --2- 172.21.15.125:0/1456910146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82e41590d0 0x7f82e40a99a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f82d800d8f0 tx=0x7f82d8008040 comp rx=0 tx=0).stop 2023-10-06T03:05:36.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.888+0000 7f82ec627700 1 -- 172.21.15.125:0/1456910146 shutdown_connections 2023-10-06T03:05:36.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.888+0000 7f82ec627700 1 --2- 172.21.15.125:0/1456910146 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f82c8066f30 0x7f82c80693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.888+0000 7f82ec627700 1 --2- 172.21.15.125:0/1456910146 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f82e41594a0 0x7f82e40a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.888+0000 7f82ec627700 1 --2- 172.21.15.125:0/1456910146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82e40ac670 0x7f82e4150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.888+0000 7f82ec627700 1 --2- 172.21.15.125:0/1456910146 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f82e41590d0 0x7f82e40a99a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:36.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.889+0000 7f82ec627700 1 -- 172.21.15.125:0/1456910146 >> 172.21.15.125:0/1456910146 conn(0x7f82e40cc5a0 msgr2=0x7f82e40c8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:36.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.889+0000 7f82ec627700 1 -- 172.21.15.125:0/1456910146 shutdown_connections 2023-10-06T03:05:36.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:36.889+0000 7f82ec627700 1 -- 172.21.15.125:0/1456910146 wait complete. 2023-10-06T03:05:36.893 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-06T03:05:36.901 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2023-10-06T03:05:35.821153+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382968,"kb_used_data":4664,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591752,"statfs":{"total":773094113280,"available":770653954048,"internally_reserved":0,"allocated":4775936,"data_stored":2754565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001101"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.977120+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:09.648317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965909+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:43.140690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.971367+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:55.892723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970103+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:40.458075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965533+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:40.458075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.964382+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:27.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.978584+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:01.791955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.971609+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:20.015541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970572+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.883295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972711+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:49.871669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970926+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:09.648317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965140+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:04.527321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968578+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:11:43.857971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968492+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:38.629349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965205+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:30.642665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968417+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:59.140697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972557+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:20.868524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.973518+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:08.111584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.969526+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:20.123410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.966794+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:02.178769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.963978+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:48.052762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968003+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:55.274836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967331+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:12:29.787384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967851+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:45.882319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.969585+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:40:02.105572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967366+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:25.832521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970990+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:40.812378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.966935+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:09.648317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967440+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:23.219456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970924+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:06.331617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.964783+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:01.960298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967824+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:46.506948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965273+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:40.459403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.973435+0000","last_change":"2023-10-06T03:05:29.973435+0000","last_active":"2023-10-06T03:05:29.973435+0000","last_peered":"2023-10-06T03:05:29.973435+0000","last_clean":"2023-10-06T03:05:29.973435+0000","last_became_active":"2023-10-06T03:05:29.973213+0000","last_became_peered":"2023-10-06T03:05:29.973213+0000","last_unstale":"2023-10-06T03:05:29.973435+0000","last_undegraded":"2023-10-06T03:05:29.973435+0000","last_fullsized":"2023-10-06T03:05:29.973435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:42.135044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970472+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:20.204857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.983368+0000","last_change":"2023-10-06T03:05:29.983368+0000","last_active":"2023-10-06T03:05:29.983368+0000","last_peered":"2023-10-06T03:05:29.983368+0000","last_clean":"2023-10-06T03:05:29.983368+0000","last_became_active":"2023-10-06T03:05:29.983086+0000","last_became_peered":"2023-10-06T03:05:29.983086+0000","last_unstale":"2023-10-06T03:05:29.983368+0000","last_undegraded":"2023-10-06T03:05:29.983368+0000","last_fullsized":"2023-10-06T03:05:29.983368+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:51.040731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.966433+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.883295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.975058+0000","last_change":"2023-10-06T03:05:29.975058+0000","last_active":"2023-10-06T03:05:29.975058+0000","last_peered":"2023-10-06T03:05:29.975058+0000","last_clean":"2023-10-06T03:05:29.975058+0000","last_became_active":"2023-10-06T03:05:29.974839+0000","last_became_peered":"2023-10-06T03:05:29.974839+0000","last_unstale":"2023-10-06T03:05:29.975058+0000","last_undegraded":"2023-10-06T03:05:29.975058+0000","last_fullsized":"2023-10-06T03:05:29.975058+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:54.194868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965487+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:12.918300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.983896+0000","last_change":"2023-10-06T03:05:29.983896+0000","last_active":"2023-10-06T03:05:29.983896+0000","last_peered":"2023-10-06T03:05:29.983896+0000","last_clean":"2023-10-06T03:05:29.983896+0000","last_became_active":"2023-10-06T03:05:29.983586+0000","last_became_peered":"2023-10-06T03:05:29.983586+0000","last_unstale":"2023-10-06T03:05:29.983896+0000","last_undegraded":"2023-10-06T03:05:29.983896+0000","last_fullsized":"2023-10-06T03:05:29.983896+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:48.866023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970382+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:30.642665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.984468+0000","last_change":"2023-10-06T03:05:29.984468+0000","last_active":"2023-10-06T03:05:29.984468+0000","last_peered":"2023-10-06T03:05:29.984468+0000","last_clean":"2023-10-06T03:05:29.984468+0000","last_became_active":"2023-10-06T03:05:29.984216+0000","last_became_peered":"2023-10-06T03:05:29.984216+0000","last_unstale":"2023-10-06T03:05:29.984468+0000","last_undegraded":"2023-10-06T03:05:29.984468+0000","last_fullsized":"2023-10-06T03:05:29.984468+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:10.613335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972004+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:04.527321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.978356+0000","last_change":"2023-10-06T03:05:29.978356+0000","last_active":"2023-10-06T03:05:29.978356+0000","last_peered":"2023-10-06T03:05:29.978356+0000","last_clean":"2023-10-06T03:05:29.978356+0000","last_became_active":"2023-10-06T03:05:29.978068+0000","last_became_peered":"2023-10-06T03:05:29.978068+0000","last_unstale":"2023-10-06T03:05:29.978356+0000","last_undegraded":"2023-10-06T03:05:29.978356+0000","last_fullsized":"2023-10-06T03:05:29.978356+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:13.299028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.971219+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:11.618981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.975560+0000","last_change":"2023-10-06T03:05:29.975560+0000","last_active":"2023-10-06T03:05:29.975560+0000","last_peered":"2023-10-06T03:05:29.975560+0000","last_clean":"2023-10-06T03:05:29.975560+0000","last_became_active":"2023-10-06T03:05:29.975146+0000","last_became_peered":"2023-10-06T03:05:29.975146+0000","last_unstale":"2023-10-06T03:05:29.975560+0000","last_undegraded":"2023-10-06T03:05:29.975560+0000","last_fullsized":"2023-10-06T03:05:29.975560+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:37.763634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968464+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:58.428726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.978576+0000","last_change":"2023-10-06T03:05:29.978576+0000","last_active":"2023-10-06T03:05:29.978576+0000","last_peered":"2023-10-06T03:05:29.978576+0000","last_clean":"2023-10-06T03:05:29.978576+0000","last_became_active":"2023-10-06T03:05:29.978314+0000","last_became_peered":"2023-10-06T03:05:29.978314+0000","last_unstale":"2023-10-06T03:05:29.978576+0000","last_undegraded":"2023-10-06T03:05:29.978576+0000","last_fullsized":"2023-10-06T03:05:29.978576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:25.902043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972141+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:13:06.401671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.976856+0000","last_change":"2023-10-06T03:05:29.976856+0000","last_active":"2023-10-06T03:05:29.976856+0000","last_peered":"2023-10-06T03:05:29.976856+0000","last_clean":"2023-10-06T03:05:29.976856+0000","last_became_active":"2023-10-06T03:05:29.976594+0000","last_became_peered":"2023-10-06T03:05:29.976594+0000","last_unstale":"2023-10-06T03:05:29.976856+0000","last_undegraded":"2023-10-06T03:05:29.976856+0000","last_fullsized":"2023-10-06T03:05:29.976856+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:51.165031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.975127+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:43.140690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.980481+0000","last_change":"2023-10-06T03:05:29.980481+0000","last_active":"2023-10-06T03:05:29.980481+0000","last_peered":"2023-10-06T03:05:29.980481+0000","last_clean":"2023-10-06T03:05:29.980481+0000","last_became_active":"2023-10-06T03:05:29.980279+0000","last_became_peered":"2023-10-06T03:05:29.980279+0000","last_unstale":"2023-10-06T03:05:29.980481+0000","last_undegraded":"2023-10-06T03:05:29.980481+0000","last_fullsized":"2023-10-06T03:05:29.980481+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:07.796869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.963684+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:14.304674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.984960+0000","last_change":"2023-10-06T03:05:29.984960+0000","last_active":"2023-10-06T03:05:29.984960+0000","last_peered":"2023-10-06T03:05:29.984960+0000","last_clean":"2023-10-06T03:05:29.984960+0000","last_became_active":"2023-10-06T03:05:29.984390+0000","last_became_peered":"2023-10-06T03:05:29.984390+0000","last_unstale":"2023-10-06T03:05:29.984960+0000","last_undegraded":"2023-10-06T03:05:29.984960+0000","last_fullsized":"2023-10-06T03:05:29.984960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:39.615480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.977218+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:11.618981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.981372+0000","last_change":"2023-10-06T03:05:29.981372+0000","last_active":"2023-10-06T03:05:29.981372+0000","last_peered":"2023-10-06T03:05:29.981372+0000","last_clean":"2023-10-06T03:05:29.981372+0000","last_became_active":"2023-10-06T03:05:29.981115+0000","last_became_peered":"2023-10-06T03:05:29.981115+0000","last_unstale":"2023-10-06T03:05:29.981372+0000","last_undegraded":"2023-10-06T03:05:29.981372+0000","last_fullsized":"2023-10-06T03:05:29.981372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:19.117764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.967727+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:21.306429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.977336+0000","last_change":"2023-10-06T03:05:29.977336+0000","last_active":"2023-10-06T03:05:29.977336+0000","last_peered":"2023-10-06T03:05:29.977336+0000","last_clean":"2023-10-06T03:05:29.977336+0000","last_became_active":"2023-10-06T03:05:29.976614+0000","last_became_peered":"2023-10-06T03:05:29.976614+0000","last_unstale":"2023-10-06T03:05:29.977336+0000","last_undegraded":"2023-10-06T03:05:29.977336+0000","last_fullsized":"2023-10-06T03:05:29.977336+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:39.452429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.972501+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:01.791955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.983120+0000","last_change":"2023-10-06T03:05:29.983120+0000","last_active":"2023-10-06T03:05:29.983120+0000","last_peered":"2023-10-06T03:05:29.983120+0000","last_clean":"2023-10-06T03:05:29.983120+0000","last_became_active":"2023-10-06T03:05:29.982850+0000","last_became_peered":"2023-10-06T03:05:29.982850+0000","last_unstale":"2023-10-06T03:05:29.983120+0000","last_undegraded":"2023-10-06T03:05:29.983120+0000","last_fullsized":"2023-10-06T03:05:29.983120+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:47.589791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.963374+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:52.046377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.976278+0000","last_change":"2023-10-06T03:05:29.976278+0000","last_active":"2023-10-06T03:05:29.976278+0000","last_peered":"2023-10-06T03:05:29.976278+0000","last_clean":"2023-10-06T03:05:29.976278+0000","last_became_active":"2023-10-06T03:05:29.976023+0000","last_became_peered":"2023-10-06T03:05:29.976023+0000","last_unstale":"2023-10-06T03:05:29.976278+0000","last_undegraded":"2023-10-06T03:05:29.976278+0000","last_fullsized":"2023-10-06T03:05:29.976278+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:03.521675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.978110+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:25.519827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.983223+0000","last_change":"2023-10-06T03:05:29.983223+0000","last_active":"2023-10-06T03:05:29.983223+0000","last_peered":"2023-10-06T03:05:29.983223+0000","last_clean":"2023-10-06T03:05:29.983223+0000","last_became_active":"2023-10-06T03:05:29.983009+0000","last_became_peered":"2023-10-06T03:05:29.983009+0000","last_unstale":"2023-10-06T03:05:29.983223+0000","last_undegraded":"2023-10-06T03:05:29.983223+0000","last_fullsized":"2023-10-06T03:05:29.983223+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:39.453757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.966931+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:40:20.204857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.971763+0000","last_change":"2023-10-06T03:05:29.971763+0000","last_active":"2023-10-06T03:05:29.971763+0000","last_peered":"2023-10-06T03:05:29.971763+0000","last_clean":"2023-10-06T03:05:29.971763+0000","last_became_active":"2023-10-06T03:05:29.971518+0000","last_became_peered":"2023-10-06T03:05:29.971518+0000","last_unstale":"2023-10-06T03:05:29.971763+0000","last_undegraded":"2023-10-06T03:05:29.971763+0000","last_fullsized":"2023-10-06T03:05:29.971763+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:44.816300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970168+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:43.140690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.980139+0000","last_change":"2023-10-06T03:05:29.980139+0000","last_active":"2023-10-06T03:05:29.980139+0000","last_peered":"2023-10-06T03:05:29.980139+0000","last_clean":"2023-10-06T03:05:29.980139+0000","last_became_active":"2023-10-06T03:05:29.979914+0000","last_became_peered":"2023-10-06T03:05:29.979914+0000","last_unstale":"2023-10-06T03:05:29.980139+0000","last_undegraded":"2023-10-06T03:05:29.980139+0000","last_fullsized":"2023-10-06T03:05:29.980139+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:47.047116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968557+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:54.082681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.974952+0000","last_change":"2023-10-06T03:05:29.974952+0000","last_active":"2023-10-06T03:05:29.974952+0000","last_peered":"2023-10-06T03:05:29.974952+0000","last_clean":"2023-10-06T03:05:29.974952+0000","last_became_active":"2023-10-06T03:05:29.974721+0000","last_became_peered":"2023-10-06T03:05:29.974721+0000","last_unstale":"2023-10-06T03:05:29.974952+0000","last_undegraded":"2023-10-06T03:05:29.974952+0000","last_fullsized":"2023-10-06T03:05:29.974952+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:47.589791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968980+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:45.821946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.972966+0000","last_change":"2023-10-06T03:05:29.972966+0000","last_active":"2023-10-06T03:05:29.972966+0000","last_peered":"2023-10-06T03:05:29.972966+0000","last_clean":"2023-10-06T03:05:29.972966+0000","last_became_active":"2023-10-06T03:05:29.972751+0000","last_became_peered":"2023-10-06T03:05:29.972751+0000","last_unstale":"2023-10-06T03:05:29.972966+0000","last_undegraded":"2023-10-06T03:05:29.972966+0000","last_fullsized":"2023-10-06T03:05:29.972966+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:54.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.963327+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:57.748161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.985021+0000","last_change":"2023-10-06T03:05:29.985021+0000","last_active":"2023-10-06T03:05:29.985021+0000","last_peered":"2023-10-06T03:05:29.985021+0000","last_clean":"2023-10-06T03:05:29.985021+0000","last_became_active":"2023-10-06T03:05:29.984799+0000","last_became_peered":"2023-10-06T03:05:29.984799+0000","last_unstale":"2023-10-06T03:05:29.985021+0000","last_undegraded":"2023-10-06T03:05:29.985021+0000","last_fullsized":"2023-10-06T03:05:29.985021+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:08.642671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.965199+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:26.907689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.974630+0000","last_change":"2023-10-06T03:05:29.974630+0000","last_active":"2023-10-06T03:05:29.974630+0000","last_peered":"2023-10-06T03:05:29.974630+0000","last_clean":"2023-10-06T03:05:29.974630+0000","last_became_active":"2023-10-06T03:05:29.974231+0000","last_became_peered":"2023-10-06T03:05:29.974231+0000","last_unstale":"2023-10-06T03:05:29.974630+0000","last_undegraded":"2023-10-06T03:05:29.974630+0000","last_fullsized":"2023-10-06T03:05:29.974630+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:54.269190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968267+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:05.824734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.984580+0000","last_change":"2023-10-06T03:05:29.984580+0000","last_active":"2023-10-06T03:05:29.984580+0000","last_peered":"2023-10-06T03:05:29.984580+0000","last_clean":"2023-10-06T03:05:29.984580+0000","last_became_active":"2023-10-06T03:05:29.984339+0000","last_became_peered":"2023-10-06T03:05:29.984339+0000","last_unstale":"2023-10-06T03:05:29.984580+0000","last_undegraded":"2023-10-06T03:05:29.984580+0000","last_fullsized":"2023-10-06T03:05:29.984580+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:54.194868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968842+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:38.769280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.984844+0000","last_change":"2023-10-06T03:05:29.984844+0000","last_active":"2023-10-06T03:05:29.984844+0000","last_peered":"2023-10-06T03:05:29.984844+0000","last_clean":"2023-10-06T03:05:29.984844+0000","last_became_active":"2023-10-06T03:05:29.984231+0000","last_became_peered":"2023-10-06T03:05:29.984231+0000","last_unstale":"2023-10-06T03:05:29.984844+0000","last_undegraded":"2023-10-06T03:05:29.984844+0000","last_fullsized":"2023-10-06T03:05:29.984844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:37.623703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.969618+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:01.960298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.975732+0000","last_change":"2023-10-06T03:05:29.975732+0000","last_active":"2023-10-06T03:05:29.975732+0000","last_peered":"2023-10-06T03:05:29.975732+0000","last_clean":"2023-10-06T03:05:29.975732+0000","last_became_active":"2023-10-06T03:05:29.975382+0000","last_became_peered":"2023-10-06T03:05:29.975382+0000","last_unstale":"2023-10-06T03:05:29.975732+0000","last_undegraded":"2023-10-06T03:05:29.975732+0000","last_fullsized":"2023-10-06T03:05:29.975732+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:39.077978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.958591+0000","last_change":"2023-10-06T03:04:23.986472+0000","last_active":"2023-10-06T03:05:28.958591+0000","last_peered":"2023-10-06T03:05:28.958591+0000","last_clean":"2023-10-06T03:05:28.958591+0000","last_became_active":"2023-10-06T03:04:23.986228+0000","last_became_peered":"2023-10-06T03:04:23.986228+0000","last_unstale":"2023-10-06T03:05:28.958591+0000","last_undegraded":"2023-10-06T03:05:28.958591+0000","last_fullsized":"2023-10-06T03:05:28.958591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:08.739849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.970004+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:02.178769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.976944+0000","last_change":"2023-10-06T03:05:29.976944+0000","last_active":"2023-10-06T03:05:29.976944+0000","last_peered":"2023-10-06T03:05:29.976944+0000","last_clean":"2023-10-06T03:05:29.976944+0000","last_became_active":"2023-10-06T03:05:29.976712+0000","last_became_peered":"2023-10-06T03:05:29.976712+0000","last_unstale":"2023-10-06T03:05:29.976944+0000","last_undegraded":"2023-10-06T03:05:29.976944+0000","last_fullsized":"2023-10-06T03:05:29.976944+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:19.009895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.959884+0000","last_change":"2023-10-06T03:04:23.814917+0000","last_active":"2023-10-06T03:05:28.959884+0000","last_peered":"2023-10-06T03:05:28.959884+0000","last_clean":"2023-10-06T03:05:28.959884+0000","last_became_active":"2023-10-06T03:04:23.814601+0000","last_became_peered":"2023-10-06T03:04:23.814601+0000","last_unstale":"2023-10-06T03:05:28.959884+0000","last_undegraded":"2023-10-06T03:05:28.959884+0000","last_fullsized":"2023-10-06T03:05:28.959884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.969001+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:40.621126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.985121+0000","last_change":"2023-10-06T03:05:29.985121+0000","last_active":"2023-10-06T03:05:29.985121+0000","last_peered":"2023-10-06T03:05:29.985121+0000","last_clean":"2023-10-06T03:05:29.985121+0000","last_became_active":"2023-10-06T03:05:29.984686+0000","last_became_peered":"2023-10-06T03:05:29.984686+0000","last_unstale":"2023-10-06T03:05:29.985121+0000","last_undegraded":"2023-10-06T03:05:29.985121+0000","last_fullsized":"2023-10-06T03:05:29.985121+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:54.269190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.955549+0000","last_change":"2023-10-06T03:04:24.314547+0000","last_active":"2023-10-06T03:05:28.955549+0000","last_peered":"2023-10-06T03:05:28.955549+0000","last_clean":"2023-10-06T03:05:28.955549+0000","last_became_active":"2023-10-06T03:04:24.314278+0000","last_became_peered":"2023-10-06T03:04:24.314278+0000","last_unstale":"2023-10-06T03:05:28.955549+0000","last_undegraded":"2023-10-06T03:05:28.955549+0000","last_fullsized":"2023-10-06T03:05:28.955549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:25.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.968906+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:48.595437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.970357+0000","last_change":"2023-10-06T03:05:29.970357+0000","last_active":"2023-10-06T03:05:29.970357+0000","last_peered":"2023-10-06T03:05:29.970357+0000","last_clean":"2023-10-06T03:05:29.970357+0000","last_became_active":"2023-10-06T03:05:29.970053+0000","last_became_peered":"2023-10-06T03:05:29.970053+0000","last_unstale":"2023-10-06T03:05:29.970357+0000","last_undegraded":"2023-10-06T03:05:29.970357+0000","last_fullsized":"2023-10-06T03:05:29.970357+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:37.623703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.959758+0000","last_change":"2023-10-06T03:04:23.807972+0000","last_active":"2023-10-06T03:05:28.959758+0000","last_peered":"2023-10-06T03:05:28.959758+0000","last_clean":"2023-10-06T03:05:28.959758+0000","last_became_active":"2023-10-06T03:04:23.807723+0000","last_became_peered":"2023-10-06T03:04:23.807723+0000","last_unstale":"2023-10-06T03:05:28.959758+0000","last_undegraded":"2023-10-06T03:05:28.959758+0000","last_fullsized":"2023-10-06T03:05:28.959758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":180,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.955973+0000","last_change":"2023-10-06T03:04:17.779925+0000","last_active":"2023-10-06T03:05:28.955973+0000","last_peered":"2023-10-06T03:05:28.955973+0000","last_clean":"2023-10-06T03:05:28.955973+0000","last_became_active":"2023-10-06T03:04:17.778997+0000","last_became_peered":"2023-10-06T03:04:17.778997+0000","last_unstale":"2023-10-06T03:05:28.955973+0000","last_undegraded":"2023-10-06T03:05:28.955973+0000","last_fullsized":"2023-10-06T03:05:28.955973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_clean_scrub_stamp":"2023-10-06T03:04:16.761610+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.975557+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:55.883295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.975059+0000","last_change":"2023-10-06T03:05:29.975059+0000","last_active":"2023-10-06T03:05:29.975059+0000","last_peered":"2023-10-06T03:05:29.975059+0000","last_clean":"2023-10-06T03:05:29.975059+0000","last_became_active":"2023-10-06T03:05:29.974806+0000","last_became_peered":"2023-10-06T03:05:29.974806+0000","last_unstale":"2023-10-06T03:05:29.975059+0000","last_undegraded":"2023-10-06T03:05:29.975059+0000","last_fullsized":"2023-10-06T03:05:29.975059+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:07.796869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.956071+0000","last_change":"2023-10-06T03:04:23.814887+0000","last_active":"2023-10-06T03:05:28.956071+0000","last_peered":"2023-10-06T03:05:28.956071+0000","last_clean":"2023-10-06T03:05:28.956071+0000","last_became_active":"2023-10-06T03:04:23.814581+0000","last_became_peered":"2023-10-06T03:04:23.814581+0000","last_unstale":"2023-10-06T03:05:28.956071+0000","last_undegraded":"2023-10-06T03:05:28.956071+0000","last_fullsized":"2023-10-06T03:05:28.956071+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.964736+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:49.871669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.973917+0000","last_change":"2023-10-06T03:05:29.973917+0000","last_active":"2023-10-06T03:05:29.973917+0000","last_peered":"2023-10-06T03:05:29.973917+0000","last_clean":"2023-10-06T03:05:29.973917+0000","last_became_active":"2023-10-06T03:05:29.973667+0000","last_became_peered":"2023-10-06T03:05:29.973667+0000","last_unstale":"2023-10-06T03:05:29.973917+0000","last_undegraded":"2023-10-06T03:05:29.973917+0000","last_fullsized":"2023-10-06T03:05:29.973917+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:07.355752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.956204+0000","last_change":"2023-10-06T03:04:23.986771+0000","last_active":"2023-10-06T03:05:28.956204+0000","last_peered":"2023-10-06T03:05:28.956204+0000","last_clean":"2023-10-06T03:05:28.956204+0000","last_became_active":"2023-10-06T03:04:23.986552+0000","last_became_peered":"2023-10-06T03:04:23.986552+0000","last_unstale":"2023-10-06T03:05:28.956204+0000","last_undegraded":"2023-10-06T03:05:28.956204+0000","last_fullsized":"2023-10-06T03:05:28.956204+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.962817+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:01.791955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.979529+0000","last_change":"2023-10-06T03:05:29.979529+0000","last_active":"2023-10-06T03:05:29.979529+0000","last_peered":"2023-10-06T03:05:29.979529+0000","last_clean":"2023-10-06T03:05:29.979529+0000","last_became_active":"2023-10-06T03:05:29.979281+0000","last_became_peered":"2023-10-06T03:05:29.979281+0000","last_unstale":"2023-10-06T03:05:29.979529+0000","last_undegraded":"2023-10-06T03:05:29.979529+0000","last_fullsized":"2023-10-06T03:05:29.979529+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:56.742515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":28,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.958623+0000","last_change":"2023-10-06T03:04:23.813862+0000","last_active":"2023-10-06T03:05:28.958623+0000","last_peered":"2023-10-06T03:05:28.958623+0000","last_clean":"2023-10-06T03:05:28.958623+0000","last_became_active":"2023-10-06T03:04:23.813584+0000","last_became_peered":"2023-10-06T03:04:23.813584+0000","last_unstale":"2023-10-06T03:05:28.958623+0000","last_undegraded":"2023-10-06T03:05:28.958623+0000","last_fullsized":"2023-10-06T03:05:28.958623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:05:29.950435+0000","last_change":"2023-10-06T03:05:29.962871+0000","last_active":"2023-10-06T03:05:29.950435+0000","last_peered":"2023-10-06T03:05:29.950435+0000","last_clean":"2023-10-06T03:05:29.950435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:05:29.950435+0000","last_undegraded":"2023-10-06T03:05:29.950435+0000","last_fullsized":"2023-10-06T03:05:29.950435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:52.170677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":8,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-06T03:05:29.985492+0000","last_change":"2023-10-06T03:05:29.985492+0000","last_active":"2023-10-06T03:05:29.985492+0000","last_peered":"2023-10-06T03:05:29.985492+0000","last_clean":"2023-10-06T03:05:29.985492+0000","last_became_active":"2023-10-06T03:05:29.984212+0000","last_became_peered":"2023-10-06T03:05:29.984212+0000","last_unstale":"2023-10-06T03:05:29.985492+0000","last_undegraded":"2023-10-06T03:05:29.985492+0000","last_fullsized":"2023-10-06T03:05:29.985492+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:37.763634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T03:05:28.955160+0000","last_change":"2023-10-06T03:04:23.805874+0000","last_active":"2023-10-06T03:05:28.955160+0000","last_peered":"2023-10-06T03:05:28.955160+0000","last_clean":"2023-10-06T03:05:28.955160+0000","last_became_active":"2023-10-06T03:04:23.805551+0000","last_became_peered":"2023-10-06T03:04:23.805551+0000","last_unstale":"2023-10-06T03:05:28.955160+0000","last_undegraded":"2023-10-06T03:05:28.955160+0000","last_fullsized":"2023-10-06T03:05:28.955160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:21.250275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298308,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073532,"statfs":{"total":96636764160,"available":96331296768,"internally_reserved":0,"allocated":1044480,"data_stored":788089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":3.8860000000000001,"5min":3.8860000000000001,"15min":3.8860000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.988,"5min":3.988,"15min":3.988},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":3.9510000000000001,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.444,"5min":3.444,"15min":3.444},"last":0.65900000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":4.1429999999999998,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":3.903,"5min":3.903,"15min":3.903},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":3.9260000000000002,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":0.63200000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.45000000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.42099999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":6.8220000000000001,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":6.8330000000000002,"5min":6.8330000000000002,"15min":6.8330000000000002},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.8929999999999998,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.497},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.948,"5min":3.948,"15min":3.948},"last":0.51500000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.379},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":3.996,"5min":3.996,"15min":3.996},"last":0.56200000000000006}]},{"osd":3,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.622}]},{"osd":5,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.59699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297716,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074124,"statfs":{"total":96636764160,"available":96331902976,"internally_reserved":0,"allocated":438272,"data_stored":190793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.314}]},{"osd":2,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":6.056,"5min":6.056,"15min":6.056},"last":0.254},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.29199999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.377},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.51500000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.49099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298304,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073536,"statfs":{"total":96636764160,"available":96331300864,"internally_reserved":0,"allocated":1040384,"data_stored":787078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.35399999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.31}]},{"osd":3,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.32700000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.61099999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56499999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":12.913,"5min":12.913,"15min":12.913},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.31900000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":3.8919999999999999,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.36399999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.28499999999999998},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":12.941000000000001,"5min":12.941000000000001,"15min":12.941000000000001},"last":0.30599999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":12.846,"5min":12.846,"15min":12.846},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.45200000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":12.884,"5min":12.884,"15min":12.884},"last":0.503}]},{"osd":6,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.48099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.30399999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.38300000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.32200000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.39300000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.41899999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.56599999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.44600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.5}]},{"osd":1,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.439},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.53600000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.42699999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.48699999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.56499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297728,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074112,"statfs":{"total":96636764160,"available":96331890688,"internally_reserved":0,"allocated":450560,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46600000000000003}]},{"osd":2,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.55800000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.51300000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.624}]},{"osd":6,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:05:39.908 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:05:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.043+0000 7f1ab620d700 1 Processor -- start 2023-10-06T03:05:40.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.043+0000 7f1ab620d700 1 -- start start 2023-10-06T03:05:40.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.044+0000 7f1ab620d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ab00c3d30 0x7f1ab00c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:40.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.044+0000 7f1ab620d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab00c4230 con 0x7f1ab00cc4b0 2023-10-06T03:05:40.045 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.044+0000 7f1ab620d700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab00cd290 con 0x7f1ab00ce8a0 2023-10-06T03:05:40.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.044+0000 7f1ab620d700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab00cd570 con 0x7f1ab00c3d30 2023-10-06T03:05:40.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.044+0000 7f1aaf7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f1ab00cc4b0 0x7f1ab00cc880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35300/0 (socket says 172.21.15.125:35300) 2023-10-06T03:05:40.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.044+0000 7f1aaf7fe700 1 -- 172.21.15.125:0/1480919678 learned_addr learned my addr 172.21.15.125:0/1480919678 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:40.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.044+0000 7f1aaeffd700 1 --2- 172.21.15.125:0/1480919678 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ab00c3d30 0x7f1ab00c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:40.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.044+0000 7f1aae7fc700 1 -- 172.21.15.125:0/1480919678 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445582530 0 0) 0x7f1ab00c4230 con 0x7f1ab00cc4b0 2023-10-06T03:05:40.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.044+0000 7f1aae7fc700 1 -- 172.21.15.125:0/1480919678 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a98003570 con 0x7f1ab00cc4b0 2023-10-06T03:05:40.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.044+0000 7f1aae7fc700 1 -- 172.21.15.125:0/1480919678 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1856110185 0 0) 0x7f1ab00cd290 con 0x7f1ab00ce8a0 2023-10-06T03:05:40.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.044+0000 7f1aae7fc700 1 -- 172.21.15.125:0/1480919678 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ab00c4230 con 0x7f1ab00ce8a0 2023-10-06T03:05:40.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.044+0000 7f1aae7fc700 1 -- 172.21.15.125:0/1480919678 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2930490859 0 0) 0x7f1a98003570 con 0x7f1ab00cc4b0 2023-10-06T03:05:40.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.044+0000 7f1aaeffd700 1 -- 172.21.15.125:0/1480919678 >> v1:172.21.15.130:6789/0 conn(0x7f1ab00ce8a0 legacy=0x7f1ab0069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:40.046 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.044+0000 7f1aaeffd700 1 -- 172.21.15.125:0/1480919678 >> v1:172.21.15.125:6789/0 conn(0x7f1ab00cc4b0 legacy=0x7f1ab00cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:40.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.044+0000 7f1aaeffd700 1 -- 172.21.15.125:0/1480919678 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab00ccf90 con 0x7f1ab00c3d30 2023-10-06T03:05:40.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.045+0000 7f1aaeffd700 1 --2- 172.21.15.125:0/1480919678 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ab00c3d30 0x7f1ab00c85c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009910 tx=0x7f1aa40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd788806b2765ab0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:40.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.045+0000 7f1aae7fc700 1 -- 172.21.15.125:0/1480919678 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0001470 con 0x7f1ab00c3d30 2023-10-06T03:05:40.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.045+0000 7f1aae7fc700 1 -- 172.21.15.125:0/1480919678 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa4011420 con 0x7f1ab00c3d30 2023-10-06T03:05:40.047 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.045+0000 7f1aae7fc700 1 -- 172.21.15.125:0/1480919678 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa40117c0 con 0x7f1ab00c3d30 2023-10-06T03:05:40.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.045+0000 7f1ab620d700 1 -- 172.21.15.125:0/1480919678 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ab00c3d30 msgr2=0x7f1ab00c85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:40.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.045+0000 7f1ab620d700 1 --2- 172.21.15.125:0/1480919678 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ab00c3d30 0x7f1ab00c85c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009910 tx=0x7f1aa40091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.045+0000 7f1ab620d700 1 -- 172.21.15.125:0/1480919678 shutdown_connections 2023-10-06T03:05:40.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.046+0000 7f1ab620d700 1 --2- 172.21.15.125:0/1480919678 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ab00c3d30 0x7f1ab00c85c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.046+0000 7f1ab620d700 1 -- 172.21.15.125:0/1480919678 >> 172.21.15.125:0/1480919678 conn(0x7f1ab0067df0 msgr2=0x7f1ab00cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:40.048 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.046+0000 7f1ab620d700 1 -- 172.21.15.125:0/1480919678 shutdown_connections 2023-10-06T03:05:40.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.046+0000 7f1ab620d700 1 -- 172.21.15.125:0/1480919678 wait complete. 2023-10-06T03:05:40.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.048+0000 7f1ab620d700 1 Processor -- start 2023-10-06T03:05:40.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.048+0000 7f1ab620d700 1 -- start start 2023-10-06T03:05:40.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1ab620d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ab00c3d30 0x7f1ab00c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:40.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1ab620d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ab00cc4b0 0x7f1ab014c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:40.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1ab620d700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ab00ce8a0 0x7f1ab00b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:40.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1ab620d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab016cd40 con 0x7f1ab00cc4b0 2023-10-06T03:05:40.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1ab620d700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab006e300 con 0x7f1ab00ce8a0 2023-10-06T03:05:40.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1ab620d700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab00c6240 con 0x7f1ab00c3d30 2023-10-06T03:05:40.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1aaeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ab00cc4b0 0x7f1ab014c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:40.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1aaeffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ab00cc4b0 0x7f1ab014c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57840/0 (socket says 172.21.15.125:57840) 2023-10-06T03:05:40.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1aaeffd700 1 -- 172.21.15.125:0/3997928109 learned_addr learned my addr 172.21.15.125:0/3997928109 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:40.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1aaf7fe700 1 --2- 172.21.15.125:0/3997928109 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ab00c3d30 0x7f1ab00c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:40.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1aaffff700 1 --2- 172.21.15.125:0/3997928109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ab00ce8a0 0x7f1ab00b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:40.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1aaeffd700 1 -- 172.21.15.125:0/3997928109 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ab00c3d30 msgr2=0x7f1ab00c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:40.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1aaeffd700 1 --2- 172.21.15.125:0/3997928109 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ab00c3d30 0x7f1ab00c7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1aaeffd700 1 -- 172.21.15.125:0/3997928109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ab00ce8a0 msgr2=0x7f1ab00b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:40.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1aaeffd700 1 --2- 172.21.15.125:0/3997928109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ab00ce8a0 0x7f1ab00b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1aaeffd700 1 -- 172.21.15.125:0/3997928109 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa4009420 con 0x7f1ab00cc4b0 2023-10-06T03:05:40.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1aaeffd700 1 --2- 172.21.15.125:0/3997928109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ab00cc4b0 0x7f1ab014c170 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40091e0 tx=0x7f1aa4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:40.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1a977fe700 1 -- 172.21.15.125:0/3997928109 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa401cb30 con 0x7f1ab00cc4b0 2023-10-06T03:05:40.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1a977fe700 1 -- 172.21.15.125:0/3997928109 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa401cc90 con 0x7f1ab00cc4b0 2023-10-06T03:05:40.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.049+0000 7f1ab620d700 1 -- 172.21.15.125:0/3997928109 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab00c67c0 con 0x7f1ab00cc4b0 2023-10-06T03:05:40.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.050+0000 7f1a977fe700 1 -- 172.21.15.125:0/3997928109 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa401a680 con 0x7f1ab00cc4b0 2023-10-06T03:05:40.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.050+0000 7f1ab620d700 1 -- 172.21.15.125:0/3997928109 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab00c6450 con 0x7f1ab00cc4b0 2023-10-06T03:05:40.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.051+0000 7f1ab620d700 1 -- 172.21.15.125:0/3997928109 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab00c6950 con 0x7f1ab00cc4b0 2023-10-06T03:05:40.053 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.051+0000 7f1a977fe700 1 -- 172.21.15.125:0/3997928109 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1aa401aa70 con 0x7f1ab00cc4b0 2023-10-06T03:05:40.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.052+0000 7f1a977fe700 1 --2- 172.21.15.125:0/3997928109 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1a9c066f60 0x7f1a9c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:40.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.052+0000 7f1aaf7fe700 1 --2- 172.21.15.125:0/3997928109 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1a9c066f60 0x7f1a9c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:40.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.052+0000 7f1a977fe700 1 -- 172.21.15.125:0/3997928109 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f1aa4086520 con 0x7f1ab00cc4b0 2023-10-06T03:05:40.054 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.052+0000 7f1aaf7fe700 1 --2- 172.21.15.125:0/3997928109 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1a9c066f60 0x7f1a9c069410 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00011e0 tx=0x7f1aa0001620 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:40.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.056+0000 7f1a977fe700 1 -- 172.21.15.125:0/3997928109 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1aa40534f0 con 0x7f1ab00cc4b0 2023-10-06T03:05:40.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.235+0000 7f1ab620d700 1 -- 172.21.15.125:0/3997928109 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ab0066570 con 0x7f1a9c066f60 2023-10-06T03:05:40.244 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.243+0000 7f1a977fe700 1 -- 172.21.15.125:0/3997928109 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310201 (secure 0 0 0) 0x7f1ab0066570 con 0x7f1a9c066f60 2023-10-06T03:05:40.247 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:40.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.246+0000 7f1ab620d700 1 -- 172.21.15.125:0/3997928109 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1a9c066f60 msgr2=0x7f1a9c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:40.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.246+0000 7f1ab620d700 1 --2- 172.21.15.125:0/3997928109 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1a9c066f60 0x7f1a9c069410 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00011e0 tx=0x7f1aa0001620 comp rx=0 tx=0).stop 2023-10-06T03:05:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.246+0000 7f1ab620d700 1 -- 172.21.15.125:0/3997928109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ab00cc4b0 msgr2=0x7f1ab014c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.246+0000 7f1ab620d700 1 --2- 172.21.15.125:0/3997928109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ab00cc4b0 0x7f1ab014c170 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1aa40091e0 tx=0x7f1aa4016000 comp rx=0 tx=0).stop 2023-10-06T03:05:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.247+0000 7f1ab620d700 1 -- 172.21.15.125:0/3997928109 shutdown_connections 2023-10-06T03:05:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.247+0000 7f1ab620d700 1 --2- 172.21.15.125:0/3997928109 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1a9c066f60 0x7f1a9c069410 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.247+0000 7f1ab620d700 1 --2- 172.21.15.125:0/3997928109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ab00ce8a0 0x7f1ab00b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.247+0000 7f1ab620d700 1 --2- 172.21.15.125:0/3997928109 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1ab00c3d30 0x7f1ab00c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.247+0000 7f1ab620d700 1 --2- 172.21.15.125:0/3997928109 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1ab00cc4b0 0x7f1ab014c170 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.247+0000 7f1ab620d700 1 -- 172.21.15.125:0/3997928109 >> 172.21.15.125:0/3997928109 conn(0x7f1ab0067df0 msgr2=0x7f1ab00cd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.247+0000 7f1ab620d700 1 -- 172.21.15.125:0/3997928109 shutdown_connections 2023-10-06T03:05:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.247+0000 7f1ab620d700 1 -- 172.21.15.125:0/3997928109 wait complete. 2023-10-06T03:05:40.250 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-06T03:05:40.259 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-10-06T03:05:39.822307+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2383236,"kb_used_data":4932,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591484,"statfs":{"total":773094113280,"available":770653679616,"internally_reserved":0,"allocated":5050368,"data_stored":2881281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.859742"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.984080+0000","last_change":"2023-10-06T03:05:30.982390+0000","last_active":"2023-10-06T03:05:30.984080+0000","last_peered":"2023-10-06T03:05:30.984080+0000","last_clean":"2023-10-06T03:05:30.984080+0000","last_became_active":"2023-10-06T03:05:30.982089+0000","last_became_peered":"2023-10-06T03:05:30.982089+0000","last_unstale":"2023-10-06T03:05:30.984080+0000","last_undegraded":"2023-10-06T03:05:30.984080+0000","last_fullsized":"2023-10-06T03:05:30.984080+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:52.170677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.989968+0000","last_change":"2023-10-06T03:05:30.989192+0000","last_active":"2023-10-06T03:05:30.989968+0000","last_peered":"2023-10-06T03:05:30.989968+0000","last_clean":"2023-10-06T03:05:30.989968+0000","last_became_active":"2023-10-06T03:05:30.988926+0000","last_became_peered":"2023-10-06T03:05:30.988926+0000","last_unstale":"2023-10-06T03:05:30.989968+0000","last_undegraded":"2023-10-06T03:05:30.989968+0000","last_fullsized":"2023-10-06T03:05:30.989968+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:19:01.791955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.982574+0000","last_change":"2023-10-06T03:05:30.979581+0000","last_active":"2023-10-06T03:05:30.982574+0000","last_peered":"2023-10-06T03:05:30.982574+0000","last_clean":"2023-10-06T03:05:30.982574+0000","last_became_active":"2023-10-06T03:05:30.979262+0000","last_became_peered":"2023-10-06T03:05:30.979262+0000","last_unstale":"2023-10-06T03:05:30.982574+0000","last_undegraded":"2023-10-06T03:05:30.982574+0000","last_fullsized":"2023-10-06T03:05:30.982574+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:59.432670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.990462+0000","last_change":"2023-10-06T03:05:30.987663+0000","last_active":"2023-10-06T03:05:30.990462+0000","last_peered":"2023-10-06T03:05:30.990462+0000","last_clean":"2023-10-06T03:05:30.990462+0000","last_became_active":"2023-10-06T03:05:30.987325+0000","last_became_peered":"2023-10-06T03:05:30.987325+0000","last_unstale":"2023-10-06T03:05:30.990462+0000","last_undegraded":"2023-10-06T03:05:30.990462+0000","last_fullsized":"2023-10-06T03:05:30.990462+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:57.748161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.985192+0000","last_change":"2023-10-06T03:05:30.984632+0000","last_active":"2023-10-06T03:05:30.985192+0000","last_peered":"2023-10-06T03:05:30.985192+0000","last_clean":"2023-10-06T03:05:30.985192+0000","last_became_active":"2023-10-06T03:05:30.984358+0000","last_became_peered":"2023-10-06T03:05:30.984358+0000","last_unstale":"2023-10-06T03:05:30.985192+0000","last_undegraded":"2023-10-06T03:05:30.985192+0000","last_fullsized":"2023-10-06T03:05:30.985192+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:25.519827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.976731+0000","last_change":"2023-10-06T03:05:30.975050+0000","last_active":"2023-10-06T03:05:30.976731+0000","last_peered":"2023-10-06T03:05:30.976731+0000","last_clean":"2023-10-06T03:05:30.976731+0000","last_became_active":"2023-10-06T03:05:30.974766+0000","last_became_peered":"2023-10-06T03:05:30.974766+0000","last_unstale":"2023-10-06T03:05:30.976731+0000","last_undegraded":"2023-10-06T03:05:30.976731+0000","last_fullsized":"2023-10-06T03:05:30.976731+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:17:31.726072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.983909+0000","last_change":"2023-10-06T03:05:30.981018+0000","last_active":"2023-10-06T03:05:30.983909+0000","last_peered":"2023-10-06T03:05:30.983909+0000","last_clean":"2023-10-06T03:05:30.983909+0000","last_became_active":"2023-10-06T03:05:30.980798+0000","last_became_peered":"2023-10-06T03:05:30.980798+0000","last_unstale":"2023-10-06T03:05:30.983909+0000","last_undegraded":"2023-10-06T03:05:30.983909+0000","last_fullsized":"2023-10-06T03:05:30.983909+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:48.052762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.990216+0000","last_change":"2023-10-06T03:05:30.984497+0000","last_active":"2023-10-06T03:05:30.990216+0000","last_peered":"2023-10-06T03:05:30.990216+0000","last_clean":"2023-10-06T03:05:30.990216+0000","last_became_active":"2023-10-06T03:05:30.984248+0000","last_became_peered":"2023-10-06T03:05:30.984248+0000","last_unstale":"2023-10-06T03:05:30.990216+0000","last_undegraded":"2023-10-06T03:05:30.990216+0000","last_fullsized":"2023-10-06T03:05:30.990216+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:49:30.642665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.990524+0000","last_change":"2023-10-06T03:05:30.988253+0000","last_active":"2023-10-06T03:05:30.990524+0000","last_peered":"2023-10-06T03:05:30.990524+0000","last_clean":"2023-10-06T03:05:30.990524+0000","last_became_active":"2023-10-06T03:05:30.987417+0000","last_became_peered":"2023-10-06T03:05:30.987417+0000","last_unstale":"2023-10-06T03:05:30.990524+0000","last_undegraded":"2023-10-06T03:05:30.990524+0000","last_fullsized":"2023-10-06T03:05:30.990524+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:33:27.920655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.990510+0000","last_change":"2023-10-06T03:05:30.988406+0000","last_active":"2023-10-06T03:05:30.990510+0000","last_peered":"2023-10-06T03:05:30.990510+0000","last_clean":"2023-10-06T03:05:30.990510+0000","last_became_active":"2023-10-06T03:05:30.988053+0000","last_became_peered":"2023-10-06T03:05:30.988053+0000","last_unstale":"2023-10-06T03:05:30.990510+0000","last_undegraded":"2023-10-06T03:05:30.990510+0000","last_fullsized":"2023-10-06T03:05:30.990510+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:40.812378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.989229+0000","last_change":"2023-10-06T03:05:30.982561+0000","last_active":"2023-10-06T03:05:30.989229+0000","last_peered":"2023-10-06T03:05:30.989229+0000","last_clean":"2023-10-06T03:05:30.989229+0000","last_became_active":"2023-10-06T03:05:30.982315+0000","last_became_peered":"2023-10-06T03:05:30.982315+0000","last_unstale":"2023-10-06T03:05:30.989229+0000","last_undegraded":"2023-10-06T03:05:30.989229+0000","last_fullsized":"2023-10-06T03:05:30.989229+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:55.892723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.984277+0000","last_change":"2023-10-06T03:05:30.978616+0000","last_active":"2023-10-06T03:05:30.984277+0000","last_peered":"2023-10-06T03:05:30.984277+0000","last_clean":"2023-10-06T03:05:30.984277+0000","last_became_active":"2023-10-06T03:05:30.978341+0000","last_became_peered":"2023-10-06T03:05:30.978341+0000","last_unstale":"2023-10-06T03:05:30.984277+0000","last_undegraded":"2023-10-06T03:05:30.984277+0000","last_fullsized":"2023-10-06T03:05:30.984277+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:52.170677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.979098+0000","last_change":"2023-10-06T03:05:30.977163+0000","last_active":"2023-10-06T03:05:30.979098+0000","last_peered":"2023-10-06T03:05:30.979098+0000","last_clean":"2023-10-06T03:05:30.979098+0000","last_became_active":"2023-10-06T03:05:30.976720+0000","last_became_peered":"2023-10-06T03:05:30.976720+0000","last_unstale":"2023-10-06T03:05:30.979098+0000","last_undegraded":"2023-10-06T03:05:30.979098+0000","last_fullsized":"2023-10-06T03:05:30.979098+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:08.802515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.990404+0000","last_change":"2023-10-06T03:05:30.987659+0000","last_active":"2023-10-06T03:05:30.990404+0000","last_peered":"2023-10-06T03:05:30.990404+0000","last_clean":"2023-10-06T03:05:30.990404+0000","last_became_active":"2023-10-06T03:05:30.987368+0000","last_became_peered":"2023-10-06T03:05:30.987368+0000","last_unstale":"2023-10-06T03:05:30.990404+0000","last_undegraded":"2023-10-06T03:05:30.990404+0000","last_fullsized":"2023-10-06T03:05:30.990404+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:14.304674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.986950+0000","last_change":"2023-10-06T03:05:30.978690+0000","last_active":"2023-10-06T03:05:30.986950+0000","last_peered":"2023-10-06T03:05:30.986950+0000","last_clean":"2023-10-06T03:05:30.986950+0000","last_became_active":"2023-10-06T03:05:30.978435+0000","last_became_peered":"2023-10-06T03:05:30.978435+0000","last_unstale":"2023-10-06T03:05:30.986950+0000","last_undegraded":"2023-10-06T03:05:30.986950+0000","last_fullsized":"2023-10-06T03:05:30.986950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:56:20.868524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.987077+0000","last_change":"2023-10-06T03:05:30.985863+0000","last_active":"2023-10-06T03:05:30.987077+0000","last_peered":"2023-10-06T03:05:30.987077+0000","last_clean":"2023-10-06T03:05:30.987077+0000","last_became_active":"2023-10-06T03:05:30.985309+0000","last_became_peered":"2023-10-06T03:05:30.985309+0000","last_unstale":"2023-10-06T03:05:30.987077+0000","last_undegraded":"2023-10-06T03:05:30.987077+0000","last_fullsized":"2023-10-06T03:05:30.987077+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:40.083624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.985479+0000","last_change":"2023-10-06T03:05:30.979871+0000","last_active":"2023-10-06T03:05:30.985479+0000","last_peered":"2023-10-06T03:05:30.985479+0000","last_clean":"2023-10-06T03:05:30.985479+0000","last_became_active":"2023-10-06T03:05:30.979525+0000","last_became_peered":"2023-10-06T03:05:30.979525+0000","last_unstale":"2023-10-06T03:05:30.985479+0000","last_undegraded":"2023-10-06T03:05:30.985479+0000","last_fullsized":"2023-10-06T03:05:30.985479+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:17:31.726072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.991156+0000","last_change":"2023-10-06T03:05:30.990567+0000","last_active":"2023-10-06T03:05:30.991156+0000","last_peered":"2023-10-06T03:05:30.991156+0000","last_clean":"2023-10-06T03:05:30.991156+0000","last_became_active":"2023-10-06T03:05:30.990312+0000","last_became_peered":"2023-10-06T03:05:30.990312+0000","last_unstale":"2023-10-06T03:05:30.991156+0000","last_undegraded":"2023-10-06T03:05:30.991156+0000","last_fullsized":"2023-10-06T03:05:30.991156+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:49.608583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.986996+0000","last_change":"2023-10-06T03:05:30.983401+0000","last_active":"2023-10-06T03:05:30.986996+0000","last_peered":"2023-10-06T03:05:30.986996+0000","last_clean":"2023-10-06T03:05:30.986996+0000","last_became_active":"2023-10-06T03:05:30.982928+0000","last_became_peered":"2023-10-06T03:05:30.982928+0000","last_unstale":"2023-10-06T03:05:30.986996+0000","last_undegraded":"2023-10-06T03:05:30.986996+0000","last_fullsized":"2023-10-06T03:05:30.986996+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:08.802515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.990561+0000","last_change":"2023-10-06T03:05:30.989841+0000","last_active":"2023-10-06T03:05:30.990561+0000","last_peered":"2023-10-06T03:05:30.990561+0000","last_clean":"2023-10-06T03:05:30.990561+0000","last_became_active":"2023-10-06T03:05:30.989573+0000","last_became_peered":"2023-10-06T03:05:30.989573+0000","last_unstale":"2023-10-06T03:05:30.990561+0000","last_undegraded":"2023-10-06T03:05:30.990561+0000","last_fullsized":"2023-10-06T03:05:30.990561+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:40.083624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.976293+0000","last_change":"2023-10-06T03:05:30.972496+0000","last_active":"2023-10-06T03:05:30.976293+0000","last_peered":"2023-10-06T03:05:30.976293+0000","last_clean":"2023-10-06T03:05:30.976293+0000","last_became_active":"2023-10-06T03:05:30.972206+0000","last_became_peered":"2023-10-06T03:05:30.972206+0000","last_unstale":"2023-10-06T03:05:30.976293+0000","last_undegraded":"2023-10-06T03:05:30.976293+0000","last_fullsized":"2023-10-06T03:05:30.976293+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:16.464786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.990548+0000","last_change":"2023-10-06T03:05:30.987953+0000","last_active":"2023-10-06T03:05:30.990548+0000","last_peered":"2023-10-06T03:05:30.990548+0000","last_clean":"2023-10-06T03:05:30.990548+0000","last_became_active":"2023-10-06T03:05:30.987687+0000","last_became_peered":"2023-10-06T03:05:30.987687+0000","last_unstale":"2023-10-06T03:05:30.990548+0000","last_undegraded":"2023-10-06T03:05:30.990548+0000","last_fullsized":"2023-10-06T03:05:30.990548+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:52.170677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.983285+0000","last_change":"2023-10-06T03:05:30.979496+0000","last_active":"2023-10-06T03:05:30.983285+0000","last_peered":"2023-10-06T03:05:30.983285+0000","last_clean":"2023-10-06T03:05:30.983285+0000","last_became_active":"2023-10-06T03:05:30.978688+0000","last_became_peered":"2023-10-06T03:05:30.978688+0000","last_unstale":"2023-10-06T03:05:30.983285+0000","last_undegraded":"2023-10-06T03:05:30.983285+0000","last_fullsized":"2023-10-06T03:05:30.983285+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:26.907689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.978257+0000","last_change":"2023-10-06T03:05:30.975151+0000","last_active":"2023-10-06T03:05:30.978257+0000","last_peered":"2023-10-06T03:05:30.978257+0000","last_clean":"2023-10-06T03:05:30.978257+0000","last_became_active":"2023-10-06T03:05:30.974873+0000","last_became_peered":"2023-10-06T03:05:30.974873+0000","last_unstale":"2023-10-06T03:05:30.978257+0000","last_undegraded":"2023-10-06T03:05:30.978257+0000","last_fullsized":"2023-10-06T03:05:30.978257+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:40.459403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.983307+0000","last_change":"2023-10-06T03:05:30.980148+0000","last_active":"2023-10-06T03:05:30.983307+0000","last_peered":"2023-10-06T03:05:30.983307+0000","last_clean":"2023-10-06T03:05:30.983307+0000","last_became_active":"2023-10-06T03:05:30.979897+0000","last_became_peered":"2023-10-06T03:05:30.979897+0000","last_unstale":"2023-10-06T03:05:30.983307+0000","last_undegraded":"2023-10-06T03:05:30.983307+0000","last_fullsized":"2023-10-06T03:05:30.983307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:45:05.824734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.977085+0000","last_change":"2023-10-06T03:05:30.970553+0000","last_active":"2023-10-06T03:05:30.977085+0000","last_peered":"2023-10-06T03:05:30.977085+0000","last_clean":"2023-10-06T03:05:30.977085+0000","last_became_active":"2023-10-06T03:05:30.970326+0000","last_became_peered":"2023-10-06T03:05:30.970326+0000","last_unstale":"2023-10-06T03:05:30.977085+0000","last_undegraded":"2023-10-06T03:05:30.977085+0000","last_fullsized":"2023-10-06T03:05:30.977085+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:55.200514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.982553+0000","last_change":"2023-10-06T03:05:30.978902+0000","last_active":"2023-10-06T03:05:30.982553+0000","last_peered":"2023-10-06T03:05:30.982553+0000","last_clean":"2023-10-06T03:05:30.982553+0000","last_became_active":"2023-10-06T03:05:30.978640+0000","last_became_peered":"2023-10-06T03:05:30.978640+0000","last_unstale":"2023-10-06T03:05:30.982553+0000","last_undegraded":"2023-10-06T03:05:30.982553+0000","last_fullsized":"2023-10-06T03:05:30.982553+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:37.769632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.977383+0000","last_change":"2023-10-06T03:05:30.973633+0000","last_active":"2023-10-06T03:05:30.977383+0000","last_peered":"2023-10-06T03:05:30.977383+0000","last_clean":"2023-10-06T03:05:30.977383+0000","last_became_active":"2023-10-06T03:05:30.973347+0000","last_became_peered":"2023-10-06T03:05:30.973347+0000","last_unstale":"2023-10-06T03:05:30.977383+0000","last_undegraded":"2023-10-06T03:05:30.977383+0000","last_fullsized":"2023-10-06T03:05:30.977383+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:57.748161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.986569+0000","last_change":"2023-10-06T03:05:30.982038+0000","last_active":"2023-10-06T03:05:30.986569+0000","last_peered":"2023-10-06T03:05:30.986569+0000","last_clean":"2023-10-06T03:05:30.986569+0000","last_became_active":"2023-10-06T03:05:30.981719+0000","last_became_peered":"2023-10-06T03:05:30.981719+0000","last_unstale":"2023-10-06T03:05:30.986569+0000","last_undegraded":"2023-10-06T03:05:30.986569+0000","last_fullsized":"2023-10-06T03:05:30.986569+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:25.832521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.982598+0000","last_change":"2023-10-06T03:05:30.979459+0000","last_active":"2023-10-06T03:05:30.982598+0000","last_peered":"2023-10-06T03:05:30.982598+0000","last_clean":"2023-10-06T03:05:30.982598+0000","last_became_active":"2023-10-06T03:05:30.978536+0000","last_became_peered":"2023-10-06T03:05:30.978536+0000","last_unstale":"2023-10-06T03:05:30.982598+0000","last_undegraded":"2023-10-06T03:05:30.982598+0000","last_fullsized":"2023-10-06T03:05:30.982598+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:50.371074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.976242+0000","last_change":"2023-10-06T03:05:30.972362+0000","last_active":"2023-10-06T03:05:30.976242+0000","last_peered":"2023-10-06T03:05:30.976242+0000","last_clean":"2023-10-06T03:05:30.976242+0000","last_became_active":"2023-10-06T03:05:30.972087+0000","last_became_peered":"2023-10-06T03:05:30.972087+0000","last_unstale":"2023-10-06T03:05:30.976242+0000","last_undegraded":"2023-10-06T03:05:30.976242+0000","last_fullsized":"2023-10-06T03:05:30.976242+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:40.812378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.985567+0000","last_change":"2023-10-06T03:05:30.981731+0000","last_active":"2023-10-06T03:05:30.985567+0000","last_peered":"2023-10-06T03:05:30.985567+0000","last_clean":"2023-10-06T03:05:30.985567+0000","last_became_active":"2023-10-06T03:05:30.980895+0000","last_became_peered":"2023-10-06T03:05:30.980895+0000","last_unstale":"2023-10-06T03:05:30.985567+0000","last_undegraded":"2023-10-06T03:05:30.985567+0000","last_fullsized":"2023-10-06T03:05:30.985567+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:08.361398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.979737+0000","last_change":"2023-10-06T03:05:30.976774+0000","last_active":"2023-10-06T03:05:30.979737+0000","last_peered":"2023-10-06T03:05:30.979737+0000","last_clean":"2023-10-06T03:05:30.979737+0000","last_became_active":"2023-10-06T03:05:30.976515+0000","last_became_peered":"2023-10-06T03:05:30.976515+0000","last_unstale":"2023-10-06T03:05:30.979737+0000","last_undegraded":"2023-10-06T03:05:30.979737+0000","last_fullsized":"2023-10-06T03:05:30.979737+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:02:13.049327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:31.257119+0000","last_change":"2023-10-06T03:05:29.973435+0000","last_active":"2023-10-06T03:05:31.257119+0000","last_peered":"2023-10-06T03:05:31.257119+0000","last_clean":"2023-10-06T03:05:31.257119+0000","last_became_active":"2023-10-06T03:05:29.973213+0000","last_became_peered":"2023-10-06T03:05:29.973213+0000","last_unstale":"2023-10-06T03:05:31.257119+0000","last_undegraded":"2023-10-06T03:05:31.257119+0000","last_fullsized":"2023-10-06T03:05:31.257119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:34:42.135044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.986531+0000","last_change":"2023-10-06T03:05:30.982671+0000","last_active":"2023-10-06T03:05:30.986531+0000","last_peered":"2023-10-06T03:05:30.986531+0000","last_clean":"2023-10-06T03:05:30.986531+0000","last_became_active":"2023-10-06T03:05:30.982395+0000","last_became_peered":"2023-10-06T03:05:30.982395+0000","last_unstale":"2023-10-06T03:05:30.986531+0000","last_undegraded":"2023-10-06T03:05:30.986531+0000","last_fullsized":"2023-10-06T03:05:30.986531+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:55.200514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:31.255098+0000","last_change":"2023-10-06T03:05:29.983368+0000","last_active":"2023-10-06T03:05:31.255098+0000","last_peered":"2023-10-06T03:05:31.255098+0000","last_clean":"2023-10-06T03:05:31.255098+0000","last_became_active":"2023-10-06T03:05:29.983086+0000","last_became_peered":"2023-10-06T03:05:29.983086+0000","last_unstale":"2023-10-06T03:05:31.255098+0000","last_undegraded":"2023-10-06T03:05:31.255098+0000","last_fullsized":"2023-10-06T03:05:31.255098+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:51.040731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.978855+0000","last_change":"2023-10-06T03:05:30.976988+0000","last_active":"2023-10-06T03:05:30.978855+0000","last_peered":"2023-10-06T03:05:30.978855+0000","last_clean":"2023-10-06T03:05:30.978855+0000","last_became_active":"2023-10-06T03:05:30.976705+0000","last_became_peered":"2023-10-06T03:05:30.976705+0000","last_unstale":"2023-10-06T03:05:30.978855+0000","last_undegraded":"2023-10-06T03:05:30.978855+0000","last_fullsized":"2023-10-06T03:05:30.978855+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:11.618981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:31.255228+0000","last_change":"2023-10-06T03:05:29.975058+0000","last_active":"2023-10-06T03:05:31.255228+0000","last_peered":"2023-10-06T03:05:31.255228+0000","last_clean":"2023-10-06T03:05:31.255228+0000","last_became_active":"2023-10-06T03:05:29.974839+0000","last_became_peered":"2023-10-06T03:05:29.974839+0000","last_unstale":"2023-10-06T03:05:31.255228+0000","last_undegraded":"2023-10-06T03:05:31.255228+0000","last_fullsized":"2023-10-06T03:05:31.255228+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:54.194868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.986066+0000","last_change":"2023-10-06T03:05:30.979396+0000","last_active":"2023-10-06T03:05:30.986066+0000","last_peered":"2023-10-06T03:05:30.986066+0000","last_clean":"2023-10-06T03:05:30.986066+0000","last_became_active":"2023-10-06T03:05:30.979138+0000","last_became_peered":"2023-10-06T03:05:30.979138+0000","last_unstale":"2023-10-06T03:05:30.986066+0000","last_undegraded":"2023-10-06T03:05:30.986066+0000","last_fullsized":"2023-10-06T03:05:30.986066+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:38.629349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:31.257135+0000","last_change":"2023-10-06T03:05:29.983896+0000","last_active":"2023-10-06T03:05:31.257135+0000","last_peered":"2023-10-06T03:05:31.257135+0000","last_clean":"2023-10-06T03:05:31.257135+0000","last_became_active":"2023-10-06T03:05:29.983586+0000","last_became_peered":"2023-10-06T03:05:29.983586+0000","last_unstale":"2023-10-06T03:05:31.257135+0000","last_undegraded":"2023-10-06T03:05:31.257135+0000","last_fullsized":"2023-10-06T03:05:31.257135+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:40:48.866023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.984234+0000","last_change":"2023-10-06T03:05:30.979945+0000","last_active":"2023-10-06T03:05:30.984234+0000","last_peered":"2023-10-06T03:05:30.984234+0000","last_clean":"2023-10-06T03:05:30.984234+0000","last_became_active":"2023-10-06T03:05:30.978880+0000","last_became_peered":"2023-10-06T03:05:30.978880+0000","last_unstale":"2023-10-06T03:05:30.984234+0000","last_undegraded":"2023-10-06T03:05:30.984234+0000","last_fullsized":"2023-10-06T03:05:30.984234+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:16.464786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:31.257037+0000","last_change":"2023-10-06T03:05:29.984468+0000","last_active":"2023-10-06T03:05:31.257037+0000","last_peered":"2023-10-06T03:05:31.257037+0000","last_clean":"2023-10-06T03:05:31.257037+0000","last_became_active":"2023-10-06T03:05:29.984216+0000","last_became_peered":"2023-10-06T03:05:29.984216+0000","last_unstale":"2023-10-06T03:05:31.257037+0000","last_undegraded":"2023-10-06T03:05:31.257037+0000","last_fullsized":"2023-10-06T03:05:31.257037+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:45:10.613335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.989282+0000","last_change":"2023-10-06T03:05:30.983107+0000","last_active":"2023-10-06T03:05:30.989282+0000","last_peered":"2023-10-06T03:05:30.989282+0000","last_clean":"2023-10-06T03:05:30.989282+0000","last_became_active":"2023-10-06T03:05:30.982425+0000","last_became_peered":"2023-10-06T03:05:30.982425+0000","last_unstale":"2023-10-06T03:05:30.989282+0000","last_undegraded":"2023-10-06T03:05:30.989282+0000","last_fullsized":"2023-10-06T03:05:30.989282+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:06.331617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:31.255385+0000","last_change":"2023-10-06T03:05:29.978356+0000","last_active":"2023-10-06T03:05:31.255385+0000","last_peered":"2023-10-06T03:05:31.255385+0000","last_clean":"2023-10-06T03:05:31.255385+0000","last_became_active":"2023-10-06T03:05:29.978068+0000","last_became_peered":"2023-10-06T03:05:29.978068+0000","last_unstale":"2023-10-06T03:05:31.255385+0000","last_undegraded":"2023-10-06T03:05:31.255385+0000","last_fullsized":"2023-10-06T03:05:31.255385+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:13.299028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.990199+0000","last_change":"2023-10-06T03:05:30.984490+0000","last_active":"2023-10-06T03:05:30.990199+0000","last_peered":"2023-10-06T03:05:30.990199+0000","last_clean":"2023-10-06T03:05:30.990199+0000","last_became_active":"2023-10-06T03:05:30.983874+0000","last_became_peered":"2023-10-06T03:05:30.983874+0000","last_unstale":"2023-10-06T03:05:30.990199+0000","last_undegraded":"2023-10-06T03:05:30.990199+0000","last_fullsized":"2023-10-06T03:05:30.990199+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:23:01.960298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.968631+0000","last_change":"2023-10-06T03:05:29.975560+0000","last_active":"2023-10-06T03:05:30.968631+0000","last_peered":"2023-10-06T03:05:30.968631+0000","last_clean":"2023-10-06T03:05:30.968631+0000","last_became_active":"2023-10-06T03:05:29.975146+0000","last_became_peered":"2023-10-06T03:05:29.975146+0000","last_unstale":"2023-10-06T03:05:30.968631+0000","last_undegraded":"2023-10-06T03:05:30.968631+0000","last_fullsized":"2023-10-06T03:05:30.968631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:37.763634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.983306+0000","last_change":"2023-10-06T03:05:30.979660+0000","last_active":"2023-10-06T03:05:30.983306+0000","last_peered":"2023-10-06T03:05:30.983306+0000","last_clean":"2023-10-06T03:05:30.983306+0000","last_became_active":"2023-10-06T03:05:30.978997+0000","last_became_peered":"2023-10-06T03:05:30.978997+0000","last_unstale":"2023-10-06T03:05:30.983306+0000","last_undegraded":"2023-10-06T03:05:30.983306+0000","last_fullsized":"2023-10-06T03:05:30.983306+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:53:12.918300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.984145+0000","last_change":"2023-10-06T03:05:29.978576+0000","last_active":"2023-10-06T03:05:30.984145+0000","last_peered":"2023-10-06T03:05:30.984145+0000","last_clean":"2023-10-06T03:05:30.984145+0000","last_became_active":"2023-10-06T03:05:29.978314+0000","last_became_peered":"2023-10-06T03:05:29.978314+0000","last_unstale":"2023-10-06T03:05:30.984145+0000","last_undegraded":"2023-10-06T03:05:30.984145+0000","last_fullsized":"2023-10-06T03:05:30.984145+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:25.902043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.989963+0000","last_change":"2023-10-06T03:05:30.989227+0000","last_active":"2023-10-06T03:05:30.989963+0000","last_peered":"2023-10-06T03:05:30.989963+0000","last_clean":"2023-10-06T03:05:30.989963+0000","last_became_active":"2023-10-06T03:05:30.988920+0000","last_became_peered":"2023-10-06T03:05:30.988920+0000","last_unstale":"2023-10-06T03:05:30.989963+0000","last_undegraded":"2023-10-06T03:05:30.989963+0000","last_fullsized":"2023-10-06T03:05:30.989963+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:18.782254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.974862+0000","last_change":"2023-10-06T03:05:29.976856+0000","last_active":"2023-10-06T03:05:30.974862+0000","last_peered":"2023-10-06T03:05:30.974862+0000","last_clean":"2023-10-06T03:05:30.974862+0000","last_became_active":"2023-10-06T03:05:29.976594+0000","last_became_peered":"2023-10-06T03:05:29.976594+0000","last_unstale":"2023-10-06T03:05:30.974862+0000","last_undegraded":"2023-10-06T03:05:30.974862+0000","last_fullsized":"2023-10-06T03:05:30.974862+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:09:51.165031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.982899+0000","last_change":"2023-10-06T03:05:30.978893+0000","last_active":"2023-10-06T03:05:30.982899+0000","last_peered":"2023-10-06T03:05:30.982899+0000","last_clean":"2023-10-06T03:05:30.982899+0000","last_became_active":"2023-10-06T03:05:30.978633+0000","last_became_peered":"2023-10-06T03:05:30.978633+0000","last_unstale":"2023-10-06T03:05:30.982899+0000","last_undegraded":"2023-10-06T03:05:30.982899+0000","last_fullsized":"2023-10-06T03:05:30.982899+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:20.015541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.984028+0000","last_change":"2023-10-06T03:05:29.980481+0000","last_active":"2023-10-06T03:05:30.984028+0000","last_peered":"2023-10-06T03:05:30.984028+0000","last_clean":"2023-10-06T03:05:30.984028+0000","last_became_active":"2023-10-06T03:05:29.980279+0000","last_became_peered":"2023-10-06T03:05:29.980279+0000","last_unstale":"2023-10-06T03:05:30.984028+0000","last_undegraded":"2023-10-06T03:05:30.984028+0000","last_fullsized":"2023-10-06T03:05:30.984028+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:07.796869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.974096+0000","last_change":"2023-10-06T03:05:30.968306+0000","last_active":"2023-10-06T03:05:30.974096+0000","last_peered":"2023-10-06T03:05:30.974096+0000","last_clean":"2023-10-06T03:05:30.974096+0000","last_became_active":"2023-10-06T03:05:30.968108+0000","last_became_peered":"2023-10-06T03:05:30.968108+0000","last_unstale":"2023-10-06T03:05:30.974096+0000","last_undegraded":"2023-10-06T03:05:30.974096+0000","last_fullsized":"2023-10-06T03:05:30.974096+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:08:55.892723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:31.256756+0000","last_change":"2023-10-06T03:05:29.984960+0000","last_active":"2023-10-06T03:05:31.256756+0000","last_peered":"2023-10-06T03:05:31.256756+0000","last_clean":"2023-10-06T03:05:31.256756+0000","last_became_active":"2023-10-06T03:05:29.984390+0000","last_became_peered":"2023-10-06T03:05:29.984390+0000","last_unstale":"2023-10-06T03:05:31.256756+0000","last_undegraded":"2023-10-06T03:05:31.256756+0000","last_fullsized":"2023-10-06T03:05:31.256756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:07:39.615480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.983904+0000","last_change":"2023-10-06T03:05:30.980852+0000","last_active":"2023-10-06T03:05:30.983904+0000","last_peered":"2023-10-06T03:05:30.983904+0000","last_clean":"2023-10-06T03:05:30.983904+0000","last_became_active":"2023-10-06T03:05:30.980602+0000","last_became_peered":"2023-10-06T03:05:30.980602+0000","last_unstale":"2023-10-06T03:05:30.983904+0000","last_undegraded":"2023-10-06T03:05:30.983904+0000","last_fullsized":"2023-10-06T03:05:30.983904+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:52.046377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:31.259167+0000","last_change":"2023-10-06T03:05:29.981372+0000","last_active":"2023-10-06T03:05:31.259167+0000","last_peered":"2023-10-06T03:05:31.259167+0000","last_clean":"2023-10-06T03:05:31.259167+0000","last_became_active":"2023-10-06T03:05:29.981115+0000","last_became_peered":"2023-10-06T03:05:29.981115+0000","last_unstale":"2023-10-06T03:05:31.259167+0000","last_undegraded":"2023-10-06T03:05:31.259167+0000","last_fullsized":"2023-10-06T03:05:31.259167+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:39:19.117764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.990579+0000","last_change":"2023-10-06T03:05:30.988582+0000","last_active":"2023-10-06T03:05:30.990579+0000","last_peered":"2023-10-06T03:05:30.990579+0000","last_clean":"2023-10-06T03:05:30.990579+0000","last_became_active":"2023-10-06T03:05:30.988367+0000","last_became_peered":"2023-10-06T03:05:30.988367+0000","last_unstale":"2023-10-06T03:05:30.990579+0000","last_undegraded":"2023-10-06T03:05:30.990579+0000","last_fullsized":"2023-10-06T03:05:30.990579+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:46.288446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:31.258579+0000","last_change":"2023-10-06T03:05:29.977336+0000","last_active":"2023-10-06T03:05:31.258579+0000","last_peered":"2023-10-06T03:05:31.258579+0000","last_clean":"2023-10-06T03:05:31.258579+0000","last_became_active":"2023-10-06T03:05:29.976614+0000","last_became_peered":"2023-10-06T03:05:29.976614+0000","last_unstale":"2023-10-06T03:05:31.258579+0000","last_undegraded":"2023-10-06T03:05:31.258579+0000","last_fullsized":"2023-10-06T03:05:31.258579+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:39.452429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.989293+0000","last_change":"2023-10-06T03:05:30.983290+0000","last_active":"2023-10-06T03:05:30.989293+0000","last_peered":"2023-10-06T03:05:30.989293+0000","last_clean":"2023-10-06T03:05:30.989293+0000","last_became_active":"2023-10-06T03:05:30.982834+0000","last_became_peered":"2023-10-06T03:05:30.982834+0000","last_unstale":"2023-10-06T03:05:30.989293+0000","last_undegraded":"2023-10-06T03:05:30.989293+0000","last_fullsized":"2023-10-06T03:05:30.989293+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:08:16.464786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.970205+0000","last_change":"2023-10-06T03:05:29.983120+0000","last_active":"2023-10-06T03:05:30.970205+0000","last_peered":"2023-10-06T03:05:30.970205+0000","last_clean":"2023-10-06T03:05:30.970205+0000","last_became_active":"2023-10-06T03:05:29.982850+0000","last_became_peered":"2023-10-06T03:05:29.982850+0000","last_unstale":"2023-10-06T03:05:30.970205+0000","last_undegraded":"2023-10-06T03:05:30.970205+0000","last_fullsized":"2023-10-06T03:05:30.970205+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:47.589791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.973847+0000","last_change":"2023-10-06T03:05:30.968227+0000","last_active":"2023-10-06T03:05:30.973847+0000","last_peered":"2023-10-06T03:05:30.973847+0000","last_clean":"2023-10-06T03:05:30.973847+0000","last_became_active":"2023-10-06T03:05:30.967941+0000","last_became_peered":"2023-10-06T03:05:30.967941+0000","last_unstale":"2023-10-06T03:05:30.973847+0000","last_undegraded":"2023-10-06T03:05:30.973847+0000","last_fullsized":"2023-10-06T03:05:30.973847+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:13:06.401671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.964710+0000","last_change":"2023-10-06T03:05:29.976278+0000","last_active":"2023-10-06T03:05:30.964710+0000","last_peered":"2023-10-06T03:05:30.964710+0000","last_clean":"2023-10-06T03:05:30.964710+0000","last_became_active":"2023-10-06T03:05:29.976023+0000","last_became_peered":"2023-10-06T03:05:29.976023+0000","last_unstale":"2023-10-06T03:05:30.964710+0000","last_undegraded":"2023-10-06T03:05:30.964710+0000","last_fullsized":"2023-10-06T03:05:30.964710+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:03.521675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.980593+0000","last_change":"2023-10-06T03:05:30.977747+0000","last_active":"2023-10-06T03:05:30.980593+0000","last_peered":"2023-10-06T03:05:30.980593+0000","last_clean":"2023-10-06T03:05:30.980593+0000","last_became_active":"2023-10-06T03:05:30.977501+0000","last_became_peered":"2023-10-06T03:05:30.977501+0000","last_unstale":"2023-10-06T03:05:30.980593+0000","last_undegraded":"2023-10-06T03:05:30.980593+0000","last_fullsized":"2023-10-06T03:05:30.980593+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:14.304674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:31.258252+0000","last_change":"2023-10-06T03:05:29.983223+0000","last_active":"2023-10-06T03:05:31.258252+0000","last_peered":"2023-10-06T03:05:31.258252+0000","last_clean":"2023-10-06T03:05:31.258252+0000","last_became_active":"2023-10-06T03:05:29.983009+0000","last_became_peered":"2023-10-06T03:05:29.983009+0000","last_unstale":"2023-10-06T03:05:31.258252+0000","last_undegraded":"2023-10-06T03:05:31.258252+0000","last_fullsized":"2023-10-06T03:05:31.258252+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:39.453757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.978811+0000","last_change":"2023-10-06T03:05:30.972873+0000","last_active":"2023-10-06T03:05:30.978811+0000","last_peered":"2023-10-06T03:05:30.978811+0000","last_clean":"2023-10-06T03:05:30.978811+0000","last_became_active":"2023-10-06T03:05:30.972641+0000","last_became_peered":"2023-10-06T03:05:30.972641+0000","last_unstale":"2023-10-06T03:05:30.978811+0000","last_undegraded":"2023-10-06T03:05:30.978811+0000","last_fullsized":"2023-10-06T03:05:30.978811+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:14:46.288446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:31.257387+0000","last_change":"2023-10-06T03:05:29.971763+0000","last_active":"2023-10-06T03:05:31.257387+0000","last_peered":"2023-10-06T03:05:31.257387+0000","last_clean":"2023-10-06T03:05:31.257387+0000","last_became_active":"2023-10-06T03:05:29.971518+0000","last_became_peered":"2023-10-06T03:05:29.971518+0000","last_unstale":"2023-10-06T03:05:31.257387+0000","last_undegraded":"2023-10-06T03:05:31.257387+0000","last_fullsized":"2023-10-06T03:05:31.257387+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:44.816300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.990542+0000","last_change":"2023-10-06T03:05:30.988857+0000","last_active":"2023-10-06T03:05:30.990542+0000","last_peered":"2023-10-06T03:05:30.990542+0000","last_clean":"2023-10-06T03:05:30.990542+0000","last_became_active":"2023-10-06T03:05:30.988487+0000","last_became_peered":"2023-10-06T03:05:30.988487+0000","last_unstale":"2023-10-06T03:05:30.990542+0000","last_undegraded":"2023-10-06T03:05:30.990542+0000","last_fullsized":"2023-10-06T03:05:30.990542+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:25.519827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:31.255218+0000","last_change":"2023-10-06T03:05:29.980139+0000","last_active":"2023-10-06T03:05:31.255218+0000","last_peered":"2023-10-06T03:05:31.255218+0000","last_clean":"2023-10-06T03:05:31.255218+0000","last_became_active":"2023-10-06T03:05:29.979914+0000","last_became_peered":"2023-10-06T03:05:29.979914+0000","last_unstale":"2023-10-06T03:05:31.255218+0000","last_undegraded":"2023-10-06T03:05:31.255218+0000","last_fullsized":"2023-10-06T03:05:31.255218+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:47.047116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.973981+0000","last_change":"2023-10-06T03:05:30.971178+0000","last_active":"2023-10-06T03:05:30.973981+0000","last_peered":"2023-10-06T03:05:30.973981+0000","last_clean":"2023-10-06T03:05:30.973981+0000","last_became_active":"2023-10-06T03:05:30.970877+0000","last_became_peered":"2023-10-06T03:05:30.970877+0000","last_unstale":"2023-10-06T03:05:30.973981+0000","last_undegraded":"2023-10-06T03:05:30.973981+0000","last_fullsized":"2023-10-06T03:05:30.973981+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:11:43.857971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:31.255985+0000","last_change":"2023-10-06T03:05:29.974952+0000","last_active":"2023-10-06T03:05:31.255985+0000","last_peered":"2023-10-06T03:05:31.255985+0000","last_clean":"2023-10-06T03:05:31.255985+0000","last_became_active":"2023-10-06T03:05:29.974721+0000","last_became_peered":"2023-10-06T03:05:29.974721+0000","last_unstale":"2023-10-06T03:05:31.255985+0000","last_undegraded":"2023-10-06T03:05:31.255985+0000","last_fullsized":"2023-10-06T03:05:31.255985+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:40:47.589791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.984084+0000","last_change":"2023-10-06T03:05:30.980789+0000","last_active":"2023-10-06T03:05:30.984084+0000","last_peered":"2023-10-06T03:05:30.984084+0000","last_clean":"2023-10-06T03:05:30.984084+0000","last_became_active":"2023-10-06T03:05:30.980453+0000","last_became_peered":"2023-10-06T03:05:30.980453+0000","last_unstale":"2023-10-06T03:05:30.984084+0000","last_undegraded":"2023-10-06T03:05:30.984084+0000","last_fullsized":"2023-10-06T03:05:30.984084+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:07:46.506948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.964706+0000","last_change":"2023-10-06T03:05:29.972966+0000","last_active":"2023-10-06T03:05:30.964706+0000","last_peered":"2023-10-06T03:05:30.964706+0000","last_clean":"2023-10-06T03:05:30.964706+0000","last_became_active":"2023-10-06T03:05:29.972751+0000","last_became_peered":"2023-10-06T03:05:29.972751+0000","last_unstale":"2023-10-06T03:05:30.964706+0000","last_undegraded":"2023-10-06T03:05:30.964706+0000","last_fullsized":"2023-10-06T03:05:30.964706+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:21:54.877649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.976128+0000","last_change":"2023-10-06T03:05:30.969754+0000","last_active":"2023-10-06T03:05:30.976128+0000","last_peered":"2023-10-06T03:05:30.976128+0000","last_clean":"2023-10-06T03:05:30.976128+0000","last_became_active":"2023-10-06T03:05:30.969484+0000","last_became_peered":"2023-10-06T03:05:30.969484+0000","last_unstale":"2023-10-06T03:05:30.976128+0000","last_undegraded":"2023-10-06T03:05:30.976128+0000","last_fullsized":"2023-10-06T03:05:30.976128+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:37.769632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:31.254816+0000","last_change":"2023-10-06T03:05:29.985021+0000","last_active":"2023-10-06T03:05:31.254816+0000","last_peered":"2023-10-06T03:05:31.254816+0000","last_clean":"2023-10-06T03:05:31.254816+0000","last_became_active":"2023-10-06T03:05:29.984799+0000","last_became_peered":"2023-10-06T03:05:29.984799+0000","last_unstale":"2023-10-06T03:05:31.254816+0000","last_undegraded":"2023-10-06T03:05:31.254816+0000","last_fullsized":"2023-10-06T03:05:31.254816+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:10:08.642671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.985550+0000","last_change":"2023-10-06T03:05:30.978376+0000","last_active":"2023-10-06T03:05:30.985550+0000","last_peered":"2023-10-06T03:05:30.985550+0000","last_clean":"2023-10-06T03:05:30.985550+0000","last_became_active":"2023-10-06T03:05:30.978101+0000","last_became_peered":"2023-10-06T03:05:30.978101+0000","last_unstale":"2023-10-06T03:05:30.985550+0000","last_undegraded":"2023-10-06T03:05:30.985550+0000","last_fullsized":"2023-10-06T03:05:30.985550+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:55.274836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.969736+0000","last_change":"2023-10-06T03:05:29.974630+0000","last_active":"2023-10-06T03:05:30.969736+0000","last_peered":"2023-10-06T03:05:30.969736+0000","last_clean":"2023-10-06T03:05:30.969736+0000","last_became_active":"2023-10-06T03:05:29.974231+0000","last_became_peered":"2023-10-06T03:05:29.974231+0000","last_unstale":"2023-10-06T03:05:30.969736+0000","last_undegraded":"2023-10-06T03:05:30.969736+0000","last_fullsized":"2023-10-06T03:05:30.969736+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:54.269190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.978854+0000","last_change":"2023-10-06T03:05:30.975793+0000","last_active":"2023-10-06T03:05:30.978854+0000","last_peered":"2023-10-06T03:05:30.978854+0000","last_clean":"2023-10-06T03:05:30.978854+0000","last_became_active":"2023-10-06T03:05:30.975575+0000","last_became_peered":"2023-10-06T03:05:30.975575+0000","last_unstale":"2023-10-06T03:05:30.978854+0000","last_undegraded":"2023-10-06T03:05:30.978854+0000","last_fullsized":"2023-10-06T03:05:30.978854+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:19:26.907689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.983907+0000","last_change":"2023-10-06T03:05:29.984580+0000","last_active":"2023-10-06T03:05:30.983907+0000","last_peered":"2023-10-06T03:05:30.983907+0000","last_clean":"2023-10-06T03:05:30.983907+0000","last_became_active":"2023-10-06T03:05:29.984339+0000","last_became_peered":"2023-10-06T03:05:29.984339+0000","last_unstale":"2023-10-06T03:05:30.983907+0000","last_undegraded":"2023-10-06T03:05:30.983907+0000","last_fullsized":"2023-10-06T03:05:30.983907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:54.194868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.990426+0000","last_change":"2023-10-06T03:05:30.987667+0000","last_active":"2023-10-06T03:05:30.990426+0000","last_peered":"2023-10-06T03:05:30.990426+0000","last_clean":"2023-10-06T03:05:30.990426+0000","last_became_active":"2023-10-06T03:05:30.987353+0000","last_became_peered":"2023-10-06T03:05:30.987353+0000","last_unstale":"2023-10-06T03:05:30.990426+0000","last_undegraded":"2023-10-06T03:05:30.990426+0000","last_fullsized":"2023-10-06T03:05:30.990426+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:16:48.052762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.970202+0000","last_change":"2023-10-06T03:05:29.984844+0000","last_active":"2023-10-06T03:05:30.970202+0000","last_peered":"2023-10-06T03:05:30.970202+0000","last_clean":"2023-10-06T03:05:30.970202+0000","last_became_active":"2023-10-06T03:05:29.984231+0000","last_became_peered":"2023-10-06T03:05:29.984231+0000","last_unstale":"2023-10-06T03:05:30.970202+0000","last_undegraded":"2023-10-06T03:05:30.970202+0000","last_fullsized":"2023-10-06T03:05:30.970202+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:37.623703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.982033+0000","last_change":"2023-10-06T03:05:30.977975+0000","last_active":"2023-10-06T03:05:30.982033+0000","last_peered":"2023-10-06T03:05:30.982033+0000","last_clean":"2023-10-06T03:05:30.982033+0000","last_became_active":"2023-10-06T03:05:30.977688+0000","last_became_peered":"2023-10-06T03:05:30.977688+0000","last_unstale":"2023-10-06T03:05:30.982033+0000","last_undegraded":"2023-10-06T03:05:30.982033+0000","last_fullsized":"2023-10-06T03:05:30.982033+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:32:29.687349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.984239+0000","last_change":"2023-10-06T03:05:29.975732+0000","last_active":"2023-10-06T03:05:30.984239+0000","last_peered":"2023-10-06T03:05:30.984239+0000","last_clean":"2023-10-06T03:05:30.984239+0000","last_became_active":"2023-10-06T03:05:29.975382+0000","last_became_peered":"2023-10-06T03:05:29.975382+0000","last_unstale":"2023-10-06T03:05:30.984239+0000","last_undegraded":"2023-10-06T03:05:30.984239+0000","last_fullsized":"2023-10-06T03:05:30.984239+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:39.077978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.974057+0000","last_change":"2023-10-06T03:04:23.986472+0000","last_active":"2023-10-06T03:05:30.974057+0000","last_peered":"2023-10-06T03:05:30.974057+0000","last_clean":"2023-10-06T03:05:30.974057+0000","last_became_active":"2023-10-06T03:04:23.986228+0000","last_became_peered":"2023-10-06T03:04:23.986228+0000","last_unstale":"2023-10-06T03:05:30.974057+0000","last_undegraded":"2023-10-06T03:05:30.974057+0000","last_fullsized":"2023-10-06T03:05:30.974057+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:08.739849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.990688+0000","last_change":"2023-10-06T03:05:30.989071+0000","last_active":"2023-10-06T03:05:30.990688+0000","last_peered":"2023-10-06T03:05:30.990688+0000","last_clean":"2023-10-06T03:05:30.990688+0000","last_became_active":"2023-10-06T03:05:30.988781+0000","last_became_peered":"2023-10-06T03:05:30.988781+0000","last_unstale":"2023-10-06T03:05:30.990688+0000","last_undegraded":"2023-10-06T03:05:30.990688+0000","last_fullsized":"2023-10-06T03:05:30.990688+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:08.361398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"41'1","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-06T03:05:31.968006+0000","last_change":"2023-10-06T03:05:29.976944+0000","last_active":"2023-10-06T03:05:31.968006+0000","last_peered":"2023-10-06T03:05:31.968006+0000","last_clean":"2023-10-06T03:05:31.968006+0000","last_became_active":"2023-10-06T03:05:29.976712+0000","last_became_peered":"2023-10-06T03:05:29.976712+0000","last_unstale":"2023-10-06T03:05:31.968006+0000","last_undegraded":"2023-10-06T03:05:31.968006+0000","last_fullsized":"2023-10-06T03:05:31.968006+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:19.009895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.969892+0000","last_change":"2023-10-06T03:04:23.814917+0000","last_active":"2023-10-06T03:05:30.969892+0000","last_peered":"2023-10-06T03:05:30.969892+0000","last_clean":"2023-10-06T03:05:30.969892+0000","last_became_active":"2023-10-06T03:04:23.814601+0000","last_became_peered":"2023-10-06T03:04:23.814601+0000","last_unstale":"2023-10-06T03:05:30.969892+0000","last_undegraded":"2023-10-06T03:05:30.969892+0000","last_fullsized":"2023-10-06T03:05:30.969892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.990184+0000","last_change":"2023-10-06T03:05:30.984889+0000","last_active":"2023-10-06T03:05:30.990184+0000","last_peered":"2023-10-06T03:05:30.990184+0000","last_clean":"2023-10-06T03:05:30.990184+0000","last_became_active":"2023-10-06T03:05:30.984735+0000","last_became_peered":"2023-10-06T03:05:30.984735+0000","last_unstale":"2023-10-06T03:05:30.990184+0000","last_undegraded":"2023-10-06T03:05:30.990184+0000","last_fullsized":"2023-10-06T03:05:30.990184+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:53:52.046377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.970845+0000","last_change":"2023-10-06T03:05:29.985121+0000","last_active":"2023-10-06T03:05:30.970845+0000","last_peered":"2023-10-06T03:05:30.970845+0000","last_clean":"2023-10-06T03:05:30.970845+0000","last_became_active":"2023-10-06T03:05:29.984686+0000","last_became_peered":"2023-10-06T03:05:29.984686+0000","last_unstale":"2023-10-06T03:05:30.970845+0000","last_undegraded":"2023-10-06T03:05:30.970845+0000","last_fullsized":"2023-10-06T03:05:30.970845+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:54.269190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.964090+0000","last_change":"2023-10-06T03:04:24.314547+0000","last_active":"2023-10-06T03:05:30.964090+0000","last_peered":"2023-10-06T03:05:30.964090+0000","last_clean":"2023-10-06T03:05:30.964090+0000","last_became_active":"2023-10-06T03:04:24.314278+0000","last_became_peered":"2023-10-06T03:04:24.314278+0000","last_unstale":"2023-10-06T03:05:30.964090+0000","last_undegraded":"2023-10-06T03:05:30.964090+0000","last_fullsized":"2023-10-06T03:05:30.964090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:25.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.990488+0000","last_change":"2023-10-06T03:05:30.987850+0000","last_active":"2023-10-06T03:05:30.990488+0000","last_peered":"2023-10-06T03:05:30.990488+0000","last_clean":"2023-10-06T03:05:30.990488+0000","last_became_active":"2023-10-06T03:05:30.987453+0000","last_became_peered":"2023-10-06T03:05:30.987453+0000","last_unstale":"2023-10-06T03:05:30.990488+0000","last_undegraded":"2023-10-06T03:05:30.990488+0000","last_fullsized":"2023-10-06T03:05:30.990488+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:59:37.769632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:31.259591+0000","last_change":"2023-10-06T03:05:29.970357+0000","last_active":"2023-10-06T03:05:31.259591+0000","last_peered":"2023-10-06T03:05:31.259591+0000","last_clean":"2023-10-06T03:05:31.259591+0000","last_became_active":"2023-10-06T03:05:29.970053+0000","last_became_peered":"2023-10-06T03:05:29.970053+0000","last_unstale":"2023-10-06T03:05:31.259591+0000","last_undegraded":"2023-10-06T03:05:31.259591+0000","last_fullsized":"2023-10-06T03:05:31.259591+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:59:37.623703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.969644+0000","last_change":"2023-10-06T03:04:23.807972+0000","last_active":"2023-10-06T03:05:30.969644+0000","last_peered":"2023-10-06T03:05:30.969644+0000","last_clean":"2023-10-06T03:05:30.969644+0000","last_became_active":"2023-10-06T03:04:23.807723+0000","last_became_peered":"2023-10-06T03:04:23.807723+0000","last_unstale":"2023-10-06T03:05:30.969644+0000","last_undegraded":"2023-10-06T03:05:30.969644+0000","last_fullsized":"2023-10-06T03:05:30.969644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":182,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.970319+0000","last_change":"2023-10-06T03:04:17.779925+0000","last_active":"2023-10-06T03:05:30.970319+0000","last_peered":"2023-10-06T03:05:30.970319+0000","last_clean":"2023-10-06T03:05:30.970319+0000","last_became_active":"2023-10-06T03:04:17.778997+0000","last_became_peered":"2023-10-06T03:04:17.778997+0000","last_unstale":"2023-10-06T03:05:30.970319+0000","last_undegraded":"2023-10-06T03:05:30.970319+0000","last_fullsized":"2023-10-06T03:05:30.970319+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_clean_scrub_stamp":"2023-10-06T03:04:16.761610+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.980950+0000","last_change":"2023-10-06T03:05:30.978373+0000","last_active":"2023-10-06T03:05:30.980950+0000","last_peered":"2023-10-06T03:05:30.980950+0000","last_clean":"2023-10-06T03:05:30.980950+0000","last_became_active":"2023-10-06T03:05:30.978120+0000","last_became_peered":"2023-10-06T03:05:30.978120+0000","last_unstale":"2023-10-06T03:05:30.980950+0000","last_undegraded":"2023-10-06T03:05:30.980950+0000","last_fullsized":"2023-10-06T03:05:30.980950+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:57.748161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.973993+0000","last_change":"2023-10-06T03:05:29.975059+0000","last_active":"2023-10-06T03:05:30.973993+0000","last_peered":"2023-10-06T03:05:30.973993+0000","last_clean":"2023-10-06T03:05:30.973993+0000","last_became_active":"2023-10-06T03:05:29.974806+0000","last_became_peered":"2023-10-06T03:05:29.974806+0000","last_unstale":"2023-10-06T03:05:30.973993+0000","last_undegraded":"2023-10-06T03:05:30.973993+0000","last_fullsized":"2023-10-06T03:05:30.973993+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:28:07.796869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.970412+0000","last_change":"2023-10-06T03:04:23.814887+0000","last_active":"2023-10-06T03:05:30.970412+0000","last_peered":"2023-10-06T03:05:30.970412+0000","last_clean":"2023-10-06T03:05:30.970412+0000","last_became_active":"2023-10-06T03:04:23.814581+0000","last_became_peered":"2023-10-06T03:04:23.814581+0000","last_unstale":"2023-10-06T03:05:30.970412+0000","last_undegraded":"2023-10-06T03:05:30.970412+0000","last_fullsized":"2023-10-06T03:05:30.970412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.984873+0000","last_change":"2023-10-06T03:05:30.981583+0000","last_active":"2023-10-06T03:05:30.984873+0000","last_peered":"2023-10-06T03:05:30.984873+0000","last_clean":"2023-10-06T03:05:30.984873+0000","last_became_active":"2023-10-06T03:05:30.981276+0000","last_became_peered":"2023-10-06T03:05:30.981276+0000","last_unstale":"2023-10-06T03:05:30.984873+0000","last_undegraded":"2023-10-06T03:05:30.984873+0000","last_fullsized":"2023-10-06T03:05:30.984873+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:35:20.015541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.973728+0000","last_change":"2023-10-06T03:05:29.973917+0000","last_active":"2023-10-06T03:05:30.973728+0000","last_peered":"2023-10-06T03:05:30.973728+0000","last_clean":"2023-10-06T03:05:30.973728+0000","last_became_active":"2023-10-06T03:05:29.973667+0000","last_became_peered":"2023-10-06T03:05:29.973667+0000","last_unstale":"2023-10-06T03:05:30.973728+0000","last_undegraded":"2023-10-06T03:05:30.973728+0000","last_fullsized":"2023-10-06T03:05:30.973728+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:07.355752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.970952+0000","last_change":"2023-10-06T03:04:23.986771+0000","last_active":"2023-10-06T03:05:30.970952+0000","last_peered":"2023-10-06T03:05:30.970952+0000","last_clean":"2023-10-06T03:05:30.970952+0000","last_became_active":"2023-10-06T03:04:23.986552+0000","last_became_peered":"2023-10-06T03:04:23.986552+0000","last_unstale":"2023-10-06T03:05:30.970952+0000","last_undegraded":"2023-10-06T03:05:30.970952+0000","last_fullsized":"2023-10-06T03:05:30.970952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.978549+0000","last_change":"2023-10-06T03:05:30.974324+0000","last_active":"2023-10-06T03:05:30.978549+0000","last_peered":"2023-10-06T03:05:30.978549+0000","last_clean":"2023-10-06T03:05:30.978549+0000","last_became_active":"2023-10-06T03:05:30.974055+0000","last_became_peered":"2023-10-06T03:05:30.974055+0000","last_unstale":"2023-10-06T03:05:30.978549+0000","last_undegraded":"2023-10-06T03:05:30.978549+0000","last_fullsized":"2023-10-06T03:05:30.978549+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:59.432670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.974986+0000","last_change":"2023-10-06T03:05:29.979529+0000","last_active":"2023-10-06T03:05:30.974986+0000","last_peered":"2023-10-06T03:05:30.974986+0000","last_clean":"2023-10-06T03:05:30.974986+0000","last_became_active":"2023-10-06T03:05:29.979281+0000","last_became_peered":"2023-10-06T03:05:29.979281+0000","last_unstale":"2023-10-06T03:05:30.974986+0000","last_undegraded":"2023-10-06T03:05:30.974986+0000","last_fullsized":"2023-10-06T03:05:30.974986+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:56.742515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.974051+0000","last_change":"2023-10-06T03:04:23.813862+0000","last_active":"2023-10-06T03:05:30.974051+0000","last_peered":"2023-10-06T03:05:30.974051+0000","last_clean":"2023-10-06T03:05:30.974051+0000","last_became_active":"2023-10-06T03:04:23.813584+0000","last_became_peered":"2023-10-06T03:04:23.813584+0000","last_unstale":"2023-10-06T03:05:30.974051+0000","last_undegraded":"2023-10-06T03:05:30.974051+0000","last_fullsized":"2023-10-06T03:05:30.974051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.985911+0000","last_change":"2023-10-06T03:05:30.980345+0000","last_active":"2023-10-06T03:05:30.985911+0000","last_peered":"2023-10-06T03:05:30.985911+0000","last_clean":"2023-10-06T03:05:30.985911+0000","last_became_active":"2023-10-06T03:05:30.980078+0000","last_became_peered":"2023-10-06T03:05:30.980078+0000","last_unstale":"2023-10-06T03:05:30.985911+0000","last_undegraded":"2023-10-06T03:05:30.985911+0000","last_fullsized":"2023-10-06T03:05:30.985911+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:29.950435+0000","last_clean_scrub_stamp":"2023-10-06T03:05:29.950435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:06.331617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.970352+0000","last_change":"2023-10-06T03:05:29.985492+0000","last_active":"2023-10-06T03:05:30.970352+0000","last_peered":"2023-10-06T03:05:30.970352+0000","last_clean":"2023-10-06T03:05:30.970352+0000","last_became_active":"2023-10-06T03:05:29.984212+0000","last_became_peered":"2023-10-06T03:05:29.984212+0000","last_unstale":"2023-10-06T03:05:30.970352+0000","last_undegraded":"2023-10-06T03:05:30.970352+0000","last_fullsized":"2023-10-06T03:05:30.970352+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:05:28.944789+0000","last_clean_scrub_stamp":"2023-10-06T03:05:28.944789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:41:37.763634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-06T03:05:30.965927+0000","last_change":"2023-10-06T03:04:23.805874+0000","last_active":"2023-10-06T03:05:30.965927+0000","last_peered":"2023-10-06T03:05:30.965927+0000","last_clean":"2023-10-06T03:05:30.965927+0000","last_became_active":"2023-10-06T03:04:23.805551+0000","last_became_peered":"2023-10-06T03:04:23.805551+0000","last_unstale":"2023-10-06T03:05:30.965927+0000","last_undegraded":"2023-10-06T03:05:30.965927+0000","last_fullsized":"2023-10-06T03:05:30.965927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:21.250275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298336,"kb_used_data":1048,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073504,"statfs":{"total":96636764160,"available":96331268096,"internally_reserved":0,"allocated":1073152,"data_stored":802576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":3.8860000000000001,"5min":3.8860000000000001,"15min":3.8860000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.988,"5min":3.988,"15min":3.988},"last":0.46999999999999997}]},{"osd":1,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":3.9510000000000001,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.444,"5min":3.444,"15min":3.444},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":4.1429999999999998,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":4.1260000000000003,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.38400000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":3.903,"5min":3.903,"15min":3.903},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":3.9260000000000002,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":0.54200000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.495}]},{"osd":5,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.53000000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297760,"kb_used_data":472,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074080,"statfs":{"total":96636764160,"available":96331857920,"internally_reserved":0,"allocated":483328,"data_stored":212762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":6.8220000000000001,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":6.8330000000000002,"5min":6.8330000000000002,"15min":6.8330000000000002},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":3.8929999999999998,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.948,"5min":3.948,"15min":3.948},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.745},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":3.996,"5min":3.996,"15min":3.996},"last":0.75800000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.70899999999999996}]},{"osd":4,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.47599999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.68000000000000005}]},{"osd":7,"last update":"Fri Oct 6 03:05:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.66200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":479232,"data_stored":212188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":6.056,"5min":6.056,"15min":6.056},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.57499999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.502},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.68400000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.69699999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.749},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.72099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298332,"kb_used_data":1044,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073508,"statfs":{"total":96636764160,"available":96331272192,"internally_reserved":0,"allocated":1069056,"data_stored":801509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.38300000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.27400000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.31},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.32500000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.52600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.499}]},{"osd":6,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.60599999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56200000000000006}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297768,"kb_used_data":480,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074072,"statfs":{"total":96636764160,"available":96331849728,"internally_reserved":0,"allocated":491520,"data_stored":213676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":12.913,"5min":12.913,"15min":12.913},"last":0.314},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.29999999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":3.8919999999999999,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.374}]},{"osd":3,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.35099999999999998},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":12.941000000000001,"5min":12.941000000000001,"15min":12.941000000000001},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":12.846,"5min":12.846,"15min":12.846},"last":0.502},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.54000000000000004},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":12.884,"5min":12.884,"15min":12.884},"last":0.47999999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.58399999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.56699999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":212728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.361,"5min":1.361,"15min":1.361},"last":0.311},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.29799999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.34499999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.372}]},{"osd":4,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.63},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.65900000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.61699999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.68799999999999994}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297764,"kb_used_data":476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074076,"statfs":{"total":96636764160,"available":96331853824,"internally_reserved":0,"allocated":487424,"data_stored":213654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.376},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.501}]},{"osd":1,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.435},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.48099999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.58499999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.56799999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.55000000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.67300000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:05:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.64500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297756,"kb_used_data":468,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074084,"statfs":{"total":96636764160,"available":96331862016,"internally_reserved":0,"allocated":479232,"data_stored":212188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.64500000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.44}]},{"osd":2,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.68200000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.61699999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.52700000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.58399999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:05:18 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.66300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:05:40.389 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:05:40.390 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T03:05:40.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.515+0000 7eff5154a700 1 Processor -- start 2023-10-06T03:05:40.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.515+0000 7eff5154a700 1 -- start start 2023-10-06T03:05:40.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.516+0000 7eff5154a700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff4c1591d0 0x7eff4c0b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:40.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.516+0000 7eff5154a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff4c0cc7f0 0x7eff4c0ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:40.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.516+0000 7eff5154a700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff4c0cc360 con 0x7eff4c1595a0 2023-10-06T03:05:40.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.516+0000 7eff5154a700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff4c0cba70 con 0x7eff4c1591d0 2023-10-06T03:05:40.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.516+0000 7eff5154a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c0b2740 con 0x7eff4c0cc7f0 2023-10-06T03:05:40.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.516+0000 7eff4affd700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff4c1591d0 0x7eff4c0b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:40.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.516+0000 7eff4b7fe700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff4c0cc7f0 0x7eff4c0ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:40.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.516+0000 7eff4affd700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7eff4c1591d0 0x7eff4c0b2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:37712/0 (socket says 172.21.15.125:37712) 2023-10-06T03:05:40.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.516+0000 7eff4b7fe700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff4c0cc7f0 0x7eff4c0ccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:55504/0 (socket says 172.21.15.125:55504) 2023-10-06T03:05:40.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.516+0000 7eff4a7fc700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7eff4c1595a0 0x7eff4c0b2030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:51200/0 (socket says 172.21.15.125:51200) 2023-10-06T03:05:40.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.516+0000 7eff4affd700 1 -- 172.21.15.125:0/719482636 learned_addr learned my addr 172.21.15.125:0/719482636 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:40.519 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.517+0000 7eff4affd700 1 -- 172.21.15.125:0/719482636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff4c0cc7f0 msgr2=0x7eff4c0ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:40.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.517+0000 7eff4affd700 1 --2- 172.21.15.125:0/719482636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff4c0cc7f0 0x7eff4c0ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.517+0000 7eff4affd700 1 -- 172.21.15.125:0/719482636 >> v1:172.21.15.130:6789/0 conn(0x7eff4c1595a0 legacy=0x7eff4c0b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:40.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.517+0000 7eff4affd700 1 -- 172.21.15.125:0/719482636 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c0cbd10 con 0x7eff4c1591d0 2023-10-06T03:05:40.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.517+0000 7eff4b7fe700 1 --2- 172.21.15.125:0/719482636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff4c0cc7f0 0x7eff4c0ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:05:40.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.517+0000 7eff4affd700 1 --2- 172.21.15.125:0/719482636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff4c1591d0 0x7eff4c0b2f50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7eff40009990 tx=0x7eff40009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c17c54290d04a5cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:40.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.517+0000 7eff49ffb700 1 -- 172.21.15.125:0/719482636 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40009e80 con 0x7eff4c1591d0 2023-10-06T03:05:40.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.517+0000 7eff49ffb700 1 -- 172.21.15.125:0/719482636 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff40005c10 con 0x7eff4c1591d0 2023-10-06T03:05:40.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.517+0000 7eff49ffb700 1 -- 172.21.15.125:0/719482636 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4000b650 con 0x7eff4c1591d0 2023-10-06T03:05:40.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.518+0000 7eff5154a700 1 -- 172.21.15.125:0/719482636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff4c1591d0 msgr2=0x7eff4c0b2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:40.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.518+0000 7eff5154a700 1 --2- 172.21.15.125:0/719482636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff4c1591d0 0x7eff4c0b2f50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7eff40009990 tx=0x7eff40009220 comp rx=0 tx=0).stop 2023-10-06T03:05:40.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.518+0000 7eff5154a700 1 -- 172.21.15.125:0/719482636 shutdown_connections 2023-10-06T03:05:40.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.518+0000 7eff5154a700 1 --2- 172.21.15.125:0/719482636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff4c0cc7f0 0x7eff4c0ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.518+0000 7eff5154a700 1 --2- 172.21.15.125:0/719482636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff4c1591d0 0x7eff4c0b2f50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.518+0000 7eff5154a700 1 -- 172.21.15.125:0/719482636 >> 172.21.15.125:0/719482636 conn(0x7eff4c06ed40 msgr2=0x7eff4c06f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:40.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.518+0000 7eff5154a700 1 -- 172.21.15.125:0/719482636 shutdown_connections 2023-10-06T03:05:40.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.518+0000 7eff5154a700 1 -- 172.21.15.125:0/719482636 wait complete. 2023-10-06T03:05:40.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.519+0000 7eff5154a700 1 Processor -- start 2023-10-06T03:05:40.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.519+0000 7eff5154a700 1 -- start start 2023-10-06T03:05:40.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.520+0000 7eff5154a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff4c0cc7f0 0x7eff4c156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:40.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.520+0000 7eff5154a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff4c1591d0 0x7eff4c14b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:40.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.520+0000 7eff5154a700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff4c1595a0 0x7eff4c156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:40.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.520+0000 7eff5154a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c0b4720 con 0x7eff4c0cc7f0 2023-10-06T03:05:40.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.520+0000 7eff5154a700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c157d20 con 0x7eff4c1595a0 2023-10-06T03:05:40.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.520+0000 7eff5154a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c0b40d0 con 0x7eff4c1591d0 2023-10-06T03:05:40.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.520+0000 7eff4affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff4c0cc7f0 0x7eff4c156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:40.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.520+0000 7eff4affd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff4c0cc7f0 0x7eff4c156720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57852/0 (socket says 172.21.15.125:57852) 2023-10-06T03:05:40.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.520+0000 7eff4affd700 1 -- 172.21.15.125:0/355714839 learned_addr learned my addr 172.21.15.125:0/355714839 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:40.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.520+0000 7eff4b7fe700 1 --2- 172.21.15.125:0/355714839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff4c1595a0 0x7eff4c156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:40.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.520+0000 7eff4a7fc700 1 --2- 172.21.15.125:0/355714839 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff4c1591d0 0x7eff4c14b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:40.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.520+0000 7eff4affd700 1 -- 172.21.15.125:0/355714839 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff4c1591d0 msgr2=0x7eff4c14b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:40.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.520+0000 7eff4affd700 1 --2- 172.21.15.125:0/355714839 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff4c1591d0 0x7eff4c14b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.520+0000 7eff4affd700 1 -- 172.21.15.125:0/355714839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff4c1595a0 msgr2=0x7eff4c156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:40.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.520+0000 7eff4affd700 1 --2- 172.21.15.125:0/355714839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff4c1595a0 0x7eff4c156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.520+0000 7eff4affd700 1 -- 172.21.15.125:0/355714839 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff44009a20 con 0x7eff4c0cc7f0 2023-10-06T03:05:40.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.520+0000 7eff4a7fc700 1 --2- 172.21.15.125:0/355714839 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff4c1591d0 0x7eff4c14b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:40.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.520+0000 7eff4affd700 1 --2- 172.21.15.125:0/355714839 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff4c0cc7f0 0x7eff4c156720 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7eff4000b3c0 tx=0x7eff40016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:40.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.520+0000 7eff32ffd700 1 -- 172.21.15.125:0/355714839 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40011ae0 con 0x7eff4c0cc7f0 2023-10-06T03:05:40.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.521+0000 7eff32ffd700 1 -- 172.21.15.125:0/355714839 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff40020070 con 0x7eff4c0cc7f0 2023-10-06T03:05:40.525 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.521+0000 7eff5154a700 1 -- 172.21.15.125:0/355714839 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff40009480 con 0x7eff4c0cc7f0 2023-10-06T03:05:40.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.521+0000 7eff32ffd700 1 -- 172.21.15.125:0/355714839 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40011e70 con 0x7eff4c0cc7f0 2023-10-06T03:05:40.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.521+0000 7eff5154a700 1 -- 172.21.15.125:0/355714839 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff4c15ac50 con 0x7eff4c0cc7f0 2023-10-06T03:05:40.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.522+0000 7eff5154a700 1 -- 172.21.15.125:0/355714839 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4c066510 con 0x7eff4c0cc7f0 2023-10-06T03:05:40.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.522+0000 7eff32ffd700 1 -- 172.21.15.125:0/355714839 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff40022030 con 0x7eff4c0cc7f0 2023-10-06T03:05:40.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.522+0000 7eff32ffd700 1 --2- 172.21.15.125:0/355714839 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7eff38066f30 0x7eff380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:40.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.523+0000 7eff4a7fc700 1 --2- 172.21.15.125:0/355714839 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7eff38066f30 0x7eff380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:40.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.523+0000 7eff32ffd700 1 -- 172.21.15.125:0/355714839 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7eff400863d0 con 0x7eff4c0cc7f0 2023-10-06T03:05:40.526 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.523+0000 7eff4a7fc700 1 --2- 172.21.15.125:0/355714839 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7eff38066f30 0x7eff380693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7eff3c007fd0 tx=0x7eff3c007e10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:40.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.527+0000 7eff32ffd700 1 -- 172.21.15.125:0/355714839 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff40053460 con 0x7eff4c0cc7f0 2023-10-06T03:05:40.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.781+0000 7eff5154a700 1 -- 172.21.15.125:0/355714839 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7eff4c0cbff0 con 0x7eff4c0cc7f0 2023-10-06T03:05:40.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.785+0000 7eff32ffd700 1 -- 172.21.15.125:0/355714839 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7eff40056a80 con 0x7eff4c0cc7f0 2023-10-06T03:05:40.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.787+0000 7eff5154a700 1 -- 172.21.15.125:0/355714839 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7eff38066f30 msgr2=0x7eff380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:40.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.787+0000 7eff5154a700 1 --2- 172.21.15.125:0/355714839 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7eff38066f30 0x7eff380693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7eff3c007fd0 tx=0x7eff3c007e10 comp rx=0 tx=0).stop 2023-10-06T03:05:40.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.787+0000 7eff5154a700 1 -- 172.21.15.125:0/355714839 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff4c0cc7f0 msgr2=0x7eff4c156720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:40.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.787+0000 7eff5154a700 1 --2- 172.21.15.125:0/355714839 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff4c0cc7f0 0x7eff4c156720 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7eff4000b3c0 tx=0x7eff40016000 comp rx=0 tx=0).stop 2023-10-06T03:05:40.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.787+0000 7eff5154a700 1 -- 172.21.15.125:0/355714839 shutdown_connections 2023-10-06T03:05:40.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.787+0000 7eff5154a700 1 --2- 172.21.15.125:0/355714839 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7eff38066f30 0x7eff380693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.787+0000 7eff5154a700 1 --2- 172.21.15.125:0/355714839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff4c1595a0 0x7eff4c156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.787+0000 7eff5154a700 1 --2- 172.21.15.125:0/355714839 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7eff4c0cc7f0 0x7eff4c156720 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.787+0000 7eff5154a700 1 --2- 172.21.15.125:0/355714839 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7eff4c1591d0 0x7eff4c14b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.787+0000 7eff5154a700 1 -- 172.21.15.125:0/355714839 >> 172.21.15.125:0/355714839 conn(0x7eff4c06ed40 msgr2=0x7eff4c0ccc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:40.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.787+0000 7eff5154a700 1 -- 172.21.15.125:0/355714839 shutdown_connections 2023-10-06T03:05:40.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.787+0000 7eff5154a700 1 -- 172.21.15.125:0/355714839 wait complete. 2023-10-06T03:05:40.789 INFO:teuthology.orchestra.run.smithi125.stderr:updated caps for client.0 2023-10-06T03:05:40.799 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:05:40.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.917+0000 7f58b0c8e700 1 Processor -- start 2023-10-06T03:05:40.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.917+0000 7f58b0c8e700 1 -- start start 2023-10-06T03:05:40.921 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.918+0000 7f58b0c8e700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f58ac0ccb60 0x7f58ac0c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:40.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.918+0000 7f58b0c8e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ac0c4b70 con 0x7f58ac0c4750 2023-10-06T03:05:40.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.918+0000 7f58b0c8e700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ac0c9d10 con 0x7f58ac157220 2023-10-06T03:05:40.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.918+0000 7f58b0c8e700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58ac0c9ff0 con 0x7f58ac0ccb60 2023-10-06T03:05:40.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.918+0000 7f58aad9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f58ac0c4750 0x7f58ac0c8d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35306/0 (socket says 172.21.15.125:35306) 2023-10-06T03:05:40.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.918+0000 7f58aad9d700 1 -- 172.21.15.125:0/1316425021 learned_addr learned my addr 172.21.15.125:0/1316425021 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:40.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.918+0000 7f58a9d9b700 1 --2- 172.21.15.125:0/1316425021 >> v2:172.21.15.130:3300/0 conn(0x7f58ac0ccb60 0x7f58ac0c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:40.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.918+0000 7f58a959a700 1 -- 172.21.15.125:0/1316425021 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2411515682 0 0) 0x7f58ac0c4b70 con 0x7f58ac0c4750 2023-10-06T03:05:40.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.918+0000 7f58a959a700 1 -- 172.21.15.125:0/1316425021 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5894003570 con 0x7f58ac0c4750 2023-10-06T03:05:40.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58a959a700 1 -- 172.21.15.125:0/1316425021 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2329673377 0 0) 0x7f5894003570 con 0x7f58ac0c4750 2023-10-06T03:05:40.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58a959a700 1 -- 172.21.15.125:0/1316425021 >> v2:172.21.15.130:3300/0 conn(0x7f58ac0ccb60 msgr2=0x7f58ac0c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:40.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58a959a700 1 --2- 172.21.15.125:0/1316425021 >> v2:172.21.15.130:3300/0 conn(0x7f58ac0ccb60 0x7f58ac0c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58a959a700 1 -- 172.21.15.125:0/1316425021 >> v1:172.21.15.130:6789/0 conn(0x7f58ac157220 legacy=0x7f58ac0b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:40.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58a959a700 1 -- 172.21.15.125:0/1316425021 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac0c3730 con 0x7f58ac0c4750 2023-10-06T03:05:40.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58a959a700 1 -- 172.21.15.125:0/1316425021 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f58a40017f0 con 0x7f58ac0c4750 2023-10-06T03:05:40.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58a959a700 1 -- 172.21.15.125:0/1316425021 >> v1:172.21.15.125:6789/0 conn(0x7f58ac0c4750 legacy=0x7f58ac0c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:40.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58a959a700 1 --2- 172.21.15.125:0/1316425021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5894003a60 0x7f5894003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:40.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58a959a700 1 --2- 172.21.15.125:0/1316425021 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5894004810 0x7f5894004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:40.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58a959a700 1 --2- 172.21.15.125:0/1316425021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58940051c0 0x7f589400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:40.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58a959a700 1 -- 172.21.15.125:0/1316425021 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac0c9ff0 con 0x7f58940051c0 2023-10-06T03:05:40.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58a959a700 1 -- 172.21.15.125:0/1316425021 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589400c160 con 0x7f5894003a60 2023-10-06T03:05:40.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58a959a700 1 -- 172.21.15.125:0/1316425021 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589400c320 con 0x7f5894004810 2023-10-06T03:05:40.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58aad9d700 1 --2- 172.21.15.125:0/1316425021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58940051c0 0x7f589400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:40.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58aa59c700 1 --2- 172.21.15.125:0/1316425021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5894003a60 0x7f5894003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:40.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58a9d9b700 1 --2- 172.21.15.125:0/1316425021 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5894004810 0x7f5894004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:40.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58aad9d700 1 -- 172.21.15.125:0/1316425021 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5894004810 msgr2=0x7f5894004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:40.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58aad9d700 1 --2- 172.21.15.125:0/1316425021 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5894004810 0x7f5894004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58aad9d700 1 -- 172.21.15.125:0/1316425021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5894003a60 msgr2=0x7f5894003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:40.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58aad9d700 1 --2- 172.21.15.125:0/1316425021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5894003a60 0x7f5894003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58aad9d700 1 -- 172.21.15.125:0/1316425021 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5894003570 con 0x7f58940051c0 2023-10-06T03:05:40.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58aad9d700 1 -- 172.21.15.125:0/1316425021 reap_dead start 2023-10-06T03:05:40.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58aad9d700 1 --2- 172.21.15.125:0/1316425021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58940051c0 0x7f589400ba60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f58a400a930 tx=0x7f58a40021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dc8ddaf058153d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:40.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58a959a700 1 -- 172.21.15.125:0/1316425021 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a40070d0 con 0x7f58940051c0 2023-10-06T03:05:40.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58a959a700 1 -- 172.21.15.125:0/1316425021 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a4007230 con 0x7f58940051c0 2023-10-06T03:05:40.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.919+0000 7f58a959a700 1 -- 172.21.15.125:0/1316425021 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a40075d0 con 0x7f58940051c0 2023-10-06T03:05:40.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.920+0000 7f58b0c8e700 1 -- 172.21.15.125:0/1316425021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58940051c0 msgr2=0x7f589400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:40.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.920+0000 7f58b0c8e700 1 --2- 172.21.15.125:0/1316425021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58940051c0 0x7f589400ba60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f58a400a930 tx=0x7f58a40021d0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.920+0000 7f58b0c8e700 1 -- 172.21.15.125:0/1316425021 shutdown_connections 2023-10-06T03:05:40.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.920+0000 7f58b0c8e700 1 --2- 172.21.15.125:0/1316425021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58940051c0 0x7f589400ba60 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.920+0000 7f58b0c8e700 1 -- 172.21.15.125:0/1316425021 >> 172.21.15.125:0/1316425021 conn(0x7f58ac067df0 msgr2=0x7f58ac0cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:40.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.920+0000 7f58b0c8e700 1 -- 172.21.15.125:0/1316425021 shutdown_connections 2023-10-06T03:05:40.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.920+0000 7f58b0c8e700 1 -- 172.21.15.125:0/1316425021 wait complete. 2023-10-06T03:05:40.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.921+0000 7f58b0c8e700 1 Processor -- start 2023-10-06T03:05:40.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.921+0000 7f58b0c8e700 1 -- start start 2023-10-06T03:05:40.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.922+0000 7f58b0c8e700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58940051c0 0x7f58ac154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:40.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.922+0000 7f58b0c8e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58ac0c6de0 0x7f58ac0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:40.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.922+0000 7f58b0c8e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58ac0aef50 0x7f58ac0af3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:40.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.922+0000 7f58b0c8e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac169390 con 0x7f58ac0aef50 2023-10-06T03:05:40.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.922+0000 7f58b0c8e700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac0c7790 con 0x7f58940051c0 2023-10-06T03:05:40.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.922+0000 7f58b0c8e700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac0afcc0 con 0x7f58ac0c6de0 2023-10-06T03:05:40.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.922+0000 7f58aad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58ac0aef50 0x7f58ac0af3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:40.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.922+0000 7f58aad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58ac0aef50 0x7f58ac0af3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57874/0 (socket says 172.21.15.125:57874) 2023-10-06T03:05:40.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.922+0000 7f58aad9d700 1 -- 172.21.15.125:0/1775217011 learned_addr learned my addr 172.21.15.125:0/1775217011 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:40.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.922+0000 7f58aa59c700 1 --2- 172.21.15.125:0/1775217011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58940051c0 0x7f58ac154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:40.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.922+0000 7f58a9d9b700 1 --2- 172.21.15.125:0/1775217011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58ac0c6de0 0x7f58ac0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:40.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.922+0000 7f58aad9d700 1 -- 172.21.15.125:0/1775217011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58ac0c6de0 msgr2=0x7f58ac0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:40.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.922+0000 7f58aad9d700 1 --2- 172.21.15.125:0/1775217011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58ac0c6de0 0x7f58ac0c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.922+0000 7f58aad9d700 1 -- 172.21.15.125:0/1775217011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58940051c0 msgr2=0x7f58ac154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:40.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.922+0000 7f58aad9d700 1 --2- 172.21.15.125:0/1775217011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58940051c0 0x7f58ac154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:40.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.922+0000 7f58aad9d700 1 -- 172.21.15.125:0/1775217011 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ac0affa0 con 0x7f58ac0aef50 2023-10-06T03:05:40.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.922+0000 7f58a9d9b700 1 --2- 172.21.15.125:0/1775217011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58ac0c6de0 0x7f58ac0c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:40.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.923+0000 7f58aad9d700 1 --2- 172.21.15.125:0/1775217011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58ac0aef50 0x7f58ac0af3c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f58a4000f80 tx=0x7f58a4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:40.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.923+0000 7f589a7fc700 1 -- 172.21.15.125:0/1775217011 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a40075b0 con 0x7f58ac0aef50 2023-10-06T03:05:40.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.923+0000 7f589a7fc700 1 -- 172.21.15.125:0/1775217011 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a401d420 con 0x7f58ac0aef50 2023-10-06T03:05:40.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.923+0000 7f58b0c8e700 1 -- 172.21.15.125:0/1775217011 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ac0b0280 con 0x7f58ac0aef50 2023-10-06T03:05:40.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.923+0000 7f589a7fc700 1 -- 172.21.15.125:0/1775217011 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a401d820 con 0x7f58ac0aef50 2023-10-06T03:05:40.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.923+0000 7f58b0c8e700 1 -- 172.21.15.125:0/1775217011 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ac154590 con 0x7f58ac0aef50 2023-10-06T03:05:40.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.924+0000 7f58b0c8e700 1 -- 172.21.15.125:0/1775217011 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ac0b07a0 con 0x7f58ac0aef50 2023-10-06T03:05:40.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.924+0000 7f589a7fc700 1 -- 172.21.15.125:0/1775217011 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58a401dc50 con 0x7f58ac0aef50 2023-10-06T03:05:40.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.924+0000 7f589a7fc700 1 --2- 172.21.15.125:0/1775217011 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f588c066f30 0x7f588c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:40.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.924+0000 7f589a7fc700 1 -- 172.21.15.125:0/1775217011 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f58a4086e60 con 0x7f58ac0aef50 2023-10-06T03:05:40.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.925+0000 7f58aa59c700 1 --2- 172.21.15.125:0/1775217011 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f588c066f30 0x7f588c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:40.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.925+0000 7f58aa59c700 1 --2- 172.21.15.125:0/1775217011 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f588c066f30 0x7f588c0693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f58a0000c00 tx=0x7f58a0007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:40.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:40.929+0000 7f589a7fc700 1 -- 172.21.15.125:0/1775217011 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58ac0b07a0 con 0x7f58ac0aef50 2023-10-06T03:05:41.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.150+0000 7f58b0c8e700 1 -- 172.21.15.125:0/1775217011 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58ac0b07a0 con 0x7f58ac0aef50 2023-10-06T03:05:41.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.150+0000 7f589a7fc700 1 -- 172.21.15.125:0/1775217011 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4609 (secure 0 0 0) 0x7f58ac0b07a0 con 0x7f58ac0aef50 2023-10-06T03:05:41.151 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:41.151 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3042542444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3042542444},{"type":"v1","addr":"172.21.15.130:6835","nonce":3042542444}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2110429483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2110429483},{"type":"v1","addr":"172.21.15.130:6833","nonce":2110429483}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/1710838785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1710838785},{"type":"v1","addr":"172.21.15.125:6836","nonce":1710838785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:05:30.346007+0000","modified":"2023-10-06T03:05:34.259823+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5085":{"gid":5085,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.125:6837/4027450913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":4027450913},{"type":"v1","addr":"172.21.15.125:6837","nonce":4027450913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:05:41.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.152+0000 7f58b0c8e700 1 -- 172.21.15.125:0/1775217011 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f588c066f30 msgr2=0x7f588c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:41.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.152+0000 7f58b0c8e700 1 --2- 172.21.15.125:0/1775217011 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f588c066f30 0x7f588c0693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f58a0000c00 tx=0x7f58a0007d30 comp rx=0 tx=0).stop 2023-10-06T03:05:41.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.152+0000 7f58b0c8e700 1 -- 172.21.15.125:0/1775217011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58ac0aef50 msgr2=0x7f58ac0af3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:41.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.152+0000 7f58b0c8e700 1 --2- 172.21.15.125:0/1775217011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58ac0aef50 0x7f58ac0af3c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f58a4000f80 tx=0x7f58a4016000 comp rx=0 tx=0).stop 2023-10-06T03:05:41.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.152+0000 7f58b0c8e700 1 -- 172.21.15.125:0/1775217011 shutdown_connections 2023-10-06T03:05:41.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.152+0000 7f58b0c8e700 1 --2- 172.21.15.125:0/1775217011 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f588c066f30 0x7f588c0693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.152+0000 7f58b0c8e700 1 --2- 172.21.15.125:0/1775217011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58ac0aef50 0x7f58ac0af3c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.152+0000 7f58b0c8e700 1 --2- 172.21.15.125:0/1775217011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58940051c0 0x7f58ac154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.152+0000 7f58b0c8e700 1 --2- 172.21.15.125:0/1775217011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58ac0c6de0 0x7f58ac0c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.152+0000 7f58b0c8e700 1 -- 172.21.15.125:0/1775217011 >> 172.21.15.125:0/1775217011 conn(0x7f58ac067df0 msgr2=0x7f58ac0b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:41.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.153+0000 7f58b0c8e700 1 -- 172.21.15.125:0/1775217011 shutdown_connections 2023-10-06T03:05:41.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.153+0000 7f58b0c8e700 1 -- 172.21.15.125:0/1775217011 wait complete. 2023-10-06T03:05:41.154 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 18 2023-10-06T03:05:41.567 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:05:30.346007+0000', 'modified': '2023-10-06T03:05:34.259823+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5085}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5085': {'gid': 5085, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.125:6837/4027450913', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6835', 'nonce': 4027450913}, {'type': 'v1', 'addr': '172.21.15.125:6837', 'nonce': 4027450913}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:05:41.569 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:05:41.569 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T03:05:41.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.687+0000 7fa56f219700 1 Processor -- start 2023-10-06T03:05:41.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.687+0000 7fa56f219700 1 -- start start 2023-10-06T03:05:41.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.688+0000 7fa56f219700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa568157300 0x7fa5680b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.688+0000 7fa56f219700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5681576d0 0x7fa5680684c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.688+0000 7fa56f219700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5680aa760 con 0x7fa568068a00 2023-10-06T03:05:41.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.688+0000 7fa56f219700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa568068e80 con 0x7fa568157300 2023-10-06T03:05:41.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.688+0000 7fa56f219700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5680aaa40 con 0x7fa5681576d0 2023-10-06T03:05:41.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.688+0000 7fa56cfb5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa568157300 0x7fa5680b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.688+0000 7fa56d7b6700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa568068a00 0x7fa5680a92e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35310/0 (socket says 172.21.15.125:35310) 2023-10-06T03:05:41.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.688+0000 7fa56d7b6700 1 -- 172.21.15.125:0/2664347378 learned_addr learned my addr 172.21.15.125:0/2664347378 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:41.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.688+0000 7fa567fff700 1 --2- 172.21.15.125:0/2664347378 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5681576d0 0x7fa5680684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.689+0000 7fa56cfb5700 1 -- 172.21.15.125:0/2664347378 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5681576d0 msgr2=0x7fa5680684c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:41.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.689+0000 7fa56cfb5700 1 --2- 172.21.15.125:0/2664347378 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5681576d0 0x7fa5680684c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.689+0000 7fa56cfb5700 1 -- 172.21.15.125:0/2664347378 >> v1:172.21.15.125:6789/0 conn(0x7fa568068a00 legacy=0x7fa5680a92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:41.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.689+0000 7fa56cfb5700 1 -- 172.21.15.125:0/2664347378 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5680aad20 con 0x7fa568157300 2023-10-06T03:05:41.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.689+0000 7fa5677fe700 1 -- 172.21.15.125:0/2664347378 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417209788 0 0) 0x7fa5680aa760 con 0x7fa568068a00 2023-10-06T03:05:41.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.689+0000 7fa56cfb5700 1 --2- 172.21.15.125:0/2664347378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa568157300 0x7fa5680b0240 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0098d0 tx=0x7fa55c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf439f9ce47434 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:41.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.689+0000 7fa5677fe700 1 -- 172.21.15.125:0/2664347378 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c009e70 con 0x7fa568157300 2023-10-06T03:05:41.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.689+0000 7fa5677fe700 1 -- 172.21.15.125:0/2664347378 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c005c10 con 0x7fa568157300 2023-10-06T03:05:41.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.689+0000 7fa5677fe700 1 -- 172.21.15.125:0/2664347378 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c00b650 con 0x7fa568157300 2023-10-06T03:05:41.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.689+0000 7fa56f219700 1 -- 172.21.15.125:0/2664347378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa568157300 msgr2=0x7fa5680b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:41.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.689+0000 7fa56f219700 1 --2- 172.21.15.125:0/2664347378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa568157300 0x7fa5680b0240 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa55c0098d0 tx=0x7fa55c009120 comp rx=0 tx=0).stop 2023-10-06T03:05:41.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.689+0000 7fa56f219700 1 -- 172.21.15.125:0/2664347378 shutdown_connections 2023-10-06T03:05:41.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.689+0000 7fa56f219700 1 --2- 172.21.15.125:0/2664347378 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa568157300 0x7fa5680b0240 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.689+0000 7fa56f219700 1 --2- 172.21.15.125:0/2664347378 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5681576d0 0x7fa5680684c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.689+0000 7fa56f219700 1 -- 172.21.15.125:0/2664347378 >> 172.21.15.125:0/2664347378 conn(0x7fa5680af730 msgr2=0x7fa5680afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:41.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.689+0000 7fa56f219700 1 -- 172.21.15.125:0/2664347378 shutdown_connections 2023-10-06T03:05:41.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.689+0000 7fa56f219700 1 -- 172.21.15.125:0/2664347378 wait complete. 2023-10-06T03:05:41.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.691+0000 7fa56f219700 1 Processor -- start 2023-10-06T03:05:41.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.691+0000 7fa56f219700 1 -- start start 2023-10-06T03:05:41.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.692+0000 7fa56f219700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa568068a00 0x7fa56814fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.692+0000 7fa56f219700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa568157300 0x7fa5680c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.692+0000 7fa56f219700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5681576d0 0x7fa5680c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.692+0000 7fa56f219700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa568167c10 con 0x7fa568068a00 2023-10-06T03:05:41.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.692+0000 7fa56f219700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5681500f0 con 0x7fa568157300 2023-10-06T03:05:41.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.692+0000 7fa56f219700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa568152e20 con 0x7fa5681576d0 2023-10-06T03:05:41.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.692+0000 7fa56cfb5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa568068a00 0x7fa56814fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.692+0000 7fa56cfb5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa568068a00 0x7fa56814fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57894/0 (socket says 172.21.15.125:57894) 2023-10-06T03:05:41.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.692+0000 7fa56cfb5700 1 -- 172.21.15.125:0/1511709803 learned_addr learned my addr 172.21.15.125:0/1511709803 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:41.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.692+0000 7fa56cfb5700 1 -- 172.21.15.125:0/1511709803 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5681576d0 msgr2=0x7fa5680c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:41.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.692+0000 7fa56cfb5700 1 --2- 172.21.15.125:0/1511709803 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5681576d0 0x7fa5680c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.692+0000 7fa56cfb5700 1 -- 172.21.15.125:0/1511709803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa568157300 msgr2=0x7fa5680c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:41.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.692+0000 7fa56cfb5700 1 --2- 172.21.15.125:0/1511709803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa568157300 0x7fa5680c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.692+0000 7fa56cfb5700 1 -- 172.21.15.125:0/1511709803 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c0093c0 con 0x7fa568068a00 2023-10-06T03:05:41.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.693+0000 7fa56cfb5700 1 --2- 172.21.15.125:0/1511709803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa568068a00 0x7fa56814fbb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009160 tx=0x7fa55c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:41.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.693+0000 7fa564ff9700 1 -- 172.21.15.125:0/1511709803 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c006310 con 0x7fa568068a00 2023-10-06T03:05:41.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.693+0000 7fa564ff9700 1 -- 172.21.15.125:0/1511709803 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c006490 con 0x7fa568068a00 2023-10-06T03:05:41.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.693+0000 7fa56f219700 1 -- 172.21.15.125:0/1511709803 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa568153100 con 0x7fa568068a00 2023-10-06T03:05:41.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.693+0000 7fa564ff9700 1 -- 172.21.15.125:0/1511709803 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c006850 con 0x7fa568068a00 2023-10-06T03:05:41.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.693+0000 7fa56f219700 1 -- 172.21.15.125:0/1511709803 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5681536c0 con 0x7fa568068a00 2023-10-06T03:05:41.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.694+0000 7fa564ff9700 1 -- 172.21.15.125:0/1511709803 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa55c01a630 con 0x7fa568068a00 2023-10-06T03:05:41.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.695+0000 7fa564ff9700 1 --2- 172.21.15.125:0/1511709803 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa54c066f30 0x7fa54c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.695+0000 7fa564ff9700 1 -- 172.21.15.125:0/1511709803 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa55c085f40 con 0x7fa568068a00 2023-10-06T03:05:41.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.695+0000 7fa567fff700 1 --2- 172.21.15.125:0/1511709803 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa54c066f30 0x7fa54c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.699 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.695+0000 7fa567fff700 1 --2- 172.21.15.125:0/1511709803 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa54c066f30 0x7fa54c0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa56806af10 tx=0x7fa554008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:41.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.697+0000 7fa57852db80 1 Processor -- start 2023-10-06T03:05:41.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.697+0000 7fa57852db80 1 -- start start 2023-10-06T03:05:41.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.698+0000 7fa57852db80 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f15ca6e770 0x55f15ca6eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.698+0000 7fa57852db80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f15cab8370 0x55f15ca6f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.698+0000 7fa57852db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15ca69260 0x55f15ca696d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.702 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.698+0000 7fa57852db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15c987310 con 0x55f15ca69260 2023-10-06T03:05:41.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.698+0000 7fa57852db80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15c9c4130 con 0x55f15cab8370 2023-10-06T03:05:41.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.698+0000 7fa57852db80 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f15c9c1af0 con 0x55f15ca6e770 2023-10-06T03:05:41.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.698+0000 7fa56d7b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15ca69260 0x55f15ca696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.698+0000 7fa56d7b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15ca69260 0x55f15ca696d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57902/0 (socket says 172.21.15.125:57902) 2023-10-06T03:05:41.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.698+0000 7fa56d7b6700 1 -- 172.21.15.125:0/413892022 learned_addr learned my addr 172.21.15.125:0/413892022 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:41.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.698+0000 7fa567fff700 1 --2- 172.21.15.125:0/413892022 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f15cab8370 0x55f15ca6f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.698+0000 7fa56cfb5700 1 --2- 172.21.15.125:0/413892022 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f15ca6e770 0x55f15ca6eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.698+0000 7fa56d7b6700 1 -- 172.21.15.125:0/413892022 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f15ca6e770 msgr2=0x55f15ca6eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:41.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.698+0000 7fa56d7b6700 1 --2- 172.21.15.125:0/413892022 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f15ca6e770 0x55f15ca6eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.698+0000 7fa56d7b6700 1 -- 172.21.15.125:0/413892022 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f15cab8370 msgr2=0x55f15ca6f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:41.703 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.698+0000 7fa56d7b6700 1 --2- 172.21.15.125:0/413892022 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f15cab8370 0x55f15ca6f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.698+0000 7fa56d7b6700 1 -- 172.21.15.125:0/413892022 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f15c7c3790 con 0x55f15ca69260 2023-10-06T03:05:41.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.699+0000 7fa56d7b6700 1 --2- 172.21.15.125:0/413892022 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15ca69260 0x55f15ca696d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa560002100 tx=0x7fa560001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d67524c5efd5c9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:41.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.699+0000 7fa551ffb700 1 -- 172.21.15.125:0/413892022 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56000cca0 con 0x55f15ca69260 2023-10-06T03:05:41.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.699+0000 7fa551ffb700 1 -- 172.21.15.125:0/413892022 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56000ce20 con 0x55f15ca69260 2023-10-06T03:05:41.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.699+0000 7fa551ffb700 1 -- 172.21.15.125:0/413892022 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa560007320 con 0x55f15ca69260 2023-10-06T03:05:41.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.699+0000 7fa57852db80 1 -- 172.21.15.125:0/413892022 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15ca69260 msgr2=0x55f15ca696d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:41.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.699+0000 7fa57852db80 1 --2- 172.21.15.125:0/413892022 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15ca69260 0x55f15ca696d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa560002100 tx=0x7fa560001a00 comp rx=0 tx=0).stop 2023-10-06T03:05:41.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.699+0000 7fa57852db80 1 -- 172.21.15.125:0/413892022 shutdown_connections 2023-10-06T03:05:41.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.699+0000 7fa57852db80 1 --2- 172.21.15.125:0/413892022 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15ca69260 0x55f15ca696d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.699+0000 7fa57852db80 1 --2- 172.21.15.125:0/413892022 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f15ca6e770 0x55f15ca6eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.699+0000 7fa57852db80 1 --2- 172.21.15.125:0/413892022 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f15cab8370 0x55f15ca6f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.699+0000 7fa57852db80 1 -- 172.21.15.125:0/413892022 >> 172.21.15.125:0/413892022 conn(0x55f15cab7890 msgr2=0x55f15cab7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:41.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.700+0000 7fa57852db80 1 -- 172.21.15.125:0/413892022 shutdown_connections 2023-10-06T03:05:41.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.700+0000 7fa57852db80 1 -- 172.21.15.125:0/413892022 wait complete. 2023-10-06T03:05:41.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.700+0000 7fa57852db80 1 -- start start 2023-10-06T03:05:41.705 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.700+0000 7fa57852db80 1 Processor -- start 2023-10-06T03:05:41.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa57852db80 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f15ca69260 0x55f15ca6df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa57852db80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f15ca6e770 0x55f15ca9bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa57852db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15cab8370 0x55f15ca6ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa57852db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15c9bd8e0 con 0x55f15cab8370 2023-10-06T03:05:41.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa57852db80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15c969980 con 0x55f15ca6e770 2023-10-06T03:05:41.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa57852db80 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f15c969620 con 0x55f15ca69260 2023-10-06T03:05:41.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa57852db80 10 client.0 _ll_register_callbacks cb 0x55f15c7cca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:05:41.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa56d7b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15cab8370 0x55f15ca6ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa56d7b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15cab8370 0x55f15ca6ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57912/0 (socket says 172.21.15.125:57912) 2023-10-06T03:05:41.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa56d7b6700 1 -- 172.21.15.125:0/270697050 learned_addr learned my addr 172.21.15.125:0/270697050 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:41.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa56cfb5700 1 --2- 172.21.15.125:0/270697050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f15ca69260 0x55f15ca6df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa567fff700 1 --2- 172.21.15.125:0/270697050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f15ca6e770 0x55f15ca9bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa56d7b6700 1 -- 172.21.15.125:0/270697050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f15ca69260 msgr2=0x55f15ca6df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:41.709 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa56d7b6700 1 --2- 172.21.15.125:0/270697050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f15ca69260 0x55f15ca6df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa56d7b6700 1 -- 172.21.15.125:0/270697050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f15ca6e770 msgr2=0x55f15ca9bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:41.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa56d7b6700 1 --2- 172.21.15.125:0/270697050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f15ca6e770 0x55f15ca9bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa56d7b6700 1 -- 172.21.15.125:0/270697050 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa560001ce0 con 0x55f15cab8370 2023-10-06T03:05:41.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa56d7b6700 1 --2- 172.21.15.125:0/270697050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15cab8370 0x55f15ca6ce50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa56000c750 tx=0x7fa560015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad38dcbc2b92dcc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:41.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa546ffd700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-06T03:05:41.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa546ffd700 1 -- 172.21.15.125:0/270697050 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa560007920 con 0x55f15cab8370 2023-10-06T03:05:41.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa546ffd700 1 -- 172.21.15.125:0/270697050 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa560007a80 con 0x55f15cab8370 2023-10-06T03:05:41.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa57852db80 1 -- 172.21.15.125:0/270697050 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f15ca61e50 con 0x55f15cab8370 2023-10-06T03:05:41.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa546ffd700 1 -- 172.21.15.125:0/270697050 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa56001f620 con 0x55f15cab8370 2023-10-06T03:05:41.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa57852db80 10 client.5289 fetch_fsmap learned FSMap version 18 2023-10-06T03:05:41.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.702+0000 7fa57852db80 1 -- 172.21.15.125:0/270697050 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55f15c8b00a0 con 0x55f15cab8370 2023-10-06T03:05:41.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.703+0000 7fa546ffd700 1 -- 172.21.15.125:0/270697050 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f15ca61e50 con 0x55f15cab8370 2023-10-06T03:05:41.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.703+0000 7fa546ffd700 1 -- 172.21.15.125:0/270697050 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 18) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa56000c0e0 con 0x55f15cab8370 2023-10-06T03:05:41.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.703+0000 7fa57852db80 10 client.5289 fetch_fsmap finished waiting for FSMap version 18 2023-10-06T03:05:41.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.703+0000 7fa57852db80 10 client.5289 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:05:41.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.703+0000 7fa57852db80 20 client.5289 populate_metadata read hostname 'smithi125' 2023-10-06T03:05:41.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.703+0000 7fa57852db80 1 --2- 172.21.15.125:0/270697050 >> [v2:172.21.15.125:6835/4027450913,v1:172.21.15.125:6837/4027450913] conn(0x55f15ca9a400 0x55f15ca9a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.703+0000 7fa57852db80 4 client.5289 mds_command: new command op to 5085 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:05:41.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.703+0000 7fa57852db80 1 -- 172.21.15.125:0/270697050 --> [v2:172.21.15.125:6835/4027450913,v1:172.21.15.125:6837/4027450913] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f15ca3ec20 con 0x55f15ca9a400 2023-10-06T03:05:41.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.703+0000 7fa56cfb5700 1 --2- 172.21.15.125:0/270697050 >> [v2:172.21.15.125:6835/4027450913,v1:172.21.15.125:6837/4027450913] conn(0x55f15ca9a400 0x55f15ca9a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.703+0000 7fa546ffd700 10 client.5289 ms_handle_connect on v2:172.21.15.125:6835/4027450913 2023-10-06T03:05:41.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.703+0000 7fa56cfb5700 1 --2- 172.21.15.125:0/270697050 >> [v2:172.21.15.125:6835/4027450913,v1:172.21.15.125:6837/4027450913] conn(0x55f15ca9a400 0x55f15ca9a7d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da9c4c3f2c35f996 server_cookie=2d1fbbbfc83ff570 in_seq=0 out_seq=0 2023-10-06T03:05:41.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.704+0000 7fa546ffd700 1 -- 172.21.15.125:0/270697050 <== mds.0 v2:172.21.15.125:6835/4027450913 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f15ca3ec20 con 0x55f15ca9a400 2023-10-06T03:05:41.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.704+0000 7fa546ffd700 10 client.5289 handle_command_reply: tid=0 2023-10-06T03:05:41.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.704+0000 7fa57852db80 1 client.5289 shutdown 2023-10-06T03:05:41.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.704+0000 7fa57852db80 1 -- 172.21.15.125:0/270697050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15cab8370 msgr2=0x55f15ca6ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:41.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.704+0000 7fa57852db80 1 --2- 172.21.15.125:0/270697050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15cab8370 0x55f15ca6ce50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fa56000c750 tx=0x7fa560015000 comp rx=0 tx=0).stop 2023-10-06T03:05:41.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.704+0000 7fa57852db80 1 -- 172.21.15.125:0/270697050 shutdown_connections 2023-10-06T03:05:41.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.704+0000 7fa57852db80 1 --2- 172.21.15.125:0/270697050 >> [v2:172.21.15.125:6835/4027450913,v1:172.21.15.125:6837/4027450913] conn(0x55f15ca9a400 0x55f15ca9a7d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.704+0000 7fa57852db80 1 --2- 172.21.15.125:0/270697050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15cab8370 0x55f15ca6ce50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.704+0000 7fa57852db80 1 --2- 172.21.15.125:0/270697050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f15ca69260 0x55f15ca6df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.704+0000 7fa57852db80 1 --2- 172.21.15.125:0/270697050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f15ca6e770 0x55f15ca9bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.704+0000 7fa546ffd700 0 client.5289 ms_handle_reset on v2:172.21.15.125:6835/4027450913 2023-10-06T03:05:41.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.704+0000 7fa57852db80 1 -- 172.21.15.125:0/270697050 >> 172.21.15.125:0/270697050 conn(0x55f15cab7890 msgr2=0x55f15ca6f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:41.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.704+0000 7fa57852db80 1 -- 172.21.15.125:0/270697050 shutdown_connections 2023-10-06T03:05:41.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.704+0000 7fa57852db80 1 -- 172.21.15.125:0/270697050 wait complete. 2023-10-06T03:05:41.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.704+0000 7fa57852db80 20 client.5289 trim_cache size 0 max 16384 2023-10-06T03:05:41.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.721+0000 7fa57852db80 1 Processor -- start 2023-10-06T03:05:41.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.721+0000 7fa57852db80 1 -- start start 2023-10-06T03:05:41.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.721+0000 7fa57852db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15ca6b330 0x55f15cab7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.721+0000 7fa57852db80 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f15cab7890 0x55f15cab3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.721+0000 7fa57852db80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f15ca69260 0x55f15cab42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.721+0000 7fa57852db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15c8551e0 con 0x55f15ca6b330 2023-10-06T03:05:41.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.721+0000 7fa57852db80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15ca65980 con 0x55f15ca69260 2023-10-06T03:05:41.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.721+0000 7fa57852db80 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f15cab81a0 con 0x55f15cab7890 2023-10-06T03:05:41.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.722+0000 7fa56cfb5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15ca6b330 0x55f15cab7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.722+0000 7fa56cfb5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15ca6b330 0x55f15cab7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57920/0 (socket says 172.21.15.125:57920) 2023-10-06T03:05:41.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.722+0000 7fa56cfb5700 1 -- 172.21.15.125:0/1990480469 learned_addr learned my addr 172.21.15.125:0/1990480469 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:41.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.722+0000 7fa56cfb5700 1 -- 172.21.15.125:0/1990480469 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f15cab7890 msgr2=0x55f15cab3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:41.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.722+0000 7fa56cfb5700 1 --2- 172.21.15.125:0/1990480469 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f15cab7890 0x55f15cab3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.722+0000 7fa56cfb5700 1 -- 172.21.15.125:0/1990480469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f15ca69260 msgr2=0x55f15cab42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:41.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.722+0000 7fa56cfb5700 1 --2- 172.21.15.125:0/1990480469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f15ca69260 0x55f15cab42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.722+0000 7fa56cfb5700 1 -- 172.21.15.125:0/1990480469 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f15c98c3c0 con 0x55f15ca6b330 2023-10-06T03:05:41.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.722+0000 7fa56cfb5700 1 --2- 172.21.15.125:0/1990480469 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15ca6b330 0x55f15cab7c60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00c010 tx=0x7fa55c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3670c465f119b2a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:41.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.722+0000 7fa5527fc700 1 -- 172.21.15.125:0/1990480469 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c05db70 con 0x55f15ca6b330 2023-10-06T03:05:41.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.722+0000 7fa5527fc700 1 -- 172.21.15.125:0/1990480469 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c0842d0 con 0x55f15ca6b330 2023-10-06T03:05:41.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.722+0000 7fa5527fc700 1 -- 172.21.15.125:0/1990480469 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c054f70 con 0x55f15ca6b330 2023-10-06T03:05:41.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.723+0000 7fa57852db80 1 -- 172.21.15.125:0/1990480469 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15ca6b330 msgr2=0x55f15cab7c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:41.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.723+0000 7fa57852db80 1 --2- 172.21.15.125:0/1990480469 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15ca6b330 0x55f15cab7c60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00c010 tx=0x7fa55c008040 comp rx=0 tx=0).stop 2023-10-06T03:05:41.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.723+0000 7fa57852db80 1 -- 172.21.15.125:0/1990480469 shutdown_connections 2023-10-06T03:05:41.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.723+0000 7fa57852db80 1 --2- 172.21.15.125:0/1990480469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f15ca69260 0x55f15cab42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.723+0000 7fa57852db80 1 --2- 172.21.15.125:0/1990480469 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15ca6b330 0x55f15cab7c60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.723+0000 7fa57852db80 1 --2- 172.21.15.125:0/1990480469 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f15cab7890 0x55f15cab3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.723+0000 7fa57852db80 1 -- 172.21.15.125:0/1990480469 >> 172.21.15.125:0/1990480469 conn(0x55f15ca986c0 msgr2=0x55f15ca70790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:41.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.723+0000 7fa57852db80 1 -- 172.21.15.125:0/1990480469 shutdown_connections 2023-10-06T03:05:41.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.723+0000 7fa57852db80 1 -- 172.21.15.125:0/1990480469 wait complete. 2023-10-06T03:05:41.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.723+0000 7fa57852db80 1 -- start start 2023-10-06T03:05:41.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.724+0000 7fa57852db80 1 Processor -- start 2023-10-06T03:05:41.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa57852db80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f15ca69260 0x55f15cb193a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa57852db80 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f15ca6b330 0x55f15ca9a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa57852db80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15cab7890 0x55f15ca9ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa57852db80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15cacd610 con 0x55f15cab7890 2023-10-06T03:05:41.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa57852db80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f15cad48f0 con 0x55f15ca69260 2023-10-06T03:05:41.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa57852db80 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f15ca9b3a0 con 0x55f15ca6b330 2023-10-06T03:05:41.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa57852db80 10 client.0 _ll_register_callbacks cb 0x55f15c7cca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:05:41.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa56d7b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15cab7890 0x55f15ca9ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa56d7b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15cab7890 0x55f15ca9ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57930/0 (socket says 172.21.15.125:57930) 2023-10-06T03:05:41.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa56d7b6700 1 -- 172.21.15.125:0/1267992900 learned_addr learned my addr 172.21.15.125:0/1267992900 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:41.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa56cfb5700 1 --2- 172.21.15.125:0/1267992900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f15ca69260 0x55f15cb193a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa567fff700 1 --2- 172.21.15.125:0/1267992900 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f15ca6b330 0x55f15ca9a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa56d7b6700 1 -- 172.21.15.125:0/1267992900 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f15ca6b330 msgr2=0x55f15ca9a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:41.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa56d7b6700 1 --2- 172.21.15.125:0/1267992900 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f15ca6b330 0x55f15ca9a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa56d7b6700 1 -- 172.21.15.125:0/1267992900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f15ca69260 msgr2=0x55f15cb193a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:41.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa56d7b6700 1 --2- 172.21.15.125:0/1267992900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f15ca69260 0x55f15cb193a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa56d7b6700 1 -- 172.21.15.125:0/1267992900 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5681536c0 con 0x55f15cab7890 2023-10-06T03:05:41.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa56d7b6700 1 --2- 172.21.15.125:0/1267992900 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15cab7890 0x55f15ca9ad10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x55f15ca96120 tx=0x7fa56000c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c774b3d062f3cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:41.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa546ffd700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-06T03:05:41.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa546ffd700 1 -- 172.21.15.125:0/1267992900 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56001faa0 con 0x55f15cab7890 2023-10-06T03:05:41.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa546ffd700 1 -- 172.21.15.125:0/1267992900 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fa56000c0c0 con 0x55f15cab7890 2023-10-06T03:05:41.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.725+0000 7fa57852db80 1 -- 172.21.15.125:0/1267992900 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa56000ce20 con 0x55f15cab7890 2023-10-06T03:05:41.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.726+0000 7fa546ffd700 1 -- 172.21.15.125:0/1267992900 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa56000cca0 con 0x55f15cab7890 2023-10-06T03:05:41.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.726+0000 7fa57852db80 10 client.5295 fetch_fsmap learned FSMap version 18 2023-10-06T03:05:41.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.726+0000 7fa57852db80 1 -- 172.21.15.125:0/1267992900 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55f15c8241d0 con 0x55f15cab7890 2023-10-06T03:05:41.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.726+0000 7fa546ffd700 1 -- 172.21.15.125:0/1267992900 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56000ce20 con 0x55f15cab7890 2023-10-06T03:05:41.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.726+0000 7fa546ffd700 1 -- 172.21.15.125:0/1267992900 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 18) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa560007920 con 0x55f15cab7890 2023-10-06T03:05:41.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.726+0000 7fa57852db80 10 client.5295 fetch_fsmap finished waiting for FSMap version 18 2023-10-06T03:05:41.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.726+0000 7fa57852db80 10 client.5295 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:05:41.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.726+0000 7fa57852db80 20 client.5295 populate_metadata read hostname 'smithi125' 2023-10-06T03:05:41.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.726+0000 7fa57852db80 1 --2- 172.21.15.125:0/1267992900 >> [v2:172.21.15.125:6835/4027450913,v1:172.21.15.125:6837/4027450913] conn(0x55f15ca6e770 0x55f15ca99050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.726+0000 7fa57852db80 4 client.5295 mds_command: new command op to 5085 tid=0[{"prefix": "status"}] 2023-10-06T03:05:41.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.726+0000 7fa57852db80 1 -- 172.21.15.125:0/1267992900 --> [v2:172.21.15.125:6835/4027450913,v1:172.21.15.125:6837/4027450913] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f15c9608d0 con 0x55f15ca6e770 2023-10-06T03:05:41.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.726+0000 7fa56cfb5700 1 --2- 172.21.15.125:0/1267992900 >> [v2:172.21.15.125:6835/4027450913,v1:172.21.15.125:6837/4027450913] conn(0x55f15ca6e770 0x55f15ca99050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.726+0000 7fa546ffd700 10 client.5295 ms_handle_connect on v2:172.21.15.125:6835/4027450913 2023-10-06T03:05:41.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.726+0000 7fa56cfb5700 1 --2- 172.21.15.125:0/1267992900 >> [v2:172.21.15.125:6835/4027450913,v1:172.21.15.125:6837/4027450913] conn(0x55f15ca6e770 0x55f15ca99050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79aebbc196980f7e server_cookie=dabf8943be9eea87 in_seq=0 out_seq=0 2023-10-06T03:05:41.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.726+0000 7fa546ffd700 1 -- 172.21.15.125:0/1267992900 <== mds.0 v2:172.21.15.125:6835/4027450913 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55f15c9608d0 con 0x55f15ca6e770 2023-10-06T03:05:41.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.726+0000 7fa546ffd700 10 client.5295 handle_command_reply: tid=0 2023-10-06T03:05:41.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.726+0000 7fa57852db80 1 client.5295 shutdown 2023-10-06T03:05:41.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa57852db80 1 -- 172.21.15.125:0/1267992900 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15cab7890 msgr2=0x55f15ca9ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:41.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa57852db80 1 --2- 172.21.15.125:0/1267992900 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15cab7890 0x55f15ca9ad10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x55f15ca96120 tx=0x7fa56000c050 comp rx=0 tx=0).stop 2023-10-06T03:05:41.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa57852db80 1 -- 172.21.15.125:0/1267992900 shutdown_connections 2023-10-06T03:05:41.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa57852db80 1 --2- 172.21.15.125:0/1267992900 >> [v2:172.21.15.125:6835/4027450913,v1:172.21.15.125:6837/4027450913] conn(0x55f15ca6e770 0x55f15ca99050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa57852db80 1 --2- 172.21.15.125:0/1267992900 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f15cab7890 0x55f15ca9ad10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa57852db80 1 --2- 172.21.15.125:0/1267992900 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f15ca69260 0x55f15cb193a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa546ffd700 0 client.5295 ms_handle_reset on v2:172.21.15.125:6835/4027450913 2023-10-06T03:05:41.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa57852db80 1 --2- 172.21.15.125:0/1267992900 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f15ca6b330 0x55f15ca9a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa57852db80 1 -- 172.21.15.125:0/1267992900 >> 172.21.15.125:0/1267992900 conn(0x55f15ca986c0 msgr2=0x55f15cab42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:41.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa57852db80 1 -- 172.21.15.125:0/1267992900 shutdown_connections 2023-10-06T03:05:41.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa57852db80 1 -- 172.21.15.125:0/1267992900 wait complete. 2023-10-06T03:05:41.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa57852db80 20 client.5295 trim_cache size 0 max 16384 2023-10-06T03:05:41.736 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:05:41.736 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_fsid": "c8556660-0880-4430-a03a-c140780d46e7", 2023-10-06T03:05:41.736 INFO:teuthology.orchestra.run.smithi125.stdout: "whoami": 0, 2023-10-06T03:05:41.736 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 5085, 2023-10-06T03:05:41.736 INFO:teuthology.orchestra.run.smithi125.stdout: "want_state": "up:active", 2023-10-06T03:05:41.736 INFO:teuthology.orchestra.run.smithi125.stdout: "state": "up:active", 2023-10-06T03:05:41.736 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs", 2023-10-06T03:05:41.736 INFO:teuthology.orchestra.run.smithi125.stdout: "rank_uptime": 10.483563476, 2023-10-06T03:05:41.736 INFO:teuthology.orchestra.run.smithi125.stdout: "mdsmap_epoch": 18, 2023-10-06T03:05:41.736 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch": 41, 2023-10-06T03:05:41.736 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch_barrier": 41, 2023-10-06T03:05:41.737 INFO:teuthology.orchestra.run.smithi125.stdout: "uptime": 18.650357983999999 2023-10-06T03:05:41.737 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:05:41.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa56f219700 1 -- 172.21.15.125:0/1511709803 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa54c066f30 msgr2=0x7fa54c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:41.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa56f219700 1 --2- 172.21.15.125:0/1511709803 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa54c066f30 0x7fa54c0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa56806af10 tx=0x7fa554008040 comp rx=0 tx=0).stop 2023-10-06T03:05:41.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa56f219700 1 -- 172.21.15.125:0/1511709803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa568068a00 msgr2=0x7fa56814fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:41.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa56f219700 1 --2- 172.21.15.125:0/1511709803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa568068a00 0x7fa56814fbb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa55c009160 tx=0x7fa55c016000 comp rx=0 tx=0).stop 2023-10-06T03:05:41.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa56f219700 1 -- 172.21.15.125:0/1511709803 shutdown_connections 2023-10-06T03:05:41.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa56f219700 1 --2- 172.21.15.125:0/1511709803 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa54c066f30 0x7fa54c0693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa56f219700 1 --2- 172.21.15.125:0/1511709803 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa5681576d0 0x7fa5680c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa56f219700 1 --2- 172.21.15.125:0/1511709803 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa568068a00 0x7fa56814fbb0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa56f219700 1 --2- 172.21.15.125:0/1511709803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa568157300 0x7fa5680c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.727+0000 7fa56f219700 1 -- 172.21.15.125:0/1511709803 >> 172.21.15.125:0/1511709803 conn(0x7fa5680af730 msgr2=0x7fa56806c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:41.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.728+0000 7fa56f219700 1 -- 172.21.15.125:0/1511709803 shutdown_connections 2023-10-06T03:05:41.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.728+0000 7fa56f219700 1 -- 172.21.15.125:0/1511709803 wait complete. 2023-10-06T03:05:41.740 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:05:41.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.857+0000 7f2552556700 1 Processor -- start 2023-10-06T03:05:41.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.857+0000 7f2552556700 1 -- start start 2023-10-06T03:05:41.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.858+0000 7f2552556700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f254c158f70 0x7f254c0b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.858+0000 7f2552556700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254c0b44a0 con 0x7f254c0b1b50 2023-10-06T03:05:41.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.858+0000 7f2552556700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f254c0b4780 con 0x7f254c159340 2023-10-06T03:05:41.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.858+0000 7f2552556700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f254c0b4a60 con 0x7f254c158f70 2023-10-06T03:05:41.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.858+0000 7f2550af3700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f254c0b1b50 0x7f254c15a9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35326/0 (socket says 172.21.15.125:35326) 2023-10-06T03:05:41.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.858+0000 7f2550af3700 1 -- 172.21.15.125:0/1619378309 learned_addr learned my addr 172.21.15.125:0/1619378309 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:41.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.858+0000 7f254affd700 1 -- 172.21.15.125:0/1619378309 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107590145 0 0) 0x7f254c0b44a0 con 0x7f254c0b1b50 2023-10-06T03:05:41.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254affd700 1 -- 172.21.15.125:0/1619378309 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2534003570 con 0x7f254c0b1b50 2023-10-06T03:05:41.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254bfff700 1 --2- 172.21.15.125:0/1619378309 >> v2:172.21.15.130:3300/0 conn(0x7f254c158f70 0x7f254c0b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254affd700 1 -- 172.21.15.125:0/1619378309 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3006910752 0 0) 0x7f2534003570 con 0x7f254c0b1b50 2023-10-06T03:05:41.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254affd700 1 -- 172.21.15.125:0/1619378309 >> v2:172.21.15.130:3300/0 conn(0x7f254c158f70 msgr2=0x7f254c0b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:41.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254affd700 1 --2- 172.21.15.125:0/1619378309 >> v2:172.21.15.130:3300/0 conn(0x7f254c158f70 0x7f254c0b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254affd700 1 -- 172.21.15.125:0/1619378309 >> v1:172.21.15.130:6789/0 conn(0x7f254c159340 legacy=0x7f254c0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:41.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254affd700 1 -- 172.21.15.125:0/1619378309 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c0b4d40 con 0x7f254c0b1b50 2023-10-06T03:05:41.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254affd700 1 -- 172.21.15.125:0/1619378309 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f25440017f0 con 0x7f254c0b1b50 2023-10-06T03:05:41.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254affd700 1 -- 172.21.15.125:0/1619378309 >> v1:172.21.15.125:6789/0 conn(0x7f254c0b1b50 legacy=0x7f254c15a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:41.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254affd700 1 --2- 172.21.15.125:0/1619378309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2534003a60 0x7f2534003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254affd700 1 --2- 172.21.15.125:0/1619378309 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2534004810 0x7f2534004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254affd700 1 --2- 172.21.15.125:0/1619378309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25340052e0 0x7f253400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254affd700 1 -- 172.21.15.125:0/1619378309 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c0b4a60 con 0x7f2534003a60 2023-10-06T03:05:41.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254affd700 1 -- 172.21.15.125:0/1619378309 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253400c230 con 0x7f25340052e0 2023-10-06T03:05:41.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254affd700 1 -- 172.21.15.125:0/1619378309 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253400c3f0 con 0x7f2534004810 2023-10-06T03:05:41.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254bfff700 1 --2- 172.21.15.125:0/1619378309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2534003a60 0x7f2534003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f2550af3700 1 --2- 172.21.15.125:0/1619378309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25340052e0 0x7f253400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254b7fe700 1 --2- 172.21.15.125:0/1619378309 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2534004810 0x7f2534004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254bfff700 1 -- 172.21.15.125:0/1619378309 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2534004810 msgr2=0x7f2534004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:41.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254bfff700 1 --2- 172.21.15.125:0/1619378309 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2534004810 0x7f2534004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254bfff700 1 -- 172.21.15.125:0/1619378309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25340052e0 msgr2=0x7f253400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:41.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254bfff700 1 --2- 172.21.15.125:0/1619378309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25340052e0 0x7f253400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254bfff700 1 -- 172.21.15.125:0/1619378309 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2534003570 con 0x7f2534003a60 2023-10-06T03:05:41.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f2550af3700 1 --2- 172.21.15.125:0/1619378309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f25340052e0 0x7f253400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:41.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f2550af3700 1 -- 172.21.15.125:0/1619378309 reap_dead start 2023-10-06T03:05:41.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254bfff700 1 --2- 172.21.15.125:0/1619378309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2534003a60 0x7f2534003e70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f254000bb90 tx=0x7f2540008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a21e2b0e4d0d2b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:41.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254affd700 1 -- 172.21.15.125:0/1619378309 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254000d5d0 con 0x7f2534003a60 2023-10-06T03:05:41.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254affd700 1 -- 172.21.15.125:0/1619378309 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254000d730 con 0x7f2534003a60 2023-10-06T03:05:41.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.859+0000 7f254affd700 1 -- 172.21.15.125:0/1619378309 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254000daf0 con 0x7f2534003a60 2023-10-06T03:05:41.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.860+0000 7f2552556700 1 -- 172.21.15.125:0/1619378309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2534003a60 msgr2=0x7f2534003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:41.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.860+0000 7f2552556700 1 --2- 172.21.15.125:0/1619378309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2534003a60 0x7f2534003e70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f254000bb90 tx=0x7f2540008040 comp rx=0 tx=0).stop 2023-10-06T03:05:41.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.860+0000 7f2552556700 1 -- 172.21.15.125:0/1619378309 shutdown_connections 2023-10-06T03:05:41.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.860+0000 7f2552556700 1 --2- 172.21.15.125:0/1619378309 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f2534003a60 0x7f2534003e70 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.860+0000 7f2552556700 1 -- 172.21.15.125:0/1619378309 >> 172.21.15.125:0/1619378309 conn(0x7f254c06ed40 msgr2=0x7f254c06f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:41.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.860+0000 7f2552556700 1 -- 172.21.15.125:0/1619378309 shutdown_connections 2023-10-06T03:05:41.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.860+0000 7f2552556700 1 -- 172.21.15.125:0/1619378309 wait complete. 2023-10-06T03:05:41.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.861+0000 7f2552556700 1 Processor -- start 2023-10-06T03:05:41.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.861+0000 7f2552556700 1 -- start start 2023-10-06T03:05:41.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.862+0000 7f2552556700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2534003a60 0x7f254c0ae4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.862+0000 7f2552556700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f254c1553c0 0x7f254c15b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.862+0000 7f2552556700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f254c15b710 0x7f254c15cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.862+0000 7f2552556700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c15bbb0 con 0x7f254c15b710 2023-10-06T03:05:41.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.862+0000 7f2552556700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254c15eb50 con 0x7f2534003a60 2023-10-06T03:05:41.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.862+0000 7f2552556700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f254c1699b0 con 0x7f254c1553c0 2023-10-06T03:05:41.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.862+0000 7f2550af3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f254c15b710 0x7f254c15cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.862+0000 7f2550af3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f254c15b710 0x7f254c15cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57938/0 (socket says 172.21.15.125:57938) 2023-10-06T03:05:41.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.862+0000 7f2550af3700 1 -- 172.21.15.125:0/2945359411 learned_addr learned my addr 172.21.15.125:0/2945359411 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:41.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.862+0000 7f2550af3700 1 -- 172.21.15.125:0/2945359411 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f254c1553c0 msgr2=0x7f254c15b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:41.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.862+0000 7f2550af3700 1 --2- 172.21.15.125:0/2945359411 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f254c1553c0 0x7f254c15b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.862+0000 7f2550af3700 1 -- 172.21.15.125:0/2945359411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2534003a60 msgr2=0x7f254c0ae4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:41.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.862+0000 7f254bfff700 1 --2- 172.21.15.125:0/2945359411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2534003a60 0x7f254c0ae4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.862+0000 7f2550af3700 1 --2- 172.21.15.125:0/2945359411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2534003a60 0x7f254c0ae4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:41.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.862+0000 7f2550af3700 1 -- 172.21.15.125:0/2945359411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c15e870 con 0x7f254c15b710 2023-10-06T03:05:41.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.863+0000 7f2550af3700 1 --2- 172.21.15.125:0/2945359411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f254c15b710 0x7f254c15cd90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f254c159710 tx=0x7f25440017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:41.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.863+0000 7f2533fff700 1 -- 172.21.15.125:0/2945359411 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544017070 con 0x7f254c15b710 2023-10-06T03:05:41.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.863+0000 7f2533fff700 1 -- 172.21.15.125:0/2945359411 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254400ebe0 con 0x7f254c15b710 2023-10-06T03:05:41.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.863+0000 7f2533fff700 1 -- 172.21.15.125:0/2945359411 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544013420 con 0x7f254c15b710 2023-10-06T03:05:41.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.863+0000 7f2552556700 1 -- 172.21.15.125:0/2945359411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f254c169c50 con 0x7f254c15b710 2023-10-06T03:05:41.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.863+0000 7f2552556700 1 -- 172.21.15.125:0/2945359411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254c158470 con 0x7f254c15b710 2023-10-06T03:05:41.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.864+0000 7f2552556700 1 -- 172.21.15.125:0/2945359411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f254c15ece0 con 0x7f254c15b710 2023-10-06T03:05:41.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.864+0000 7f2533fff700 1 -- 172.21.15.125:0/2945359411 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2544013790 con 0x7f254c15b710 2023-10-06T03:05:41.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.864+0000 7f2533fff700 1 --2- 172.21.15.125:0/2945359411 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2538066f30 0x7f25380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:41.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.865+0000 7f2533fff700 1 -- 172.21.15.125:0/2945359411 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2544084800 con 0x7f254c15b710 2023-10-06T03:05:41.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.865+0000 7f254bfff700 1 --2- 172.21.15.125:0/2945359411 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2538066f30 0x7f25380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:41.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.865+0000 7f254bfff700 1 --2- 172.21.15.125:0/2945359411 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2538066f30 0x7f25380693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f254000bb90 tx=0x7f254001b000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:41.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:41.869+0000 7f2533fff700 1 -- 172.21.15.125:0/2945359411 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2544051730 con 0x7f254c15b710 2023-10-06T03:05:42.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:42.095+0000 7f2552556700 1 -- 172.21.15.125:0/2945359411 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f254c066510 con 0x7f254c15b710 2023-10-06T03:05:42.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:42.096+0000 7f2533fff700 1 -- 172.21.15.125:0/2945359411 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2544054d50 con 0x7f254c15b710 2023-10-06T03:05:42.097 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:05:42.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:42.098+0000 7f2552556700 1 -- 172.21.15.125:0/2945359411 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2538066f30 msgr2=0x7f25380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:42.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:42.098+0000 7f2552556700 1 --2- 172.21.15.125:0/2945359411 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2538066f30 0x7f25380693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f254000bb90 tx=0x7f254001b000 comp rx=0 tx=0).stop 2023-10-06T03:05:42.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:42.098+0000 7f2552556700 1 -- 172.21.15.125:0/2945359411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f254c15b710 msgr2=0x7f254c15cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:42.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:42.098+0000 7f2552556700 1 --2- 172.21.15.125:0/2945359411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f254c15b710 0x7f254c15cd90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f254c159710 tx=0x7f25440017f0 comp rx=0 tx=0).stop 2023-10-06T03:05:42.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:42.098+0000 7f2552556700 1 -- 172.21.15.125:0/2945359411 shutdown_connections 2023-10-06T03:05:42.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:42.098+0000 7f2552556700 1 --2- 172.21.15.125:0/2945359411 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2538066f30 0x7f25380693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:42.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:42.098+0000 7f2552556700 1 --2- 172.21.15.125:0/2945359411 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f254c15b710 0x7f254c15cd90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:42.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:42.098+0000 7f2552556700 1 --2- 172.21.15.125:0/2945359411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2534003a60 0x7f254c0ae4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:42.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:42.098+0000 7f2552556700 1 --2- 172.21.15.125:0/2945359411 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f254c1553c0 0x7f254c15b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:42.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:42.098+0000 7f2552556700 1 -- 172.21.15.125:0/2945359411 >> 172.21.15.125:0/2945359411 conn(0x7f254c06ed40 msgr2=0x7f254c0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:42.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:42.098+0000 7f2552556700 1 -- 172.21.15.125:0/2945359411 shutdown_connections 2023-10-06T03:05:42.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:42.098+0000 7f2552556700 1 -- 172.21.15.125:0/2945359411 wait complete. 2023-10-06T03:05:42.111 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:05:42.111 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:05:42.111 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-10-06T03:05:42.111 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:05:42.111 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:42.111 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:05:42.112 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:05:42.112 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:05:42.112 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:05:42.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:42.112 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-10-06T03:05:42.131 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:05:42.131 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:05:42.131 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:05:42.131 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:42.131 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-10-06T03:05:42.131 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:42.131 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:05:42.131 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:42.131 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2023-10-06T03:05:42.131 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:05:42.132 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:42.132 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2023-10-06T03:05:42.132 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:05:42.132 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:42.132 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:05:42.132 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:42.132 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:05:42.132 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42459sec preferred_lft 42459sec 2023-10-06T03:05:42.132 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2023-10-06T03:05:42.132 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:42.132 INFO:teuthology.orchestra.run.smithi125.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:05:42.132 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 46:01:08:d7:90:9a brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:42.133 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:05:42.133 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:42.133 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::f829:e8ff:fe3d:51e0/64 scope link 2023-10-06T03:05:42.133 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:42.133 INFO:teuthology.orchestra.run.smithi125.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:05:42.133 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 46:01:08:d7:90:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:05:42.133 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::4401:8ff:fed7:909a/64 scope link 2023-10-06T03:05:42.133 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:42.133 INFO:teuthology.orchestra.run.smithi125.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:05:42.133 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 9a:de:60:3d:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:05:42.133 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::98de:60ff:fe3d:d710/64 scope link 2023-10-06T03:05:42.133 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:42.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:42.134 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:05:42.197 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-10-06T03:05:42.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:42.199 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-10-06T03:05:42.259 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-10-06T03:05:42.259 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:05:42.259 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:05:42.259 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:05:42.259 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:05:42.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:42.260 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:05:42.260 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:05:42.260 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:05:42.260 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:05:42.260 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:05:42.260 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:05:42.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:42.365 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-06T03:05:42.382 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:05:42.383 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:05:42.383 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:05:42.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:42.383 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2023-10-06T03:05:42.451 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T03:05:42.452 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:05:42.452 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:42.510 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:05:42.510 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:05:42.511 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:42.568 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-06T03:05:42.636 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:05:42.636 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:05:42.703 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:05:42.704 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:05:42.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:42.705 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-06T03:05:42.763 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T03:05:42.763 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T03:05:42.806 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-06T03:05:42.832 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:05:42.833 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:05:42.888 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2023-10-06T03:05:42.886+0000 7f4bc642d540 -1 init, newargv = 0x56134c90f660 newargc=15 2023-10-06T03:05:42.888 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[136309]: starting ceph client 2023-10-06T03:05:42.892 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[136309]: starting fuse 2023-10-06T03:05:42.902 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:05:42.903 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:05:42.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:42.904 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-06T03:05:42.962 INFO:teuthology.orchestra.run.smithi125.stdout:46 2023-10-06T03:05:42.962 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T03:05:42.963 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:05:42.963 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2023-10-06T03:05:42.963 DEBUG:teuthology.orchestra.run.smithi125:> import re 2023-10-06T03:05:42.963 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-10-06T03:05:42.963 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2023-10-06T03:05:42.963 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:05:42.963 DEBUG:teuthology.orchestra.run.smithi125:> def _find_admin_socket(client_name): 2023-10-06T03:05:42.963 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T03:05:42.963 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2023-10-06T03:05:42.963 DEBUG:teuthology.orchestra.run.smithi125:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T03:05:42.963 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:05:42.963 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2023-10-06T03:05:42.963 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2023-10-06T03:05:42.964 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2023-10-06T03:05:42.964 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2023-10-06T03:05:42.964 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:05:42.964 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2023-10-06T03:05:42.964 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T03:05:42.964 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T03:05:42.964 DEBUG:teuthology.orchestra.run.smithi125:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T03:05:42.964 DEBUG:teuthology.orchestra.run.smithi125:> contents = proc_f.read() 2023-10-06T03:05:42.964 DEBUG:teuthology.orchestra.run.smithi125:> if mountpoint in contents: 2023-10-06T03:05:42.964 DEBUG:teuthology.orchestra.run.smithi125:> return f 2023-10-06T03:05:42.964 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T03:05:42.964 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:05:42.964 DEBUG:teuthology.orchestra.run.smithi125:> print(_find_admin_socket("client.0")) 2023-10-06T03:05:42.965 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-10-06T03:05:43.085 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.136309.asok 2023-10-06T03:05:43.270 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.136309.asok 2023-10-06T03:05:43.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:43.270 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.136309.asok status 2023-10-06T03:05:43.424 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:05:43.424 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2023-10-06T03:05:43.424 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T03:05:43.424 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T03:05:43.424 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2023-10-06T03:05:43.425 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2023-10-06T03:05:43.425 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T03:05:43.425 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "136309", 2023-10-06T03:05:43.425 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2023-10-06T03:05:43.425 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:43.425 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2023-10-06T03:05:43.425 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2023-10-06T03:05:43.425 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 5310, 2023-10-06T03:05:43.425 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2023-10-06T03:05:43.425 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2023-10-06T03:05:43.425 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2023-10-06T03:05:43.426 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 5310 2023-10-06T03:05:43.426 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:43.426 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-06T03:05:43.426 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-06T03:05:43.426 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:05:43.426 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 1193625878 2023-10-06T03:05:43.426 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:43.426 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:43.426 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-06T03:05:43.426 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-06T03:05:43.426 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:05:43.427 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 1193625878 2023-10-06T03:05:43.427 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:43.427 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.5310 192.168.0.1:0/1193625878", 2023-10-06T03:05:43.427 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "192.168.0.1:0/1193625878", 2023-10-06T03:05:43.427 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2023-10-06T03:05:43.427 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 18, 2023-10-06T03:05:43.427 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 41, 2023-10-06T03:05:43.427 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2023-10-06T03:05:43.427 INFO:teuthology.orchestra.run.smithi125.stdout: "blocklisted": false, 2023-10-06T03:05:43.427 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2023-10-06T03:05:43.428 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:05:43.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:43.434 DEBUG:teuthology.orchestra.run.smithi125:> stat --file-system '--printf=%T 2023-10-06T03:05:43.434 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:43.452 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2023-10-06T03:05:43.452 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:43.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:43.453 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:43.520 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create data_new --pg_num_min 64 2023-10-06T03:05:43.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.680+0000 7fde870f8700 1 Processor -- start 2023-10-06T03:05:43.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.680+0000 7fde870f8700 1 -- start start 2023-10-06T03:05:43.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.680+0000 7fde870f8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fde8006ee90 0x7fde80155c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:43.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.680+0000 7fde870f8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde800c2570 con 0x7fde800ae230 2023-10-06T03:05:43.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.680+0000 7fde870f8700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde80150190 con 0x7fde8006eac0 2023-10-06T03:05:43.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.680+0000 7fde870f8700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde800ae6d0 con 0x7fde8006ee90 2023-10-06T03:05:43.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.681+0000 7fde7ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fde8006ee90 0x7fde80155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:43.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.681+0000 7fde85695700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fde800ae230 0x7fde800caf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35334/0 (socket says 172.21.15.125:35334) 2023-10-06T03:05:43.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.681+0000 7fde7ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fde8006ee90 0x7fde80155c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57950/0 (socket says 172.21.15.125:57950) 2023-10-06T03:05:43.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.681+0000 7fde85695700 1 -- 172.21.15.125:0/3367791993 learned_addr learned my addr 172.21.15.125:0/3367791993 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:43.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.681+0000 7fde7ffff700 1 -- 172.21.15.125:0/3367791993 >> v1:172.21.15.130:6789/0 conn(0x7fde8006eac0 legacy=0x7fde800c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:43.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.681+0000 7fde7ffff700 1 -- 172.21.15.125:0/3367791993 >> v1:172.21.15.125:6789/0 conn(0x7fde800ae230 legacy=0x7fde800caf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:43.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.681+0000 7fde7f7fe700 1 -- 172.21.15.125:0/3367791993 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790523391 0 0) 0x7fde800c2570 con 0x7fde800ae230 2023-10-06T03:05:43.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.681+0000 7fde7ffff700 1 -- 172.21.15.125:0/3367791993 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde80156260 con 0x7fde8006ee90 2023-10-06T03:05:43.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.681+0000 7fde7ffff700 1 --2- 172.21.15.125:0/3367791993 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde8006ee90 0x7fde80155c80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fde6c0098e0 tx=0x7fde6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db4cc40bac8be53 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:43.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.681+0000 7fde7f7fe700 1 -- 172.21.15.125:0/3367791993 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c009e80 con 0x7fde8006ee90 2023-10-06T03:05:43.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.681+0000 7fde7f7fe700 1 -- 172.21.15.125:0/3367791993 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c00b820 con 0x7fde8006ee90 2023-10-06T03:05:43.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.681+0000 7fde7f7fe700 1 -- 172.21.15.125:0/3367791993 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c00bba0 con 0x7fde8006ee90 2023-10-06T03:05:43.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.682+0000 7fde870f8700 1 -- 172.21.15.125:0/3367791993 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde8006ee90 msgr2=0x7fde80155c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:43.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.682+0000 7fde870f8700 1 --2- 172.21.15.125:0/3367791993 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde8006ee90 0x7fde80155c80 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fde6c0098e0 tx=0x7fde6c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:43.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.682+0000 7fde870f8700 1 -- 172.21.15.125:0/3367791993 shutdown_connections 2023-10-06T03:05:43.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.682+0000 7fde870f8700 1 --2- 172.21.15.125:0/3367791993 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde8006ee90 0x7fde80155c80 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:43.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.682+0000 7fde870f8700 1 -- 172.21.15.125:0/3367791993 >> 172.21.15.125:0/3367791993 conn(0x7fde800c87b0 msgr2=0x7fde800c8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:43.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.682+0000 7fde870f8700 1 -- 172.21.15.125:0/3367791993 shutdown_connections 2023-10-06T03:05:43.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.682+0000 7fde870f8700 1 -- 172.21.15.125:0/3367791993 wait complete. 2023-10-06T03:05:43.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.683+0000 7fde870f8700 1 Processor -- start 2023-10-06T03:05:43.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.683+0000 7fde870f8700 1 -- start start 2023-10-06T03:05:43.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.684+0000 7fde870f8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde8006eac0 0x7fde8015ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:43.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.684+0000 7fde870f8700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde8006ee90 0x7fde801596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:43.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.684+0000 7fde870f8700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde800ae230 0x7fde8014de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:43.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.684+0000 7fde870f8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8014ef50 con 0x7fde8006eac0 2023-10-06T03:05:43.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.684+0000 7fde870f8700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde80159da0 con 0x7fde800ae230 2023-10-06T03:05:43.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.684+0000 7fde870f8700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde8015a080 con 0x7fde8006ee90 2023-10-06T03:05:43.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.684+0000 7fde84e94700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde8006eac0 0x7fde8015ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:43.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.684+0000 7fde84e94700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde8006eac0 0x7fde8015ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57956/0 (socket says 172.21.15.125:57956) 2023-10-06T03:05:43.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.684+0000 7fde84e94700 1 -- 172.21.15.125:0/3580673076 learned_addr learned my addr 172.21.15.125:0/3580673076 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:43.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.684+0000 7fde85695700 1 --2- 172.21.15.125:0/3580673076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde800ae230 0x7fde8014de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:43.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.684+0000 7fde84e94700 1 -- 172.21.15.125:0/3580673076 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde8006ee90 msgr2=0x7fde801596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:43.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.684+0000 7fde84e94700 1 --2- 172.21.15.125:0/3580673076 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde8006ee90 0x7fde801596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:43.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.684+0000 7fde84e94700 1 -- 172.21.15.125:0/3580673076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde800ae230 msgr2=0x7fde8014de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:43.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.684+0000 7fde84e94700 1 --2- 172.21.15.125:0/3580673076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde800ae230 0x7fde8014de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:43.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.684+0000 7fde84e94700 1 -- 172.21.15.125:0/3580673076 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6c009420 con 0x7fde8006eac0 2023-10-06T03:05:43.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.684+0000 7fde85695700 1 --2- 172.21.15.125:0/3580673076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde800ae230 0x7fde8014de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:43.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.684+0000 7fde84e94700 1 --2- 172.21.15.125:0/3580673076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde8006eac0 0x7fde8015ae40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fde7400b5e0 tx=0x7fde740090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:43.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.685+0000 7fde7cff9700 1 -- 172.21.15.125:0/3580673076 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7400f510 con 0x7fde8006eac0 2023-10-06T03:05:43.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.685+0000 7fde7cff9700 1 -- 172.21.15.125:0/3580673076 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7400f670 con 0x7fde8006eac0 2023-10-06T03:05:43.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.685+0000 7fde870f8700 1 -- 172.21.15.125:0/3580673076 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8015a360 con 0x7fde8006eac0 2023-10-06T03:05:43.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.685+0000 7fde7cff9700 1 -- 172.21.15.125:0/3580673076 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7400fa30 con 0x7fde8006eac0 2023-10-06T03:05:43.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.685+0000 7fde870f8700 1 -- 172.21.15.125:0/3580673076 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8015a920 con 0x7fde8006eac0 2023-10-06T03:05:43.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.686+0000 7fde870f8700 1 -- 172.21.15.125:0/3580673076 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8006d220 con 0x7fde8006eac0 2023-10-06T03:05:43.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.686+0000 7fde7cff9700 1 -- 172.21.15.125:0/3580673076 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde7401a400 con 0x7fde8006eac0 2023-10-06T03:05:43.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.686+0000 7fde7cff9700 1 --2- 172.21.15.125:0/3580673076 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fde64066f30 0x7fde640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:43.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.686+0000 7fde7cff9700 1 -- 172.21.15.125:0/3580673076 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fde74084270 con 0x7fde8006eac0 2023-10-06T03:05:43.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.686+0000 7fde7ffff700 1 --2- 172.21.15.125:0/3580673076 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fde64066f30 0x7fde640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:43.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.687+0000 7fde7ffff700 1 --2- 172.21.15.125:0/3580673076 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fde64066f30 0x7fde640693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fde8015b600 tx=0x7fde6c016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:43.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.691+0000 7fde7cff9700 1 -- 172.21.15.125:0/3580673076 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde74054d50 con 0x7fde8006eac0 2023-10-06T03:05:43.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:43.873+0000 7fde870f8700 1 -- 172.21.15.125:0/3580673076 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64} v 0) v1 -- 0x7fde80155a60 con 0x7fde8006eac0 2023-10-06T03:05:44.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.296+0000 7fde7cff9700 1 -- 172.21.15.125:0/3580673076 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "data_new", "pg_num_min": 64}]=0 pool 'data_new' created v42) v1 ==== 124+0+0 (secure 0 0 0) 0x7fde740548e0 con 0x7fde8006eac0 2023-10-06T03:05:44.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.300+0000 7fde870f8700 1 -- 172.21.15.125:0/3580673076 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fde64066f30 msgr2=0x7fde640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:44.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.300+0000 7fde870f8700 1 --2- 172.21.15.125:0/3580673076 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fde64066f30 0x7fde640693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fde8015b600 tx=0x7fde6c016000 comp rx=0 tx=0).stop 2023-10-06T03:05:44.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.300+0000 7fde870f8700 1 -- 172.21.15.125:0/3580673076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde8006eac0 msgr2=0x7fde8015ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:44.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.300+0000 7fde870f8700 1 --2- 172.21.15.125:0/3580673076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde8006eac0 0x7fde8015ae40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fde7400b5e0 tx=0x7fde740090f0 comp rx=0 tx=0).stop 2023-10-06T03:05:44.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.302+0000 7fde870f8700 1 -- 172.21.15.125:0/3580673076 shutdown_connections 2023-10-06T03:05:44.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.302+0000 7fde870f8700 1 --2- 172.21.15.125:0/3580673076 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fde64066f30 0x7fde640693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:44.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.302+0000 7fde870f8700 1 --2- 172.21.15.125:0/3580673076 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde800ae230 0x7fde8014de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:44.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.302+0000 7fde870f8700 1 --2- 172.21.15.125:0/3580673076 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fde8006eac0 0x7fde8015ae40 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:44.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.302+0000 7fde870f8700 1 --2- 172.21.15.125:0/3580673076 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fde8006ee90 0x7fde801596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:44.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.302+0000 7fde870f8700 1 -- 172.21.15.125:0/3580673076 >> 172.21.15.125:0/3580673076 conn(0x7fde800c87b0 msgr2=0x7fde80067610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:44.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.302+0000 7fde870f8700 1 -- 172.21.15.125:0/3580673076 shutdown_connections 2023-10-06T03:05:44.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.303+0000 7fde870f8700 1 -- 172.21.15.125:0/3580673076 wait complete. 2023-10-06T03:05:44.306 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'data_new' created 2023-10-06T03:05:44.317 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs data_new 2023-10-06T03:05:44.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.435+0000 7f488c8ba700 1 Processor -- start 2023-10-06T03:05:44.437 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.435+0000 7f488c8ba700 1 -- start start 2023-10-06T03:05:44.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.436+0000 7f488c8ba700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4888156de0 0x7f48881571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:44.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.436+0000 7f488c8ba700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f48880cd790 0x7f48880ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:44.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.436+0000 7f488c8ba700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48880cd300 con 0x7f48880cc060 2023-10-06T03:05:44.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.436+0000 7f488c8ba700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48880cc4e0 con 0x7f4888156de0 2023-10-06T03:05:44.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.436+0000 7f488c8ba700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48880cc6f0 con 0x7f48880cd790 2023-10-06T03:05:44.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.436+0000 7f488659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4888156de0 0x7f48881571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:44.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.436+0000 7f4885d9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f48880cc060 0x7f488815b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:35350/0 (socket says 172.21.15.125:35350) 2023-10-06T03:05:44.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.436+0000 7f4885d9b700 1 -- 172.21.15.125:0/1860418030 learned_addr learned my addr 172.21.15.125:0/1860418030 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:44.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.437+0000 7f488659c700 1 -- 172.21.15.125:0/1860418030 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f48880cd790 msgr2=0x7f48880ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:44.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.437+0000 7f4886d9d700 1 --2- 172.21.15.125:0/1860418030 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f48880cd790 0x7f48880ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:44.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.437+0000 7f488659c700 1 --2- 172.21.15.125:0/1860418030 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f48880cd790 0x7f48880ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:44.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.437+0000 7f488659c700 1 -- 172.21.15.125:0/1860418030 >> v1:172.21.15.125:6789/0 conn(0x7f48880cc060 legacy=0x7f488815b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:44.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.437+0000 7f488559a700 1 -- 172.21.15.125:0/1860418030 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689130642 0 0) 0x7f48880cd300 con 0x7f48880cc060 2023-10-06T03:05:44.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.437+0000 7f488659c700 1 -- 172.21.15.125:0/1860418030 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48880cc9d0 con 0x7f4888156de0 2023-10-06T03:05:44.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.437+0000 7f488659c700 1 --2- 172.21.15.125:0/1860418030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4888156de0 0x7f48881571b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f487c0098e0 tx=0x7f487c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fc3663f8bd37fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:44.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.437+0000 7f488559a700 1 -- 172.21.15.125:0/1860418030 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c009e80 con 0x7f4888156de0 2023-10-06T03:05:44.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.437+0000 7f488559a700 1 -- 172.21.15.125:0/1860418030 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487c00b860 con 0x7f4888156de0 2023-10-06T03:05:44.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.437+0000 7f488559a700 1 -- 172.21.15.125:0/1860418030 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c00bbe0 con 0x7f4888156de0 2023-10-06T03:05:44.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.438+0000 7f488c8ba700 1 -- 172.21.15.125:0/1860418030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4888156de0 msgr2=0x7f48881571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:44.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.438+0000 7f488c8ba700 1 --2- 172.21.15.125:0/1860418030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4888156de0 0x7f48881571b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f487c0098e0 tx=0x7f487c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:44.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.438+0000 7f488c8ba700 1 -- 172.21.15.125:0/1860418030 shutdown_connections 2023-10-06T03:05:44.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.438+0000 7f488c8ba700 1 --2- 172.21.15.125:0/1860418030 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f48880cd790 0x7f48880ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:44.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.438+0000 7f488c8ba700 1 --2- 172.21.15.125:0/1860418030 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4888156de0 0x7f48881571b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:44.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.438+0000 7f488c8ba700 1 -- 172.21.15.125:0/1860418030 >> 172.21.15.125:0/1860418030 conn(0x7f48880cdf80 msgr2=0x7f48880ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:44.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.438+0000 7f488c8ba700 1 -- 172.21.15.125:0/1860418030 shutdown_connections 2023-10-06T03:05:44.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.438+0000 7f488c8ba700 1 -- 172.21.15.125:0/1860418030 wait complete. 2023-10-06T03:05:44.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.439+0000 7f488c8ba700 1 Processor -- start 2023-10-06T03:05:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.439+0000 7f488c8ba700 1 -- start start 2023-10-06T03:05:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f488c8ba700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f48880cc060 0x7f48880afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f488c8ba700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48880cd790 0x7f4888069b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f488c8ba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4888156de0 0x7f48880c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f488c8ba700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48880b0230 con 0x7f4888156de0 2023-10-06T03:05:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f488c8ba700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48880aec50 con 0x7f48880cd790 2023-10-06T03:05:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f488c8ba700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48880aef30 con 0x7f48880cc060 2023-10-06T03:05:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f4886d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4888156de0 0x7f48880c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f4886d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4888156de0 0x7f48880c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:57966/0 (socket says 172.21.15.125:57966) 2023-10-06T03:05:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f4886d9d700 1 -- 172.21.15.125:0/2619916459 learned_addr learned my addr 172.21.15.125:0/2619916459 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:44.445 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f488659c700 1 --2- 172.21.15.125:0/2619916459 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f48880cc060 0x7f48880afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:44.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f4885d9b700 1 --2- 172.21.15.125:0/2619916459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48880cd790 0x7f4888069b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:44.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f4886d9d700 1 -- 172.21.15.125:0/2619916459 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f48880cc060 msgr2=0x7f48880afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:44.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f4886d9d700 1 --2- 172.21.15.125:0/2619916459 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f48880cc060 0x7f48880afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:44.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f4886d9d700 1 -- 172.21.15.125:0/2619916459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48880cd790 msgr2=0x7f4888069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:44.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f4886d9d700 1 --2- 172.21.15.125:0/2619916459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48880cd790 0x7f4888069b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:44.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f4886d9d700 1 -- 172.21.15.125:0/2619916459 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c009420 con 0x7f4888156de0 2023-10-06T03:05:44.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f488659c700 1 --2- 172.21.15.125:0/2619916459 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f48880cc060 0x7f48880afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:44.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f4885d9b700 1 --2- 172.21.15.125:0/2619916459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48880cd790 0x7f4888069b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:44.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f4886d9d700 1 --2- 172.21.15.125:0/2619916459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4888156de0 0x7f48880c6090 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f488000ceb0 tx=0x7f4880007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:44.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f48767fc700 1 -- 172.21.15.125:0/2619916459 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488000ae40 con 0x7f4888156de0 2023-10-06T03:05:44.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f48767fc700 1 -- 172.21.15.125:0/2619916459 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4880016430 con 0x7f4888156de0 2023-10-06T03:05:44.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f488c8ba700 1 -- 172.21.15.125:0/2619916459 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48880af210 con 0x7f4888156de0 2023-10-06T03:05:44.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f48767fc700 1 -- 172.21.15.125:0/2619916459 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48800167d0 con 0x7f4888156de0 2023-10-06T03:05:44.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.440+0000 7f488c8ba700 1 -- 172.21.15.125:0/2619916459 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48880af7d0 con 0x7f4888156de0 2023-10-06T03:05:44.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.441+0000 7f488c8ba700 1 -- 172.21.15.125:0/2619916459 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4888066510 con 0x7f4888156de0 2023-10-06T03:05:44.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.442+0000 7f48767fc700 1 -- 172.21.15.125:0/2619916459 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4880003020 con 0x7f4888156de0 2023-10-06T03:05:44.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.442+0000 7f48767fc700 1 --2- 172.21.15.125:0/2619916459 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4868066f30 0x7f48680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:44.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.442+0000 7f48767fc700 1 -- 172.21.15.125:0/2619916459 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6741+0+0 (secure 0 0 0) 0x7f4880012070 con 0x7f4888156de0 2023-10-06T03:05:44.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.442+0000 7f488659c700 1 --2- 172.21.15.125:0/2619916459 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4868066f30 0x7f48680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:44.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.443+0000 7f488659c700 1 --2- 172.21.15.125:0/2619916459 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4868066f30 0x7f48680693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f487c0091e0 tx=0x7f487c017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:44.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.447+0000 7f48767fc700 1 -- 172.21.15.125:0/2619916459 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4880056150 con 0x7f4888156de0 2023-10-06T03:05:44.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:44.672+0000 7f488c8ba700 1 -- 172.21.15.125:0/2619916459 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"} v 0) v1 -- 0x7f48880cccb0 con 0x7f4888156de0 2023-10-06T03:05:45.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.299+0000 7f48767fc700 1 -- 172.21.15.125:0/2619916459 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "data_new"}]=0 added data pool 8 to fsmap v19) v1 ==== 131+0+0 (secure 0 0 0) 0x7f4880055ce0 con 0x7f4888156de0 2023-10-06T03:05:45.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.303+0000 7f488c8ba700 1 -- 172.21.15.125:0/2619916459 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4868066f30 msgr2=0x7f48680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:45.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.303+0000 7f488c8ba700 1 --2- 172.21.15.125:0/2619916459 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4868066f30 0x7f48680693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f487c0091e0 tx=0x7f487c017000 comp rx=0 tx=0).stop 2023-10-06T03:05:45.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.303+0000 7f488c8ba700 1 -- 172.21.15.125:0/2619916459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4888156de0 msgr2=0x7f48880c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:45.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.303+0000 7f488c8ba700 1 --2- 172.21.15.125:0/2619916459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4888156de0 0x7f48880c6090 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f488000ceb0 tx=0x7f4880007870 comp rx=0 tx=0).stop 2023-10-06T03:05:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.305+0000 7f488c8ba700 1 -- 172.21.15.125:0/2619916459 shutdown_connections 2023-10-06T03:05:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.305+0000 7f488c8ba700 1 --2- 172.21.15.125:0/2619916459 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4868066f30 0x7f48680693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.305+0000 7f488c8ba700 1 --2- 172.21.15.125:0/2619916459 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4888156de0 0x7f48880c6090 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.305+0000 7f488c8ba700 1 --2- 172.21.15.125:0/2619916459 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f48880cc060 0x7f48880afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.305+0000 7f488c8ba700 1 --2- 172.21.15.125:0/2619916459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48880cd790 0x7f4888069b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.305+0000 7f488c8ba700 1 -- 172.21.15.125:0/2619916459 >> 172.21.15.125:0/2619916459 conn(0x7f48880cdf80 msgr2=0x7f488806c240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:45.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.306+0000 7f488c8ba700 1 -- 172.21.15.125:0/2619916459 shutdown_connections 2023-10-06T03:05:45.310 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.306+0000 7f488c8ba700 1 -- 172.21.15.125:0/2619916459 wait complete. 2023-10-06T03:05:45.317 INFO:teuthology.orchestra.run.smithi125.stderr:added data pool 8 to fsmap 2023-10-06T03:05:45.327 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:05:45.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.446+0000 7f83a937a700 1 Processor -- start 2023-10-06T03:05:45.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.446+0000 7f83a937a700 1 -- start start 2023-10-06T03:05:45.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.447+0000 7f83a937a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83a406e6b0 0x7f83a40c7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:45.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.447+0000 7f83a937a700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f83a40c79a0 0x7f83a40ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:45.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.447+0000 7f83a937a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a40c80b0 con 0x7f83a41555d0 2023-10-06T03:05:45.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.447+0000 7f83a937a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a40c6d00 con 0x7f83a406e6b0 2023-10-06T03:05:45.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.447+0000 7f83a937a700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a40c7190 con 0x7f83a40c79a0 2023-10-06T03:05:45.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.447+0000 7f83a27fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f83a406e6b0 0x7f83a40c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:45.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.447+0000 7f83a2ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f83a41555d0 0x7f83a406dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46858/0 (socket says 172.21.15.125:46858) 2023-10-06T03:05:45.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.447+0000 7f83a2ffd700 1 -- 172.21.15.125:0/3241089516 learned_addr learned my addr 172.21.15.125:0/3241089516 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:45.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.447+0000 7f83a37fe700 1 --2- 172.21.15.125:0/3241089516 >> v2:172.21.15.130:3300/0 conn(0x7f83a40c79a0 0x7f83a40ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:45.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.447+0000 7f83a27fc700 1 -- 172.21.15.125:0/3241089516 >> v2:172.21.15.130:3300/0 conn(0x7f83a40c79a0 msgr2=0x7f83a40ac5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:45.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.447+0000 7f83a27fc700 1 --2- 172.21.15.125:0/3241089516 >> v2:172.21.15.130:3300/0 conn(0x7f83a40c79a0 0x7f83a40ac5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:45.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.447+0000 7f83a27fc700 1 -- 172.21.15.125:0/3241089516 >> v1:172.21.15.125:6789/0 conn(0x7f83a41555d0 legacy=0x7f83a406dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:45.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.447+0000 7f83a27fc700 1 -- 172.21.15.125:0/3241089516 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a40c63d0 con 0x7f83a406e6b0 2023-10-06T03:05:45.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.447+0000 7f83a1ffb700 1 -- 172.21.15.125:0/3241089516 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999342505 0 0) 0x7f83a40c80b0 con 0x7f83a41555d0 2023-10-06T03:05:45.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.447+0000 7f83a27fc700 1 --2- 172.21.15.125:0/3241089516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83a406e6b0 0x7f83a40c7460 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f83a4068160 tx=0x7f839400a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ca44c2f5aa12a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:45.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.447+0000 7f83a1ffb700 1 -- 172.21.15.125:0/3241089516 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839400c970 con 0x7f83a406e6b0 2023-10-06T03:05:45.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.448+0000 7f83a1ffb700 1 -- 172.21.15.125:0/3241089516 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839400cad0 con 0x7f83a406e6b0 2023-10-06T03:05:45.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.448+0000 7f83a1ffb700 1 -- 172.21.15.125:0/3241089516 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839400ce70 con 0x7f83a406e6b0 2023-10-06T03:05:45.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.448+0000 7f83a937a700 1 -- 172.21.15.125:0/3241089516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83a406e6b0 msgr2=0x7f83a40c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:45.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.448+0000 7f83a937a700 1 --2- 172.21.15.125:0/3241089516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83a406e6b0 0x7f83a40c7460 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f83a4068160 tx=0x7f839400a330 comp rx=0 tx=0).stop 2023-10-06T03:05:45.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.448+0000 7f83a937a700 1 -- 172.21.15.125:0/3241089516 shutdown_connections 2023-10-06T03:05:45.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.448+0000 7f83a937a700 1 --2- 172.21.15.125:0/3241089516 >> v2:172.21.15.130:3300/0 conn(0x7f83a40c79a0 0x7f83a40ac5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:45.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.448+0000 7f83a937a700 1 --2- 172.21.15.125:0/3241089516 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83a406e6b0 0x7f83a40c7460 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:45.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.448+0000 7f83a937a700 1 -- 172.21.15.125:0/3241089516 >> 172.21.15.125:0/3241089516 conn(0x7f83a40cbd00 msgr2=0x7f83a40cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:45.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.448+0000 7f83a937a700 1 -- 172.21.15.125:0/3241089516 shutdown_connections 2023-10-06T03:05:45.452 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.448+0000 7f83a937a700 1 -- 172.21.15.125:0/3241089516 wait complete. 2023-10-06T03:05:45.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.449+0000 7f83a937a700 1 Processor -- start 2023-10-06T03:05:45.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.449+0000 7f83a937a700 1 -- start start 2023-10-06T03:05:45.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.450+0000 7f83a937a700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83a406e6b0 0x7f83a414f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:45.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.450+0000 7f83a937a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83a40c79a0 0x7f83a4152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:45.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.450+0000 7f83a937a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83a41555d0 0x7f83a41531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:45.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.450+0000 7f83a937a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a40c5660 con 0x7f83a41555d0 2023-10-06T03:05:45.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.450+0000 7f83a937a700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a40afe90 con 0x7f83a406e6b0 2023-10-06T03:05:45.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.450+0000 7f83a937a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a414f560 con 0x7f83a40c79a0 2023-10-06T03:05:45.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.450+0000 7f83a37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83a41555d0 0x7f83a41531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:45.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.450+0000 7f83a37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83a41555d0 0x7f83a41531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39024/0 (socket says 172.21.15.125:39024) 2023-10-06T03:05:45.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.450+0000 7f83a37fe700 1 -- 172.21.15.125:0/3149268379 learned_addr learned my addr 172.21.15.125:0/3149268379 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:45.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.450+0000 7f83a2ffd700 1 --2- 172.21.15.125:0/3149268379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83a406e6b0 0x7f83a414f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:45.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.450+0000 7f83a27fc700 1 --2- 172.21.15.125:0/3149268379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83a40c79a0 0x7f83a4152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:45.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.450+0000 7f83a37fe700 1 -- 172.21.15.125:0/3149268379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83a40c79a0 msgr2=0x7f83a4152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:45.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.450+0000 7f83a37fe700 1 --2- 172.21.15.125:0/3149268379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83a40c79a0 0x7f83a4152c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:45.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.450+0000 7f83a37fe700 1 -- 172.21.15.125:0/3149268379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83a406e6b0 msgr2=0x7f83a414f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:45.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.450+0000 7f83a37fe700 1 --2- 172.21.15.125:0/3149268379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83a406e6b0 0x7f83a414f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:45.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.450+0000 7f83a37fe700 1 -- 172.21.15.125:0/3149268379 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839400a5d0 con 0x7f83a41555d0 2023-10-06T03:05:45.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.450+0000 7f83a2ffd700 1 --2- 172.21.15.125:0/3149268379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83a406e6b0 0x7f83a414f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:45.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.451+0000 7f83a37fe700 1 --2- 172.21.15.125:0/3149268379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83a41555d0 0x7f83a41531b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f839c009fa0 tx=0x7f839c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:45.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.451+0000 7f838affd700 1 -- 172.21.15.125:0/3149268379 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c00ed20 con 0x7f83a41555d0 2023-10-06T03:05:45.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.451+0000 7f838affd700 1 -- 172.21.15.125:0/3149268379 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839c00ee80 con 0x7f83a41555d0 2023-10-06T03:05:45.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.451+0000 7f83a937a700 1 -- 172.21.15.125:0/3149268379 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a40c5e50 con 0x7f83a41555d0 2023-10-06T03:05:45.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.451+0000 7f838affd700 1 -- 172.21.15.125:0/3149268379 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c014670 con 0x7f83a41555d0 2023-10-06T03:05:45.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.451+0000 7f83a937a700 1 -- 172.21.15.125:0/3149268379 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a40c5b70 con 0x7f83a41555d0 2023-10-06T03:05:45.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.452+0000 7f83a937a700 1 -- 172.21.15.125:0/3149268379 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a40b0000 con 0x7f83a41555d0 2023-10-06T03:05:45.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.452+0000 7f838affd700 1 -- 172.21.15.125:0/3149268379 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f839c014a20 con 0x7f83a41555d0 2023-10-06T03:05:45.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.452+0000 7f838affd700 1 --2- 172.21.15.125:0/3149268379 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f8390066f30 0x7f83900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:45.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.452+0000 7f838affd700 1 -- 172.21.15.125:0/3149268379 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f839c0850c0 con 0x7f83a41555d0 2023-10-06T03:05:45.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.452+0000 7f83a2ffd700 1 --2- 172.21.15.125:0/3149268379 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f8390066f30 0x7f83900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:45.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.453+0000 7f83a2ffd700 1 --2- 172.21.15.125:0/3149268379 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f8390066f30 0x7f83900693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8398001810 tx=0x7f8398009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:45.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.457+0000 7f838affd700 1 -- 172.21.15.125:0/3149268379 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f839c051f00 con 0x7f83a41555d0 2023-10-06T03:05:45.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.679+0000 7f83a937a700 1 -- 172.21.15.125:0/3149268379 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83a4066510 con 0x7f83a41555d0 2023-10-06T03:05:45.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.680+0000 7f838affd700 1 -- 172.21.15.125:0/3149268379 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f839c055520 con 0x7f83a41555d0 2023-10-06T03:05:45.681 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:45.681 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3042542444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3042542444},{"type":"v1","addr":"172.21.15.130:6835","nonce":3042542444}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2110429483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2110429483},{"type":"v1","addr":"172.21.15.130:6833","nonce":2110429483}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/1710838785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1710838785},{"type":"v1","addr":"172.21.15.125:6836","nonce":1710838785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:05:30.346007+0000","modified":"2023-10-06T03:05:45.295717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5085":{"gid":5085,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.125:6837/4027450913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":4027450913},{"type":"v1","addr":"172.21.15.125:6837","nonce":4027450913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7,8],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:05:45.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.682+0000 7f83a937a700 1 -- 172.21.15.125:0/3149268379 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f8390066f30 msgr2=0x7f83900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:45.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.682+0000 7f83a937a700 1 --2- 172.21.15.125:0/3149268379 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f8390066f30 0x7f83900693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8398001810 tx=0x7f8398009040 comp rx=0 tx=0).stop 2023-10-06T03:05:45.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.682+0000 7f83a937a700 1 -- 172.21.15.125:0/3149268379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83a41555d0 msgr2=0x7f83a41531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:45.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.682+0000 7f83a937a700 1 --2- 172.21.15.125:0/3149268379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83a41555d0 0x7f83a41531b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f839c009fa0 tx=0x7f839c009900 comp rx=0 tx=0).stop 2023-10-06T03:05:45.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.682+0000 7f83a937a700 1 -- 172.21.15.125:0/3149268379 shutdown_connections 2023-10-06T03:05:45.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.682+0000 7f83a937a700 1 --2- 172.21.15.125:0/3149268379 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f8390066f30 0x7f83900693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:45.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.682+0000 7f83a937a700 1 --2- 172.21.15.125:0/3149268379 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83a41555d0 0x7f83a41531b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:45.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.682+0000 7f83a937a700 1 --2- 172.21.15.125:0/3149268379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83a406e6b0 0x7f83a414f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:45.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.682+0000 7f83a937a700 1 --2- 172.21.15.125:0/3149268379 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83a40c79a0 0x7f83a4152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:45.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.682+0000 7f83a937a700 1 -- 172.21.15.125:0/3149268379 >> 172.21.15.125:0/3149268379 conn(0x7f83a40cbd00 msgr2=0x7f83a40ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:45.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.682+0000 7f83a937a700 1 -- 172.21.15.125:0/3149268379 shutdown_connections 2023-10-06T03:05:45.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.682+0000 7f83a937a700 1 -- 172.21.15.125:0/3149268379 wait complete. 2023-10-06T03:05:45.685 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 19 2023-10-06T03:05:45.695 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:05:45.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.810+0000 7fb117fef700 1 Processor -- start 2023-10-06T03:05:45.812 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.811+0000 7fb117fef700 1 -- start start 2023-10-06T03:05:45.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb117fef700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1101590d0 0x7fb11006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:45.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb117fef700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb110067c70 con 0x7fb1100ac670 2023-10-06T03:05:45.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb117fef700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1100c77e0 con 0x7fb1101594a0 2023-10-06T03:05:45.815 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb117fef700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100c7ac0 con 0x7fb1101590d0 2023-10-06T03:05:45.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb11558a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb1100ac670 0x7fb1100c6b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46860/0 (socket says 172.21.15.125:46860) 2023-10-06T03:05:45.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb11558a700 1 -- 172.21.15.125:0/4208285050 learned_addr learned my addr 172.21.15.125:0/4208285050 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:45.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb115d8b700 1 --2- 172.21.15.125:0/4208285050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1101590d0 0x7fb11006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:45.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb114d89700 1 -- 172.21.15.125:0/4208285050 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809206871 0 0) 0x7fb110067c70 con 0x7fb1100ac670 2023-10-06T03:05:45.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb114d89700 1 -- 172.21.15.125:0/4208285050 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0fc003570 con 0x7fb1100ac670 2023-10-06T03:05:45.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb114d89700 1 -- 172.21.15.125:0/4208285050 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3337381578 0 0) 0x7fb0fc003570 con 0x7fb1100ac670 2023-10-06T03:05:45.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb114d89700 1 -- 172.21.15.125:0/4208285050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1101590d0 msgr2=0x7fb11006a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:45.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb114d89700 1 --2- 172.21.15.125:0/4208285050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1101590d0 0x7fb11006a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:45.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb114d89700 1 -- 172.21.15.125:0/4208285050 >> v1:172.21.15.130:6789/0 conn(0x7fb1101594a0 legacy=0x7fb110068100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:45.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb114d89700 1 -- 172.21.15.125:0/4208285050 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1100c7da0 con 0x7fb1100ac670 2023-10-06T03:05:45.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb114d89700 1 -- 172.21.15.125:0/4208285050 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7fb10c001470 con 0x7fb1100ac670 2023-10-06T03:05:45.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb114d89700 1 -- 172.21.15.125:0/4208285050 >> v1:172.21.15.125:6789/0 conn(0x7fb1100ac670 legacy=0x7fb1100c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:45.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb114d89700 1 --2- 172.21.15.125:0/4208285050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1101590d0 0x7fb0fc003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:45.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb114d89700 1 --2- 172.21.15.125:0/4208285050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0fc003fd0 0x7fb0fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:45.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb114d89700 1 --2- 172.21.15.125:0/4208285050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0fc004d50 0x7fb0fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:45.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb114d89700 1 -- 172.21.15.125:0/4208285050 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100c7ac0 con 0x7fb0fc003fd0 2023-10-06T03:05:45.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb114d89700 1 -- 172.21.15.125:0/4208285050 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc00bb40 con 0x7fb0fc004d50 2023-10-06T03:05:45.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb114d89700 1 -- 172.21.15.125:0/4208285050 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc00bd00 con 0x7fb1101590d0 2023-10-06T03:05:45.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb11558a700 1 --2- 172.21.15.125:0/4208285050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0fc003fd0 0x7fb0fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:45.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.812+0000 7fb115d8b700 1 --2- 172.21.15.125:0/4208285050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1101590d0 0x7fb0fc003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:45.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.813+0000 7fb11658c700 1 --2- 172.21.15.125:0/4208285050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0fc004d50 0x7fb0fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:45.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.813+0000 7fb11558a700 1 -- 172.21.15.125:0/4208285050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1101590d0 msgr2=0x7fb0fc003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:45.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.813+0000 7fb11558a700 1 --2- 172.21.15.125:0/4208285050 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1101590d0 0x7fb0fc003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:45.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.813+0000 7fb11558a700 1 -- 172.21.15.125:0/4208285050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0fc004d50 msgr2=0x7fb0fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:45.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.813+0000 7fb11558a700 1 --2- 172.21.15.125:0/4208285050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0fc004d50 0x7fb0fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:45.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.813+0000 7fb11558a700 1 -- 172.21.15.125:0/4208285050 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc003570 con 0x7fb0fc003fd0 2023-10-06T03:05:45.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.813+0000 7fb11558a700 1 --2- 172.21.15.125:0/4208285050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0fc003fd0 0x7fb0fc004810 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00c390 tx=0x7fb110067be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed47f7c1ea99a99b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:45.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.813+0000 7fb114d89700 1 -- 172.21.15.125:0/4208285050 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c00cc60 con 0x7fb0fc003fd0 2023-10-06T03:05:45.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.813+0000 7fb114d89700 1 -- 172.21.15.125:0/4208285050 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c00ce00 con 0x7fb0fc003fd0 2023-10-06T03:05:45.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.813+0000 7fb114d89700 1 -- 172.21.15.125:0/4208285050 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c005b70 con 0x7fb0fc003fd0 2023-10-06T03:05:45.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.813+0000 7fb117fef700 1 -- 172.21.15.125:0/4208285050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0fc003fd0 msgr2=0x7fb0fc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:45.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.813+0000 7fb117fef700 1 --2- 172.21.15.125:0/4208285050 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb0fc003fd0 0x7fb0fc004810 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb10c00c390 tx=0x7fb110067be0 comp rx=0 tx=0).stop 2023-10-06T03:05:45.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.814+0000 7fb11658c700 1 -- 172.21.15.125:0/4208285050 reap_dead start 2023-10-06T03:05:45.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.814+0000 7fb117fef700 1 -- 172.21.15.125:0/4208285050 shutdown_connections 2023-10-06T03:05:45.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.814+0000 7fb117fef700 1 -- 172.21.15.125:0/4208285050 >> 172.21.15.125:0/4208285050 conn(0x7fb1100cc5a0 msgr2=0x7fb1100cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:45.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.814+0000 7fb117fef700 1 -- 172.21.15.125:0/4208285050 shutdown_connections 2023-10-06T03:05:45.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.814+0000 7fb117fef700 1 -- 172.21.15.125:0/4208285050 wait complete. 2023-10-06T03:05:45.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.815+0000 7fb117fef700 1 Processor -- start 2023-10-06T03:05:45.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.815+0000 7fb117fef700 1 -- start start 2023-10-06T03:05:45.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.815+0000 7fb117fef700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0fc003fd0 0x7fb1100b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:45.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.815+0000 7fb117fef700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1100b01a0 0x7fb110157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:45.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.815+0000 7fb117fef700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb110158080 0x7fb11016a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:45.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.815+0000 7fb117fef700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1101506d0 con 0x7fb1100b01a0 2023-10-06T03:05:45.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.815+0000 7fb117fef700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1101576b0 con 0x7fb0fc003fd0 2023-10-06T03:05:45.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.815+0000 7fb117fef700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb110156aa0 con 0x7fb110158080 2023-10-06T03:05:45.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.816+0000 7fb11558a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1100b01a0 0x7fb110157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:45.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.816+0000 7fb11558a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1100b01a0 0x7fb110157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39036/0 (socket says 172.21.15.125:39036) 2023-10-06T03:05:45.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.816+0000 7fb11558a700 1 -- 172.21.15.125:0/8818353 learned_addr learned my addr 172.21.15.125:0/8818353 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:45.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.816+0000 7fb11658c700 1 --2- 172.21.15.125:0/8818353 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb110158080 0x7fb11016a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:45.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.816+0000 7fb115d8b700 1 --2- 172.21.15.125:0/8818353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0fc003fd0 0x7fb1100b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:45.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.816+0000 7fb11558a700 1 -- 172.21.15.125:0/8818353 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb110158080 msgr2=0x7fb11016a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:45.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.816+0000 7fb11558a700 1 --2- 172.21.15.125:0/8818353 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb110158080 0x7fb11016a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:45.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.816+0000 7fb11558a700 1 -- 172.21.15.125:0/8818353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0fc003fd0 msgr2=0x7fb1100b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:45.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.816+0000 7fb11558a700 1 --2- 172.21.15.125:0/8818353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0fc003fd0 0x7fb1100b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:45.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.816+0000 7fb11558a700 1 -- 172.21.15.125:0/8818353 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb110156d80 con 0x7fb1100b01a0 2023-10-06T03:05:45.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.816+0000 7fb11658c700 1 --2- 172.21.15.125:0/8818353 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb110158080 0x7fb11016a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:45.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.816+0000 7fb115d8b700 1 --2- 172.21.15.125:0/8818353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0fc003fd0 0x7fb1100b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:45.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.816+0000 7fb11558a700 1 --2- 172.21.15.125:0/8818353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1100b01a0 0x7fb110157b40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00bb10 tx=0x7fb10c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:45.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.816+0000 7fb105ffb700 1 -- 172.21.15.125:0/8818353 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c00cc60 con 0x7fb1100b01a0 2023-10-06T03:05:45.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.816+0000 7fb105ffb700 1 -- 172.21.15.125:0/8818353 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c0072e0 con 0x7fb1100b01a0 2023-10-06T03:05:45.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.816+0000 7fb117fef700 1 -- 172.21.15.125:0/8818353 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb110157060 con 0x7fb1100b01a0 2023-10-06T03:05:45.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.816+0000 7fb105ffb700 1 -- 172.21.15.125:0/8818353 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c0076a0 con 0x7fb1100b01a0 2023-10-06T03:05:45.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.816+0000 7fb117fef700 1 -- 172.21.15.125:0/8818353 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1100b0610 con 0x7fb1100b01a0 2023-10-06T03:05:45.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.817+0000 7fb117fef700 1 -- 172.21.15.125:0/8818353 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb110066510 con 0x7fb1100b01a0 2023-10-06T03:05:45.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.818+0000 7fb105ffb700 1 -- 172.21.15.125:0/8818353 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb10c019070 con 0x7fb1100b01a0 2023-10-06T03:05:45.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.819+0000 7fb105ffb700 1 --2- 172.21.15.125:0/8818353 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb0f4066f30 0x7fb0f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:45.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.819+0000 7fb115d8b700 1 --2- 172.21.15.125:0/8818353 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb0f4066f30 0x7fb0f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:45.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.819+0000 7fb105ffb700 1 -- 172.21.15.125:0/8818353 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7fb10c086140 con 0x7fb1100b01a0 2023-10-06T03:05:45.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.819+0000 7fb115d8b700 1 --2- 172.21.15.125:0/8818353 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb0f4066f30 0x7fb0f40693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb1000093f0 tx=0x7fb100008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:45.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:45.822+0000 7fb105ffb700 1 -- 172.21.15.125:0/8818353 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb10c052f60 con 0x7fb1100b01a0 2023-10-06T03:05:46.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.009+0000 7fb117fef700 1 -- 172.21.15.125:0/8818353 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb110068530 con 0x7fb1100b01a0 2023-10-06T03:05:46.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.010+0000 7fb105ffb700 1 -- 172.21.15.125:0/8818353 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18787 (secure 0 0 0) 0x7fb10c056580 con 0x7fb1100b01a0 2023-10-06T03:05:46.011 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:05:46.011 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":43,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:05:44.673577+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:05:28.440579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T03:05:29.311703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":8,"pool_name":"data_new","create_time":"2023-10-06T03:05:43.892252+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:05:46.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.012+0000 7fb117fef700 1 -- 172.21.15.125:0/8818353 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb0f4066f30 msgr2=0x7fb0f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:46.013 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.012+0000 7fb117fef700 1 --2- 172.21.15.125:0/8818353 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb0f4066f30 0x7fb0f40693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb1000093f0 tx=0x7fb100008040 comp rx=0 tx=0).stop 2023-10-06T03:05:46.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.012+0000 7fb117fef700 1 -- 172.21.15.125:0/8818353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1100b01a0 msgr2=0x7fb110157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:46.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.012+0000 7fb117fef700 1 --2- 172.21.15.125:0/8818353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1100b01a0 0x7fb110157b40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00bb10 tx=0x7fb10c015000 comp rx=0 tx=0).stop 2023-10-06T03:05:46.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.012+0000 7fb117fef700 1 -- 172.21.15.125:0/8818353 shutdown_connections 2023-10-06T03:05:46.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.012+0000 7fb117fef700 1 --2- 172.21.15.125:0/8818353 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb0f4066f30 0x7fb0f40693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:46.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.012+0000 7fb117fef700 1 --2- 172.21.15.125:0/8818353 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb110158080 0x7fb11016a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:46.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.012+0000 7fb117fef700 1 --2- 172.21.15.125:0/8818353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb0fc003fd0 0x7fb1100b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:46.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.012+0000 7fb117fef700 1 --2- 172.21.15.125:0/8818353 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1100b01a0 0x7fb110157b40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:46.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.012+0000 7fb117fef700 1 -- 172.21.15.125:0/8818353 >> 172.21.15.125:0/8818353 conn(0x7fb1100cc5a0 msgr2=0x7fb110152500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:46.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.012+0000 7fb117fef700 1 -- 172.21.15.125:0/8818353 shutdown_connections 2023-10-06T03:05:46.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.012+0000 7fb117fef700 1 -- 172.21.15.125:0/8818353 wait complete. 2023-10-06T03:05:46.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:46.025 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch layoutfile) 2023-10-06T03:05:46.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:46.049 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir layoutdir) 2023-10-06T03:05:46.109 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rw' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2023-10-06T03:05:46.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.271+0000 7f5be9b50700 1 Processor -- start 2023-10-06T03:05:46.273 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.271+0000 7f5be9b50700 1 -- start start 2023-10-06T03:05:46.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.272+0000 7f5be9b50700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be4156270 0x7f5be4156640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:46.275 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.272+0000 7f5be9b50700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5be40b0240 0x7f5be40c1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:46.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.272+0000 7f5be9b50700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be4068710 con 0x7f5be40c1b50 2023-10-06T03:05:46.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.272+0000 7f5be9b50700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be40c7350 con 0x7f5be40b0240 2023-10-06T03:05:46.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.272+0000 7f5be9b50700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be4068150 con 0x7f5be4156270 2023-10-06T03:05:46.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.272+0000 7f5be2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5be40b0240 0x7f5be40c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:46.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.272+0000 7f5be2ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5be40b0240 0x7f5be40c1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39038/0 (socket says 172.21.15.125:39038) 2023-10-06T03:05:46.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.272+0000 7f5be2ffd700 1 -- 172.21.15.125:0/171494164 learned_addr learned my addr 172.21.15.125:0/171494164 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:46.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.273+0000 7f5be37fe700 1 --2- 172.21.15.125:0/171494164 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be4156270 0x7f5be4156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:46.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.273+0000 7f5be2ffd700 1 -- 172.21.15.125:0/171494164 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be4156270 msgr2=0x7f5be4156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:46.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.273+0000 7f5be2ffd700 1 --2- 172.21.15.125:0/171494164 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be4156270 0x7f5be4156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:46.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.273+0000 7f5be2ffd700 1 -- 172.21.15.125:0/171494164 >> v1:172.21.15.130:6789/0 conn(0x7f5be40c1b50 legacy=0x7f5be40c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:46.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.273+0000 7f5be2ffd700 1 -- 172.21.15.125:0/171494164 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be4068430 con 0x7f5be40b0240 2023-10-06T03:05:46.276 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.273+0000 7f5be37fe700 1 --2- 172.21.15.125:0/171494164 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be4156270 0x7f5be4156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.273+0000 7f5be2ffd700 1 --2- 172.21.15.125:0/171494164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5be40b0240 0x7f5be40c1610 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80099b0 tx=0x7f5bd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25aaec94da790a5c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.273+0000 7f5be27fc700 1 -- 172.21.15.125:0/171494164 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800b820 con 0x7f5be40b0240 2023-10-06T03:05:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.273+0000 7f5be27fc700 1 -- 172.21.15.125:0/171494164 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd800b980 con 0x7f5be40b0240 2023-10-06T03:05:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.273+0000 7f5be27fc700 1 -- 172.21.15.125:0/171494164 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd800bd20 con 0x7f5be40b0240 2023-10-06T03:05:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.273+0000 7f5be9b50700 1 -- 172.21.15.125:0/171494164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5be40b0240 msgr2=0x7f5be40c1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.274+0000 7f5be9b50700 1 --2- 172.21.15.125:0/171494164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5be40b0240 0x7f5be40c1610 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80099b0 tx=0x7f5bd8009250 comp rx=0 tx=0).stop 2023-10-06T03:05:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.274+0000 7f5be9b50700 1 -- 172.21.15.125:0/171494164 shutdown_connections 2023-10-06T03:05:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.274+0000 7f5be9b50700 1 --2- 172.21.15.125:0/171494164 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be4156270 0x7f5be4156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.274+0000 7f5be9b50700 1 --2- 172.21.15.125:0/171494164 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5be40b0240 0x7f5be40c1610 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.274+0000 7f5be9b50700 1 -- 172.21.15.125:0/171494164 >> 172.21.15.125:0/171494164 conn(0x7f5be40af730 msgr2=0x7f5be40afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:46.277 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.274+0000 7f5be9b50700 1 -- 172.21.15.125:0/171494164 shutdown_connections 2023-10-06T03:05:46.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.274+0000 7f5be9b50700 1 -- 172.21.15.125:0/171494164 wait complete. 2023-10-06T03:05:46.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.275+0000 7f5be9b50700 1 Processor -- start 2023-10-06T03:05:46.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.275+0000 7f5be9b50700 1 -- start start 2023-10-06T03:05:46.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5be9b50700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5be40b0240 0x7f5be40c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5be9b50700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5be40c1b50 0x7f5be41414f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5be9b50700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be4156270 0x7f5be40cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5be9b50700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40c5380 con 0x7f5be40b0240 2023-10-06T03:05:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5be9b50700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40c4770 con 0x7f5be40c1b50 2023-10-06T03:05:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5be9b50700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40c4a50 con 0x7f5be4156270 2023-10-06T03:05:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5be37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5be40b0240 0x7f5be40c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5be37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5be40b0240 0x7f5be40c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39044/0 (socket says 172.21.15.125:39044) 2023-10-06T03:05:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5be37fe700 1 -- 172.21.15.125:0/4125434228 learned_addr learned my addr 172.21.15.125:0/4125434228 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5be2ffd700 1 --2- 172.21.15.125:0/4125434228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5be40c1b50 0x7f5be41414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5be3fff700 1 --2- 172.21.15.125:0/4125434228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be4156270 0x7f5be40cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5be37fe700 1 -- 172.21.15.125:0/4125434228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be4156270 msgr2=0x7f5be40cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:46.281 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5be37fe700 1 --2- 172.21.15.125:0/4125434228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be4156270 0x7f5be40cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5be37fe700 1 -- 172.21.15.125:0/4125434228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5be40c1b50 msgr2=0x7f5be41414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5be37fe700 1 --2- 172.21.15.125:0/4125434228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5be40c1b50 0x7f5be41414f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5be37fe700 1 -- 172.21.15.125:0/4125434228 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd80094f0 con 0x7f5be40b0240 2023-10-06T03:05:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5be37fe700 1 --2- 172.21.15.125:0/4125434228 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5be40b0240 0x7f5be40c5810 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400c880 tx=0x7f5bd4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5bcb7fe700 1 -- 172.21.15.125:0/4125434228 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4005a00 con 0x7f5be40b0240 2023-10-06T03:05:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5bcb7fe700 1 -- 172.21.15.125:0/4125434228 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd4005b60 con 0x7f5be40b0240 2023-10-06T03:05:46.282 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5be9b50700 1 -- 172.21.15.125:0/4125434228 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be40c4d30 con 0x7f5be40b0240 2023-10-06T03:05:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5bcb7fe700 1 -- 172.21.15.125:0/4125434228 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd4011600 con 0x7f5be40b0240 2023-10-06T03:05:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.276+0000 7f5be9b50700 1 -- 172.21.15.125:0/4125434228 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be40c5d50 con 0x7f5be40b0240 2023-10-06T03:05:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.277+0000 7f5be9b50700 1 -- 172.21.15.125:0/4125434228 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be40c5660 con 0x7f5be40b0240 2023-10-06T03:05:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.278+0000 7f5bcb7fe700 1 -- 172.21.15.125:0/4125434228 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5bd40119f0 con 0x7f5be40b0240 2023-10-06T03:05:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.278+0000 7f5bcb7fe700 1 --2- 172.21.15.125:0/4125434228 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5bd0066f30 0x7f5bd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.278+0000 7f5bcb7fe700 1 -- 172.21.15.125:0/4125434228 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f5bd4084640 con 0x7f5be40b0240 2023-10-06T03:05:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.278+0000 7f5be2ffd700 1 --2- 172.21.15.125:0/4125434228 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5bd0066f30 0x7f5bd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.278+0000 7f5be2ffd700 1 --2- 172.21.15.125:0/4125434228 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5bd0066f30 0x7f5bd00693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80099b0 tx=0x7f5bd8016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:46.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.282+0000 7f5bcb7fe700 1 -- 172.21.15.125:0/4125434228 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5bd4051480 con 0x7f5be40b0240 2023-10-06T03:05:46.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.546+0000 7f5be9b50700 1 -- 172.21.15.125:0/4125434228 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7f5be4066510 con 0x7f5be40b0240 2023-10-06T03:05:46.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.549+0000 7f5bcb7fe700 1 -- 172.21.15.125:0/4125434228 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rw", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v16) v1 ==== 210+0+0 (secure 0 0 0) 0x7f5bd4054aa0 con 0x7f5be40b0240 2023-10-06T03:05:46.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.551+0000 7f5be9b50700 1 -- 172.21.15.125:0/4125434228 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5bd0066f30 msgr2=0x7f5bd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:46.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.551+0000 7f5be9b50700 1 --2- 172.21.15.125:0/4125434228 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5bd0066f30 0x7f5bd00693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80099b0 tx=0x7f5bd8016000 comp rx=0 tx=0).stop 2023-10-06T03:05:46.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.551+0000 7f5be9b50700 1 -- 172.21.15.125:0/4125434228 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5be40b0240 msgr2=0x7f5be40c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:46.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.551+0000 7f5be9b50700 1 --2- 172.21.15.125:0/4125434228 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5be40b0240 0x7f5be40c5810 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5bd400c880 tx=0x7f5bd4008040 comp rx=0 tx=0).stop 2023-10-06T03:05:46.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.552+0000 7f5be9b50700 1 -- 172.21.15.125:0/4125434228 shutdown_connections 2023-10-06T03:05:46.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.552+0000 7f5be9b50700 1 --2- 172.21.15.125:0/4125434228 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5bd0066f30 0x7f5bd00693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:46.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.552+0000 7f5be9b50700 1 --2- 172.21.15.125:0/4125434228 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5be4156270 0x7f5be40cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:46.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.552+0000 7f5be9b50700 1 --2- 172.21.15.125:0/4125434228 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5be40b0240 0x7f5be40c5810 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:46.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.552+0000 7f5be9b50700 1 --2- 172.21.15.125:0/4125434228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5be40c1b50 0x7f5be41414f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:46.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.552+0000 7f5be9b50700 1 -- 172.21.15.125:0/4125434228 >> 172.21.15.125:0/4125434228 conn(0x7f5be40af730 msgr2=0x7f5be406b930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:46.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.552+0000 7f5be9b50700 1 -- 172.21.15.125:0/4125434228 shutdown_connections 2023-10-06T03:05:46.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.552+0000 7f5be9b50700 1 -- 172.21.15.125:0/4125434228 wait complete. 2023-10-06T03:05:46.555 INFO:teuthology.orchestra.run.smithi125.stderr:updated caps for client.0 2023-10-06T03:05:46.565 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2023-10-06T03:05:46.565 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:05:46.565 DEBUG:teuthology.orchestra.run.smithi125:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:46.600 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[136309]: fuse finished with error 0 and tester_r 0 2023-10-06T03:05:46.601 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T03:05:46.684 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:05:46.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:46.684 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:05:46.702 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:05:46.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.858+0000 7f17e73b9700 1 Processor -- start 2023-10-06T03:05:46.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.859+0000 7f17e73b9700 1 -- start start 2023-10-06T03:05:46.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.859+0000 7f17e73b9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f17e0159720 0x7f17e00684f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:46.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.859+0000 7f17e73b9700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17e0067610 0x7f17e00c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:46.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.859+0000 7f17e73b9700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e0068d80 con 0x7f17e0159350 2023-10-06T03:05:46.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.860+0000 7f17e73b9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e00af8a0 con 0x7f17e0159720 2023-10-06T03:05:46.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.860+0000 7f17e73b9700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e00cb420 con 0x7f17e0067610 2023-10-06T03:05:46.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.860+0000 7f17e4954700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f17e0159720 0x7f17e00684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:46.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.860+0000 7f17e4954700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f17e0159720 0x7f17e00684f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39048/0 (socket says 172.21.15.125:39048) 2023-10-06T03:05:46.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.860+0000 7f17e4954700 1 -- 172.21.15.125:0/3374328035 learned_addr learned my addr 172.21.15.125:0/3374328035 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:46.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.860+0000 7f17e4954700 1 -- 172.21.15.125:0/3374328035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17e0067610 msgr2=0x7f17e00c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:46.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.860+0000 7f17e5956700 1 --2- 172.21.15.125:0/3374328035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17e0067610 0x7f17e00c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:46.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.860+0000 7f17e4954700 1 --2- 172.21.15.125:0/3374328035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17e0067610 0x7f17e00c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:46.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.860+0000 7f17e4954700 1 -- 172.21.15.125:0/3374328035 >> v1:172.21.15.130:6789/0 conn(0x7f17e0159350 legacy=0x7f17e00a88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:46.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.860+0000 7f17e4954700 1 -- 172.21.15.125:0/3374328035 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e00caaf0 con 0x7f17e0159720 2023-10-06T03:05:46.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.860+0000 7f17e5956700 1 --2- 172.21.15.125:0/3374328035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17e0067610 0x7f17e00c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:46.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.860+0000 7f17e4954700 1 --2- 172.21.15.125:0/3374328035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17e0159720 0x7f17e00684f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f17d40099b0 tx=0x7f17d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c51ac8b1ae7b1f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:46.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.860+0000 7f17d3fff700 1 -- 172.21.15.125:0/3374328035 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d400b820 con 0x7f17e0159720 2023-10-06T03:05:46.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.860+0000 7f17d3fff700 1 -- 172.21.15.125:0/3374328035 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d400b980 con 0x7f17e0159720 2023-10-06T03:05:46.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.860+0000 7f17d3fff700 1 -- 172.21.15.125:0/3374328035 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d400bd20 con 0x7f17e0159720 2023-10-06T03:05:46.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.861+0000 7f17e73b9700 1 -- 172.21.15.125:0/3374328035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17e0159720 msgr2=0x7f17e00684f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:46.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.861+0000 7f17e73b9700 1 --2- 172.21.15.125:0/3374328035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17e0159720 0x7f17e00684f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f17d40099b0 tx=0x7f17d4009250 comp rx=0 tx=0).stop 2023-10-06T03:05:46.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.861+0000 7f17e73b9700 1 -- 172.21.15.125:0/3374328035 shutdown_connections 2023-10-06T03:05:46.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.861+0000 7f17e73b9700 1 --2- 172.21.15.125:0/3374328035 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17e0067610 0x7f17e00c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:46.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.861+0000 7f17e73b9700 1 --2- 172.21.15.125:0/3374328035 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17e0159720 0x7f17e00684f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:46.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.861+0000 7f17e73b9700 1 -- 172.21.15.125:0/3374328035 >> 172.21.15.125:0/3374328035 conn(0x7f17e006b190 msgr2=0x7f17e006b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:46.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.861+0000 7f17e73b9700 1 -- 172.21.15.125:0/3374328035 shutdown_connections 2023-10-06T03:05:46.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.861+0000 7f17e73b9700 1 -- 172.21.15.125:0/3374328035 wait complete. 2023-10-06T03:05:46.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.862+0000 7f17e73b9700 1 Processor -- start 2023-10-06T03:05:46.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.863+0000 7f17e73b9700 1 -- start start 2023-10-06T03:05:46.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17e73b9700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17e0067610 0x7f17e0154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:46.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17e73b9700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17e0159350 0x7f17e00b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:46.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17e73b9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17e0159720 0x7f17e00b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:46.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17e73b9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e00abc70 con 0x7f17e0159720 2023-10-06T03:05:46.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17e73b9700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e00b1020 con 0x7f17e0067610 2023-10-06T03:05:46.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17e73b9700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e0155290 con 0x7f17e0159350 2023-10-06T03:05:46.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17e5956700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17e0159720 0x7f17e00b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:46.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17e5956700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17e0159720 0x7f17e00b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39054/0 (socket says 172.21.15.125:39054) 2023-10-06T03:05:46.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17e5956700 1 -- 172.21.15.125:0/3268159029 learned_addr learned my addr 172.21.15.125:0/3268159029 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:46.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17e4954700 1 --2- 172.21.15.125:0/3268159029 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17e0159350 0x7f17e00b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:46.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17e5155700 1 --2- 172.21.15.125:0/3268159029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17e0067610 0x7f17e0154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:46.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17e5956700 1 -- 172.21.15.125:0/3268159029 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17e0159350 msgr2=0x7f17e00b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:46.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17e5956700 1 --2- 172.21.15.125:0/3268159029 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17e0159350 0x7f17e00b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:46.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17e5956700 1 -- 172.21.15.125:0/3268159029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17e0067610 msgr2=0x7f17e0154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:46.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17e5956700 1 --2- 172.21.15.125:0/3268159029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17e0067610 0x7f17e0154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:46.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17e5956700 1 -- 172.21.15.125:0/3268159029 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d40094f0 con 0x7f17e0159720 2023-10-06T03:05:46.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17e5956700 1 --2- 172.21.15.125:0/3268159029 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17e0159720 0x7f17e00b0ae0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f17d800a380 tx=0x7f17d8007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:46.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17d17fa700 1 -- 172.21.15.125:0/3268159029 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8015440 con 0x7f17e0159720 2023-10-06T03:05:46.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17d17fa700 1 -- 172.21.15.125:0/3268159029 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d80155a0 con 0x7f17e0159720 2023-10-06T03:05:46.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17e73b9700 1 -- 172.21.15.125:0/3268159029 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e00b1e30 con 0x7f17e0159720 2023-10-06T03:05:46.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17d17fa700 1 -- 172.21.15.125:0/3268159029 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8015960 con 0x7f17e0159720 2023-10-06T03:05:46.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.864+0000 7f17e73b9700 1 -- 172.21.15.125:0/3268159029 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e00b12d0 con 0x7f17e0159720 2023-10-06T03:05:46.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.865+0000 7f17e73b9700 1 -- 172.21.15.125:0/3268159029 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e00b1fc0 con 0x7f17e0159720 2023-10-06T03:05:46.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.866+0000 7f17d17fa700 1 -- 172.21.15.125:0/3268159029 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17d8015d50 con 0x7f17e0159720 2023-10-06T03:05:46.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.866+0000 7f17d17fa700 1 --2- 172.21.15.125:0/3268159029 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f17c4066f30 0x7f17c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:46.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.866+0000 7f17d17fa700 1 -- 172.21.15.125:0/3268159029 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f17d80851f0 con 0x7f17e0159720 2023-10-06T03:05:46.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.866+0000 7f17e5155700 1 --2- 172.21.15.125:0/3268159029 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f17c4066f30 0x7f17c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:46.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.867+0000 7f17e5155700 1 --2- 172.21.15.125:0/3268159029 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f17c4066f30 0x7f17c40693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f17dc003a30 tx=0x7f17dc007ea0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:46.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:46.870+0000 7f17d17fa700 1 -- 172.21.15.125:0/3268159029 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17d8052030 con 0x7f17e0159720 2023-10-06T03:05:47.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:47.102+0000 7f17e73b9700 1 -- 172.21.15.125:0/3268159029 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f17e0071490 con 0x7f17e0159720 2023-10-06T03:05:47.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:47.103+0000 7f17d17fa700 1 -- 172.21.15.125:0/3268159029 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+82 (secure 0 0 0) 0x7f17d8055650 con 0x7f17e0159720 2023-10-06T03:05:47.105 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2023-10-06T03:05:47.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:47.105+0000 7f17e73b9700 1 -- 172.21.15.125:0/3268159029 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f17c4066f30 msgr2=0x7f17c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:47.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:47.105+0000 7f17e73b9700 1 --2- 172.21.15.125:0/3268159029 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f17c4066f30 0x7f17c40693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f17dc003a30 tx=0x7f17dc007ea0 comp rx=0 tx=0).stop 2023-10-06T03:05:47.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:47.105+0000 7f17e73b9700 1 -- 172.21.15.125:0/3268159029 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17e0159720 msgr2=0x7f17e00b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:47.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:47.105+0000 7f17e73b9700 1 --2- 172.21.15.125:0/3268159029 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17e0159720 0x7f17e00b0ae0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f17d800a380 tx=0x7f17d8007900 comp rx=0 tx=0).stop 2023-10-06T03:05:47.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:47.105+0000 7f17e73b9700 1 -- 172.21.15.125:0/3268159029 shutdown_connections 2023-10-06T03:05:47.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:47.105+0000 7f17e73b9700 1 --2- 172.21.15.125:0/3268159029 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f17c4066f30 0x7f17c40693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:47.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:47.105+0000 7f17e73b9700 1 --2- 172.21.15.125:0/3268159029 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f17e0159720 0x7f17e00b0ae0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:47.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:47.105+0000 7f17e73b9700 1 --2- 172.21.15.125:0/3268159029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f17e0067610 0x7f17e0154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:47.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:47.105+0000 7f17e73b9700 1 --2- 172.21.15.125:0/3268159029 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f17e0159350 0x7f17e00b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:47.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:47.105+0000 7f17e73b9700 1 -- 172.21.15.125:0/3268159029 >> 172.21.15.125:0/3268159029 conn(0x7f17e006b190 msgr2=0x7f17e00c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:47.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:47.105+0000 7f17e73b9700 1 -- 172.21.15.125:0/3268159029 shutdown_connections 2023-10-06T03:05:47.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:47.105+0000 7f17e73b9700 1 -- 172.21.15.125:0/3268159029 wait complete. 2023-10-06T03:05:47.118 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:05:47.118 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:05:47.118 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-10-06T03:05:47.118 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:05:47.118 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:47.119 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:05:47.119 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:05:47.119 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:05:47.119 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:05:47.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:47.119 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-10-06T03:05:47.137 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:05:47.138 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:05:47.138 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:05:47.138 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:47.138 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-10-06T03:05:47.138 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:47.138 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:05:47.138 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:47.138 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2023-10-06T03:05:47.139 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:05:47.139 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:47.139 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2023-10-06T03:05:47.139 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:05:47.139 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:47.139 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:05:47.139 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:47.139 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:05:47.139 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42454sec preferred_lft 42454sec 2023-10-06T03:05:47.139 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2023-10-06T03:05:47.140 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:47.140 INFO:teuthology.orchestra.run.smithi125.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:05:47.140 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 46:01:08:d7:90:9a brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:47.140 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:05:47.140 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:47.140 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::f829:e8ff:fe3d:51e0/64 scope link 2023-10-06T03:05:47.140 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:47.140 INFO:teuthology.orchestra.run.smithi125.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:05:47.140 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 46:01:08:d7:90:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:05:47.140 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::4401:8ff:fed7:909a/64 scope link 2023-10-06T03:05:47.141 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:47.141 INFO:teuthology.orchestra.run.smithi125.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:05:47.141 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 9a:de:60:3d:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:05:47.141 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::98de:60ff:fe3d:d710/64 scope link 2023-10-06T03:05:47.141 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:47.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:47.141 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:05:47.204 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-10-06T03:05:47.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:47.206 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-10-06T03:05:47.266 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-10-06T03:05:47.266 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:05:47.266 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:05:47.266 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:05:47.266 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:05:47.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:47.267 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:05:47.267 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:05:47.267 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:05:47.267 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:05:47.267 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:05:47.267 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:05:47.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:47.372 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-06T03:05:47.390 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:05:47.390 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:05:47.390 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:05:47.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:47.391 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2023-10-06T03:05:47.458 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T03:05:47.458 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:05:47.458 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:47.516 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:05:47.517 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:05:47.517 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:47.574 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-06T03:05:47.641 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:05:47.642 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:05:47.708 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:05:47.709 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:05:47.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:47.710 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-06T03:05:47.769 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T03:05:47.770 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T03:05:47.811 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-06T03:05:47.838 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:05:47.838 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:05:47.894 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2023-10-06T03:05:47.892+0000 7f56e031f540 -1 init, newargv = 0x55c97937ecc0 newargc=15 2023-10-06T03:05:47.894 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[137208]: starting ceph client 2023-10-06T03:05:47.898 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[137208]: starting fuse 2023-10-06T03:05:47.907 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:05:47.908 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:05:47.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:47.909 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-06T03:05:47.967 INFO:teuthology.orchestra.run.smithi125.stdout:46 2023-10-06T03:05:47.967 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T03:05:47.967 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:05:47.968 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2023-10-06T03:05:47.968 DEBUG:teuthology.orchestra.run.smithi125:> import re 2023-10-06T03:05:47.968 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-10-06T03:05:47.968 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2023-10-06T03:05:47.968 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:05:47.968 DEBUG:teuthology.orchestra.run.smithi125:> def _find_admin_socket(client_name): 2023-10-06T03:05:47.968 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T03:05:47.968 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2023-10-06T03:05:47.968 DEBUG:teuthology.orchestra.run.smithi125:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T03:05:47.968 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:05:47.969 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2023-10-06T03:05:47.969 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2023-10-06T03:05:47.969 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2023-10-06T03:05:47.969 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2023-10-06T03:05:47.969 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:05:47.969 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2023-10-06T03:05:47.969 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T03:05:47.969 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T03:05:47.969 DEBUG:teuthology.orchestra.run.smithi125:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T03:05:47.970 DEBUG:teuthology.orchestra.run.smithi125:> contents = proc_f.read() 2023-10-06T03:05:47.970 DEBUG:teuthology.orchestra.run.smithi125:> if mountpoint in contents: 2023-10-06T03:05:47.970 DEBUG:teuthology.orchestra.run.smithi125:> return f 2023-10-06T03:05:47.970 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T03:05:47.970 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:05:47.970 DEBUG:teuthology.orchestra.run.smithi125:> print(_find_admin_socket("client.0")) 2023-10-06T03:05:47.970 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-10-06T03:05:48.091 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.137208.asok 2023-10-06T03:05:48.273 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.137208.asok 2023-10-06T03:05:48.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:48.273 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.137208.asok status 2023-10-06T03:05:48.427 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:05:48.427 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2023-10-06T03:05:48.427 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T03:05:48.427 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T03:05:48.427 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2023-10-06T03:05:48.427 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2023-10-06T03:05:48.427 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T03:05:48.428 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "137208", 2023-10-06T03:05:48.428 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2023-10-06T03:05:48.428 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:48.428 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2023-10-06T03:05:48.428 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2023-10-06T03:05:48.428 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 5361, 2023-10-06T03:05:48.428 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2023-10-06T03:05:48.428 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2023-10-06T03:05:48.428 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2023-10-06T03:05:48.428 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 5361 2023-10-06T03:05:48.429 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:48.429 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-06T03:05:48.429 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-06T03:05:48.429 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:05:48.429 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 3431113421 2023-10-06T03:05:48.429 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:48.429 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:48.429 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-06T03:05:48.429 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-06T03:05:48.429 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:05:48.429 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 3431113421 2023-10-06T03:05:48.429 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:48.430 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.5361 192.168.0.1:0/3431113421", 2023-10-06T03:05:48.430 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "192.168.0.1:0/3431113421", 2023-10-06T03:05:48.430 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2023-10-06T03:05:48.430 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 19, 2023-10-06T03:05:48.430 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 44, 2023-10-06T03:05:48.430 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2023-10-06T03:05:48.430 INFO:teuthology.orchestra.run.smithi125.stdout: "blocklisted": false, 2023-10-06T03:05:48.430 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2023-10-06T03:05:48.430 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:05:48.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:48.436 DEBUG:teuthology.orchestra.run.smithi125:> stat --file-system '--printf=%T 2023-10-06T03:05:48.437 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:48.455 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2023-10-06T03:05:48.455 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:48.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:48.456 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:48.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:48.522 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2023-10-06T03:05:48.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:05:48.581 INFO:teuthology.orchestra.run.smithi125.stderr:setfattr: layoutfile: Permission denied 2023-10-06T03:05:48.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:48.582 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2023-10-06T03:05:48.641 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:05:48.641 INFO:teuthology.orchestra.run.smithi125.stderr:setfattr: layoutdir: Permission denied 2023-10-06T03:05:48.641 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2023-10-06T03:05:48.642 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:05:48.642 DEBUG:teuthology.orchestra.run.smithi125:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:48.713 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[137208]: fuse finished with error 0 and tester_r 0 2023-10-06T03:05:48.714 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T03:05:54.816 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:05:54.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:54.817 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:05:54.839 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds 'allow rwp' mon 'allow r' osd 'allow rw pool=cephfs_data,allow rw pool=data_new' 2023-10-06T03:05:55.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.022+0000 7fa9fdbfd700 1 Processor -- start 2023-10-06T03:05:55.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.023+0000 7fa9fdbfd700 1 -- start start 2023-10-06T03:05:55.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.023+0000 7fa9fdbfd700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9f8067d20 0x7fa9f80caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:55.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.023+0000 7fa9fdbfd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f80cafe0 con 0x7fa9f80ca190 2023-10-06T03:05:55.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.023+0000 7fa9fdbfd700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f80c3b40 con 0x7fa9f80af320 2023-10-06T03:05:55.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.023+0000 7fa9fdbfd700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f80ca710 con 0x7fa9f8067d20 2023-10-06T03:05:55.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.024+0000 7fa9f7fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa9f80ca190 0x7fa9f80c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:46864/0 (socket says 172.21.15.125:46864) 2023-10-06T03:05:55.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.024+0000 7fa9f7fff700 1 -- 172.21.15.125:0/4174398101 learned_addr learned my addr 172.21.15.125:0/4174398101 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:55.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.024+0000 7fa9f6ffd700 1 --2- 172.21.15.125:0/4174398101 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9f8067d20 0x7fa9f80caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:55.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.024+0000 7fa9f67fc700 1 -- 172.21.15.125:0/4174398101 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3825816445 0 0) 0x7fa9f0001490 con 0x7fa9f80ca190 2023-10-06T03:05:55.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.024+0000 7fa9f67fc700 1 -- 172.21.15.125:0/4174398101 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9e0003570 con 0x7fa9f80ca190 2023-10-06T03:05:55.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.024+0000 7fa9f67fc700 1 -- 172.21.15.125:0/4174398101 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457826974 0 0) 0x7fa9f80c3b40 con 0x7fa9f80af320 2023-10-06T03:05:55.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.024+0000 7fa9f6ffd700 1 -- 172.21.15.125:0/4174398101 >> v1:172.21.15.130:6789/0 conn(0x7fa9f80af320 legacy=0x7fa9f8067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:55.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.024+0000 7fa9f6ffd700 1 -- 172.21.15.125:0/4174398101 >> v1:172.21.15.125:6789/0 conn(0x7fa9f80ca190 legacy=0x7fa9f80c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:55.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.024+0000 7fa9f6ffd700 1 -- 172.21.15.125:0/4174398101 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f80cc750 con 0x7fa9f8067d20 2023-10-06T03:05:55.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.024+0000 7fa9f6ffd700 1 --2- 172.21.15.125:0/4174398101 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9f8067d20 0x7fa9f80caaa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009910 tx=0x7fa9e80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce5ba1b48a3f7fd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:55.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.024+0000 7fa9f67fc700 1 -- 172.21.15.125:0/4174398101 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f0001980 con 0x7fa9f8067d20 2023-10-06T03:05:55.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.025+0000 7fa9f67fc700 1 -- 172.21.15.125:0/4174398101 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e8011420 con 0x7fa9f8067d20 2023-10-06T03:05:55.028 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.025+0000 7fa9f67fc700 1 -- 172.21.15.125:0/4174398101 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e80117c0 con 0x7fa9f8067d20 2023-10-06T03:05:55.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.025+0000 7fa9fdbfd700 1 -- 172.21.15.125:0/4174398101 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9f8067d20 msgr2=0x7fa9f80caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:55.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.025+0000 7fa9fdbfd700 1 --2- 172.21.15.125:0/4174398101 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9f8067d20 0x7fa9f80caaa0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8009910 tx=0x7fa9e80091a0 comp rx=0 tx=0).stop 2023-10-06T03:05:55.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.025+0000 7fa9fdbfd700 1 -- 172.21.15.125:0/4174398101 shutdown_connections 2023-10-06T03:05:55.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.025+0000 7fa9fdbfd700 1 --2- 172.21.15.125:0/4174398101 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9f8067d20 0x7fa9f80caaa0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:55.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.025+0000 7fa9fdbfd700 1 -- 172.21.15.125:0/4174398101 >> 172.21.15.125:0/4174398101 conn(0x7fa9f8096120 msgr2=0x7fa9f8068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:55.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.025+0000 7fa9fdbfd700 1 -- 172.21.15.125:0/4174398101 shutdown_connections 2023-10-06T03:05:55.029 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.025+0000 7fa9fdbfd700 1 -- 172.21.15.125:0/4174398101 wait complete. 2023-10-06T03:05:55.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.027+0000 7fa9fdbfd700 1 Processor -- start 2023-10-06T03:05:55.031 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.027+0000 7fa9fdbfd700 1 -- start start 2023-10-06T03:05:55.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.028+0000 7fa9fdbfd700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9f8067d20 0x7fa9f80b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:55.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.028+0000 7fa9fdbfd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9f80af320 0x7fa9f815bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:55.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.028+0000 7fa9fdbfd700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9f80ca190 0x7fa9f815a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:55.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.028+0000 7fa9fdbfd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f815c0d0 con 0x7fa9f80af320 2023-10-06T03:05:55.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.028+0000 7fa9fdbfd700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f81417e0 con 0x7fa9f80ca190 2023-10-06T03:05:55.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.028+0000 7fa9fdbfd700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f8155250 con 0x7fa9f8067d20 2023-10-06T03:05:55.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.028+0000 7fa9f6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9f80af320 0x7fa9f815bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:55.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.028+0000 7fa9f6ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9f80af320 0x7fa9f815bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:39070/0 (socket says 172.21.15.125:39070) 2023-10-06T03:05:55.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.028+0000 7fa9f6ffd700 1 -- 172.21.15.125:0/1642355362 learned_addr learned my addr 172.21.15.125:0/1642355362 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:55.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.028+0000 7fa9f7fff700 1 --2- 172.21.15.125:0/1642355362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9f80ca190 0x7fa9f815a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:55.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.028+0000 7fa9f77fe700 1 --2- 172.21.15.125:0/1642355362 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9f8067d20 0x7fa9f80b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:55.032 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.028+0000 7fa9f6ffd700 1 -- 172.21.15.125:0/1642355362 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9f8067d20 msgr2=0x7fa9f80b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:55.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.028+0000 7fa9f6ffd700 1 --2- 172.21.15.125:0/1642355362 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9f8067d20 0x7fa9f80b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:55.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.028+0000 7fa9f6ffd700 1 -- 172.21.15.125:0/1642355362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9f80ca190 msgr2=0x7fa9f815a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:55.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.028+0000 7fa9f6ffd700 1 --2- 172.21.15.125:0/1642355362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9f80ca190 0x7fa9f815a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:55.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.028+0000 7fa9f6ffd700 1 -- 172.21.15.125:0/1642355362 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e8009420 con 0x7fa9f80af320 2023-10-06T03:05:55.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.028+0000 7fa9f6ffd700 1 --2- 172.21.15.125:0/1642355362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9f80af320 0x7fa9f815bb90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa9f806df40 tx=0x7fa9e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:55.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.029+0000 7fa9df7fe700 1 -- 172.21.15.125:0/1642355362 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e8010ac0 con 0x7fa9f80af320 2023-10-06T03:05:55.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.029+0000 7fa9df7fe700 1 -- 172.21.15.125:0/1642355362 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e8010c20 con 0x7fa9f80af320 2023-10-06T03:05:55.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.029+0000 7fa9fdbfd700 1 -- 172.21.15.125:0/1642355362 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f815c2b0 con 0x7fa9f80af320 2023-10-06T03:05:55.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.029+0000 7fa9df7fe700 1 -- 172.21.15.125:0/1642355362 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e801d430 con 0x7fa9f80af320 2023-10-06T03:05:55.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.029+0000 7fa9fdbfd700 1 -- 172.21.15.125:0/1642355362 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f815c870 con 0x7fa9f80af320 2023-10-06T03:05:55.033 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.030+0000 7fa9fdbfd700 1 -- 172.21.15.125:0/1642355362 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f8141950 con 0x7fa9f80af320 2023-10-06T03:05:55.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.031+0000 7fa9df7fe700 1 -- 172.21.15.125:0/1642355362 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9e801d860 con 0x7fa9f80af320 2023-10-06T03:05:55.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.031+0000 7fa9df7fe700 1 --2- 172.21.15.125:0/1642355362 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa9e4066f30 0x7fa9e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:55.034 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.031+0000 7fa9df7fe700 1 -- 172.21.15.125:0/1642355362 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6773+0+0 (secure 0 0 0) 0x7fa9e80865d0 con 0x7fa9f80af320 2023-10-06T03:05:55.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.031+0000 7fa9f77fe700 1 --2- 172.21.15.125:0/1642355362 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa9e4066f30 0x7fa9e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:55.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.031+0000 7fa9f77fe700 1 --2- 172.21.15.125:0/1642355362 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa9e4066f30 0x7fa9e40693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec003a80 tx=0x7fa9ec007f10 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:55.036 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.035+0000 7fa9df7fe700 1 -- 172.21.15.125:0/1642355362 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9e8053490 con 0x7fa9f80af320 2023-10-06T03:05:55.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.294+0000 7fa9fdbfd700 1 -- 172.21.15.125:0/1642355362 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]} v 0) v1 -- 0x7fa9f8066510 con 0x7fa9f80af320 2023-10-06T03:05:55.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.298+0000 7fa9df7fe700 1 -- 172.21.15.125:0/1642355362 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow rwp", "mon", "allow r", "osd", "allow rw pool=cephfs_data,allow rw pool=data_new"]}]=0 updated caps for client.0 v17) v1 ==== 211+0+0 (secure 0 0 0) 0x7fa9e8056ab0 con 0x7fa9f80af320 2023-10-06T03:05:55.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.300+0000 7fa9fdbfd700 1 -- 172.21.15.125:0/1642355362 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa9e4066f30 msgr2=0x7fa9e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:55.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.300+0000 7fa9fdbfd700 1 --2- 172.21.15.125:0/1642355362 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa9e4066f30 0x7fa9e40693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec003a80 tx=0x7fa9ec007f10 comp rx=0 tx=0).stop 2023-10-06T03:05:55.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.300+0000 7fa9fdbfd700 1 -- 172.21.15.125:0/1642355362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9f80af320 msgr2=0x7fa9f815bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:55.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.300+0000 7fa9fdbfd700 1 --2- 172.21.15.125:0/1642355362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9f80af320 0x7fa9f815bb90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa9f806df40 tx=0x7fa9e8017000 comp rx=0 tx=0).stop 2023-10-06T03:05:55.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.300+0000 7fa9fdbfd700 1 -- 172.21.15.125:0/1642355362 shutdown_connections 2023-10-06T03:05:55.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.300+0000 7fa9fdbfd700 1 --2- 172.21.15.125:0/1642355362 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa9e4066f30 0x7fa9e40693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:55.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.300+0000 7fa9fdbfd700 1 --2- 172.21.15.125:0/1642355362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa9f80ca190 0x7fa9f815a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:55.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.300+0000 7fa9fdbfd700 1 --2- 172.21.15.125:0/1642355362 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa9f8067d20 0x7fa9f80b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:55.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.300+0000 7fa9fdbfd700 1 --2- 172.21.15.125:0/1642355362 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa9f80af320 0x7fa9f815bb90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:55.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.300+0000 7fa9fdbfd700 1 -- 172.21.15.125:0/1642355362 >> 172.21.15.125:0/1642355362 conn(0x7fa9f8096120 msgr2=0x7fa9f80c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:55.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.300+0000 7fa9fdbfd700 1 -- 172.21.15.125:0/1642355362 shutdown_connections 2023-10-06T03:05:55.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.300+0000 7fa9fdbfd700 1 -- 172.21.15.125:0/1642355362 wait complete. 2023-10-06T03:05:55.303 INFO:teuthology.orchestra.run.smithi125.stderr:updated caps for client.0 2023-10-06T03:05:55.313 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:05:55.430 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.429+0000 7f6ffc037700 1 Processor -- start 2023-10-06T03:05:55.431 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.429+0000 7f6ffc037700 1 -- start start 2023-10-06T03:05:55.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.430+0000 7f6ffc037700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ff41590d0 0x7f6ff406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:55.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.430+0000 7f6ffc037700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6ff41594a0 0x7f6ff406ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:55.433 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.430+0000 7f6ffc037700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff4067c70 con 0x7f6ff40ac670 2023-10-06T03:05:55.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.430+0000 7f6ffc037700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff4069110 con 0x7f6ff41594a0 2023-10-06T03:05:55.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.430+0000 7f6ffc037700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40c77e0 con 0x7f6ff41590d0 2023-10-06T03:05:55.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.430+0000 7f6ffa5d4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6ff41594a0 0x7f6ff406ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:55.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.430+0000 7f6ff95d2700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6ff40ac670 0x7f6ff40c6b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52744/0 (socket says 172.21.15.125:52744) 2023-10-06T03:05:55.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.430+0000 7f6ff95d2700 1 -- 172.21.15.125:0/485143515 learned_addr learned my addr 172.21.15.125:0/485143515 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:05:55.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.431+0000 7f6ffa5d4700 1 -- 172.21.15.125:0/485143515 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ff41590d0 msgr2=0x7f6ff406a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:05:55.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.431+0000 7f6ff9dd3700 1 --2- 172.21.15.125:0/485143515 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ff41590d0 0x7f6ff406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:55.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.431+0000 7f6ff8dd1700 1 -- 172.21.15.125:0/485143515 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072873333 0 0) 0x7f6ff4067c70 con 0x7f6ff40ac670 2023-10-06T03:05:55.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.431+0000 7f6ffa5d4700 1 --2- 172.21.15.125:0/485143515 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ff41590d0 0x7f6ff406a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:55.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.431+0000 7f6ffa5d4700 1 -- 172.21.15.125:0/485143515 >> v1:172.21.15.125:6789/0 conn(0x7f6ff40ac670 legacy=0x7f6ff40c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:55.434 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.431+0000 7f6ffa5d4700 1 -- 172.21.15.125:0/485143515 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff40c7ac0 con 0x7f6ff41594a0 2023-10-06T03:05:55.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.431+0000 7f6ff9dd3700 1 --2- 172.21.15.125:0/485143515 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ff41590d0 0x7f6ff406a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:05:55.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.431+0000 7f6ffa5d4700 1 --2- 172.21.15.125:0/485143515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ff41594a0 0x7f6ff406ae00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009e60 tx=0x7f6fec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da0277cb48073370 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:55.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.431+0000 7f6ff8dd1700 1 -- 172.21.15.125:0/485143515 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec00e070 con 0x7f6ff41594a0 2023-10-06T03:05:55.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.431+0000 7f6ff8dd1700 1 -- 172.21.15.125:0/485143515 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec00bc30 con 0x7f6ff41594a0 2023-10-06T03:05:55.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.431+0000 7f6ff8dd1700 1 -- 172.21.15.125:0/485143515 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec012430 con 0x7f6ff41594a0 2023-10-06T03:05:55.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.431+0000 7f6ffc037700 1 -- 172.21.15.125:0/485143515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ff41594a0 msgr2=0x7f6ff406ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:55.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.431+0000 7f6ffc037700 1 --2- 172.21.15.125:0/485143515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ff41594a0 0x7f6ff406ae00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009e60 tx=0x7f6fec009780 comp rx=0 tx=0).stop 2023-10-06T03:05:55.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.431+0000 7f6ffc037700 1 -- 172.21.15.125:0/485143515 shutdown_connections 2023-10-06T03:05:55.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.431+0000 7f6ffc037700 1 --2- 172.21.15.125:0/485143515 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ff41594a0 0x7f6ff406ae00 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:55.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.431+0000 7f6ffc037700 1 --2- 172.21.15.125:0/485143515 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ff41590d0 0x7f6ff406a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:55.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.431+0000 7f6ffc037700 1 -- 172.21.15.125:0/485143515 >> 172.21.15.125:0/485143515 conn(0x7f6ff40cc5a0 msgr2=0x7f6ff40cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:55.435 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.432+0000 7f6ffc037700 1 -- 172.21.15.125:0/485143515 shutdown_connections 2023-10-06T03:05:55.436 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.432+0000 7f6ffc037700 1 -- 172.21.15.125:0/485143515 wait complete. 2023-10-06T03:05:55.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.433+0000 7f6ffc037700 1 Processor -- start 2023-10-06T03:05:55.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.433+0000 7f6ffc037700 1 -- start start 2023-10-06T03:05:55.438 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6ffc037700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ff40ac670 0x7f6ff40b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:55.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6ffc037700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ff41590d0 0x7f6ff4151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:55.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6ffc037700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ff41594a0 0x7f6ff4169c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:55.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6ffc037700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff4159d50 con 0x7f6ff41594a0 2023-10-06T03:05:55.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6ffc037700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff416a150 con 0x7f6ff41590d0 2023-10-06T03:05:55.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6ffc037700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff4152240 con 0x7f6ff40ac670 2023-10-06T03:05:55.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6ffa5d4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ff41594a0 0x7f6ff4169c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:55.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6ffa5d4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ff41594a0 0x7f6ff4169c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47774/0 (socket says 172.21.15.125:47774) 2023-10-06T03:05:55.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6ffa5d4700 1 -- 172.21.15.125:0/2252109591 learned_addr learned my addr 172.21.15.125:0/2252109591 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:05:55.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6ff9dd3700 1 --2- 172.21.15.125:0/2252109591 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ff40ac670 0x7f6ff40b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:55.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6ff95d2700 1 --2- 172.21.15.125:0/2252109591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ff41590d0 0x7f6ff4151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:55.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6ffa5d4700 1 -- 172.21.15.125:0/2252109591 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ff40ac670 msgr2=0x7f6ff40b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6ffa5d4700 1 --2- 172.21.15.125:0/2252109591 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ff40ac670 0x7f6ff40b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6ffa5d4700 1 -- 172.21.15.125:0/2252109591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ff41590d0 msgr2=0x7f6ff4151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6ffa5d4700 1 --2- 172.21.15.125:0/2252109591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ff41590d0 0x7f6ff4151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6ffa5d4700 1 -- 172.21.15.125:0/2252109591 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec009a20 con 0x7f6ff41594a0 2023-10-06T03:05:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6ff95d2700 1 --2- 172.21.15.125:0/2252109591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ff41590d0 0x7f6ff4151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:05:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6ffa5d4700 1 --2- 172.21.15.125:0/2252109591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ff41594a0 0x7f6ff4169c10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6fec013000 tx=0x7f6fec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6fe9ffb700 1 -- 172.21.15.125:0/2252109591 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec012e70 con 0x7f6ff41594a0 2023-10-06T03:05:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6fe9ffb700 1 -- 172.21.15.125:0/2252109591 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fec01d630 con 0x7f6ff41594a0 2023-10-06T03:05:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6ffc037700 1 -- 172.21.15.125:0/2252109591 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff4152520 con 0x7f6ff41594a0 2023-10-06T03:05:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.434+0000 7f6fe9ffb700 1 -- 172.21.15.125:0/2252109591 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fec01d9d0 con 0x7f6ff41594a0 2023-10-06T03:05:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.435+0000 7f6ffc037700 1 -- 172.21.15.125:0/2252109591 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff4152ae0 con 0x7f6ff41594a0 2023-10-06T03:05:55.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.435+0000 7f6ffc037700 1 -- 172.21.15.125:0/2252109591 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff4159f00 con 0x7f6ff41594a0 2023-10-06T03:05:55.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.436+0000 7f6fe9ffb700 1 -- 172.21.15.125:0/2252109591 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6fec024070 con 0x7f6ff41594a0 2023-10-06T03:05:55.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.436+0000 7f6fe9ffb700 1 --2- 172.21.15.125:0/2252109591 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6fd8066f30 0x7f6fd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:05:55.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.436+0000 7f6fe9ffb700 1 -- 172.21.15.125:0/2252109591 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f6fec087300 con 0x7f6ff41594a0 2023-10-06T03:05:55.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.436+0000 7f6ff9dd3700 1 --2- 172.21.15.125:0/2252109591 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6fd8066f30 0x7f6fd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:05:55.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.437+0000 7f6ff9dd3700 1 --2- 172.21.15.125:0/2252109591 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6fd8066f30 0x7f6fd80693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4157c60 tx=0x7f6fe4006f90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:05:55.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.440+0000 7f6fe9ffb700 1 -- 172.21.15.125:0/2252109591 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ff4159f00 con 0x7f6ff41594a0 2023-10-06T03:05:55.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.664+0000 7f6ffc037700 1 -- 172.21.15.125:0/2252109591 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6ff4159ec0 con 0x7f6ff41594a0 2023-10-06T03:05:55.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.664+0000 7f6fe9ffb700 1 -- 172.21.15.125:0/2252109591 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+82 (secure 0 0 0) 0x7f6fec0540a0 con 0x7f6ff41594a0 2023-10-06T03:05:55.666 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data data_new ] 2023-10-06T03:05:55.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.666+0000 7f6ffc037700 1 -- 172.21.15.125:0/2252109591 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6fd8066f30 msgr2=0x7f6fd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:55.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.666+0000 7f6ffc037700 1 --2- 172.21.15.125:0/2252109591 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6fd8066f30 0x7f6fd80693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4157c60 tx=0x7f6fe4006f90 comp rx=0 tx=0).stop 2023-10-06T03:05:55.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.666+0000 7f6ffc037700 1 -- 172.21.15.125:0/2252109591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ff41594a0 msgr2=0x7f6ff4169c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:05:55.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.666+0000 7f6ffc037700 1 --2- 172.21.15.125:0/2252109591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ff41594a0 0x7f6ff4169c10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6fec013000 tx=0x7f6fec019000 comp rx=0 tx=0).stop 2023-10-06T03:05:55.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.666+0000 7f6ffc037700 1 -- 172.21.15.125:0/2252109591 shutdown_connections 2023-10-06T03:05:55.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.666+0000 7f6ffc037700 1 --2- 172.21.15.125:0/2252109591 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6fd8066f30 0x7f6fd80693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:55.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.666+0000 7f6ffc037700 1 --2- 172.21.15.125:0/2252109591 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6ff41594a0 0x7f6ff4169c10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:55.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.666+0000 7f6ffc037700 1 --2- 172.21.15.125:0/2252109591 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6ff40ac670 0x7f6ff40b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:55.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.666+0000 7f6ffc037700 1 --2- 172.21.15.125:0/2252109591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ff41590d0 0x7f6ff4151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:05:55.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.666+0000 7f6ffc037700 1 -- 172.21.15.125:0/2252109591 >> 172.21.15.125:0/2252109591 conn(0x7f6ff40cc5a0 msgr2=0x7f6ff41554a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:05:55.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.666+0000 7f6ffc037700 1 -- 172.21.15.125:0/2252109591 shutdown_connections 2023-10-06T03:05:55.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:05:55.666+0000 7f6ffc037700 1 -- 172.21.15.125:0/2252109591 wait complete. 2023-10-06T03:05:55.679 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:05:55.680 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:05:55.680 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-10-06T03:05:55.680 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:05:55.680 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:55.680 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:05:55.680 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:05:55.680 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:05:55.680 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:05:55.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:55.681 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-10-06T03:05:55.699 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:05:55.700 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:05:55.700 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:05:55.700 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:55.700 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-10-06T03:05:55.700 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:55.700 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:05:55.700 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:55.700 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2023-10-06T03:05:55.700 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:05:55.700 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:55.700 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2023-10-06T03:05:55.701 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:05:55.701 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:55.701 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:05:55.701 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:55.701 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:05:55.701 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42445sec preferred_lft 42445sec 2023-10-06T03:05:55.701 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2023-10-06T03:05:55.701 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:55.701 INFO:teuthology.orchestra.run.smithi125.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:05:55.701 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 46:01:08:d7:90:9a brd ff:ff:ff:ff:ff:ff 2023-10-06T03:05:55.701 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:05:55.701 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:55.702 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::f829:e8ff:fe3d:51e0/64 scope link 2023-10-06T03:05:55.702 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:55.702 INFO:teuthology.orchestra.run.smithi125.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:05:55.702 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 46:01:08:d7:90:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:05:55.702 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::4401:8ff:fed7:909a/64 scope link 2023-10-06T03:05:55.702 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:55.702 INFO:teuthology.orchestra.run.smithi125.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:05:55.702 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 9a:de:60:3d:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:05:55.702 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::98de:60ff:fe3d:d710/64 scope link 2023-10-06T03:05:55.702 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:05:55.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:55.703 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:05:55.766 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-10-06T03:05:55.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:55.767 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-10-06T03:05:55.827 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-10-06T03:05:55.827 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:05:55.827 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:05:55.828 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:05:55.828 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:05:55.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:55.828 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:05:55.828 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:05:55.828 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:05:55.828 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:05:55.828 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:05:55.828 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:05:55.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:55.932 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-06T03:05:55.950 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:05:55.950 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:05:55.951 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:05:55.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:05:55.951 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2023-10-06T03:05:56.018 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T03:05:56.018 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:05:56.018 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:56.076 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:05:56.077 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:05:56.077 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:56.134 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-06T03:05:56.201 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:05:56.202 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:05:56.268 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:05:56.269 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:05:56.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:56.270 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-06T03:05:56.328 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T03:05:56.328 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T03:05:56.371 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-06T03:05:56.398 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:05:56.398 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:05:56.455 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2023-10-06T03:05:56.454+0000 7f351132c540 -1 init, newargv = 0x555a0f76a820 newargc=15 2023-10-06T03:05:56.455 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[137909]: starting ceph client 2023-10-06T03:05:56.460 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[137909]: starting fuse 2023-10-06T03:05:56.468 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:05:56.469 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:05:56.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:56.470 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-06T03:05:56.528 INFO:teuthology.orchestra.run.smithi125.stdout:46 2023-10-06T03:05:56.528 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T03:05:56.528 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:05:56.529 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2023-10-06T03:05:56.529 DEBUG:teuthology.orchestra.run.smithi125:> import re 2023-10-06T03:05:56.529 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-10-06T03:05:56.529 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2023-10-06T03:05:56.529 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:05:56.529 DEBUG:teuthology.orchestra.run.smithi125:> def _find_admin_socket(client_name): 2023-10-06T03:05:56.529 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T03:05:56.529 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2023-10-06T03:05:56.529 DEBUG:teuthology.orchestra.run.smithi125:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T03:05:56.529 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:05:56.529 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2023-10-06T03:05:56.529 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2023-10-06T03:05:56.530 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2023-10-06T03:05:56.530 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2023-10-06T03:05:56.530 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:05:56.530 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2023-10-06T03:05:56.530 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T03:05:56.530 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T03:05:56.530 DEBUG:teuthology.orchestra.run.smithi125:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T03:05:56.530 DEBUG:teuthology.orchestra.run.smithi125:> contents = proc_f.read() 2023-10-06T03:05:56.530 DEBUG:teuthology.orchestra.run.smithi125:> if mountpoint in contents: 2023-10-06T03:05:56.530 DEBUG:teuthology.orchestra.run.smithi125:> return f 2023-10-06T03:05:56.530 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T03:05:56.530 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:05:56.531 DEBUG:teuthology.orchestra.run.smithi125:> print(_find_admin_socket("client.0")) 2023-10-06T03:05:56.531 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-10-06T03:05:56.651 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.137909.asok 2023-10-06T03:05:56.833 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.137909.asok 2023-10-06T03:05:56.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:56.834 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.137909.asok status 2023-10-06T03:05:56.987 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:05:56.987 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2023-10-06T03:05:56.987 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T03:05:56.987 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T03:05:56.987 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2023-10-06T03:05:56.987 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2023-10-06T03:05:56.987 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T03:05:56.987 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "137909", 2023-10-06T03:05:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2023-10-06T03:05:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2023-10-06T03:05:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2023-10-06T03:05:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 5382, 2023-10-06T03:05:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2023-10-06T03:05:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2023-10-06T03:05:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2023-10-06T03:05:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 5382 2023-10-06T03:05:56.988 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-06T03:05:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-06T03:05:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:05:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 2489563824 2023-10-06T03:05:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:05:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-06T03:05:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-06T03:05:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:05:56.989 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 2489563824 2023-10-06T03:05:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:05:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.5382 192.168.0.1:0/2489563824", 2023-10-06T03:05:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "192.168.0.1:0/2489563824", 2023-10-06T03:05:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2023-10-06T03:05:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 19, 2023-10-06T03:05:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 44, 2023-10-06T03:05:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2023-10-06T03:05:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: "blocklisted": false, 2023-10-06T03:05:56.990 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2023-10-06T03:05:56.990 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:05:56.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:56.997 DEBUG:teuthology.orchestra.run.smithi125:> stat --file-system '--printf=%T 2023-10-06T03:05:56.997 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:57.015 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2023-10-06T03:05:57.015 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:57.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:57.016 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:57.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:57.082 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.file.layout.pool -v data_new layoutfile) 2023-10-06T03:05:57.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:05:57.142 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v data_new layoutdir) 2023-10-06T03:05:57.204 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2023-10-06T03:05:57.204 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:05:57.204 DEBUG:teuthology.orchestra.run.smithi125:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T03:05:57.286 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[137909]: fuse finished with error 0 and tester_r 0 2023-10-06T03:05:57.287 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T03:05:58.689 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:05:58.691 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:06:03.388 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:06:03.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:03.389 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:06:03.412 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2023-10-06T03:06:03.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.587+0000 7f4f3e13e700 1 Processor -- start 2023-10-06T03:06:03.589 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.587+0000 7f4f3e13e700 1 -- start start 2023-10-06T03:06:03.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f3e13e700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4f380c8320 0x7f4f38160c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:03.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f3e13e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f380c9470 con 0x7f4f380cba50 2023-10-06T03:06:03.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f3e13e700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f380c9b40 con 0x7f4f380af320 2023-10-06T03:06:03.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f3e13e700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f380c8860 con 0x7f4f380c8320 2023-10-06T03:06:03.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f36ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4f380cba50 0x7f4f380c7c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52756/0 (socket says 172.21.15.125:52756) 2023-10-06T03:06:03.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f36ffd700 1 -- 172.21.15.125:0/2463928992 learned_addr learned my addr 172.21.15.125:0/2463928992 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:03.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f367fc700 1 -- 172.21.15.125:0/2463928992 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180092963 0 0) 0x7f4f380c9470 con 0x7f4f380cba50 2023-10-06T03:06:03.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f37fff700 1 --2- 172.21.15.125:0/2463928992 >> v2:172.21.15.130:3300/0 conn(0x7f4f380c8320 0x7f4f38160c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:03.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f367fc700 1 -- 172.21.15.125:0/2463928992 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f20003570 con 0x7f4f380cba50 2023-10-06T03:06:03.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f367fc700 1 -- 172.21.15.125:0/2463928992 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2458512831 0 0) 0x7f4f20003570 con 0x7f4f380cba50 2023-10-06T03:06:03.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f367fc700 1 -- 172.21.15.125:0/2463928992 >> v2:172.21.15.130:3300/0 conn(0x7f4f380c8320 msgr2=0x7f4f38160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:03.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f367fc700 1 --2- 172.21.15.125:0/2463928992 >> v2:172.21.15.130:3300/0 conn(0x7f4f380c8320 0x7f4f38160c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:03.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f367fc700 1 -- 172.21.15.125:0/2463928992 >> v1:172.21.15.130:6789/0 conn(0x7f4f380af320 legacy=0x7f4f380cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:03.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f367fc700 1 -- 172.21.15.125:0/2463928992 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f380c8b40 con 0x7f4f380cba50 2023-10-06T03:06:03.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f367fc700 1 -- 172.21.15.125:0/2463928992 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f4f2c001470 con 0x7f4f380cba50 2023-10-06T03:06:03.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f367fc700 1 -- 172.21.15.125:0/2463928992 >> v1:172.21.15.125:6789/0 conn(0x7f4f380cba50 legacy=0x7f4f380c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:03.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f367fc700 1 --2- 172.21.15.125:0/2463928992 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f20003ab0 0x7f4f20003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:03.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f367fc700 1 --2- 172.21.15.125:0/2463928992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f20004810 0x7f4f20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:03.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f367fc700 1 --2- 172.21.15.125:0/2463928992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f20005210 0x7f4f2000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:03.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f367fc700 1 -- 172.21.15.125:0/2463928992 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f380c8860 con 0x7f4f20004810 2023-10-06T03:06:03.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f367fc700 1 -- 172.21.15.125:0/2463928992 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2000c130 con 0x7f4f20005210 2023-10-06T03:06:03.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f367fc700 1 -- 172.21.15.125:0/2463928992 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2000c2f0 con 0x7f4f20003ab0 2023-10-06T03:06:03.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.588+0000 7f4f36ffd700 1 --2- 172.21.15.125:0/2463928992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f20004810 0x7f4f20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:03.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.589+0000 7f4f377fe700 1 --2- 172.21.15.125:0/2463928992 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f20003ab0 0x7f4f20003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:03.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.589+0000 7f4f37fff700 1 --2- 172.21.15.125:0/2463928992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f20005210 0x7f4f2000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:03.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.589+0000 7f4f36ffd700 1 -- 172.21.15.125:0/2463928992 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f20003ab0 msgr2=0x7f4f20003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:03.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.589+0000 7f4f36ffd700 1 --2- 172.21.15.125:0/2463928992 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f20003ab0 0x7f4f20003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:03.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.589+0000 7f4f36ffd700 1 -- 172.21.15.125:0/2463928992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f20005210 msgr2=0x7f4f2000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:03.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.589+0000 7f4f36ffd700 1 --2- 172.21.15.125:0/2463928992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f20005210 0x7f4f2000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:03.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.589+0000 7f4f37fff700 1 -- 172.21.15.125:0/2463928992 reap_dead start 2023-10-06T03:06:03.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.589+0000 7f4f36ffd700 1 -- 172.21.15.125:0/2463928992 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f20003570 con 0x7f4f20004810 2023-10-06T03:06:03.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.589+0000 7f4f36ffd700 1 --2- 172.21.15.125:0/2463928992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f20004810 0x7f4f20004c80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00c2d0 tx=0x7f4f2c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=225859412336b651 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:03.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.589+0000 7f4f367fc700 1 -- 172.21.15.125:0/2463928992 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c00cb20 con 0x7f4f20004810 2023-10-06T03:06:03.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.589+0000 7f4f367fc700 1 -- 172.21.15.125:0/2463928992 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c00cca0 con 0x7f4f20004810 2023-10-06T03:06:03.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.589+0000 7f4f367fc700 1 -- 172.21.15.125:0/2463928992 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c005b70 con 0x7f4f20004810 2023-10-06T03:06:03.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.590+0000 7f4f3e13e700 1 -- 172.21.15.125:0/2463928992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f20004810 msgr2=0x7f4f20004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:03.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.590+0000 7f4f3e13e700 1 --2- 172.21.15.125:0/2463928992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f20004810 0x7f4f20004c80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00c2d0 tx=0x7f4f2c001d80 comp rx=0 tx=0).stop 2023-10-06T03:06:03.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.590+0000 7f4f3e13e700 1 -- 172.21.15.125:0/2463928992 shutdown_connections 2023-10-06T03:06:03.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.590+0000 7f4f3e13e700 1 --2- 172.21.15.125:0/2463928992 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f20004810 0x7f4f20004c80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:03.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.590+0000 7f4f3e13e700 1 -- 172.21.15.125:0/2463928992 >> 172.21.15.125:0/2463928992 conn(0x7f4f38096120 msgr2=0x7f4f38068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:03.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.590+0000 7f4f3e13e700 1 -- 172.21.15.125:0/2463928992 shutdown_connections 2023-10-06T03:06:03.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.590+0000 7f4f3e13e700 1 -- 172.21.15.125:0/2463928992 wait complete. 2023-10-06T03:06:03.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.591+0000 7f4f3e13e700 1 Processor -- start 2023-10-06T03:06:03.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.591+0000 7f4f3e13e700 1 -- start start 2023-10-06T03:06:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f3e13e700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f20004810 0x7f4f38155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f3e13e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f3814dc90 0x7f4f3814e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f3e13e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f3814ed30 0x7f4f3815cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f3e13e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f38155d40 con 0x7f4f3814ed30 2023-10-06T03:06:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f3e13e700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f38155370 con 0x7f4f20004810 2023-10-06T03:06:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f3e13e700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f38154760 con 0x7f4f3814dc90 2023-10-06T03:06:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f37fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f3814ed30 0x7f4f3815cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f37fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f3814ed30 0x7f4f3815cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47786/0 (socket says 172.21.15.125:47786) 2023-10-06T03:06:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f37fff700 1 -- 172.21.15.125:0/617120094 learned_addr learned my addr 172.21.15.125:0/617120094 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f377fe700 1 --2- 172.21.15.125:0/617120094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f20004810 0x7f4f38155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:03.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f36ffd700 1 --2- 172.21.15.125:0/617120094 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f3814dc90 0x7f4f3814e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f37fff700 1 -- 172.21.15.125:0/617120094 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f3814dc90 msgr2=0x7f4f3814e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f37fff700 1 --2- 172.21.15.125:0/617120094 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f3814dc90 0x7f4f3814e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f37fff700 1 -- 172.21.15.125:0/617120094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f20004810 msgr2=0x7f4f38155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f37fff700 1 --2- 172.21.15.125:0/617120094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f20004810 0x7f4f38155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f37fff700 1 -- 172.21.15.125:0/617120094 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f38154a40 con 0x7f4f3814ed30 2023-10-06T03:06:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f36ffd700 1 --2- 172.21.15.125:0/617120094 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f3814dc90 0x7f4f3814e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f37fff700 1 --2- 172.21.15.125:0/617120094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f3814ed30 0x7f4f3815cae0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4f300094d0 tx=0x7f4f3000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f1f7fe700 1 -- 172.21.15.125:0/617120094 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3000e040 con 0x7f4f3814ed30 2023-10-06T03:06:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f1f7fe700 1 -- 172.21.15.125:0/617120094 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3000f040 con 0x7f4f3814ed30 2023-10-06T03:06:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f3e13e700 1 -- 172.21.15.125:0/617120094 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f38154d20 con 0x7f4f3814ed30 2023-10-06T03:06:03.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.592+0000 7f4f1f7fe700 1 -- 172.21.15.125:0/617120094 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3000fe50 con 0x7f4f3814ed30 2023-10-06T03:06:03.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.593+0000 7f4f3e13e700 1 -- 172.21.15.125:0/617120094 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f381543a0 con 0x7f4f3814ed30 2023-10-06T03:06:03.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.593+0000 7f4f3e13e700 1 -- 172.21.15.125:0/617120094 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f38155500 con 0x7f4f3814ed30 2023-10-06T03:06:03.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.595+0000 7f4f1f7fe700 1 -- 172.21.15.125:0/617120094 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f30015640 con 0x7f4f3814ed30 2023-10-06T03:06:03.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.595+0000 7f4f1f7fe700 1 --2- 172.21.15.125:0/617120094 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4f24066f30 0x7f4f240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:03.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.595+0000 7f4f1f7fe700 1 -- 172.21.15.125:0/617120094 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f4f30085dd0 con 0x7f4f3814ed30 2023-10-06T03:06:03.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.595+0000 7f4f377fe700 1 --2- 172.21.15.125:0/617120094 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4f24066f30 0x7f4f240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:03.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.596+0000 7f4f377fe700 1 --2- 172.21.15.125:0/617120094 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4f24066f30 0x7f4f240693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4f28000c00 tx=0x7f4f28009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:03.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.599+0000 7f4f1f7fe700 1 -- 172.21.15.125:0/617120094 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f30056680 con 0x7f4f3814ed30 2023-10-06T03:06:03.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.854+0000 7f4f3e13e700 1 -- 172.21.15.125:0/617120094 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f4f38066510 con 0x7f4f3814ed30 2023-10-06T03:06:03.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.857+0000 7f4f1f7fe700 1 -- 172.21.15.125:0/617120094 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v18) v1 ==== 184+0+0 (secure 0 0 0) 0x7f4f30056210 con 0x7f4f3814ed30 2023-10-06T03:06:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.859+0000 7f4f3e13e700 1 -- 172.21.15.125:0/617120094 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4f24066f30 msgr2=0x7f4f240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.859+0000 7f4f3e13e700 1 --2- 172.21.15.125:0/617120094 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4f24066f30 0x7f4f240693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4f28000c00 tx=0x7f4f28009040 comp rx=0 tx=0).stop 2023-10-06T03:06:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.859+0000 7f4f3e13e700 1 -- 172.21.15.125:0/617120094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f3814ed30 msgr2=0x7f4f3815cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.859+0000 7f4f3e13e700 1 --2- 172.21.15.125:0/617120094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f3814ed30 0x7f4f3815cae0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4f300094d0 tx=0x7f4f3000b040 comp rx=0 tx=0).stop 2023-10-06T03:06:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.859+0000 7f4f3e13e700 1 -- 172.21.15.125:0/617120094 shutdown_connections 2023-10-06T03:06:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.859+0000 7f4f3e13e700 1 --2- 172.21.15.125:0/617120094 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4f24066f30 0x7f4f240693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:03.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.859+0000 7f4f3e13e700 1 --2- 172.21.15.125:0/617120094 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f3814ed30 0x7f4f3815cae0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.859+0000 7f4f3e13e700 1 --2- 172.21.15.125:0/617120094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f20004810 0x7f4f38155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.859+0000 7f4f3e13e700 1 --2- 172.21.15.125:0/617120094 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f3814dc90 0x7f4f3814e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.859+0000 7f4f3e13e700 1 -- 172.21.15.125:0/617120094 >> 172.21.15.125:0/617120094 conn(0x7f4f38096120 msgr2=0x7f4f3814f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.859+0000 7f4f3e13e700 1 -- 172.21.15.125:0/617120094 shutdown_connections 2023-10-06T03:06:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:03.859+0000 7f4f3e13e700 1 -- 172.21.15.125:0/617120094 wait complete. 2023-10-06T03:06:03.862 INFO:teuthology.orchestra.run.smithi125.stderr:updated caps for client.0 2023-10-06T03:06:03.872 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:06:03.873 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:06:03.918 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:06:03.961 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:06:03.962 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:06:03.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:03.962 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:06:03.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:06:03.980 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T03:06:03.980 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-10-06T03:06:03.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:03.981 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T03:06:04.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:06:04.023 INFO:teuthology.orchestra.run.smithi130.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T03:06:04.023 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:06:04.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:04.023 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T03:06:04.040 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:06:04.041 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T03:06:04.041 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-10-06T03:06:04.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:04.041 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T03:06:04.082 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:06:04.083 INFO:teuthology.orchestra.run.smithi130.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T03:06:04.083 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:06:04.200 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.199+0000 7fafee1f6700 1 Processor -- start 2023-10-06T03:06:04.201 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.199+0000 7fafee1f6700 1 -- start start 2023-10-06T03:06:04.204 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.200+0000 7fafee1f6700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fafe80c3d30 0x7fafe80c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.200+0000 7fafee1f6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe80c4230 con 0x7fafe80ce8a0 2023-10-06T03:06:04.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.200+0000 7fafee1f6700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe80cd290 con 0x7fafe80cc4b0 2023-10-06T03:06:04.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.200+0000 7fafee1f6700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe80cd570 con 0x7fafe80c3d30 2023-10-06T03:06:04.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.200+0000 7fafe7fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fafe80ce8a0 0x7fafe8069510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52772/0 (socket says 172.21.15.125:52772) 2023-10-06T03:06:04.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.200+0000 7fafe7fff700 1 -- 172.21.15.125:0/509613656 learned_addr learned my addr 172.21.15.125:0/509613656 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:04.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.200+0000 7fafe6ffd700 1 --2- 172.21.15.125:0/509613656 >> v2:172.21.15.130:3300/0 conn(0x7fafe80c3d30 0x7fafe80c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.200+0000 7fafe67fc700 1 -- 172.21.15.125:0/509613656 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570890408 0 0) 0x7fafe80c4230 con 0x7fafe80ce8a0 2023-10-06T03:06:04.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.200+0000 7fafe67fc700 1 -- 172.21.15.125:0/509613656 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafd0003570 con 0x7fafe80ce8a0 2023-10-06T03:06:04.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe67fc700 1 -- 172.21.15.125:0/509613656 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2657711480 0 0) 0x7fafd0003570 con 0x7fafe80ce8a0 2023-10-06T03:06:04.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe67fc700 1 -- 172.21.15.125:0/509613656 >> v2:172.21.15.130:3300/0 conn(0x7fafe80c3d30 msgr2=0x7fafe80c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:04.205 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe67fc700 1 --2- 172.21.15.125:0/509613656 >> v2:172.21.15.130:3300/0 conn(0x7fafe80c3d30 0x7fafe80c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe67fc700 1 -- 172.21.15.125:0/509613656 >> v1:172.21.15.130:6789/0 conn(0x7fafe80cc4b0 legacy=0x7fafe80cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:04.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe67fc700 1 -- 172.21.15.125:0/509613656 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe80ccf90 con 0x7fafe80ce8a0 2023-10-06T03:06:04.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe67fc700 1 -- 172.21.15.125:0/509613656 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7fafe00017f0 con 0x7fafe80ce8a0 2023-10-06T03:06:04.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe67fc700 1 -- 172.21.15.125:0/509613656 >> v1:172.21.15.125:6789/0 conn(0x7fafe80ce8a0 legacy=0x7fafe8069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:04.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe67fc700 1 --2- 172.21.15.125:0/509613656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafd0003a60 0x7fafd0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe67fc700 1 --2- 172.21.15.125:0/509613656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd0004810 0x7fafd0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe67fc700 1 --2- 172.21.15.125:0/509613656 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafd00051c0 0x7fafd000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe67fc700 1 -- 172.21.15.125:0/509613656 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80cd570 con 0x7fafd0003a60 2023-10-06T03:06:04.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe67fc700 1 -- 172.21.15.125:0/509613656 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd000c0d0 con 0x7fafd0004810 2023-10-06T03:06:04.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe67fc700 1 -- 172.21.15.125:0/509613656 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafd000c290 con 0x7fafd00051c0 2023-10-06T03:06:04.206 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe77fe700 1 --2- 172.21.15.125:0/509613656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafd0003a60 0x7fafd0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe6ffd700 1 --2- 172.21.15.125:0/509613656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd0004810 0x7fafd0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe7fff700 1 --2- 172.21.15.125:0/509613656 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafd00051c0 0x7fafd000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe77fe700 1 -- 172.21.15.125:0/509613656 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafd00051c0 msgr2=0x7fafd000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe77fe700 1 --2- 172.21.15.125:0/509613656 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafd00051c0 0x7fafd000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe77fe700 1 -- 172.21.15.125:0/509613656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd0004810 msgr2=0x7fafd0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe77fe700 1 --2- 172.21.15.125:0/509613656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafd0004810 0x7fafd0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe77fe700 1 -- 172.21.15.125:0/509613656 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd0003570 con 0x7fafd0003a60 2023-10-06T03:06:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe7fff700 1 -- 172.21.15.125:0/509613656 reap_dead start 2023-10-06T03:06:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe77fe700 1 --2- 172.21.15.125:0/509613656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafd0003a60 0x7fafd0003e70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0018b0 tx=0x7fafdc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc79e050d92142 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe67fc700 1 -- 172.21.15.125:0/509613656 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc012420 con 0x7fafd0003a60 2023-10-06T03:06:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe67fc700 1 -- 172.21.15.125:0/509613656 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafdc0125a0 con 0x7fafd0003a60 2023-10-06T03:06:04.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.201+0000 7fafe67fc700 1 -- 172.21.15.125:0/509613656 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafdc012960 con 0x7fafd0003a60 2023-10-06T03:06:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.202+0000 7fafee1f6700 1 -- 172.21.15.125:0/509613656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafd0003a60 msgr2=0x7fafd0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.202+0000 7fafee1f6700 1 --2- 172.21.15.125:0/509613656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafd0003a60 0x7fafd0003e70 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fafdc0018b0 tx=0x7fafdc007d30 comp rx=0 tx=0).stop 2023-10-06T03:06:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.202+0000 7fafee1f6700 1 -- 172.21.15.125:0/509613656 shutdown_connections 2023-10-06T03:06:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.202+0000 7fafee1f6700 1 --2- 172.21.15.125:0/509613656 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafd0003a60 0x7fafd0003e70 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.202+0000 7fafee1f6700 1 -- 172.21.15.125:0/509613656 >> 172.21.15.125:0/509613656 conn(0x7fafe8067df0 msgr2=0x7fafe80cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.202+0000 7fafee1f6700 1 -- 172.21.15.125:0/509613656 shutdown_connections 2023-10-06T03:06:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.202+0000 7fafee1f6700 1 -- 172.21.15.125:0/509613656 wait complete. 2023-10-06T03:06:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.203+0000 7fafee1f6700 1 Processor -- start 2023-10-06T03:06:04.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.203+0000 7fafee1f6700 1 -- start start 2023-10-06T03:06:04.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.204+0000 7fafee1f6700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafd0003a60 0x7fafe80c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.204+0000 7fafee1f6700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafe816d6a0 0x7fafe8156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.204+0000 7fafee1f6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafe816ca80 0x7fafe816cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.204+0000 7fafee1f6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe816d440 con 0x7fafe816ca80 2023-10-06T03:06:04.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.204+0000 7fafee1f6700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe815c820 con 0x7fafe816d6a0 2023-10-06T03:06:04.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.204+0000 7fafee1f6700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe815c260 con 0x7fafd0003a60 2023-10-06T03:06:04.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.204+0000 7fafe7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafe816ca80 0x7fafe816cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.204+0000 7fafe7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafe816ca80 0x7fafe816cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47814/0 (socket says 172.21.15.125:47814) 2023-10-06T03:06:04.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.204+0000 7fafe7fff700 1 -- 172.21.15.125:0/340149220 learned_addr learned my addr 172.21.15.125:0/340149220 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:04.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.204+0000 7fafe6ffd700 1 --2- 172.21.15.125:0/340149220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafe816d6a0 0x7fafe8156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.204+0000 7fafe77fe700 1 --2- 172.21.15.125:0/340149220 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafd0003a60 0x7fafe80c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.204+0000 7fafe7fff700 1 -- 172.21.15.125:0/340149220 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafd0003a60 msgr2=0x7fafe80c5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:04.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.204+0000 7fafe7fff700 1 --2- 172.21.15.125:0/340149220 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafd0003a60 0x7fafe80c5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.204+0000 7fafe7fff700 1 -- 172.21.15.125:0/340149220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafe816d6a0 msgr2=0x7fafe8156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:04.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.204+0000 7fafe7fff700 1 --2- 172.21.15.125:0/340149220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafe816d6a0 0x7fafe8156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.204+0000 7fafe7fff700 1 -- 172.21.15.125:0/340149220 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe815c540 con 0x7fafe816ca80 2023-10-06T03:06:04.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.204+0000 7fafe77fe700 1 --2- 172.21.15.125:0/340149220 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafd0003a60 0x7fafe80c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:04.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.204+0000 7fafe7fff700 1 --2- 172.21.15.125:0/340149220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafe816ca80 0x7fafe816cf00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fafe0000f80 tx=0x7fafe00018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:04.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.205+0000 7fafcf7fe700 1 -- 172.21.15.125:0/340149220 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe000ebc0 con 0x7fafe816ca80 2023-10-06T03:06:04.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.205+0000 7fafcf7fe700 1 -- 172.21.15.125:0/340149220 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe000ed40 con 0x7fafe816ca80 2023-10-06T03:06:04.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.205+0000 7fafee1f6700 1 -- 172.21.15.125:0/340149220 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe80c6ac0 con 0x7fafe816ca80 2023-10-06T03:06:04.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.205+0000 7fafcf7fe700 1 -- 172.21.15.125:0/340149220 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe0013670 con 0x7fafe816ca80 2023-10-06T03:06:04.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.205+0000 7fafee1f6700 1 -- 172.21.15.125:0/340149220 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe815bf30 con 0x7fafe816ca80 2023-10-06T03:06:04.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.205+0000 7fafee1f6700 1 -- 172.21.15.125:0/340149220 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe80c6920 con 0x7fafe816ca80 2023-10-06T03:06:04.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.206+0000 7fafcf7fe700 1 -- 172.21.15.125:0/340149220 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fafe00139e0 con 0x7fafe816ca80 2023-10-06T03:06:04.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.206+0000 7fafcf7fe700 1 --2- 172.21.15.125:0/340149220 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fafd4066f30 0x7fafd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.206+0000 7fafe77fe700 1 --2- 172.21.15.125:0/340149220 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fafd4066f30 0x7fafd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.206+0000 7fafcf7fe700 1 -- 172.21.15.125:0/340149220 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6773+0+0 (secure 0 0 0) 0x7fafe0084f20 con 0x7fafe816ca80 2023-10-06T03:06:04.213 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.207+0000 7fafe77fe700 1 --2- 172.21.15.125:0/340149220 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fafd4066f30 0x7fafd40693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fafe815e690 tx=0x7fafdc015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:04.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.211+0000 7fafcf7fe700 1 -- 172.21.15.125:0/340149220 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fafe80c6920 con 0x7fafe816ca80 2023-10-06T03:06:04.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.439+0000 7fafee1f6700 1 -- 172.21.15.125:0/340149220 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fafe80c6fe0 con 0x7fafe816ca80 2023-10-06T03:06:04.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.439+0000 7fafcf7fe700 1 -- 172.21.15.125:0/340149220 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4611 (secure 0 0 0) 0x7fafe80c6fe0 con 0x7fafe816ca80 2023-10-06T03:06:04.441 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:04.441 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3042542444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3042542444},{"type":"v1","addr":"172.21.15.130:6835","nonce":3042542444}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2110429483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2110429483},{"type":"v1","addr":"172.21.15.130:6833","nonce":2110429483}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/1710838785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1710838785},{"type":"v1","addr":"172.21.15.125:6836","nonce":1710838785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:05:30.346007+0000","modified":"2023-10-06T03:05:45.295717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5085":{"gid":5085,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.125:6837/4027450913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":4027450913},{"type":"v1","addr":"172.21.15.125:6837","nonce":4027450913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7,8],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:06:04.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.441+0000 7fafee1f6700 1 -- 172.21.15.125:0/340149220 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fafd4066f30 msgr2=0x7fafd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:04.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.441+0000 7fafee1f6700 1 --2- 172.21.15.125:0/340149220 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fafd4066f30 0x7fafd40693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fafe815e690 tx=0x7fafdc015000 comp rx=0 tx=0).stop 2023-10-06T03:06:04.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.441+0000 7fafee1f6700 1 -- 172.21.15.125:0/340149220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafe816ca80 msgr2=0x7fafe816cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:04.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.441+0000 7fafee1f6700 1 --2- 172.21.15.125:0/340149220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafe816ca80 0x7fafe816cf00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fafe0000f80 tx=0x7fafe00018a0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.441+0000 7fafee1f6700 1 -- 172.21.15.125:0/340149220 shutdown_connections 2023-10-06T03:06:04.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.441+0000 7fafee1f6700 1 --2- 172.21.15.125:0/340149220 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fafd4066f30 0x7fafd40693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.441+0000 7fafee1f6700 1 --2- 172.21.15.125:0/340149220 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafe816ca80 0x7fafe816cf00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.441+0000 7fafee1f6700 1 --2- 172.21.15.125:0/340149220 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafd0003a60 0x7fafe80c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.441+0000 7fafee1f6700 1 --2- 172.21.15.125:0/340149220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafe816d6a0 0x7fafe8156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.441+0000 7fafee1f6700 1 -- 172.21.15.125:0/340149220 >> 172.21.15.125:0/340149220 conn(0x7fafe8067df0 msgr2=0x7fafe8158d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:04.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.441+0000 7fafee1f6700 1 -- 172.21.15.125:0/340149220 shutdown_connections 2023-10-06T03:06:04.444 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.441+0000 7fafee1f6700 1 -- 172.21.15.125:0/340149220 wait complete. 2023-10-06T03:06:04.444 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 19 2023-10-06T03:06:04.455 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:06:04.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.571+0000 7f398c3d4700 1 Processor -- start 2023-10-06T03:06:04.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.571+0000 7f398c3d4700 1 -- start start 2023-10-06T03:06:04.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.572+0000 7f398c3d4700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3984157220 0x7f39840b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.572+0000 7f398c3d4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f39840b1280 0x7f39840c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.572+0000 7f398c3d4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39840c9d10 con 0x7f39840c4750 2023-10-06T03:06:04.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.572+0000 7f398c3d4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39840c9ff0 con 0x7f39840b1280 2023-10-06T03:06:04.580 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.572+0000 7f398c3d4700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39840c3730 con 0x7f3984157220 2023-10-06T03:06:04.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.572+0000 7f398996f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f39840b1280 0x7f39840c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.572+0000 7f398a971700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f39840c4750 0x7f39840c8d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:52788/0 (socket says 172.21.15.125:52788) 2023-10-06T03:06:04.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.572+0000 7f398a971700 1 -- 172.21.15.125:0/1539296026 learned_addr learned my addr 172.21.15.125:0/1539296026 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:04.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.573+0000 7f398a170700 1 --2- 172.21.15.125:0/1539296026 >> v2:172.21.15.130:3300/0 conn(0x7f3984157220 0x7f39840b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.573+0000 7f398996f700 1 -- 172.21.15.125:0/1539296026 >> v2:172.21.15.130:3300/0 conn(0x7f3984157220 msgr2=0x7f39840b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:04.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.573+0000 7f398996f700 1 --2- 172.21.15.125:0/1539296026 >> v2:172.21.15.130:3300/0 conn(0x7f3984157220 0x7f39840b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.573+0000 7f398996f700 1 -- 172.21.15.125:0/1539296026 >> v1:172.21.15.125:6789/0 conn(0x7f39840c4750 legacy=0x7f39840c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:04.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.573+0000 7f398996f700 1 -- 172.21.15.125:0/1539296026 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39840c3a10 con 0x7f39840b1280 2023-10-06T03:06:04.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.573+0000 7f398916e700 1 -- 172.21.15.125:0/1539296026 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036364454 0 0) 0x7f39840c9d10 con 0x7f39840c4750 2023-10-06T03:06:04.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.573+0000 7f398996f700 1 --2- 172.21.15.125:0/1539296026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39840b1280 0x7f39840c4210 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3984064850 tx=0x7f39800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2508862212bddb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:04.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.573+0000 7f398916e700 1 -- 172.21.15.125:0/1539296026 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398000b6b0 con 0x7f39840b1280 2023-10-06T03:06:04.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.573+0000 7f398916e700 1 -- 172.21.15.125:0/1539296026 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398000b810 con 0x7f39840b1280 2023-10-06T03:06:04.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.573+0000 7f398916e700 1 -- 172.21.15.125:0/1539296026 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398000bbb0 con 0x7f39840b1280 2023-10-06T03:06:04.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.574+0000 7f398c3d4700 1 -- 172.21.15.125:0/1539296026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39840b1280 msgr2=0x7f39840c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:04.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.574+0000 7f398c3d4700 1 --2- 172.21.15.125:0/1539296026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39840b1280 0x7f39840c4210 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3984064850 tx=0x7f39800091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.574+0000 7f398c3d4700 1 -- 172.21.15.125:0/1539296026 shutdown_connections 2023-10-06T03:06:04.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.574+0000 7f398c3d4700 1 --2- 172.21.15.125:0/1539296026 >> v2:172.21.15.130:3300/0 conn(0x7f3984157220 0x7f39840b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.574+0000 7f398c3d4700 1 --2- 172.21.15.125:0/1539296026 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39840b1280 0x7f39840c4210 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.574+0000 7f398c3d4700 1 -- 172.21.15.125:0/1539296026 >> 172.21.15.125:0/1539296026 conn(0x7f3984067df0 msgr2=0x7f39840cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:04.582 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.574+0000 7f398c3d4700 1 -- 172.21.15.125:0/1539296026 shutdown_connections 2023-10-06T03:06:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.574+0000 7f398c3d4700 1 -- 172.21.15.125:0/1539296026 wait complete. 2023-10-06T03:06:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.575+0000 7f398c3d4700 1 Processor -- start 2023-10-06T03:06:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.575+0000 7f398c3d4700 1 -- start start 2023-10-06T03:06:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.575+0000 7f398c3d4700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39840b1280 0x7f398414fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.575+0000 7f398c3d4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39840c4750 0x7f39840c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.575+0000 7f398c3d4700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3984157220 0x7f398415cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.575+0000 7f398c3d4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39841532e0 con 0x7f39840c4750 2023-10-06T03:06:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.575+0000 7f398c3d4700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39840c69c0 con 0x7f39840b1280 2023-10-06T03:06:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.575+0000 7f398c3d4700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3984153880 con 0x7f3984157220 2023-10-06T03:06:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.576+0000 7f398996f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39840c4750 0x7f39840c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.583 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.576+0000 7f398996f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39840c4750 0x7f39840c5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47840/0 (socket says 172.21.15.125:47840) 2023-10-06T03:06:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.576+0000 7f398996f700 1 -- 172.21.15.125:0/789427234 learned_addr learned my addr 172.21.15.125:0/789427234 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.576+0000 7f398a170700 1 --2- 172.21.15.125:0/789427234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39840b1280 0x7f398414fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.576+0000 7f398a971700 1 --2- 172.21.15.125:0/789427234 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3984157220 0x7f398415cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.576+0000 7f398996f700 1 -- 172.21.15.125:0/789427234 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3984157220 msgr2=0x7f398415cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.576+0000 7f398996f700 1 --2- 172.21.15.125:0/789427234 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3984157220 0x7f398415cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.576+0000 7f398996f700 1 -- 172.21.15.125:0/789427234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39840b1280 msgr2=0x7f398414fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.576+0000 7f398996f700 1 --2- 172.21.15.125:0/789427234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39840b1280 0x7f398414fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.576+0000 7f398996f700 1 -- 172.21.15.125:0/789427234 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3980009420 con 0x7f39840c4750 2023-10-06T03:06:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.576+0000 7f398996f700 1 --2- 172.21.15.125:0/789427234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39840c4750 0x7f39840c5a40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f398000b0e0 tx=0x7f3980017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.576+0000 7f397a7fc700 1 -- 172.21.15.125:0/789427234 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398000bb90 con 0x7f39840c4750 2023-10-06T03:06:04.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.576+0000 7f397a7fc700 1 -- 172.21.15.125:0/789427234 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3980011420 con 0x7f39840c4750 2023-10-06T03:06:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.576+0000 7f398c3d4700 1 -- 172.21.15.125:0/789427234 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39840c6400 con 0x7f39840c4750 2023-10-06T03:06:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.576+0000 7f397a7fc700 1 -- 172.21.15.125:0/789427234 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39800117e0 con 0x7f39840c4750 2023-10-06T03:06:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.576+0000 7f398c3d4700 1 -- 172.21.15.125:0/789427234 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3984153510 con 0x7f39840c4750 2023-10-06T03:06:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.577+0000 7f398c3d4700 1 -- 172.21.15.125:0/789427234 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3984066510 con 0x7f39840c4750 2023-10-06T03:06:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.577+0000 7f397a7fc700 1 -- 172.21.15.125:0/789427234 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3980011c10 con 0x7f39840c4750 2023-10-06T03:06:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.578+0000 7f397a7fc700 1 --2- 172.21.15.125:0/789427234 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3968066f60 0x7f3968069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.578+0000 7f397a7fc700 1 -- 172.21.15.125:0/789427234 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f3980086240 con 0x7f39840c4750 2023-10-06T03:06:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.578+0000 7f398a170700 1 --2- 172.21.15.125:0/789427234 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3968066f60 0x7f3968069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.578+0000 7f398a170700 1 --2- 172.21.15.125:0/789427234 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3968066f60 0x7f3968069410 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3974006fd0 tx=0x7f3974008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:04.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.582+0000 7f397a7fc700 1 -- 172.21.15.125:0/789427234 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3980053080 con 0x7f39840c4750 2023-10-06T03:06:04.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.765+0000 7f398c3d4700 1 -- 172.21.15.125:0/789427234 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39841539f0 con 0x7f39840c4750 2023-10-06T03:06:04.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.766+0000 7f397a7fc700 1 -- 172.21.15.125:0/789427234 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18774 (secure 0 0 0) 0x7f39800566a0 con 0x7f39840c4750 2023-10-06T03:06:04.767 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:04.767 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":44,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:05:46.297098+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:05:28.440579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T03:05:29.311703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":8,"pool_name":"data_new","create_time":"2023-10-06T03:05:43.892252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:06:04.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.768+0000 7f398c3d4700 1 -- 172.21.15.125:0/789427234 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3968066f60 msgr2=0x7f3968069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:04.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.768+0000 7f398c3d4700 1 --2- 172.21.15.125:0/789427234 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3968066f60 0x7f3968069410 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3974006fd0 tx=0x7f3974008040 comp rx=0 tx=0).stop 2023-10-06T03:06:04.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.768+0000 7f398c3d4700 1 -- 172.21.15.125:0/789427234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39840c4750 msgr2=0x7f39840c5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:04.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.768+0000 7f398c3d4700 1 --2- 172.21.15.125:0/789427234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39840c4750 0x7f39840c5a40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f398000b0e0 tx=0x7f3980017000 comp rx=0 tx=0).stop 2023-10-06T03:06:04.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.768+0000 7f398c3d4700 1 -- 172.21.15.125:0/789427234 shutdown_connections 2023-10-06T03:06:04.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.768+0000 7f398c3d4700 1 --2- 172.21.15.125:0/789427234 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3968066f60 0x7f3968069410 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.768+0000 7f398c3d4700 1 --2- 172.21.15.125:0/789427234 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3984157220 0x7f398415cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.768+0000 7f398c3d4700 1 --2- 172.21.15.125:0/789427234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39840b1280 0x7f398414fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.768+0000 7f398c3d4700 1 --2- 172.21.15.125:0/789427234 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f39840c4750 0x7f39840c5a40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.768+0000 7f398c3d4700 1 -- 172.21.15.125:0/789427234 >> 172.21.15.125:0/789427234 conn(0x7f3984067df0 msgr2=0x7f39841514e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:04.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.768+0000 7f398c3d4700 1 -- 172.21.15.125:0/789427234 shutdown_connections 2023-10-06T03:06:04.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.768+0000 7f398c3d4700 1 -- 172.21.15.125:0/789427234 wait complete. 2023-10-06T03:06:04.781 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:04:15.845430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:04:22.729795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:05:28.440579+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:05:29.311703+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 8, 'pool_name': 'data_new', 'create_time': '2023-10-06T03:05:43.892252+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:06:04.781 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:06:04.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.901+0000 7f6d98f89700 1 Processor -- start 2023-10-06T03:06:04.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.901+0000 7f6d98f89700 1 -- start start 2023-10-06T03:06:04.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.902+0000 7f6d98f89700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d940cba50 0x7f6d940c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.902+0000 7f6d98f89700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6d940c8150 0x7f6d940c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.902+0000 7f6d98f89700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d940c9470 con 0x7f6d940af320 2023-10-06T03:06:04.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.902+0000 7f6d98f89700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d940c9b40 con 0x7f6d940c8150 2023-10-06T03:06:04.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.902+0000 7f6d98f89700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940c85a0 con 0x7f6d940cba50 2023-10-06T03:06:04.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.903+0000 7f6d92d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6d940c8150 0x7f6d940c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.903+0000 7f6d92d9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6d940c8150 0x7f6d940c1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47856/0 (socket says 172.21.15.125:47856) 2023-10-06T03:06:04.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.903+0000 7f6d92d9d700 1 -- 172.21.15.125:0/3044121451 learned_addr learned my addr 172.21.15.125:0/3044121451 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:04.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.903+0000 7f6d91d9b700 1 --2- 172.21.15.125:0/3044121451 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d940cba50 0x7f6d940c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.903+0000 7f6d92d9d700 1 -- 172.21.15.125:0/3044121451 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d940cba50 msgr2=0x7f6d940c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:04.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.903+0000 7f6d92d9d700 1 --2- 172.21.15.125:0/3044121451 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d940cba50 0x7f6d940c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.903+0000 7f6d92d9d700 1 -- 172.21.15.125:0/3044121451 >> v1:172.21.15.130:6789/0 conn(0x7f6d940af320 legacy=0x7f6d940cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:04.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.903+0000 7f6d92d9d700 1 -- 172.21.15.125:0/3044121451 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d940c8860 con 0x7f6d940c8150 2023-10-06T03:06:04.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.903+0000 7f6d92d9d700 1 --2- 172.21.15.125:0/3044121451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d940c8150 0x7f6d940c1e20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009f20 tx=0x7f6d8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fba6258cc34bd65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:04.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.903+0000 7f6d9159a700 1 -- 172.21.15.125:0/3044121451 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00e070 con 0x7f6d940c8150 2023-10-06T03:06:04.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.903+0000 7f6d9159a700 1 -- 172.21.15.125:0/3044121451 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c00ba80 con 0x7f6d940c8150 2023-10-06T03:06:04.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.903+0000 7f6d9159a700 1 -- 172.21.15.125:0/3044121451 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0092e0 con 0x7f6d940c8150 2023-10-06T03:06:04.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.904+0000 7f6d98f89700 1 -- 172.21.15.125:0/3044121451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d940c8150 msgr2=0x7f6d940c1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:04.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.904+0000 7f6d98f89700 1 --2- 172.21.15.125:0/3044121451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d940c8150 0x7f6d940c1e20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009f20 tx=0x7f6d8c009840 comp rx=0 tx=0).stop 2023-10-06T03:06:04.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.904+0000 7f6d98f89700 1 -- 172.21.15.125:0/3044121451 shutdown_connections 2023-10-06T03:06:04.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.904+0000 7f6d98f89700 1 --2- 172.21.15.125:0/3044121451 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d940c8150 0x7f6d940c1e20 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.904+0000 7f6d98f89700 1 --2- 172.21.15.125:0/3044121451 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d940cba50 0x7f6d940c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.904+0000 7f6d98f89700 1 -- 172.21.15.125:0/3044121451 >> 172.21.15.125:0/3044121451 conn(0x7f6d94096120 msgr2=0x7f6d94068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:04.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.904+0000 7f6d98f89700 1 -- 172.21.15.125:0/3044121451 shutdown_connections 2023-10-06T03:06:04.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.904+0000 7f6d98f89700 1 -- 172.21.15.125:0/3044121451 wait complete. 2023-10-06T03:06:04.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.905+0000 7f6d98f89700 1 Processor -- start 2023-10-06T03:06:04.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.905+0000 7f6d98f89700 1 -- start start 2023-10-06T03:06:04.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.906+0000 7f6d98f89700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d940af320 0x7f6d94098a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.906+0000 7f6d98f89700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d940c8150 0x7f6d9409a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.906+0000 7f6d98f89700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d940cba50 0x7f6d941532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.906+0000 7f6d98f89700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940c4190 con 0x7f6d940cba50 2023-10-06T03:06:04.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.906+0000 7f6d98f89700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d94099040 con 0x7f6d940af320 2023-10-06T03:06:04.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.906+0000 7f6d98f89700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940c6440 con 0x7f6d940c8150 2023-10-06T03:06:04.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.906+0000 7f6d92d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d940cba50 0x7f6d941532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.906+0000 7f6d92d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d940cba50 0x7f6d941532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47872/0 (socket says 172.21.15.125:47872) 2023-10-06T03:06:04.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.906+0000 7f6d92d9d700 1 -- 172.21.15.125:0/2872587365 learned_addr learned my addr 172.21.15.125:0/2872587365 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:04.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.906+0000 7f6d9259c700 1 --2- 172.21.15.125:0/2872587365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d940af320 0x7f6d94098a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.906+0000 7f6d91d9b700 1 --2- 172.21.15.125:0/2872587365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d940c8150 0x7f6d9409a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.906+0000 7f6d92d9d700 1 -- 172.21.15.125:0/2872587365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d940c8150 msgr2=0x7f6d9409a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:04.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.906+0000 7f6d92d9d700 1 --2- 172.21.15.125:0/2872587365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d940c8150 0x7f6d9409a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.906+0000 7f6d92d9d700 1 -- 172.21.15.125:0/2872587365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d940af320 msgr2=0x7f6d94098a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:04.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.906+0000 7f6d92d9d700 1 --2- 172.21.15.125:0/2872587365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d940af320 0x7f6d94098a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:04.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.906+0000 7f6d92d9d700 1 -- 172.21.15.125:0/2872587365 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c009ae0 con 0x7f6d940cba50 2023-10-06T03:06:04.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.906+0000 7f6d92d9d700 1 --2- 172.21.15.125:0/2872587365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d940cba50 0x7f6d941532d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00b6c0 tx=0x7f6d8c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:04.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.906+0000 7f6d827fc700 1 -- 172.21.15.125:0/2872587365 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c020070 con 0x7f6d940cba50 2023-10-06T03:06:04.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.907+0000 7f6d827fc700 1 -- 172.21.15.125:0/2872587365 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c0092e0 con 0x7f6d940cba50 2023-10-06T03:06:04.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.907+0000 7f6d98f89700 1 -- 172.21.15.125:0/2872587365 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d940c6720 con 0x7f6d940cba50 2023-10-06T03:06:04.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.907+0000 7f6d827fc700 1 -- 172.21.15.125:0/2872587365 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c01a4c0 con 0x7f6d940cba50 2023-10-06T03:06:04.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.907+0000 7f6d98f89700 1 -- 172.21.15.125:0/2872587365 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d94096b90 con 0x7f6d940cba50 2023-10-06T03:06:04.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.907+0000 7f6d98f89700 1 -- 172.21.15.125:0/2872587365 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d940c4340 con 0x7f6d940cba50 2023-10-06T03:06:04.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.908+0000 7f6d827fc700 1 -- 172.21.15.125:0/2872587365 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d8c003040 con 0x7f6d940cba50 2023-10-06T03:06:04.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.908+0000 7f6d827fc700 1 --2- 172.21.15.125:0/2872587365 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6d74066f30 0x7f6d740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:04.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.908+0000 7f6d827fc700 1 -- 172.21.15.125:0/2872587365 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f6d8c087d00 con 0x7f6d940cba50 2023-10-06T03:06:04.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.908+0000 7f6d9259c700 1 --2- 172.21.15.125:0/2872587365 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6d74066f30 0x7f6d740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:04.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.909+0000 7f6d9259c700 1 --2- 172.21.15.125:0/2872587365 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6d74066f30 0x7f6d740693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6d940aef30 tx=0x7f6d88009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:04.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:04.912+0000 7f6d827fc700 1 -- 172.21.15.125:0/2872587365 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d940c4340 con 0x7f6d940cba50 2023-10-06T03:06:05.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.095+0000 7f6d98f89700 1 -- 172.21.15.125:0/2872587365 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d94066510 con 0x7f6d940cba50 2023-10-06T03:06:05.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.095+0000 7f6d827fc700 1 -- 172.21.15.125:0/2872587365 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d8c02a020 con 0x7f6d940cba50 2023-10-06T03:06:05.097 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-06T03:06:05.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.097+0000 7f6d98f89700 1 -- 172.21.15.125:0/2872587365 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6d74066f30 msgr2=0x7f6d740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:05.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.097+0000 7f6d98f89700 1 --2- 172.21.15.125:0/2872587365 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6d74066f30 0x7f6d740693e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6d940aef30 tx=0x7f6d88009040 comp rx=0 tx=0).stop 2023-10-06T03:06:05.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.097+0000 7f6d98f89700 1 -- 172.21.15.125:0/2872587365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d940cba50 msgr2=0x7f6d941532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:05.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.097+0000 7f6d98f89700 1 --2- 172.21.15.125:0/2872587365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d940cba50 0x7f6d941532d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00b6c0 tx=0x7f6d8c018000 comp rx=0 tx=0).stop 2023-10-06T03:06:05.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.097+0000 7f6d98f89700 1 -- 172.21.15.125:0/2872587365 shutdown_connections 2023-10-06T03:06:05.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.097+0000 7f6d98f89700 1 --2- 172.21.15.125:0/2872587365 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6d74066f30 0x7f6d740693e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.097+0000 7f6d98f89700 1 --2- 172.21.15.125:0/2872587365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6d940cba50 0x7f6d941532d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.097+0000 7f6d98f89700 1 --2- 172.21.15.125:0/2872587365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6d940af320 0x7f6d94098a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.097+0000 7f6d98f89700 1 --2- 172.21.15.125:0/2872587365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6d940c8150 0x7f6d9409a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.097+0000 7f6d98f89700 1 -- 172.21.15.125:0/2872587365 >> 172.21.15.125:0/2872587365 conn(0x7f6d94096120 msgr2=0x7f6d940c36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:05.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.097+0000 7f6d98f89700 1 -- 172.21.15.125:0/2872587365 shutdown_connections 2023-10-06T03:06:05.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.097+0000 7f6d98f89700 1 -- 172.21.15.125:0/2872587365 wait complete. 2023-10-06T03:06:05.110 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:06:05.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.228+0000 7f5d15a15700 1 Processor -- start 2023-10-06T03:06:05.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.228+0000 7f5d15a15700 1 -- start start 2023-10-06T03:06:05.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.229+0000 7f5d15a15700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5d101591d0 0x7f5d100b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.229+0000 7f5d15a15700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5d101595a0 0x7f5d100b2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.229+0000 7f5d15a15700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f5d100b2570 0x7f5d100cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.229+0000 7f5d15a15700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d100cc360 con 0x7f5d101595a0 2023-10-06T03:06:05.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.229+0000 7f5d15a15700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d100cba70 con 0x7f5d100b2570 2023-10-06T03:06:05.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.229+0000 7f5d15a15700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d100cbd10 con 0x7f5d101591d0 2023-10-06T03:06:05.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.229+0000 7f5d0e7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5d101595a0 0x7f5d100b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.229+0000 7f5d0e7fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f5d101595a0 0x7f5d100b2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47884/0 (socket says 172.21.15.125:47884) 2023-10-06T03:06:05.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.229+0000 7f5d0e7fc700 1 -- 172.21.15.125:0/1463665425 learned_addr learned my addr 172.21.15.125:0/1463665425 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:05.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.229+0000 7f5d0effd700 1 --2- 172.21.15.125:0/1463665425 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5d101591d0 0x7f5d100b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.229+0000 7f5d0f7fe700 1 --2- 172.21.15.125:0/1463665425 >> v2:172.21.15.130:3300/0 conn(0x7f5d100b2570 0x7f5d100cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.229+0000 7f5d0e7fc700 1 -- 172.21.15.125:0/1463665425 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5d101591d0 msgr2=0x7f5d100b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:05.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.229+0000 7f5d0e7fc700 1 --2- 172.21.15.125:0/1463665425 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5d101591d0 0x7f5d100b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.229+0000 7f5d0e7fc700 1 -- 172.21.15.125:0/1463665425 >> v2:172.21.15.130:3300/0 conn(0x7f5d100b2570 msgr2=0x7f5d100cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:05.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.229+0000 7f5d0e7fc700 1 --2- 172.21.15.125:0/1463665425 >> v2:172.21.15.130:3300/0 conn(0x7f5d100b2570 0x7f5d100cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.229+0000 7f5d0e7fc700 1 -- 172.21.15.125:0/1463665425 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d100cbff0 con 0x7f5d101595a0 2023-10-06T03:06:05.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.230+0000 7f5d0e7fc700 1 --2- 172.21.15.125:0/1463665425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d101595a0 0x7f5d100b2030 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5d1006fcb0 tx=0x7f5d00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaaecb1ec87b152d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:05.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.230+0000 7f5d0dffb700 1 -- 172.21.15.125:0/1463665425 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0000b860 con 0x7f5d101595a0 2023-10-06T03:06:05.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.230+0000 7f5d0dffb700 1 -- 172.21.15.125:0/1463665425 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0000b9c0 con 0x7f5d101595a0 2023-10-06T03:06:05.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.230+0000 7f5d0dffb700 1 -- 172.21.15.125:0/1463665425 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0000bd60 con 0x7f5d101595a0 2023-10-06T03:06:05.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.230+0000 7f5d15a15700 1 -- 172.21.15.125:0/1463665425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d101595a0 msgr2=0x7f5d100b2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:05.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.230+0000 7f5d15a15700 1 --2- 172.21.15.125:0/1463665425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d101595a0 0x7f5d100b2030 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5d1006fcb0 tx=0x7f5d00009250 comp rx=0 tx=0).stop 2023-10-06T03:06:05.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.230+0000 7f5d15a15700 1 -- 172.21.15.125:0/1463665425 shutdown_connections 2023-10-06T03:06:05.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.230+0000 7f5d15a15700 1 --2- 172.21.15.125:0/1463665425 >> v2:172.21.15.130:3300/0 conn(0x7f5d100b2570 0x7f5d100cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.230+0000 7f5d15a15700 1 --2- 172.21.15.125:0/1463665425 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5d101591d0 0x7f5d100b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.230+0000 7f5d15a15700 1 --2- 172.21.15.125:0/1463665425 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d101595a0 0x7f5d100b2030 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.230+0000 7f5d15a15700 1 -- 172.21.15.125:0/1463665425 >> 172.21.15.125:0/1463665425 conn(0x7f5d1006ed40 msgr2=0x7f5d1006f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:05.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.230+0000 7f5d15a15700 1 -- 172.21.15.125:0/1463665425 shutdown_connections 2023-10-06T03:06:05.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.230+0000 7f5d15a15700 1 -- 172.21.15.125:0/1463665425 wait complete. 2023-10-06T03:06:05.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.232+0000 7f5d15a15700 1 Processor -- start 2023-10-06T03:06:05.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.232+0000 7f5d15a15700 1 -- start start 2023-10-06T03:06:05.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.232+0000 7f5d15a15700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d101591d0 0x7f5d1014d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.238 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.232+0000 7f5d15a15700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d101595a0 0x7f5d10157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.232+0000 7f5d15a15700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5d1014dcc0 0x7f5d1014e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.232+0000 7f5d15a15700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1014cd80 con 0x7f5d101595a0 2023-10-06T03:06:05.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.232+0000 7f5d15a15700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1014c450 con 0x7f5d101591d0 2023-10-06T03:06:05.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.232+0000 7f5d15a15700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1014c730 con 0x7f5d1014dcc0 2023-10-06T03:06:05.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.232+0000 7f5d0e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d101595a0 0x7f5d10157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.232+0000 7f5d0e7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d101595a0 0x7f5d10157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:47888/0 (socket says 172.21.15.125:47888) 2023-10-06T03:06:05.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.232+0000 7f5d0e7fc700 1 -- 172.21.15.125:0/1667209966 learned_addr learned my addr 172.21.15.125:0/1667209966 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:05.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.233+0000 7f5d0effd700 1 --2- 172.21.15.125:0/1667209966 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d101591d0 0x7f5d1014d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.233+0000 7f5d0f7fe700 1 --2- 172.21.15.125:0/1667209966 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5d1014dcc0 0x7f5d1014e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.239 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.233+0000 7f5d0e7fc700 1 -- 172.21.15.125:0/1667209966 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5d1014dcc0 msgr2=0x7f5d1014e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:05.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.233+0000 7f5d0e7fc700 1 --2- 172.21.15.125:0/1667209966 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5d1014dcc0 0x7f5d1014e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.233+0000 7f5d0e7fc700 1 -- 172.21.15.125:0/1667209966 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d101591d0 msgr2=0x7f5d1014d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:05.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.233+0000 7f5d0e7fc700 1 --2- 172.21.15.125:0/1667209966 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d101591d0 0x7f5d1014d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.233+0000 7f5d0e7fc700 1 -- 172.21.15.125:0/1667209966 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d000094f0 con 0x7f5d101595a0 2023-10-06T03:06:05.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.233+0000 7f5d0effd700 1 --2- 172.21.15.125:0/1667209966 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d101591d0 0x7f5d1014d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:05.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.233+0000 7f5d0e7fc700 1 --2- 172.21.15.125:0/1667209966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d101595a0 0x7f5d10157110 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5d100cff40 tx=0x7f5d00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:05.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.233+0000 7f5cf6ffd700 1 -- 172.21.15.125:0/1667209966 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d00024440 con 0x7f5d101595a0 2023-10-06T03:06:05.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.233+0000 7f5cf6ffd700 1 -- 172.21.15.125:0/1667209966 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d000245a0 con 0x7f5d101595a0 2023-10-06T03:06:05.240 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.233+0000 7f5d15a15700 1 -- 172.21.15.125:0/1667209966 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d1014ca10 con 0x7f5d101595a0 2023-10-06T03:06:05.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.233+0000 7f5cf6ffd700 1 -- 172.21.15.125:0/1667209966 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d00024960 con 0x7f5d101595a0 2023-10-06T03:06:05.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.233+0000 7f5d15a15700 1 -- 172.21.15.125:0/1667209966 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d10157650 con 0x7f5d101595a0 2023-10-06T03:06:05.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.234+0000 7f5d15a15700 1 -- 172.21.15.125:0/1667209966 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d1014cf30 con 0x7f5d101595a0 2023-10-06T03:06:05.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.234+0000 7f5cf6ffd700 1 -- 172.21.15.125:0/1667209966 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d0001a420 con 0x7f5d101595a0 2023-10-06T03:06:05.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.235+0000 7f5cf6ffd700 1 --2- 172.21.15.125:0/1667209966 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5cfc066f30 0x7f5cfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.235+0000 7f5cf6ffd700 1 -- 172.21.15.125:0/1667209966 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f5d000867e0 con 0x7f5d101595a0 2023-10-06T03:06:05.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.235+0000 7f5d0effd700 1 --2- 172.21.15.125:0/1667209966 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5cfc066f30 0x7f5cfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.241 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.235+0000 7f5d0effd700 1 --2- 172.21.15.125:0/1667209966 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5cfc066f30 0x7f5cfc0693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5d100ca330 tx=0x7f5d04008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:05.242 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.239+0000 7f5cf6ffd700 1 -- 172.21.15.125:0/1667209966 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d1014cf30 con 0x7f5d101595a0 2023-10-06T03:06:05.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.419+0000 7f5d15a15700 1 -- 172.21.15.125:0/1667209966 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5d10066510 con 0x7f5d101595a0 2023-10-06T03:06:05.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.420+0000 7f5cf6ffd700 1 -- 172.21.15.125:0/1667209966 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5d00053620 con 0x7f5d101595a0 2023-10-06T03:06:05.421 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-06T03:06:05.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.421+0000 7f5d15a15700 1 -- 172.21.15.125:0/1667209966 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5cfc066f30 msgr2=0x7f5cfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:05.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.421+0000 7f5d15a15700 1 --2- 172.21.15.125:0/1667209966 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5cfc066f30 0x7f5cfc0693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5d100ca330 tx=0x7f5d04008040 comp rx=0 tx=0).stop 2023-10-06T03:06:05.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.421+0000 7f5d15a15700 1 -- 172.21.15.125:0/1667209966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d101595a0 msgr2=0x7f5d10157110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:05.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.421+0000 7f5d15a15700 1 --2- 172.21.15.125:0/1667209966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d101595a0 0x7f5d10157110 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5d100cff40 tx=0x7f5d00017000 comp rx=0 tx=0).stop 2023-10-06T03:06:05.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.422+0000 7f5d15a15700 1 -- 172.21.15.125:0/1667209966 shutdown_connections 2023-10-06T03:06:05.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.422+0000 7f5d15a15700 1 --2- 172.21.15.125:0/1667209966 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5cfc066f30 0x7f5cfc0693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.422+0000 7f5d15a15700 1 --2- 172.21.15.125:0/1667209966 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5d1014dcc0 0x7f5d1014e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.422+0000 7f5d15a15700 1 --2- 172.21.15.125:0/1667209966 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5d101591d0 0x7f5d1014d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.422+0000 7f5d15a15700 1 --2- 172.21.15.125:0/1667209966 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5d101595a0 0x7f5d10157110 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.422+0000 7f5d15a15700 1 -- 172.21.15.125:0/1667209966 >> 172.21.15.125:0/1667209966 conn(0x7f5d1006ed40 msgr2=0x7f5d1014ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:05.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.422+0000 7f5d15a15700 1 -- 172.21.15.125:0/1667209966 shutdown_connections 2023-10-06T03:06:05.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.422+0000 7f5d15a15700 1 -- 172.21.15.125:0/1667209966 wait complete. 2023-10-06T03:06:05.435 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:06:05.555 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.554+0000 7f338dfcb700 1 Processor -- start 2023-10-06T03:06:05.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.554+0000 7f338dfcb700 1 -- start start 2023-10-06T03:06:05.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.555+0000 7f338dfcb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f338815cb00 0x7f33880b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.555+0000 7f338dfcb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33880ca670 con 0x7f3388067610 2023-10-06T03:06:05.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.555+0000 7f338dfcb700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3388067a80 con 0x7f3388068ba0 2023-10-06T03:06:05.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.555+0000 7f338dfcb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3388068320 con 0x7f338815cb00 2023-10-06T03:06:05.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.555+0000 7f33877fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f338815cb00 0x7f33880b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.555+0000 7f337effd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3388067610 0x7f3388068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36008/0 (socket says 172.21.15.125:36008) 2023-10-06T03:06:05.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.555+0000 7f337effd700 1 -- 172.21.15.125:0/125974312 learned_addr learned my addr 172.21.15.125:0/125974312 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:05.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.555+0000 7f33877fe700 1 -- 172.21.15.125:0/125974312 >> v1:172.21.15.130:6789/0 conn(0x7f3388068ba0 legacy=0x7f33880cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:05.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.555+0000 7f33877fe700 1 -- 172.21.15.125:0/125974312 >> v1:172.21.15.125:6789/0 conn(0x7f3388067610 legacy=0x7f3388068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:05.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.555+0000 7f33877fe700 1 -- 172.21.15.125:0/125974312 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3388067d60 con 0x7f338815cb00 2023-10-06T03:06:05.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.555+0000 7f3386ffd700 1 -- 172.21.15.125:0/125974312 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425036682 0 0) 0x7f33880ca670 con 0x7f3388067610 2023-10-06T03:06:05.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.555+0000 7f33877fe700 1 --2- 172.21.15.125:0/125974312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f338815cb00 0x7f33880b0240 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f33780098d0 tx=0x7f3378009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c386c15ef9eadb83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:05.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.556+0000 7f3386ffd700 1 -- 172.21.15.125:0/125974312 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3378009e70 con 0x7f338815cb00 2023-10-06T03:06:05.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.556+0000 7f3386ffd700 1 -- 172.21.15.125:0/125974312 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3378005c10 con 0x7f338815cb00 2023-10-06T03:06:05.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.556+0000 7f3386ffd700 1 -- 172.21.15.125:0/125974312 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337800b650 con 0x7f338815cb00 2023-10-06T03:06:05.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.556+0000 7f338dfcb700 1 -- 172.21.15.125:0/125974312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f338815cb00 msgr2=0x7f33880b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:05.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.556+0000 7f338dfcb700 1 --2- 172.21.15.125:0/125974312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f338815cb00 0x7f33880b0240 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f33780098d0 tx=0x7f3378009120 comp rx=0 tx=0).stop 2023-10-06T03:06:05.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.556+0000 7f338dfcb700 1 -- 172.21.15.125:0/125974312 shutdown_connections 2023-10-06T03:06:05.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.556+0000 7f338dfcb700 1 --2- 172.21.15.125:0/125974312 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f338815cb00 0x7f33880b0240 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.556+0000 7f338dfcb700 1 -- 172.21.15.125:0/125974312 >> 172.21.15.125:0/125974312 conn(0x7f33880af730 msgr2=0x7f33880afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:05.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.556+0000 7f338dfcb700 1 -- 172.21.15.125:0/125974312 shutdown_connections 2023-10-06T03:06:05.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.556+0000 7f338dfcb700 1 -- 172.21.15.125:0/125974312 wait complete. 2023-10-06T03:06:05.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.557+0000 7f338dfcb700 1 Processor -- start 2023-10-06T03:06:05.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.557+0000 7f338dfcb700 1 -- start start 2023-10-06T03:06:05.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.558+0000 7f338dfcb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3388067610 0x7f3388151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.558+0000 7f338dfcb700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3388068ba0 0x7f338816a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.558+0000 7f338dfcb700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f338815cb00 0x7f3388169790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.558+0000 7f338dfcb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33880c6810 con 0x7f3388067610 2023-10-06T03:06:05.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.558+0000 7f338dfcb700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3388153000 con 0x7f338815cb00 2023-10-06T03:06:05.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.558+0000 7f338dfcb700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338816ae50 con 0x7f3388068ba0 2023-10-06T03:06:05.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.558+0000 7f33877fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3388067610 0x7f3388151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.558+0000 7f33877fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3388067610 0x7f3388151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49120/0 (socket says 172.21.15.125:49120) 2023-10-06T03:06:05.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.558+0000 7f33877fe700 1 -- 172.21.15.125:0/2353313519 learned_addr learned my addr 172.21.15.125:0/2353313519 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:05.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.558+0000 7f337effd700 1 --2- 172.21.15.125:0/2353313519 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3388068ba0 0x7f338816a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.558+0000 7f3387fff700 1 --2- 172.21.15.125:0/2353313519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f338815cb00 0x7f3388169790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.559+0000 7f33877fe700 1 -- 172.21.15.125:0/2353313519 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3388068ba0 msgr2=0x7f338816a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:05.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.559+0000 7f33877fe700 1 --2- 172.21.15.125:0/2353313519 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3388068ba0 0x7f338816a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.559+0000 7f33877fe700 1 -- 172.21.15.125:0/2353313519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f338815cb00 msgr2=0x7f3388169790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:05.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.559+0000 7f33877fe700 1 --2- 172.21.15.125:0/2353313519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f338815cb00 0x7f3388169790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.559+0000 7f33877fe700 1 -- 172.21.15.125:0/2353313519 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33780093c0 con 0x7f3388067610 2023-10-06T03:06:05.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.559+0000 7f337effd700 1 --2- 172.21.15.125:0/2353313519 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3388068ba0 0x7f338816a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:05.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.559+0000 7f3387fff700 1 --2- 172.21.15.125:0/2353313519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f338815cb00 0x7f3388169790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:05.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.559+0000 7f33877fe700 1 --2- 172.21.15.125:0/2353313519 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3388067610 0x7f3388151ca0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3378003080 tx=0x7f3378015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:05.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.559+0000 7f337ffff700 1 -- 172.21.15.125:0/2353313519 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33780066c0 con 0x7f3388067610 2023-10-06T03:06:05.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.559+0000 7f337ffff700 1 -- 172.21.15.125:0/2353313519 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3378006820 con 0x7f3388067610 2023-10-06T03:06:05.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.559+0000 7f338dfcb700 1 -- 172.21.15.125:0/2353313519 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3388152380 con 0x7f3388067610 2023-10-06T03:06:05.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.559+0000 7f337ffff700 1 -- 172.21.15.125:0/2353313519 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337801c680 con 0x7f3388067610 2023-10-06T03:06:05.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.559+0000 7f338dfcb700 1 -- 172.21.15.125:0/2353313519 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3388152940 con 0x7f3388067610 2023-10-06T03:06:05.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.560+0000 7f338dfcb700 1 -- 172.21.15.125:0/2353313519 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f338806e770 con 0x7f3388067610 2023-10-06T03:06:05.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.560+0000 7f337ffff700 1 -- 172.21.15.125:0/2353313519 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3378023070 con 0x7f3388067610 2023-10-06T03:06:05.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.560+0000 7f337ffff700 1 --2- 172.21.15.125:0/2353313519 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3368066f30 0x7f33680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.561+0000 7f337ffff700 1 -- 172.21.15.125:0/2353313519 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f3378086a00 con 0x7f3388067610 2023-10-06T03:06:05.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.561+0000 7f337effd700 1 --2- 172.21.15.125:0/2353313519 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3368066f30 0x7f33680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.561+0000 7f337effd700 1 --2- 172.21.15.125:0/2353313519 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3368066f30 0x7f33680693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f338806bc50 tx=0x7f3370009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:05.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.565+0000 7f337ffff700 1 -- 172.21.15.125:0/2353313519 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3378053840 con 0x7f3388067610 2023-10-06T03:06:05.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.745+0000 7f338dfcb700 1 -- 172.21.15.125:0/2353313519 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3388066510 con 0x7f3388067610 2023-10-06T03:06:05.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.745+0000 7f337ffff700 1 -- 172.21.15.125:0/2353313519 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3378056e60 con 0x7f3388067610 2023-10-06T03:06:05.747 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-06T03:06:05.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.747+0000 7f338dfcb700 1 -- 172.21.15.125:0/2353313519 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3368066f30 msgr2=0x7f33680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:05.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.747+0000 7f338dfcb700 1 --2- 172.21.15.125:0/2353313519 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3368066f30 0x7f33680693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f338806bc50 tx=0x7f3370009040 comp rx=0 tx=0).stop 2023-10-06T03:06:05.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.747+0000 7f338dfcb700 1 -- 172.21.15.125:0/2353313519 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3388067610 msgr2=0x7f3388151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:05.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.747+0000 7f338dfcb700 1 --2- 172.21.15.125:0/2353313519 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3388067610 0x7f3388151ca0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3378003080 tx=0x7f3378015000 comp rx=0 tx=0).stop 2023-10-06T03:06:05.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.747+0000 7f338dfcb700 1 -- 172.21.15.125:0/2353313519 shutdown_connections 2023-10-06T03:06:05.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.747+0000 7f338dfcb700 1 --2- 172.21.15.125:0/2353313519 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3368066f30 0x7f33680693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.747+0000 7f338dfcb700 1 --2- 172.21.15.125:0/2353313519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f338815cb00 0x7f3388169790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.747+0000 7f338dfcb700 1 --2- 172.21.15.125:0/2353313519 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3388067610 0x7f3388151ca0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.747+0000 7f338dfcb700 1 --2- 172.21.15.125:0/2353313519 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3388068ba0 0x7f338816a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.747+0000 7f338dfcb700 1 -- 172.21.15.125:0/2353313519 >> 172.21.15.125:0/2353313519 conn(0x7f33880af730 msgr2=0x7f33880cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:05.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.747+0000 7f338dfcb700 1 -- 172.21.15.125:0/2353313519 shutdown_connections 2023-10-06T03:06:05.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.747+0000 7f338dfcb700 1 -- 172.21.15.125:0/2353313519 wait complete. 2023-10-06T03:06:05.760 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:06:05.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.880+0000 7fb764c2e700 1 Processor -- start 2023-10-06T03:06:05.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.881+0000 7fb764c2e700 1 -- start start 2023-10-06T03:06:05.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.881+0000 7fb764c2e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb760156de0 0x7fb7601571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.886 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.881+0000 7fb764c2e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7600cd300 con 0x7fb7600cc060 2023-10-06T03:06:05.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.881+0000 7fb764c2e700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7600cc6f0 con 0x7fb7600cd790 2023-10-06T03:06:05.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.881+0000 7fb764c2e700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7600cc4d0 con 0x7fb760156de0 2023-10-06T03:06:05.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75dd9b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb7600cc060 0x7fb76015b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36014/0 (socket says 172.21.15.125:36014) 2023-10-06T03:06:05.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75dd9b700 1 -- 172.21.15.125:0/754447628 learned_addr learned my addr 172.21.15.125:0/754447628 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:05.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75e59c700 1 --2- 172.21.15.125:0/754447628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb760156de0 0x7fb7601571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75d59a700 1 -- 172.21.15.125:0/754447628 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199615331 0 0) 0x7fb7600cd300 con 0x7fb7600cc060 2023-10-06T03:06:05.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75d59a700 1 -- 172.21.15.125:0/754447628 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb74c003570 con 0x7fb7600cc060 2023-10-06T03:06:05.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75d59a700 1 -- 172.21.15.125:0/754447628 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254410015 0 0) 0x7fb7600cc6f0 con 0x7fb7600cd790 2023-10-06T03:06:05.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75d59a700 1 -- 172.21.15.125:0/754447628 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7600cd300 con 0x7fb7600cd790 2023-10-06T03:06:05.887 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75d59a700 1 -- 172.21.15.125:0/754447628 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1721536825 0 0) 0x7fb74c003570 con 0x7fb7600cc060 2023-10-06T03:06:05.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75d59a700 1 -- 172.21.15.125:0/754447628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb760156de0 msgr2=0x7fb7601571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:05.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75d59a700 1 --2- 172.21.15.125:0/754447628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb760156de0 0x7fb7601571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75d59a700 1 -- 172.21.15.125:0/754447628 >> v1:172.21.15.130:6789/0 conn(0x7fb7600cd790 legacy=0x7fb7600ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:05.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75d59a700 1 -- 172.21.15.125:0/754447628 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7600cc9d0 con 0x7fb7600cc060 2023-10-06T03:06:05.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75d59a700 1 -- 172.21.15.125:0/754447628 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7fb750001470 con 0x7fb7600cc060 2023-10-06T03:06:05.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75d59a700 1 -- 172.21.15.125:0/754447628 >> v1:172.21.15.125:6789/0 conn(0x7fb7600cc060 legacy=0x7fb76015b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:05.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75d59a700 1 --2- 172.21.15.125:0/754447628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb74c003c20 0x7fb74c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.888 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75d59a700 1 --2- 172.21.15.125:0/754447628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb74c004810 0x7fb74c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75d59a700 1 --2- 172.21.15.125:0/754447628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb74c0051c0 0x7fb74c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75d59a700 1 -- 172.21.15.125:0/754447628 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7600cc4d0 con 0x7fb74c0051c0 2023-10-06T03:06:05.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75d59a700 1 -- 172.21.15.125:0/754447628 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c00c020 con 0x7fb74c003c20 2023-10-06T03:06:05.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75d59a700 1 -- 172.21.15.125:0/754447628 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74c00c1e0 con 0x7fb74c004810 2023-10-06T03:06:05.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75e59c700 1 --2- 172.21.15.125:0/754447628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb760156de0 0x7fb7601571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:06:05.889 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75ed9d700 1 --2- 172.21.15.125:0/754447628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb74c0051c0 0x7fb74c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75dd9b700 1 --2- 172.21.15.125:0/754447628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb74c004810 0x7fb74c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.882+0000 7fb75e59c700 1 --2- 172.21.15.125:0/754447628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb74c003c20 0x7fb74c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.883+0000 7fb75ed9d700 1 -- 172.21.15.125:0/754447628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb74c004810 msgr2=0x7fb74c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:05.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.883+0000 7fb75ed9d700 1 --2- 172.21.15.125:0/754447628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb74c004810 0x7fb74c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.883+0000 7fb75ed9d700 1 -- 172.21.15.125:0/754447628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb74c003c20 msgr2=0x7fb74c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:05.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.883+0000 7fb75ed9d700 1 --2- 172.21.15.125:0/754447628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb74c003c20 0x7fb74c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.883+0000 7fb75ed9d700 1 -- 172.21.15.125:0/754447628 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb74c003570 con 0x7fb74c0051c0 2023-10-06T03:06:05.890 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.883+0000 7fb75dd9b700 1 --2- 172.21.15.125:0/754447628 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb74c004810 0x7fb74c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:05.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.883+0000 7fb75e59c700 1 --2- 172.21.15.125:0/754447628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb74c003c20 0x7fb74c004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:05.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.883+0000 7fb75ed9d700 1 --2- 172.21.15.125:0/754447628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb74c0051c0 0x7fb74c00ba60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb758002120 tx=0x7fb7580017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678e85b7dda14002 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:05.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.883+0000 7fb75d59a700 1 -- 172.21.15.125:0/754447628 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb758001ab0 con 0x7fb74c0051c0 2023-10-06T03:06:05.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.883+0000 7fb75d59a700 1 -- 172.21.15.125:0/754447628 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75800c980 con 0x7fb74c0051c0 2023-10-06T03:06:05.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.883+0000 7fb75d59a700 1 -- 172.21.15.125:0/754447628 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75800cd20 con 0x7fb74c0051c0 2023-10-06T03:06:05.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.883+0000 7fb764c2e700 1 -- 172.21.15.125:0/754447628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb74c0051c0 msgr2=0x7fb74c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:05.891 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.883+0000 7fb764c2e700 1 --2- 172.21.15.125:0/754447628 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb74c0051c0 0x7fb74c00ba60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb758002120 tx=0x7fb7580017a0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.883+0000 7fb75ed9d700 1 -- 172.21.15.125:0/754447628 reap_dead start 2023-10-06T03:06:05.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.883+0000 7fb764c2e700 1 -- 172.21.15.125:0/754447628 shutdown_connections 2023-10-06T03:06:05.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.883+0000 7fb764c2e700 1 -- 172.21.15.125:0/754447628 >> 172.21.15.125:0/754447628 conn(0x7fb7600cdf80 msgr2=0x7fb7600ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:05.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.883+0000 7fb764c2e700 1 -- 172.21.15.125:0/754447628 shutdown_connections 2023-10-06T03:06:05.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.883+0000 7fb764c2e700 1 -- 172.21.15.125:0/754447628 wait complete. 2023-10-06T03:06:05.892 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.885+0000 7fb764c2e700 1 Processor -- start 2023-10-06T03:06:05.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.885+0000 7fb764c2e700 1 -- start start 2023-10-06T03:06:05.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.886+0000 7fb764c2e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb74c0051c0 0x7fb760159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.886+0000 7fb764c2e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb76014ed40 0x7fb760147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.886+0000 7fb764c2e700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb76015a410 0x7fb760167940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.886+0000 7fb764c2e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb760157e90 con 0x7fb76014ed40 2023-10-06T03:06:05.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.886+0000 7fb764c2e700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7601688d0 con 0x7fb76015a410 2023-10-06T03:06:05.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.886+0000 7fb764c2e700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7601578d0 con 0x7fb74c0051c0 2023-10-06T03:06:05.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.886+0000 7fb75dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb76014ed40 0x7fb760147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.886+0000 7fb75dd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb76014ed40 0x7fb760147160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49144/0 (socket says 172.21.15.125:49144) 2023-10-06T03:06:05.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.886+0000 7fb75dd9b700 1 -- 172.21.15.125:0/1026852270 learned_addr learned my addr 172.21.15.125:0/1026852270 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:05.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.886+0000 7fb75e59c700 1 --2- 172.21.15.125:0/1026852270 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb74c0051c0 0x7fb760159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.886+0000 7fb75ed9d700 1 --2- 172.21.15.125:0/1026852270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb76015a410 0x7fb760167940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.886+0000 7fb75dd9b700 1 -- 172.21.15.125:0/1026852270 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb74c0051c0 msgr2=0x7fb760159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:05.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.886+0000 7fb75dd9b700 1 --2- 172.21.15.125:0/1026852270 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb74c0051c0 0x7fb760159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.886+0000 7fb75dd9b700 1 -- 172.21.15.125:0/1026852270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb76015a410 msgr2=0x7fb760167940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:05.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.886+0000 7fb75dd9b700 1 --2- 172.21.15.125:0/1026852270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb76015a410 0x7fb760167940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:05.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.886+0000 7fb75dd9b700 1 -- 172.21.15.125:0/1026852270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb760157bb0 con 0x7fb76014ed40 2023-10-06T03:06:05.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.886+0000 7fb75ed9d700 1 --2- 172.21.15.125:0/1026852270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb76015a410 0x7fb760167940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:05.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.886+0000 7fb75dd9b700 1 --2- 172.21.15.125:0/1026852270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb76014ed40 0x7fb760147160 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb75000eb00 tx=0x7fb750001060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:05.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.887+0000 7fb7567fc700 1 -- 172.21.15.125:0/1026852270 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb750005e10 con 0x7fb76014ed40 2023-10-06T03:06:05.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.887+0000 7fb7567fc700 1 -- 172.21.15.125:0/1026852270 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb750010040 con 0x7fb76014ed40 2023-10-06T03:06:05.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.887+0000 7fb764c2e700 1 -- 172.21.15.125:0/1026852270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7600c5ec0 con 0x7fb76014ed40 2023-10-06T03:06:05.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.887+0000 7fb7567fc700 1 -- 172.21.15.125:0/1026852270 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75000a9b0 con 0x7fb76014ed40 2023-10-06T03:06:05.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.887+0000 7fb764c2e700 1 -- 172.21.15.125:0/1026852270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7601476a0 con 0x7fb76014ed40 2023-10-06T03:06:05.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.888+0000 7fb764c2e700 1 -- 172.21.15.125:0/1026852270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb760066510 con 0x7fb76014ed40 2023-10-06T03:06:05.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.888+0000 7fb7567fc700 1 -- 172.21.15.125:0/1026852270 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7500143f0 con 0x7fb76014ed40 2023-10-06T03:06:05.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.889+0000 7fb7567fc700 1 --2- 172.21.15.125:0/1026852270 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb740066f30 0x7fb7400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:05.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.889+0000 7fb7567fc700 1 -- 172.21.15.125:0/1026852270 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6773+0+0 (secure 0 0 0) 0x7fb750084560 con 0x7fb76014ed40 2023-10-06T03:06:05.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.889+0000 7fb75e59c700 1 --2- 172.21.15.125:0/1026852270 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb740066f30 0x7fb7400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:05.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.889+0000 7fb75e59c700 1 --2- 172.21.15.125:0/1026852270 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb740066f30 0x7fb7400693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb748006f00 tx=0x7fb748008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:05.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:05.893+0000 7fb7567fc700 1 -- 172.21.15.125:0/1026852270 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7500514d0 con 0x7fb76014ed40 2023-10-06T03:06:06.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.075+0000 7fb764c2e700 1 -- 172.21.15.125:0/1026852270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7600cccb0 con 0x7fb76014ed40 2023-10-06T03:06:06.077 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.076+0000 7fb7567fc700 1 -- 172.21.15.125:0/1026852270 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb750019020 con 0x7fb76014ed40 2023-10-06T03:06:06.077 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-06T03:06:06.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.078+0000 7fb764c2e700 1 -- 172.21.15.125:0/1026852270 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb740066f30 msgr2=0x7fb7400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:06.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.078+0000 7fb764c2e700 1 --2- 172.21.15.125:0/1026852270 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb740066f30 0x7fb7400693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb748006f00 tx=0x7fb748008040 comp rx=0 tx=0).stop 2023-10-06T03:06:06.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.078+0000 7fb764c2e700 1 -- 172.21.15.125:0/1026852270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb76014ed40 msgr2=0x7fb760147160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:06.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.078+0000 7fb764c2e700 1 --2- 172.21.15.125:0/1026852270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb76014ed40 0x7fb760147160 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb75000eb00 tx=0x7fb750001060 comp rx=0 tx=0).stop 2023-10-06T03:06:06.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.078+0000 7fb764c2e700 1 -- 172.21.15.125:0/1026852270 shutdown_connections 2023-10-06T03:06:06.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.078+0000 7fb764c2e700 1 --2- 172.21.15.125:0/1026852270 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb740066f30 0x7fb7400693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.078+0000 7fb764c2e700 1 --2- 172.21.15.125:0/1026852270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb76015a410 0x7fb760167940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.078+0000 7fb764c2e700 1 --2- 172.21.15.125:0/1026852270 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb74c0051c0 0x7fb760159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.078+0000 7fb764c2e700 1 --2- 172.21.15.125:0/1026852270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb76014ed40 0x7fb760147160 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.078+0000 7fb764c2e700 1 -- 172.21.15.125:0/1026852270 >> 172.21.15.125:0/1026852270 conn(0x7fb7600cdf80 msgr2=0x7fb7600c4190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:06.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.078+0000 7fb764c2e700 1 -- 172.21.15.125:0/1026852270 shutdown_connections 2023-10-06T03:06:06.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.078+0000 7fb764c2e700 1 -- 172.21.15.125:0/1026852270 wait complete. 2023-10-06T03:06:06.091 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get data_new pg_num 2023-10-06T03:06:06.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.210+0000 7fb1d1705700 1 Processor -- start 2023-10-06T03:06:06.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.210+0000 7fb1d1705700 1 -- start start 2023-10-06T03:06:06.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.210+0000 7fb1d1705700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1cc15db30 0x7fb1cc0ca990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:06.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.210+0000 7fb1d1705700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb1cc0caed0 0x7fb1cc068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:06.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.210+0000 7fb1d1705700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1cc0ca1a0 con 0x7fb1cc0b03f0 2023-10-06T03:06:06.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.210+0000 7fb1d1705700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1cc0cb370 con 0x7fb1cc0caed0 2023-10-06T03:06:06.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.211+0000 7fb1d1705700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc0c9590 con 0x7fb1cc15db30 2023-10-06T03:06:06.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.211+0000 7fb1cb7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb1cc0caed0 0x7fb1cc068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:06.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.211+0000 7fb1cb7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb1cc0caed0 0x7fb1cc068820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49154/0 (socket says 172.21.15.125:49154) 2023-10-06T03:06:06.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.211+0000 7fb1cb7fe700 1 -- 172.21.15.125:0/520788554 learned_addr learned my addr 172.21.15.125:0/520788554 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:06.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.211+0000 7fb1ca7fc700 1 --2- 172.21.15.125:0/520788554 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1cc15db30 0x7fb1cc0ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:06.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.211+0000 7fb1cb7fe700 1 -- 172.21.15.125:0/520788554 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1cc15db30 msgr2=0x7fb1cc0ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:06.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.211+0000 7fb1cb7fe700 1 --2- 172.21.15.125:0/520788554 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1cc15db30 0x7fb1cc0ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.211+0000 7fb1cb7fe700 1 -- 172.21.15.125:0/520788554 >> v1:172.21.15.130:6789/0 conn(0x7fb1cc0b03f0 legacy=0x7fb1cc0c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:06.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.211+0000 7fb1cb7fe700 1 -- 172.21.15.125:0/520788554 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc0c9870 con 0x7fb1cc0caed0 2023-10-06T03:06:06.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.211+0000 7fb1cb7fe700 1 --2- 172.21.15.125:0/520788554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1cc0caed0 0x7fb1cc068820 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009f20 tx=0x7fb1c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a3f4d33faebc73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:06.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.211+0000 7fb1c9ffb700 1 -- 172.21.15.125:0/520788554 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c400e070 con 0x7fb1cc0caed0 2023-10-06T03:06:06.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.211+0000 7fb1c9ffb700 1 -- 172.21.15.125:0/520788554 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c400b9d0 con 0x7fb1cc0caed0 2023-10-06T03:06:06.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.211+0000 7fb1c9ffb700 1 -- 172.21.15.125:0/520788554 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c40092e0 con 0x7fb1cc0caed0 2023-10-06T03:06:06.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.212+0000 7fb1d1705700 1 -- 172.21.15.125:0/520788554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1cc0caed0 msgr2=0x7fb1cc068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:06.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.212+0000 7fb1d1705700 1 --2- 172.21.15.125:0/520788554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1cc0caed0 0x7fb1cc068820 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009f20 tx=0x7fb1c4009840 comp rx=0 tx=0).stop 2023-10-06T03:06:06.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.212+0000 7fb1d1705700 1 -- 172.21.15.125:0/520788554 shutdown_connections 2023-10-06T03:06:06.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.212+0000 7fb1d1705700 1 --2- 172.21.15.125:0/520788554 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1cc0caed0 0x7fb1cc068820 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.212+0000 7fb1d1705700 1 --2- 172.21.15.125:0/520788554 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1cc15db30 0x7fb1cc0ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.212+0000 7fb1d1705700 1 -- 172.21.15.125:0/520788554 >> 172.21.15.125:0/520788554 conn(0x7fb1cc068080 msgr2=0x7fb1cc0cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:06.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.212+0000 7fb1d1705700 1 -- 172.21.15.125:0/520788554 shutdown_connections 2023-10-06T03:06:06.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.212+0000 7fb1d1705700 1 -- 172.21.15.125:0/520788554 wait complete. 2023-10-06T03:06:06.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.213+0000 7fb1d1705700 1 Processor -- start 2023-10-06T03:06:06.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.213+0000 7fb1d1705700 1 -- start start 2023-10-06T03:06:06.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.214+0000 7fb1d1705700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1cc0b03f0 0x7fb1cc16ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:06.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.214+0000 7fb1d1705700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1cc0caed0 0x7fb1cc154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:06.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.214+0000 7fb1d1705700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1cc15db30 0x7fb1cc0c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:06.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.214+0000 7fb1d1705700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc0b0d30 con 0x7fb1cc0caed0 2023-10-06T03:06:06.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.214+0000 7fb1d1705700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc16d1f0 con 0x7fb1cc0b03f0 2023-10-06T03:06:06.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.214+0000 7fb1d1705700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1cc0b0fa0 con 0x7fb1cc15db30 2023-10-06T03:06:06.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.214+0000 7fb1ca7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1cc0caed0 0x7fb1cc154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:06.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.214+0000 7fb1ca7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1cc0caed0 0x7fb1cc154f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49168/0 (socket says 172.21.15.125:49168) 2023-10-06T03:06:06.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.214+0000 7fb1ca7fc700 1 -- 172.21.15.125:0/826888882 learned_addr learned my addr 172.21.15.125:0/826888882 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:06.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.214+0000 7fb1cb7fe700 1 --2- 172.21.15.125:0/826888882 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1cc15db30 0x7fb1cc0c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:06.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.214+0000 7fb1caffd700 1 --2- 172.21.15.125:0/826888882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1cc0b03f0 0x7fb1cc16ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:06.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.214+0000 7fb1ca7fc700 1 -- 172.21.15.125:0/826888882 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1cc15db30 msgr2=0x7fb1cc0c3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:06.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.214+0000 7fb1ca7fc700 1 --2- 172.21.15.125:0/826888882 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1cc15db30 0x7fb1cc0c3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.214+0000 7fb1ca7fc700 1 -- 172.21.15.125:0/826888882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1cc0b03f0 msgr2=0x7fb1cc16ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:06.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.214+0000 7fb1ca7fc700 1 --2- 172.21.15.125:0/826888882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1cc0b03f0 0x7fb1cc16ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.214+0000 7fb1ca7fc700 1 -- 172.21.15.125:0/826888882 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c4009ae0 con 0x7fb1cc0caed0 2023-10-06T03:06:06.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.214+0000 7fb1caffd700 1 --2- 172.21.15.125:0/826888882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1cc0b03f0 0x7fb1cc16ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:06.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.214+0000 7fb1cb7fe700 1 --2- 172.21.15.125:0/826888882 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1cc15db30 0x7fb1cc0c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:06.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.214+0000 7fb1ca7fc700 1 --2- 172.21.15.125:0/826888882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1cc0caed0 0x7fb1cc154f50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000e930 tx=0x7fb1c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:06.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.215+0000 7fb1b2ffd700 1 -- 172.21.15.125:0/826888882 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c000eed0 con 0x7fb1cc0caed0 2023-10-06T03:06:06.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.215+0000 7fb1b2ffd700 1 -- 172.21.15.125:0/826888882 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c000c8e0 con 0x7fb1cc0caed0 2023-10-06T03:06:06.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.215+0000 7fb1b2ffd700 1 -- 172.21.15.125:0/826888882 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c000cc80 con 0x7fb1cc0caed0 2023-10-06T03:06:06.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.215+0000 7fb1d1705700 1 -- 172.21.15.125:0/826888882 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1cc16d420 con 0x7fb1cc0caed0 2023-10-06T03:06:06.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.215+0000 7fb1d1705700 1 -- 172.21.15.125:0/826888882 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1cc16d9e0 con 0x7fb1cc0caed0 2023-10-06T03:06:06.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.216+0000 7fb1d1705700 1 -- 172.21.15.125:0/826888882 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1cc0b1150 con 0x7fb1cc0caed0 2023-10-06T03:06:06.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.216+0000 7fb1b2ffd700 1 -- 172.21.15.125:0/826888882 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1c0013680 con 0x7fb1cc0caed0 2023-10-06T03:06:06.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.216+0000 7fb1b2ffd700 1 --2- 172.21.15.125:0/826888882 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb1b8066f60 0x7fb1b8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:06.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.216+0000 7fb1b2ffd700 1 -- 172.21.15.125:0/826888882 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6773+0+0 (secure 0 0 0) 0x7fb1c0084b90 con 0x7fb1cc0caed0 2023-10-06T03:06:06.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.216+0000 7fb1caffd700 1 --2- 172.21.15.125:0/826888882 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb1b8066f60 0x7fb1b8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:06.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.217+0000 7fb1caffd700 1 --2- 172.21.15.125:0/826888882 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb1b8066f60 0x7fb1b8069410 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc001840 tx=0x7fb1bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:06.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.220+0000 7fb1b2ffd700 1 -- 172.21.15.125:0/826888882 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1cc0b1150 con 0x7fb1cc0caed0 2023-10-06T03:06:06.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.405+0000 7fb1d1705700 1 -- 172.21.15.125:0/826888882 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"} v 0) v1 -- 0x7fb1cc0b1110 con 0x7fb1cc0caed0 2023-10-06T03:06:06.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.405+0000 7fb1b2ffd700 1 -- 172.21.15.125:0/826888882 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "data_new", "var": "pg_num"}]=0 v44) v1 ==== 97+0+11 (secure 0 0 0) 0x7fb1c00519d0 con 0x7fb1cc0caed0 2023-10-06T03:06:06.407 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-06T03:06:06.408 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.407+0000 7fb1d1705700 1 -- 172.21.15.125:0/826888882 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb1b8066f60 msgr2=0x7fb1b8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:06.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.407+0000 7fb1d1705700 1 --2- 172.21.15.125:0/826888882 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb1b8066f60 0x7fb1b8069410 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc001840 tx=0x7fb1bc009040 comp rx=0 tx=0).stop 2023-10-06T03:06:06.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.407+0000 7fb1d1705700 1 -- 172.21.15.125:0/826888882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1cc0caed0 msgr2=0x7fb1cc154f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:06.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.407+0000 7fb1d1705700 1 --2- 172.21.15.125:0/826888882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1cc0caed0 0x7fb1cc154f50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000e930 tx=0x7fb1c00091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.407+0000 7fb1d1705700 1 -- 172.21.15.125:0/826888882 shutdown_connections 2023-10-06T03:06:06.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.407+0000 7fb1d1705700 1 --2- 172.21.15.125:0/826888882 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb1b8066f60 0x7fb1b8069410 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.407+0000 7fb1d1705700 1 --2- 172.21.15.125:0/826888882 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb1cc15db30 0x7fb1cc0c3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.407+0000 7fb1d1705700 1 --2- 172.21.15.125:0/826888882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb1cc0b03f0 0x7fb1cc16ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.407+0000 7fb1d1705700 1 --2- 172.21.15.125:0/826888882 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb1cc0caed0 0x7fb1cc154f50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.407+0000 7fb1d1705700 1 -- 172.21.15.125:0/826888882 >> 172.21.15.125:0/826888882 conn(0x7fb1cc068080 msgr2=0x7fb1cc15cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:06.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.407+0000 7fb1d1705700 1 -- 172.21.15.125:0/826888882 shutdown_connections 2023-10-06T03:06:06.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.407+0000 7fb1d1705700 1 -- 172.21.15.125:0/826888882 wait complete. 2023-10-06T03:06:06.420 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:06:06.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.536+0000 7fd5cb7b6700 1 Processor -- start 2023-10-06T03:06:06.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.536+0000 7fd5cb7b6700 1 -- start start 2023-10-06T03:06:06.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.537+0000 7fd5cb7b6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd5c4159350 0x7fd5c40a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:06.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.537+0000 7fd5cb7b6700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5c4159720 0x7fd5c40684f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:06.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.537+0000 7fd5cb7b6700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c4068d80 con 0x7fd5c4067610 2023-10-06T03:06:06.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.537+0000 7fd5cb7b6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c40af8a0 con 0x7fd5c4159350 2023-10-06T03:06:06.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.537+0000 7fd5cb7b6700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c40cb420 con 0x7fd5c4159720 2023-10-06T03:06:06.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.537+0000 7fd5c9552700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd5c4159350 0x7fd5c40a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:06.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.537+0000 7fd5c9552700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd5c4159350 0x7fd5c40a88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49174/0 (socket says 172.21.15.125:49174) 2023-10-06T03:06:06.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.537+0000 7fd5c9552700 1 -- 172.21.15.125:0/3236868532 learned_addr learned my addr 172.21.15.125:0/3236868532 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:06.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.538+0000 7fd5c8d51700 1 --2- 172.21.15.125:0/3236868532 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5c4159720 0x7fd5c40684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:06.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.538+0000 7fd5c9552700 1 -- 172.21.15.125:0/3236868532 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5c4159720 msgr2=0x7fd5c40684f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:06.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.538+0000 7fd5c9552700 1 --2- 172.21.15.125:0/3236868532 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5c4159720 0x7fd5c40684f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.538+0000 7fd5c9552700 1 -- 172.21.15.125:0/3236868532 >> v1:172.21.15.130:6789/0 conn(0x7fd5c4067610 legacy=0x7fd5c40c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:06.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.538+0000 7fd5c9552700 1 -- 172.21.15.125:0/3236868532 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c40caaf0 con 0x7fd5c4159350 2023-10-06T03:06:06.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.538+0000 7fd5c9552700 1 --2- 172.21.15.125:0/3236868532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c4159350 0x7fd5c40a88a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80099b0 tx=0x7fd5b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b29f8fa54c47a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:06.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.538+0000 7fd5b7fff700 1 -- 172.21.15.125:0/3236868532 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b800b860 con 0x7fd5c4159350 2023-10-06T03:06:06.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.538+0000 7fd5b7fff700 1 -- 172.21.15.125:0/3236868532 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b800b9c0 con 0x7fd5c4159350 2023-10-06T03:06:06.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.538+0000 7fd5b7fff700 1 -- 172.21.15.125:0/3236868532 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b800bd60 con 0x7fd5c4159350 2023-10-06T03:06:06.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.539+0000 7fd5cb7b6700 1 -- 172.21.15.125:0/3236868532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c4159350 msgr2=0x7fd5c40a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:06.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.539+0000 7fd5cb7b6700 1 --2- 172.21.15.125:0/3236868532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c4159350 0x7fd5c40a88a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80099b0 tx=0x7fd5b8009250 comp rx=0 tx=0).stop 2023-10-06T03:06:06.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.539+0000 7fd5cb7b6700 1 -- 172.21.15.125:0/3236868532 shutdown_connections 2023-10-06T03:06:06.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.539+0000 7fd5cb7b6700 1 --2- 172.21.15.125:0/3236868532 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c4159350 0x7fd5c40a88a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.539+0000 7fd5cb7b6700 1 --2- 172.21.15.125:0/3236868532 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5c4159720 0x7fd5c40684f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.539+0000 7fd5cb7b6700 1 -- 172.21.15.125:0/3236868532 >> 172.21.15.125:0/3236868532 conn(0x7fd5c406b190 msgr2=0x7fd5c406b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:06.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.539+0000 7fd5cb7b6700 1 -- 172.21.15.125:0/3236868532 shutdown_connections 2023-10-06T03:06:06.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.539+0000 7fd5cb7b6700 1 -- 172.21.15.125:0/3236868532 wait complete. 2023-10-06T03:06:06.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.540+0000 7fd5cb7b6700 1 Processor -- start 2023-10-06T03:06:06.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.540+0000 7fd5cb7b6700 1 -- start start 2023-10-06T03:06:06.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.541+0000 7fd5cb7b6700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5c4067610 0x7fd5c40c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:06.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.541+0000 7fd5cb7b6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c4159350 0x7fd5c4151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:06.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.541+0000 7fd5cb7b6700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5c4159720 0x7fd5c40afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:06.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.541+0000 7fd5cb7b6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c40b2a50 con 0x7fd5c4159350 2023-10-06T03:06:06.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.541+0000 7fd5cb7b6700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c40b0160 con 0x7fd5c4067610 2023-10-06T03:06:06.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.541+0000 7fd5cb7b6700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c40b0400 con 0x7fd5c4159720 2023-10-06T03:06:06.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.541+0000 7fd5c8d51700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c4159350 0x7fd5c4151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:06.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.541+0000 7fd5c8d51700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c4159350 0x7fd5c4151590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49188/0 (socket says 172.21.15.125:49188) 2023-10-06T03:06:06.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.541+0000 7fd5c8d51700 1 -- 172.21.15.125:0/4251978206 learned_addr learned my addr 172.21.15.125:0/4251978206 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:06.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.541+0000 7fd5c9552700 1 --2- 172.21.15.125:0/4251978206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5c4067610 0x7fd5c40c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:06.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.541+0000 7fd5c9d53700 1 --2- 172.21.15.125:0/4251978206 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5c4159720 0x7fd5c40afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:06.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.541+0000 7fd5c8d51700 1 -- 172.21.15.125:0/4251978206 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5c4159720 msgr2=0x7fd5c40afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:06.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.541+0000 7fd5c8d51700 1 --2- 172.21.15.125:0/4251978206 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5c4159720 0x7fd5c40afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.541+0000 7fd5c8d51700 1 -- 172.21.15.125:0/4251978206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5c4067610 msgr2=0x7fd5c40c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:06.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.541+0000 7fd5c8d51700 1 --2- 172.21.15.125:0/4251978206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5c4067610 0x7fd5c40c9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.541+0000 7fd5c8d51700 1 -- 172.21.15.125:0/4251978206 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b80094f0 con 0x7fd5c4159350 2023-10-06T03:06:06.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.541+0000 7fd5c8d51700 1 --2- 172.21.15.125:0/4251978206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c4159350 0x7fd5c4151590 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000d860 tx=0x7fd5c0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:06.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.541+0000 7fd5b57fa700 1 -- 172.21.15.125:0/4251978206 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c00125f0 con 0x7fd5c4159350 2023-10-06T03:06:06.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.542+0000 7fd5b57fa700 1 -- 172.21.15.125:0/4251978206 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c0012770 con 0x7fd5c4159350 2023-10-06T03:06:06.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.542+0000 7fd5cb7b6700 1 -- 172.21.15.125:0/4251978206 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c40b06e0 con 0x7fd5c4159350 2023-10-06T03:06:06.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.542+0000 7fd5b57fa700 1 -- 172.21.15.125:0/4251978206 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0012b30 con 0x7fd5c4159350 2023-10-06T03:06:06.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.542+0000 7fd5cb7b6700 1 -- 172.21.15.125:0/4251978206 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c416d000 con 0x7fd5c4159350 2023-10-06T03:06:06.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.543+0000 7fd5cb7b6700 1 -- 172.21.15.125:0/4251978206 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c4066510 con 0x7fd5c4159350 2023-10-06T03:06:06.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.543+0000 7fd5b57fa700 1 -- 172.21.15.125:0/4251978206 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd5c0013480 con 0x7fd5c4159350 2023-10-06T03:06:06.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.543+0000 7fd5b57fa700 1 --2- 172.21.15.125:0/4251978206 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd5a8066f30 0x7fd5a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:06.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.543+0000 7fd5b57fa700 1 -- 172.21.15.125:0/4251978206 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6773+0+0 (secure 0 0 0) 0x7fd5c0084cc0 con 0x7fd5c4159350 2023-10-06T03:06:06.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.543+0000 7fd5c9552700 1 --2- 172.21.15.125:0/4251978206 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd5a8066f30 0x7fd5a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:06.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.544+0000 7fd5c9552700 1 --2- 172.21.15.125:0/4251978206 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd5a8066f30 0x7fd5a80693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80099b0 tx=0x7fd5b8017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:06.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.547+0000 7fd5b57fa700 1 -- 172.21.15.125:0/4251978206 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5c0051b00 con 0x7fd5c4159350 2023-10-06T03:06:06.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.771+0000 7fd5cb7b6700 1 -- 172.21.15.125:0/4251978206 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5c40cadd0 con 0x7fd5c4159350 2023-10-06T03:06:06.773 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.772+0000 7fd5b57fa700 1 -- 172.21.15.125:0/4251978206 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4611 (secure 0 0 0) 0x7fd5c0055120 con 0x7fd5c4159350 2023-10-06T03:06:06.774 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:06.774 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3042542444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3042542444},{"type":"v1","addr":"172.21.15.130:6835","nonce":3042542444}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2110429483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2110429483},{"type":"v1","addr":"172.21.15.130:6833","nonce":2110429483}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/1710838785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1710838785},{"type":"v1","addr":"172.21.15.125:6836","nonce":1710838785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:05:30.346007+0000","modified":"2023-10-06T03:05:45.295717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5085":{"gid":5085,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.125:6837/4027450913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":4027450913},{"type":"v1","addr":"172.21.15.125:6837","nonce":4027450913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7,8],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:06:06.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.774+0000 7fd5cb7b6700 1 -- 172.21.15.125:0/4251978206 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd5a8066f30 msgr2=0x7fd5a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.774+0000 7fd5cb7b6700 1 --2- 172.21.15.125:0/4251978206 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd5a8066f30 0x7fd5a80693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80099b0 tx=0x7fd5b8017000 comp rx=0 tx=0).stop 2023-10-06T03:06:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.774+0000 7fd5cb7b6700 1 -- 172.21.15.125:0/4251978206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c4159350 msgr2=0x7fd5c4151590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.774+0000 7fd5cb7b6700 1 --2- 172.21.15.125:0/4251978206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c4159350 0x7fd5c4151590 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000d860 tx=0x7fd5c0008040 comp rx=0 tx=0).stop 2023-10-06T03:06:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.774+0000 7fd5cb7b6700 1 -- 172.21.15.125:0/4251978206 shutdown_connections 2023-10-06T03:06:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.774+0000 7fd5cb7b6700 1 --2- 172.21.15.125:0/4251978206 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd5a8066f30 0x7fd5a80693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.774+0000 7fd5cb7b6700 1 --2- 172.21.15.125:0/4251978206 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd5c4159720 0x7fd5c40afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.774+0000 7fd5cb7b6700 1 --2- 172.21.15.125:0/4251978206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd5c4067610 0x7fd5c40c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.774+0000 7fd5cb7b6700 1 --2- 172.21.15.125:0/4251978206 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd5c4159350 0x7fd5c4151590 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.774+0000 7fd5cb7b6700 1 -- 172.21.15.125:0/4251978206 >> 172.21.15.125:0/4251978206 conn(0x7fd5c406b190 msgr2=0x7fd5c4154940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.774+0000 7fd5cb7b6700 1 -- 172.21.15.125:0/4251978206 shutdown_connections 2023-10-06T03:06:06.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.774+0000 7fd5cb7b6700 1 -- 172.21.15.125:0/4251978206 wait complete. 2023-10-06T03:06:06.777 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 19 2023-10-06T03:06:06.787 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:06:06.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.903+0000 7f02f2109700 1 Processor -- start 2023-10-06T03:06:06.905 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.903+0000 7f02f2109700 1 -- start start 2023-10-06T03:06:06.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.904+0000 7f02f2109700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f02ec0cbb50 0x7f02ec0a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:06.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.904+0000 7f02f2109700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f02ec0cbf20 0x7f02ec0caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:06.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.904+0000 7f02f2109700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02ec0caf80 0x7f02ec0c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:06.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.904+0000 7f02f2109700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02ec0cb400 con 0x7f02ec0cbf20 2023-10-06T03:06:06.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.904+0000 7f02f2109700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02ec0c2910 con 0x7f02ec0cbb50 2023-10-06T03:06:06.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.904+0000 7f02f2109700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec0c1d40 con 0x7f02ec0caf80 2023-10-06T03:06:06.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.904+0000 7f02eaffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f02ec0cbf20 0x7f02ec0caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:06.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.905+0000 7f02eaffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f02ec0cbf20 0x7f02ec0caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49204/0 (socket says 172.21.15.125:49204) 2023-10-06T03:06:06.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.905+0000 7f02eaffd700 1 -- 172.21.15.125:0/1470145473 learned_addr learned my addr 172.21.15.125:0/1470145473 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:06.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.905+0000 7f02eb7fe700 1 --2- 172.21.15.125:0/1470145473 >> v2:172.21.15.130:3300/0 conn(0x7f02ec0cbb50 0x7f02ec0a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:06.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.905+0000 7f02ebfff700 1 --2- 172.21.15.125:0/1470145473 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02ec0caf80 0x7f02ec0c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:06.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.905+0000 7f02eaffd700 1 -- 172.21.15.125:0/1470145473 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02ec0caf80 msgr2=0x7f02ec0c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:06.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.905+0000 7f02eaffd700 1 --2- 172.21.15.125:0/1470145473 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02ec0caf80 0x7f02ec0c2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.905+0000 7f02eaffd700 1 -- 172.21.15.125:0/1470145473 >> v2:172.21.15.130:3300/0 conn(0x7f02ec0cbb50 msgr2=0x7f02ec0a99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:06.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.905+0000 7f02eaffd700 1 --2- 172.21.15.125:0/1470145473 >> v2:172.21.15.130:3300/0 conn(0x7f02ec0cbb50 0x7f02ec0a99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.905+0000 7f02eaffd700 1 -- 172.21.15.125:0/1470145473 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ec0c1fe0 con 0x7f02ec0cbf20 2023-10-06T03:06:06.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.905+0000 7f02eb7fe700 1 --2- 172.21.15.125:0/1470145473 >> v2:172.21.15.130:3300/0 conn(0x7f02ec0cbb50 0x7f02ec0a99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:06.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.905+0000 7f02ebfff700 1 --2- 172.21.15.125:0/1470145473 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02ec0caf80 0x7f02ec0c2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:06.909 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.905+0000 7f02eaffd700 1 --2- 172.21.15.125:0/1470145473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02ec0cbf20 0x7f02ec0caa40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f02ec06fe40 tx=0x7f02dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92ee84a4870b44d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:06.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.905+0000 7f02ea7fc700 1 -- 172.21.15.125:0/1470145473 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc00b860 con 0x7f02ec0cbf20 2023-10-06T03:06:06.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.905+0000 7f02ea7fc700 1 -- 172.21.15.125:0/1470145473 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02dc00b9c0 con 0x7f02ec0cbf20 2023-10-06T03:06:06.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.905+0000 7f02ea7fc700 1 -- 172.21.15.125:0/1470145473 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc00bd60 con 0x7f02ec0cbf20 2023-10-06T03:06:06.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.906+0000 7f02f2109700 1 -- 172.21.15.125:0/1470145473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02ec0cbf20 msgr2=0x7f02ec0caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:06.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.906+0000 7f02f2109700 1 --2- 172.21.15.125:0/1470145473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02ec0cbf20 0x7f02ec0caa40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f02ec06fe40 tx=0x7f02dc009250 comp rx=0 tx=0).stop 2023-10-06T03:06:06.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.906+0000 7f02f2109700 1 -- 172.21.15.125:0/1470145473 shutdown_connections 2023-10-06T03:06:06.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.906+0000 7f02f2109700 1 --2- 172.21.15.125:0/1470145473 >> v2:172.21.15.130:3300/0 conn(0x7f02ec0cbb50 0x7f02ec0a99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.906+0000 7f02f2109700 1 --2- 172.21.15.125:0/1470145473 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02ec0caf80 0x7f02ec0c2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.906+0000 7f02f2109700 1 --2- 172.21.15.125:0/1470145473 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02ec0cbf20 0x7f02ec0caa40 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.906+0000 7f02f2109700 1 -- 172.21.15.125:0/1470145473 >> 172.21.15.125:0/1470145473 conn(0x7f02ec068f00 msgr2=0x7f02ec0cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:06.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.906+0000 7f02f2109700 1 -- 172.21.15.125:0/1470145473 shutdown_connections 2023-10-06T03:06:06.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.906+0000 7f02f2109700 1 -- 172.21.15.125:0/1470145473 wait complete. 2023-10-06T03:06:06.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.907+0000 7f02f2109700 1 Processor -- start 2023-10-06T03:06:06.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.907+0000 7f02f2109700 1 -- start start 2023-10-06T03:06:06.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02f2109700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02ec0caf80 0x7f02ec16d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:06.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02f2109700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02ec0cbb50 0x7f02ec0c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:06.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02f2109700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02ec0cbf20 0x7f02ec149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:06.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02f2109700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec0c6070 con 0x7f02ec0cbf20 2023-10-06T03:06:06.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02f2109700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec0c5740 con 0x7f02ec0cbb50 2023-10-06T03:06:06.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02f2109700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec0c5a20 con 0x7f02ec0caf80 2023-10-06T03:06:06.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02ebfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02ec0cbf20 0x7f02ec149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:06.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02ebfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02ec0cbf20 0x7f02ec149b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49214/0 (socket says 172.21.15.125:49214) 2023-10-06T03:06:06.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02ebfff700 1 -- 172.21.15.125:0/619600314 learned_addr learned my addr 172.21.15.125:0/619600314 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:06.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02eb7fe700 1 --2- 172.21.15.125:0/619600314 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02ec0caf80 0x7f02ec16d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:06.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02eaffd700 1 --2- 172.21.15.125:0/619600314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02ec0cbb50 0x7f02ec0c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:06.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02ebfff700 1 -- 172.21.15.125:0/619600314 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02ec0caf80 msgr2=0x7f02ec16d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:06.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02ebfff700 1 --2- 172.21.15.125:0/619600314 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02ec0caf80 0x7f02ec16d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02ebfff700 1 -- 172.21.15.125:0/619600314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02ec0cbb50 msgr2=0x7f02ec0c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:06.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02ebfff700 1 --2- 172.21.15.125:0/619600314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02ec0cbb50 0x7f02ec0c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:06.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02ebfff700 1 -- 172.21.15.125:0/619600314 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc0094f0 con 0x7f02ec0cbf20 2023-10-06T03:06:06.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02ebfff700 1 --2- 172.21.15.125:0/619600314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02ec0cbf20 0x7f02ec149b80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f02e400ce40 tx=0x7f02e40077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:06.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02e37fe700 1 -- 172.21.15.125:0/619600314 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e400ac70 con 0x7f02ec0cbf20 2023-10-06T03:06:06.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02e37fe700 1 -- 172.21.15.125:0/619600314 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e400adf0 con 0x7f02ec0cbf20 2023-10-06T03:06:06.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02f2109700 1 -- 172.21.15.125:0/619600314 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02ec0c5d00 con 0x7f02ec0cbf20 2023-10-06T03:06:06.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.908+0000 7f02e37fe700 1 -- 172.21.15.125:0/619600314 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e4016670 con 0x7f02ec0cbf20 2023-10-06T03:06:06.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.909+0000 7f02f2109700 1 -- 172.21.15.125:0/619600314 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02ec0c53f0 con 0x7f02ec0cbf20 2023-10-06T03:06:06.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.909+0000 7f02f2109700 1 -- 172.21.15.125:0/619600314 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02ec0c61e0 con 0x7f02ec0cbf20 2023-10-06T03:06:06.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.910+0000 7f02e37fe700 1 -- 172.21.15.125:0/619600314 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f02e4016a20 con 0x7f02ec0cbf20 2023-10-06T03:06:06.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.910+0000 7f02e37fe700 1 --2- 172.21.15.125:0/619600314 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f02cc066f30 0x7f02cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:06.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.910+0000 7f02e37fe700 1 -- 172.21.15.125:0/619600314 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f02e4012070 con 0x7f02ec0cbf20 2023-10-06T03:06:06.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.910+0000 7f02eb7fe700 1 --2- 172.21.15.125:0/619600314 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f02cc066f30 0x7f02cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:06.916 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.911+0000 7f02eb7fe700 1 --2- 172.21.15.125:0/619600314 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f02cc066f30 0x7f02cc0693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f02d400aca0 tx=0x7f02d4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:06.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:06.914+0000 7f02e37fe700 1 -- 172.21.15.125:0/619600314 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02e4051f80 con 0x7f02ec0cbf20 2023-10-06T03:06:07.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.097+0000 7f02f2109700 1 -- 172.21.15.125:0/619600314 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02ec066510 con 0x7f02ec0cbf20 2023-10-06T03:06:07.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.098+0000 7f02e37fe700 1 -- 172.21.15.125:0/619600314 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18774 (secure 0 0 0) 0x7f02e40555a0 con 0x7f02ec0cbf20 2023-10-06T03:06:07.100 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:07.100 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":44,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:05:46.297098+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:05:28.440579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T03:05:29.311703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":8,"pool_name":"data_new","create_time":"2023-10-06T03:05:43.892252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:06:07.101 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.100+0000 7f02f2109700 1 -- 172.21.15.125:0/619600314 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f02cc066f30 msgr2=0x7f02cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:07.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.100+0000 7f02f2109700 1 --2- 172.21.15.125:0/619600314 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f02cc066f30 0x7f02cc0693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f02d400aca0 tx=0x7f02d4008040 comp rx=0 tx=0).stop 2023-10-06T03:06:07.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.100+0000 7f02f2109700 1 -- 172.21.15.125:0/619600314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02ec0cbf20 msgr2=0x7f02ec149b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:07.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.100+0000 7f02f2109700 1 --2- 172.21.15.125:0/619600314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02ec0cbf20 0x7f02ec149b80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f02e400ce40 tx=0x7f02e40077d0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.100+0000 7f02f2109700 1 -- 172.21.15.125:0/619600314 shutdown_connections 2023-10-06T03:06:07.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.100+0000 7f02f2109700 1 --2- 172.21.15.125:0/619600314 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f02cc066f30 0x7f02cc0693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.100+0000 7f02f2109700 1 --2- 172.21.15.125:0/619600314 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f02ec0cbf20 0x7f02ec149b80 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.100+0000 7f02f2109700 1 --2- 172.21.15.125:0/619600314 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f02ec0caf80 0x7f02ec16d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.100+0000 7f02f2109700 1 --2- 172.21.15.125:0/619600314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f02ec0cbb50 0x7f02ec0c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.102 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.100+0000 7f02f2109700 1 -- 172.21.15.125:0/619600314 >> 172.21.15.125:0/619600314 conn(0x7f02ec068f00 msgr2=0x7f02ec0b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:07.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.100+0000 7f02f2109700 1 -- 172.21.15.125:0/619600314 shutdown_connections 2023-10-06T03:06:07.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.100+0000 7f02f2109700 1 -- 172.21.15.125:0/619600314 wait complete. 2023-10-06T03:06:07.113 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:06:07.114 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:06:07.245 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.230+0000 7f831f374700 1 Processor -- start 2023-10-06T03:06:07.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.230+0000 7f831f374700 1 -- start start 2023-10-06T03:06:07.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.231+0000 7f831f374700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f83180ac670 0x7f83180c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:07.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.231+0000 7f831f374700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f831806afd0 0x7f83180c7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:07.246 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.231+0000 7f831f374700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8318067c70 con 0x7f83181590d0 2023-10-06T03:06:07.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.231+0000 7f831f374700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83180c75c0 con 0x7f831806afd0 2023-10-06T03:06:07.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.231+0000 7f831f374700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8318069110 con 0x7f83180ac670 2023-10-06T03:06:07.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.231+0000 7f831d911700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f831806afd0 0x7f83180c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:07.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.231+0000 7f831d911700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f831806afd0 0x7f83180c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49220/0 (socket says 172.21.15.125:49220) 2023-10-06T03:06:07.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.231+0000 7f831d911700 1 -- 172.21.15.125:0/3014695623 learned_addr learned my addr 172.21.15.125:0/3014695623 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:07.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.231+0000 7f831c90f700 1 --2- 172.21.15.125:0/3014695623 >> v2:172.21.15.130:3300/0 conn(0x7f83180ac670 0x7f83180c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:07.247 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.231+0000 7f831d911700 1 -- 172.21.15.125:0/3014695623 >> v2:172.21.15.130:3300/0 conn(0x7f83180ac670 msgr2=0x7f83180c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:07.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.231+0000 7f831d911700 1 --2- 172.21.15.125:0/3014695623 >> v2:172.21.15.130:3300/0 conn(0x7f83180ac670 0x7f83180c6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.231+0000 7f831d911700 1 -- 172.21.15.125:0/3014695623 >> v1:172.21.15.130:6789/0 conn(0x7f83181590d0 legacy=0x7f831806a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:07.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.231+0000 7f831d911700 1 -- 172.21.15.125:0/3014695623 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83180c77e0 con 0x7f831806afd0 2023-10-06T03:06:07.248 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.231+0000 7f831d911700 1 --2- 172.21.15.125:0/3014695623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831806afd0 0x7f83180c7080 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f83180722e0 tx=0x7f8310009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ffcea710b1e6d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:07.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.231+0000 7f830ffff700 1 -- 172.21.15.125:0/3014695623 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831000e070 con 0x7f831806afd0 2023-10-06T03:06:07.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.231+0000 7f830ffff700 1 -- 172.21.15.125:0/3014695623 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831000b990 con 0x7f831806afd0 2023-10-06T03:06:07.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.231+0000 7f830ffff700 1 -- 172.21.15.125:0/3014695623 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100092e0 con 0x7f831806afd0 2023-10-06T03:06:07.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.232+0000 7f831f374700 1 -- 172.21.15.125:0/3014695623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831806afd0 msgr2=0x7f83180c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:07.249 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.232+0000 7f831f374700 1 --2- 172.21.15.125:0/3014695623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831806afd0 0x7f83180c7080 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f83180722e0 tx=0x7f8310009840 comp rx=0 tx=0).stop 2023-10-06T03:06:07.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.232+0000 7f831f374700 1 -- 172.21.15.125:0/3014695623 shutdown_connections 2023-10-06T03:06:07.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.232+0000 7f831f374700 1 --2- 172.21.15.125:0/3014695623 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f831806afd0 0x7f83180c7080 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.232+0000 7f831f374700 1 --2- 172.21.15.125:0/3014695623 >> v2:172.21.15.130:3300/0 conn(0x7f83180ac670 0x7f83180c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.232+0000 7f831f374700 1 -- 172.21.15.125:0/3014695623 >> 172.21.15.125:0/3014695623 conn(0x7f83180cc5a0 msgr2=0x7f83180cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:07.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.232+0000 7f831f374700 1 -- 172.21.15.125:0/3014695623 shutdown_connections 2023-10-06T03:06:07.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.232+0000 7f831f374700 1 -- 172.21.15.125:0/3014695623 wait complete. 2023-10-06T03:06:07.250 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.233+0000 7f831f374700 1 Processor -- start 2023-10-06T03:06:07.251 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.233+0000 7f831f374700 1 -- start start 2023-10-06T03:06:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.234+0000 7f831f374700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f831806afd0 0x7f831815c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.234+0000 7f831f374700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83180ac670 0x7f83180b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.234+0000 7f831f374700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83181590d0 0x7f83181594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.234+0000 7f831f374700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831815bdb0 con 0x7f83181590d0 2023-10-06T03:06:07.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.234+0000 7f831f374700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83180b1c50 con 0x7f831806afd0 2023-10-06T03:06:07.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.234+0000 7f831f374700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831815b1a0 con 0x7f83180ac670 2023-10-06T03:06:07.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.234+0000 7f831d911700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83181590d0 0x7f83181594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:07.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.234+0000 7f831d911700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83181590d0 0x7f83181594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49228/0 (socket says 172.21.15.125:49228) 2023-10-06T03:06:07.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.234+0000 7f831d911700 1 -- 172.21.15.125:0/808733814 learned_addr learned my addr 172.21.15.125:0/808733814 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:07.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.234+0000 7f831c90f700 1 --2- 172.21.15.125:0/808733814 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83180ac670 0x7f83180b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:07.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.234+0000 7f831d110700 1 --2- 172.21.15.125:0/808733814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f831806afd0 0x7f831815c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:07.254 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.234+0000 7f831d911700 1 -- 172.21.15.125:0/808733814 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83180ac670 msgr2=0x7f83180b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:07.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.234+0000 7f831d911700 1 --2- 172.21.15.125:0/808733814 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83180ac670 0x7f83180b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.234+0000 7f831d911700 1 -- 172.21.15.125:0/808733814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f831806afd0 msgr2=0x7f831815c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:07.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.234+0000 7f831d911700 1 --2- 172.21.15.125:0/808733814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f831806afd0 0x7f831815c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.234+0000 7f831d911700 1 -- 172.21.15.125:0/808733814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8310009ae0 con 0x7f83181590d0 2023-10-06T03:06:07.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.235+0000 7f831d911700 1 --2- 172.21.15.125:0/808733814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83181590d0 0x7f83181594a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8310009880 tx=0x7f8310018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:07.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.235+0000 7f830d7fa700 1 -- 172.21.15.125:0/808733814 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8310008ad0 con 0x7f83181590d0 2023-10-06T03:06:07.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.235+0000 7f830d7fa700 1 -- 172.21.15.125:0/808733814 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8310008c90 con 0x7f83181590d0 2023-10-06T03:06:07.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.235+0000 7f830d7fa700 1 -- 172.21.15.125:0/808733814 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83100266b0 con 0x7f83181590d0 2023-10-06T03:06:07.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.235+0000 7f831f374700 1 -- 172.21.15.125:0/808733814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831815b480 con 0x7f83181590d0 2023-10-06T03:06:07.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.235+0000 7f831f374700 1 -- 172.21.15.125:0/808733814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831815ba40 con 0x7f83181590d0 2023-10-06T03:06:07.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.236+0000 7f831f374700 1 -- 172.21.15.125:0/808733814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8318066510 con 0x7f83181590d0 2023-10-06T03:06:07.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.236+0000 7f830d7fa700 1 -- 172.21.15.125:0/808733814 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8310003040 con 0x7f83181590d0 2023-10-06T03:06:07.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.236+0000 7f830d7fa700 1 --2- 172.21.15.125:0/808733814 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f82fc066f30 0x7f82fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:07.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.236+0000 7f830d7fa700 1 -- 172.21.15.125:0/808733814 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f8310086790 con 0x7f83181590d0 2023-10-06T03:06:07.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.237+0000 7f831d110700 1 --2- 172.21.15.125:0/808733814 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f82fc066f30 0x7f82fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:07.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.237+0000 7f831d110700 1 --2- 172.21.15.125:0/808733814 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f82fc066f30 0x7f82fc0693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f83180aba00 tx=0x7f8314009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:07.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.241+0000 7f830d7fa700 1 -- 172.21.15.125:0/808733814 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83100535d0 con 0x7f83181590d0 2023-10-06T03:06:07.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.465+0000 7f831f374700 1 -- 172.21.15.125:0/808733814 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83180c7ac0 con 0x7f83181590d0 2023-10-06T03:06:07.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.465+0000 7f830d7fa700 1 -- 172.21.15.125:0/808733814 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f8310056bf0 con 0x7f83181590d0 2023-10-06T03:06:07.467 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:07.467 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3042542444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3042542444},{"type":"v1","addr":"172.21.15.130:6835","nonce":3042542444}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2110429483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2110429483},{"type":"v1","addr":"172.21.15.130:6833","nonce":2110429483}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/1710838785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1710838785},{"type":"v1","addr":"172.21.15.125:6836","nonce":1710838785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:05:30.346007+0000","modified":"2023-10-06T03:05:45.295717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5085":{"gid":5085,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.125:6837/4027450913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":4027450913},{"type":"v1","addr":"172.21.15.125:6837","nonce":4027450913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7,8],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:06:07.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.468+0000 7f831f374700 1 -- 172.21.15.125:0/808733814 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f82fc066f30 msgr2=0x7f82fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:07.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.468+0000 7f831f374700 1 --2- 172.21.15.125:0/808733814 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f82fc066f30 0x7f82fc0693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f83180aba00 tx=0x7f8314009040 comp rx=0 tx=0).stop 2023-10-06T03:06:07.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.468+0000 7f831f374700 1 -- 172.21.15.125:0/808733814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83181590d0 msgr2=0x7f83181594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:07.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.468+0000 7f831f374700 1 --2- 172.21.15.125:0/808733814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83181590d0 0x7f83181594a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f8310009880 tx=0x7f8310018000 comp rx=0 tx=0).stop 2023-10-06T03:06:07.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.468+0000 7f831f374700 1 -- 172.21.15.125:0/808733814 shutdown_connections 2023-10-06T03:06:07.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.468+0000 7f831f374700 1 --2- 172.21.15.125:0/808733814 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f82fc066f30 0x7f82fc0693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.468+0000 7f831f374700 1 --2- 172.21.15.125:0/808733814 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f83181590d0 0x7f83181594a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.468+0000 7f831f374700 1 --2- 172.21.15.125:0/808733814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f831806afd0 0x7f831815c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.468+0000 7f831f374700 1 --2- 172.21.15.125:0/808733814 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f83180ac670 0x7f83180b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.468+0000 7f831f374700 1 -- 172.21.15.125:0/808733814 >> 172.21.15.125:0/808733814 conn(0x7f83180cc5a0 msgr2=0x7f8318155390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:07.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.468+0000 7f831f374700 1 -- 172.21.15.125:0/808733814 shutdown_connections 2023-10-06T03:06:07.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.468+0000 7f831f374700 1 -- 172.21.15.125:0/808733814 wait complete. 2023-10-06T03:06:07.470 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 19 2023-10-06T03:06:07.481 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:06:07.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.596+0000 7f787ad6b700 1 Processor -- start 2023-10-06T03:06:07.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.597+0000 7f787ad6b700 1 -- start start 2023-10-06T03:06:07.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.597+0000 7f787ad6b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f78740af320 0x7f78740c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:07.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.597+0000 7f787ad6b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78740cc5a0 0x7f7874067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:07.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.597+0000 7f787ad6b700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78740caa40 con 0x7f7874067b50 2023-10-06T03:06:07.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.597+0000 7f787ad6b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7874067fd0 con 0x7f78740af320 2023-10-06T03:06:07.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.597+0000 7f787ad6b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78740c1ca0 con 0x7f78740cc5a0 2023-10-06T03:06:07.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.597+0000 7f7878b07700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f78740af320 0x7f78740c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:07.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.598+0000 7f7878b07700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f78740af320 0x7f78740c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49244/0 (socket says 172.21.15.125:49244) 2023-10-06T03:06:07.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.598+0000 7f7878b07700 1 -- 172.21.15.125:0/4280661080 learned_addr learned my addr 172.21.15.125:0/4280661080 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:07.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.598+0000 7f7873fff700 1 --2- 172.21.15.125:0/4280661080 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78740cc5a0 0x7f7874067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:07.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.598+0000 7f7878b07700 1 -- 172.21.15.125:0/4280661080 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78740cc5a0 msgr2=0x7f7874067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:07.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.598+0000 7f7878b07700 1 --2- 172.21.15.125:0/4280661080 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78740cc5a0 0x7f7874067610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.598+0000 7f7878b07700 1 -- 172.21.15.125:0/4280661080 >> v1:172.21.15.130:6789/0 conn(0x7f7874067b50 legacy=0x7f78740c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:07.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.598+0000 7f7878b07700 1 -- 172.21.15.125:0/4280661080 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78740cca60 con 0x7f78740af320 2023-10-06T03:06:07.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.598+0000 7f7878b07700 1 --2- 172.21.15.125:0/4280661080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78740af320 0x7f78740c8ed0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7868009990 tx=0x7f7868009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440abfd8ab488a79 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:07.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.598+0000 7f78737fe700 1 -- 172.21.15.125:0/4280661080 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7868005c10 con 0x7f78740af320 2023-10-06T03:06:07.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.598+0000 7f78737fe700 1 -- 172.21.15.125:0/4280661080 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7868005d70 con 0x7f78740af320 2023-10-06T03:06:07.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.598+0000 7f78737fe700 1 -- 172.21.15.125:0/4280661080 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786800b840 con 0x7f78740af320 2023-10-06T03:06:07.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.599+0000 7f787ad6b700 1 -- 172.21.15.125:0/4280661080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78740af320 msgr2=0x7f78740c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:07.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.599+0000 7f787ad6b700 1 --2- 172.21.15.125:0/4280661080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78740af320 0x7f78740c8ed0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7868009990 tx=0x7f7868009220 comp rx=0 tx=0).stop 2023-10-06T03:06:07.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.599+0000 7f787ad6b700 1 -- 172.21.15.125:0/4280661080 shutdown_connections 2023-10-06T03:06:07.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.599+0000 7f787ad6b700 1 --2- 172.21.15.125:0/4280661080 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78740af320 0x7f78740c8ed0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.599+0000 7f787ad6b700 1 --2- 172.21.15.125:0/4280661080 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78740cc5a0 0x7f7874067610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.599+0000 7f787ad6b700 1 -- 172.21.15.125:0/4280661080 >> 172.21.15.125:0/4280661080 conn(0x7f7874068f00 msgr2=0x7f78740cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:07.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.599+0000 7f787ad6b700 1 -- 172.21.15.125:0/4280661080 shutdown_connections 2023-10-06T03:06:07.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.599+0000 7f787ad6b700 1 -- 172.21.15.125:0/4280661080 wait complete. 2023-10-06T03:06:07.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.600+0000 7f787ad6b700 1 Processor -- start 2023-10-06T03:06:07.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.600+0000 7f787ad6b700 1 -- start start 2023-10-06T03:06:07.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f787ad6b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7874067b50 0x7f78740c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:07.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f787ad6b700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78740af320 0x7f78740c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:07.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f787ad6b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78740cc5a0 0x7f78740c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:07.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f787ad6b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78741573e0 con 0x7f7874067b50 2023-10-06T03:06:07.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f787ad6b700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787415a240 con 0x7f78740af320 2023-10-06T03:06:07.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f787ad6b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787415c6f0 con 0x7f78740cc5a0 2023-10-06T03:06:07.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f7878b07700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7874067b50 0x7f78740c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:07.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f7878b07700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7874067b50 0x7f78740c4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49254/0 (socket says 172.21.15.125:49254) 2023-10-06T03:06:07.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f7878b07700 1 -- 172.21.15.125:0/583904352 learned_addr learned my addr 172.21.15.125:0/583904352 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:07.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f7873fff700 1 --2- 172.21.15.125:0/583904352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78740af320 0x7f78740c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:07.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f7879308700 1 --2- 172.21.15.125:0/583904352 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78740cc5a0 0x7f78740c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:07.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f7878b07700 1 -- 172.21.15.125:0/583904352 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78740cc5a0 msgr2=0x7f78740c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:07.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f7878b07700 1 --2- 172.21.15.125:0/583904352 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78740cc5a0 0x7f78740c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f7878b07700 1 -- 172.21.15.125:0/583904352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78740af320 msgr2=0x7f78740c5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:07.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f7878b07700 1 --2- 172.21.15.125:0/583904352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78740af320 0x7f78740c5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f7878b07700 1 -- 172.21.15.125:0/583904352 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7868009480 con 0x7f7874067b50 2023-10-06T03:06:07.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f7873fff700 1 --2- 172.21.15.125:0/583904352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78740af320 0x7f78740c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:07.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f7878b07700 1 --2- 172.21.15.125:0/583904352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7874067b50 0x7f78740c4b50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f787406a4d0 tx=0x7f7868015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:07.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f7870ff9700 1 -- 172.21.15.125:0/583904352 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7868000cf0 con 0x7f7874067b50 2023-10-06T03:06:07.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f7870ff9700 1 -- 172.21.15.125:0/583904352 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7868011c80 con 0x7f7874067b50 2023-10-06T03:06:07.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f787ad6b700 1 -- 172.21.15.125:0/583904352 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787415cb80 con 0x7f7874067b50 2023-10-06T03:06:07.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.601+0000 7f7870ff9700 1 -- 172.21.15.125:0/583904352 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786801c420 con 0x7f7874067b50 2023-10-06T03:06:07.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.602+0000 7f787ad6b700 1 -- 172.21.15.125:0/583904352 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7874159f60 con 0x7f7874067b50 2023-10-06T03:06:07.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.603+0000 7f787ad6b700 1 -- 172.21.15.125:0/583904352 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7874066510 con 0x7f7874067b50 2023-10-06T03:06:07.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.603+0000 7f7870ff9700 1 -- 172.21.15.125:0/583904352 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f786801c810 con 0x7f7874067b50 2023-10-06T03:06:07.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.603+0000 7f7870ff9700 1 --2- 172.21.15.125:0/583904352 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7858066f30 0x7f78580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:07.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.603+0000 7f7870ff9700 1 -- 172.21.15.125:0/583904352 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f7868086160 con 0x7f7874067b50 2023-10-06T03:06:07.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.603+0000 7f7873fff700 1 --2- 172.21.15.125:0/583904352 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7858066f30 0x7f78580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:07.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.604+0000 7f7873fff700 1 --2- 172.21.15.125:0/583904352 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7858066f30 0x7f78580693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7860006fd0 tx=0x7f7860008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:07.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.607+0000 7f7870ff9700 1 -- 172.21.15.125:0/583904352 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7868052fa0 con 0x7f7874067b50 2023-10-06T03:06:07.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.831+0000 7f787ad6b700 1 -- 172.21.15.125:0/583904352 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78740cac90 con 0x7f7874067b50 2023-10-06T03:06:07.832 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.831+0000 7f7870ff9700 1 -- 172.21.15.125:0/583904352 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f78680565c0 con 0x7f7874067b50 2023-10-06T03:06:07.833 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:07.833 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3042542444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3042542444},{"type":"v1","addr":"172.21.15.130:6835","nonce":3042542444}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2110429483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2110429483},{"type":"v1","addr":"172.21.15.130:6833","nonce":2110429483}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/1710838785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1710838785},{"type":"v1","addr":"172.21.15.125:6836","nonce":1710838785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:05:30.346007+0000","modified":"2023-10-06T03:05:45.295717+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5085},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5085":{"gid":5085,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.125:6837/4027450913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":4027450913},{"type":"v1","addr":"172.21.15.125:6837","nonce":4027450913}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7,8],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T03:06:07.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.833+0000 7f787ad6b700 1 -- 172.21.15.125:0/583904352 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7858066f30 msgr2=0x7f78580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:07.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.833+0000 7f787ad6b700 1 --2- 172.21.15.125:0/583904352 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7858066f30 0x7f78580693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7860006fd0 tx=0x7f7860008040 comp rx=0 tx=0).stop 2023-10-06T03:06:07.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.833+0000 7f787ad6b700 1 -- 172.21.15.125:0/583904352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7874067b50 msgr2=0x7f78740c4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:07.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.833+0000 7f787ad6b700 1 --2- 172.21.15.125:0/583904352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7874067b50 0x7f78740c4b50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f787406a4d0 tx=0x7f7868015000 comp rx=0 tx=0).stop 2023-10-06T03:06:07.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.833+0000 7f787ad6b700 1 -- 172.21.15.125:0/583904352 shutdown_connections 2023-10-06T03:06:07.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.833+0000 7f787ad6b700 1 --2- 172.21.15.125:0/583904352 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7858066f30 0x7f78580693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.833+0000 7f787ad6b700 1 --2- 172.21.15.125:0/583904352 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78740cc5a0 0x7f78740c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.835 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.833+0000 7f787ad6b700 1 --2- 172.21.15.125:0/583904352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7874067b50 0x7f78740c4b50 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.833+0000 7f787ad6b700 1 --2- 172.21.15.125:0/583904352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78740af320 0x7f78740c5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.833+0000 7f787ad6b700 1 -- 172.21.15.125:0/583904352 >> 172.21.15.125:0/583904352 conn(0x7f7874068f00 msgr2=0x7f7874158c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:07.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.833+0000 7f787ad6b700 1 -- 172.21.15.125:0/583904352 shutdown_connections 2023-10-06T03:06:07.836 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.833+0000 7f787ad6b700 1 -- 172.21.15.125:0/583904352 wait complete. 2023-10-06T03:06:07.836 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 19 2023-10-06T03:06:07.846 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:06:07.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.963+0000 7f1d9a656700 1 Processor -- start 2023-10-06T03:06:07.964 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.963+0000 7f1d9a656700 1 -- start start 2023-10-06T03:06:07.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.963+0000 7f1d9a656700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1d94159340 0x7f1d940b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:07.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.963+0000 7f1d9a656700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f1d940b3f20 0x7f1d940b1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:07.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.963+0000 7f1d9a656700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d940b44a0 con 0x7f1d94158f70 2023-10-06T03:06:07.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.963+0000 7f1d9a656700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d940b4780 con 0x7f1d94159340 2023-10-06T03:06:07.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.963+0000 7f1d9a656700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d940b4a60 con 0x7f1d940b3f20 2023-10-06T03:06:07.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.964+0000 7f1d937fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1d94159340 0x7f1d940b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:07.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.964+0000 7f1d937fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f1d94159340 0x7f1d940b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49260/0 (socket says 172.21.15.125:49260) 2023-10-06T03:06:07.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.964+0000 7f1d937fe700 1 -- 172.21.15.125:0/2318617253 learned_addr learned my addr 172.21.15.125:0/2318617253 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:07.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.964+0000 7f1d98bf3700 1 --2- 172.21.15.125:0/2318617253 >> v2:172.21.15.130:3300/0 conn(0x7f1d940b3f20 0x7f1d940b1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:07.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.964+0000 7f1d937fe700 1 -- 172.21.15.125:0/2318617253 >> v2:172.21.15.130:3300/0 conn(0x7f1d940b3f20 msgr2=0x7f1d940b1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:07.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.964+0000 7f1d937fe700 1 --2- 172.21.15.125:0/2318617253 >> v2:172.21.15.130:3300/0 conn(0x7f1d940b3f20 0x7f1d940b1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.964+0000 7f1d937fe700 1 -- 172.21.15.125:0/2318617253 >> v1:172.21.15.130:6789/0 conn(0x7f1d94158f70 legacy=0x7f1d940b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:07.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.964+0000 7f1d937fe700 1 -- 172.21.15.125:0/2318617253 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d940b4d40 con 0x7f1d94159340 2023-10-06T03:06:07.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.964+0000 7f1d98bf3700 1 --2- 172.21.15.125:0/2318617253 >> v2:172.21.15.130:3300/0 conn(0x7f1d940b3f20 0x7f1d940b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:07.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.964+0000 7f1d937fe700 1 --2- 172.21.15.125:0/2318617253 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d94159340 0x7f1d940b39e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1d9406fd00 tx=0x7f1d88009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbc2bbc22c9f065 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:07.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.964+0000 7f1d92ffd700 1 -- 172.21.15.125:0/2318617253 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8800b860 con 0x7f1d94159340 2023-10-06T03:06:07.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.964+0000 7f1d92ffd700 1 -- 172.21.15.125:0/2318617253 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8800b9c0 con 0x7f1d94159340 2023-10-06T03:06:07.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.964+0000 7f1d92ffd700 1 -- 172.21.15.125:0/2318617253 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8800bd60 con 0x7f1d94159340 2023-10-06T03:06:07.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.965+0000 7f1d9a656700 1 -- 172.21.15.125:0/2318617253 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d94159340 msgr2=0x7f1d940b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:07.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.965+0000 7f1d9a656700 1 --2- 172.21.15.125:0/2318617253 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d94159340 0x7f1d940b39e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1d9406fd00 tx=0x7f1d88009250 comp rx=0 tx=0).stop 2023-10-06T03:06:07.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.965+0000 7f1d9a656700 1 -- 172.21.15.125:0/2318617253 shutdown_connections 2023-10-06T03:06:07.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.965+0000 7f1d9a656700 1 --2- 172.21.15.125:0/2318617253 >> v2:172.21.15.130:3300/0 conn(0x7f1d940b3f20 0x7f1d940b1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.965+0000 7f1d9a656700 1 --2- 172.21.15.125:0/2318617253 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d94159340 0x7f1d940b39e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.965+0000 7f1d9a656700 1 -- 172.21.15.125:0/2318617253 >> 172.21.15.125:0/2318617253 conn(0x7f1d9406ed40 msgr2=0x7f1d9406f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:07.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.965+0000 7f1d9a656700 1 -- 172.21.15.125:0/2318617253 shutdown_connections 2023-10-06T03:06:07.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.965+0000 7f1d9a656700 1 -- 172.21.15.125:0/2318617253 wait complete. 2023-10-06T03:06:07.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.966+0000 7f1d9a656700 1 Processor -- start 2023-10-06T03:06:07.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.966+0000 7f1d9a656700 1 -- start start 2023-10-06T03:06:07.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.967+0000 7f1d9a656700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1d940b3f20 0x7f1d9414bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:07.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.967+0000 7f1d9a656700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d94158f70 0x7f1d9414da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:07.971 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.967+0000 7f1d9a656700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d94159340 0x7f1d9414df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.967+0000 7f1d9a656700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940c9e40 con 0x7f1d94159340 2023-10-06T03:06:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.967+0000 7f1d9a656700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940ca120 con 0x7f1d94158f70 2023-10-06T03:06:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.967+0000 7f1d9a656700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d940ca400 con 0x7f1d940b3f20 2023-10-06T03:06:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.967+0000 7f1d98bf3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d94159340 0x7f1d9414df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.967+0000 7f1d98bf3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d94159340 0x7f1d9414df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49272/0 (socket says 172.21.15.125:49272) 2023-10-06T03:06:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.967+0000 7f1d98bf3700 1 -- 172.21.15.125:0/2484738352 learned_addr learned my addr 172.21.15.125:0/2484738352 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.967+0000 7f1d937fe700 1 --2- 172.21.15.125:0/2484738352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d94158f70 0x7f1d9414da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.967+0000 7f1d93fff700 1 --2- 172.21.15.125:0/2484738352 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1d940b3f20 0x7f1d9414bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.967+0000 7f1d98bf3700 1 -- 172.21.15.125:0/2484738352 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1d940b3f20 msgr2=0x7f1d9414bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:07.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.967+0000 7f1d98bf3700 1 --2- 172.21.15.125:0/2484738352 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1d940b3f20 0x7f1d9414bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.967+0000 7f1d98bf3700 1 -- 172.21.15.125:0/2484738352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d94158f70 msgr2=0x7f1d9414da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:07.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.967+0000 7f1d98bf3700 1 --2- 172.21.15.125:0/2484738352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d94158f70 0x7f1d9414da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:07.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.967+0000 7f1d98bf3700 1 -- 172.21.15.125:0/2484738352 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d880094f0 con 0x7f1d94159340 2023-10-06T03:06:07.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.967+0000 7f1d98bf3700 1 --2- 172.21.15.125:0/2484738352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d94159340 0x7f1d9414df50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00d180 tx=0x7f1d8c009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:07.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.968+0000 7f1d7bfff700 1 -- 172.21.15.125:0/2484738352 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c00dd70 con 0x7f1d94159340 2023-10-06T03:06:07.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.968+0000 7f1d7bfff700 1 -- 172.21.15.125:0/2484738352 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c00f040 con 0x7f1d94159340 2023-10-06T03:06:07.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.968+0000 7f1d9a656700 1 -- 172.21.15.125:0/2484738352 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d940ca6e0 con 0x7f1d94159340 2023-10-06T03:06:07.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.968+0000 7f1d7bfff700 1 -- 172.21.15.125:0/2484738352 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c015690 con 0x7f1d94159340 2023-10-06T03:06:07.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.968+0000 7f1d9a656700 1 -- 172.21.15.125:0/2484738352 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d940c9af0 con 0x7f1d94159340 2023-10-06T03:06:07.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.969+0000 7f1d9a656700 1 -- 172.21.15.125:0/2484738352 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d940cac00 con 0x7f1d94159340 2023-10-06T03:06:07.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.969+0000 7f1d7bfff700 1 -- 172.21.15.125:0/2484738352 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d8c01e3b0 con 0x7f1d94159340 2023-10-06T03:06:07.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.969+0000 7f1d7bfff700 1 --2- 172.21.15.125:0/2484738352 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1d80066f30 0x7f1d800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:07.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.969+0000 7f1d7bfff700 1 -- 172.21.15.125:0/2484738352 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f1d8c084e90 con 0x7f1d94159340 2023-10-06T03:06:07.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.969+0000 7f1d93fff700 1 --2- 172.21.15.125:0/2484738352 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1d80066f30 0x7f1d800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:07.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.970+0000 7f1d93fff700 1 --2- 172.21.15.125:0/2484738352 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1d80066f30 0x7f1d800693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1d840037c0 tx=0x7f1d84009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:07.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:07.973+0000 7f1d7bfff700 1 -- 172.21.15.125:0/2484738352 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d940cac00 con 0x7f1d94159340 2023-10-06T03:06:08.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.158+0000 7f1d9a656700 1 -- 172.21.15.125:0/2484738352 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d940cac00 con 0x7f1d94159340 2023-10-06T03:06:08.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.159+0000 7f1d7bfff700 1 -- 172.21.15.125:0/2484738352 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18774 (secure 0 0 0) 0x7f1d940cac00 con 0x7f1d94159340 2023-10-06T03:06:08.161 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:08.161 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":44,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:05:46.297098+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:05:28.440579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-06T03:05:29.311703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":8,"pool_name":"data_new","create_time":"2023-10-06T03:05:43.892252+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:06:08.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.161+0000 7f1d9a656700 1 -- 172.21.15.125:0/2484738352 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1d80066f30 msgr2=0x7f1d800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:08.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.161+0000 7f1d9a656700 1 --2- 172.21.15.125:0/2484738352 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1d80066f30 0x7f1d800693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1d840037c0 tx=0x7f1d84009040 comp rx=0 tx=0).stop 2023-10-06T03:06:08.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.161+0000 7f1d9a656700 1 -- 172.21.15.125:0/2484738352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d94159340 msgr2=0x7f1d9414df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:08.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.161+0000 7f1d9a656700 1 --2- 172.21.15.125:0/2484738352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d94159340 0x7f1d9414df50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c00d180 tx=0x7f1d8c009a50 comp rx=0 tx=0).stop 2023-10-06T03:06:08.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.161+0000 7f1d9a656700 1 -- 172.21.15.125:0/2484738352 shutdown_connections 2023-10-06T03:06:08.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.161+0000 7f1d9a656700 1 --2- 172.21.15.125:0/2484738352 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1d80066f30 0x7f1d800693e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.161+0000 7f1d9a656700 1 --2- 172.21.15.125:0/2484738352 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1d94159340 0x7f1d9414df50 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.161+0000 7f1d9a656700 1 --2- 172.21.15.125:0/2484738352 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f1d940b3f20 0x7f1d9414bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.161+0000 7f1d9a656700 1 --2- 172.21.15.125:0/2484738352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d94158f70 0x7f1d9414da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.161+0000 7f1d9a656700 1 -- 172.21.15.125:0/2484738352 >> 172.21.15.125:0/2484738352 conn(0x7f1d9406ed40 msgr2=0x7f1d940afad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:08.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.161+0000 7f1d9a656700 1 -- 172.21.15.125:0/2484738352 shutdown_connections 2023-10-06T03:06:08.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.161+0000 7f1d9a656700 1 -- 172.21.15.125:0/2484738352 wait complete. 2023-10-06T03:06:08.175 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:06:08.292 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.291+0000 7f1239bd8700 1 Processor -- start 2023-10-06T03:06:08.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.291+0000 7f1239bd8700 1 -- start start 2023-10-06T03:06:08.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.292+0000 7f1239bd8700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f123415cef0 0x7f12340b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:08.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.292+0000 7f1239bd8700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123415d360 con 0x7f12340cc4d0 2023-10-06T03:06:08.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.292+0000 7f1239bd8700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123415d640 con 0x7f12340b01a0 2023-10-06T03:06:08.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.292+0000 7f1239bd8700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1234068e60 con 0x7f123415cef0 2023-10-06T03:06:08.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.292+0000 7f1233fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f12340cc4d0 0x7f12340cc930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36018/0 (socket says 172.21.15.125:36018) 2023-10-06T03:06:08.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.292+0000 7f1233fff700 1 -- 172.21.15.125:0/2319307250 learned_addr learned my addr 172.21.15.125:0/2319307250 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:08.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.292+0000 7f12327fc700 1 -- 172.21.15.125:0/2319307250 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805793634 0 0) 0x7f123415d360 con 0x7f12340cc4d0 2023-10-06T03:06:08.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.292+0000 7f1232ffd700 1 --2- 172.21.15.125:0/2319307250 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f123415cef0 0x7f12340b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:08.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.292+0000 7f12327fc700 1 -- 172.21.15.125:0/2319307250 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1220003570 con 0x7f12340cc4d0 2023-10-06T03:06:08.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12327fc700 1 -- 172.21.15.125:0/2319307250 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3987178497 0 0) 0x7f1220003570 con 0x7f12340cc4d0 2023-10-06T03:06:08.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12327fc700 1 -- 172.21.15.125:0/2319307250 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f123415cef0 msgr2=0x7f12340b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:08.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12327fc700 1 --2- 172.21.15.125:0/2319307250 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f123415cef0 0x7f12340b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12327fc700 1 -- 172.21.15.125:0/2319307250 >> v1:172.21.15.130:6789/0 conn(0x7f12340b01a0 legacy=0x7f123415a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:08.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12327fc700 1 -- 172.21.15.125:0/2319307250 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123415d920 con 0x7f12340cc4d0 2023-10-06T03:06:08.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12327fc700 1 -- 172.21.15.125:0/2319307250 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f122c0017f0 con 0x7f12340cc4d0 2023-10-06T03:06:08.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12327fc700 1 -- 172.21.15.125:0/2319307250 >> v1:172.21.15.125:6789/0 conn(0x7f12340cc4d0 legacy=0x7f12340cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:08.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12327fc700 1 --2- 172.21.15.125:0/2319307250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1220003a90 0x7f1220003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:08.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12327fc700 1 --2- 172.21.15.125:0/2319307250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1220004810 0x7f1220004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:08.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12327fc700 1 --2- 172.21.15.125:0/2319307250 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f123415cef0 0x7f12200051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:08.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12327fc700 1 -- 172.21.15.125:0/2319307250 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1234068e60 con 0x7f1220003a90 2023-10-06T03:06:08.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12327fc700 1 -- 172.21.15.125:0/2319307250 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122000bb60 con 0x7f1220004810 2023-10-06T03:06:08.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12327fc700 1 -- 172.21.15.125:0/2319307250 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122000bd20 con 0x7f123415cef0 2023-10-06T03:06:08.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12337fe700 1 --2- 172.21.15.125:0/2319307250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1220003a90 0x7f1220003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:08.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f1232ffd700 1 --2- 172.21.15.125:0/2319307250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1220004810 0x7f1220004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:08.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f1233fff700 1 --2- 172.21.15.125:0/2319307250 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f123415cef0 0x7f12200051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:08.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12337fe700 1 -- 172.21.15.125:0/2319307250 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f123415cef0 msgr2=0x7f12200051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:08.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12337fe700 1 --2- 172.21.15.125:0/2319307250 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f123415cef0 0x7f12200051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12337fe700 1 -- 172.21.15.125:0/2319307250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1220004810 msgr2=0x7f1220004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:08.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12337fe700 1 --2- 172.21.15.125:0/2319307250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1220004810 0x7f1220004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12337fe700 1 -- 172.21.15.125:0/2319307250 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1220003570 con 0x7f1220003a90 2023-10-06T03:06:08.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12337fe700 1 --2- 172.21.15.125:0/2319307250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1220003a90 0x7f1220003ea0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f121c0018b0 tx=0x7f121c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8097e64ce6c4070f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:08.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12327fc700 1 -- 172.21.15.125:0/2319307250 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c012420 con 0x7f1220003a90 2023-10-06T03:06:08.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12327fc700 1 -- 172.21.15.125:0/2319307250 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121c012580 con 0x7f1220003a90 2023-10-06T03:06:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.293+0000 7f12327fc700 1 -- 172.21.15.125:0/2319307250 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c012920 con 0x7f1220003a90 2023-10-06T03:06:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.294+0000 7f1239bd8700 1 -- 172.21.15.125:0/2319307250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1220003a90 msgr2=0x7f1220003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.294+0000 7f1239bd8700 1 --2- 172.21.15.125:0/2319307250 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1220003a90 0x7f1220003ea0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f121c0018b0 tx=0x7f121c007d30 comp rx=0 tx=0).stop 2023-10-06T03:06:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.294+0000 7f1233fff700 1 -- 172.21.15.125:0/2319307250 reap_dead start 2023-10-06T03:06:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.294+0000 7f1239bd8700 1 -- 172.21.15.125:0/2319307250 shutdown_connections 2023-10-06T03:06:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.294+0000 7f1239bd8700 1 -- 172.21.15.125:0/2319307250 >> 172.21.15.125:0/2319307250 conn(0x7f12340cdf80 msgr2=0x7f12340ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.294+0000 7f1239bd8700 1 -- 172.21.15.125:0/2319307250 shutdown_connections 2023-10-06T03:06:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.294+0000 7f1239bd8700 1 -- 172.21.15.125:0/2319307250 wait complete. 2023-10-06T03:06:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.295+0000 7f1239bd8700 1 Processor -- start 2023-10-06T03:06:08.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.295+0000 7f1239bd8700 1 -- start start 2023-10-06T03:06:08.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.296+0000 7f1239bd8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1220003a90 0x7f123416a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:08.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.296+0000 7f1239bd8700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f123414b3f0 0x7f12340b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:08.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.296+0000 7f1239bd8700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12340b0d20 0x7f12340b1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:08.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.296+0000 7f1239bd8700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1234152640 con 0x7f1220003a90 2023-10-06T03:06:08.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.296+0000 7f1239bd8700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12340b16d0 con 0x7f12340b0d20 2023-10-06T03:06:08.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.296+0000 7f1239bd8700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1234152b90 con 0x7f123414b3f0 2023-10-06T03:06:08.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.296+0000 7f12337fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1220003a90 0x7f123416a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:08.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.296+0000 7f12337fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1220003a90 0x7f123416a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49298/0 (socket says 172.21.15.125:49298) 2023-10-06T03:06:08.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.296+0000 7f12337fe700 1 -- 172.21.15.125:0/798637454 learned_addr learned my addr 172.21.15.125:0/798637454 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:08.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.296+0000 7f12337fe700 1 -- 172.21.15.125:0/798637454 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f123414b3f0 msgr2=0x7f12340b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:08.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.296+0000 7f12337fe700 1 --2- 172.21.15.125:0/798637454 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f123414b3f0 0x7f12340b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.296+0000 7f12337fe700 1 -- 172.21.15.125:0/798637454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12340b0d20 msgr2=0x7f12340b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:08.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.296+0000 7f12337fe700 1 --2- 172.21.15.125:0/798637454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12340b0d20 0x7f12340b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.296+0000 7f12337fe700 1 -- 172.21.15.125:0/798637454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12340b3760 con 0x7f1220003a90 2023-10-06T03:06:08.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.296+0000 7f12337fe700 1 --2- 172.21.15.125:0/798637454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1220003a90 0x7f123416a4f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f121c00c3f0 tx=0x7f121c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:08.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.297+0000 7f122b7fe700 1 -- 172.21.15.125:0/798637454 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c001200 con 0x7f1220003a90 2023-10-06T03:06:08.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.297+0000 7f122b7fe700 1 -- 172.21.15.125:0/798637454 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121c012c90 con 0x7f1220003a90 2023-10-06T03:06:08.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.297+0000 7f1239bd8700 1 -- 172.21.15.125:0/798637454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12340b3a40 con 0x7f1220003a90 2023-10-06T03:06:08.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.297+0000 7f122b7fe700 1 -- 172.21.15.125:0/798637454 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c012920 con 0x7f1220003a90 2023-10-06T03:06:08.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.297+0000 7f1239bd8700 1 -- 172.21.15.125:0/798637454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123414b860 con 0x7f1220003a90 2023-10-06T03:06:08.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.298+0000 7f1239bd8700 1 -- 172.21.15.125:0/798637454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12340afe20 con 0x7f1220003a90 2023-10-06T03:06:08.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.298+0000 7f122b7fe700 1 -- 172.21.15.125:0/798637454 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f121c006a30 con 0x7f1220003a90 2023-10-06T03:06:08.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.298+0000 7f122b7fe700 1 --2- 172.21.15.125:0/798637454 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1214066f30 0x7f12140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:08.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.298+0000 7f122b7fe700 1 -- 172.21.15.125:0/798637454 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6773+0+0 (secure 0 0 0) 0x7f121c085fd0 con 0x7f1220003a90 2023-10-06T03:06:08.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.298+0000 7f1232ffd700 1 --2- 172.21.15.125:0/798637454 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1214066f30 0x7f12140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:08.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.299+0000 7f1232ffd700 1 --2- 172.21.15.125:0/798637454 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1214066f30 0x7f12140693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f12340cb460 tx=0x7f12240091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:08.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.302+0000 7f122b7fe700 1 -- 172.21.15.125:0/798637454 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f121c052e10 con 0x7f1220003a90 2023-10-06T03:06:08.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.527+0000 7f1239bd8700 1 -- 172.21.15.125:0/798637454 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1234066510 con 0x7f1220003a90 2023-10-06T03:06:08.529 INFO:tasks.ceph.mon.a.smithi125.stderr:2023-10-06T03:06:08.528+0000 7f8a89245700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:06:08.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.531+0000 7f122b7fe700 1 -- 172.21.15.125:0/798637454 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7f121c024090 con 0x7f1220003a90 2023-10-06T03:06:08.534 INFO:tasks.ceph.mds.a.smithi125.stderr: -3015> 2023-10-06T03:05:34.940+0000 7f6bc6f07700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:06:08.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.534+0000 7f1239bd8700 1 -- 172.21.15.125:0/798637454 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1214066f30 msgr2=0x7f12140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:08.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.534+0000 7f1239bd8700 1 --2- 172.21.15.125:0/798637454 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1214066f30 0x7f12140693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f12340cb460 tx=0x7f12240091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.534+0000 7f1239bd8700 1 -- 172.21.15.125:0/798637454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1220003a90 msgr2=0x7f123416a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:08.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.534+0000 7f1239bd8700 1 --2- 172.21.15.125:0/798637454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1220003a90 0x7f123416a4f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f121c00c3f0 tx=0x7f121c015000 comp rx=0 tx=0).stop 2023-10-06T03:06:08.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.534+0000 7f1239bd8700 1 -- 172.21.15.125:0/798637454 shutdown_connections 2023-10-06T03:06:08.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.534+0000 7f1239bd8700 1 --2- 172.21.15.125:0/798637454 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1214066f30 0x7f12140693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.534+0000 7f1239bd8700 1 --2- 172.21.15.125:0/798637454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12340b0d20 0x7f12340b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.534+0000 7f1239bd8700 1 --2- 172.21.15.125:0/798637454 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f1220003a90 0x7f123416a4f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.534+0000 7f1239bd8700 1 --2- 172.21.15.125:0/798637454 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f123414b3f0 0x7f12340b2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.534+0000 7f1239bd8700 1 -- 172.21.15.125:0/798637454 >> 172.21.15.125:0/798637454 conn(0x7f12340cdf80 msgr2=0x7f1234157430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:08.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.534+0000 7f1239bd8700 1 -- 172.21.15.125:0/798637454 shutdown_connections 2023-10-06T03:06:08.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.534+0000 7f1239bd8700 1 -- 172.21.15.125:0/798637454 wait complete. 2023-10-06T03:06:08.536 INFO:teuthology.orchestra.run.smithi125.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:06:08.548 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:06:08.558 INFO:tasks.ceph.mds.a.smithi125.stdout:starting mds.a at 2023-10-06T03:06:08.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.666+0000 7f26c973e700 1 Processor -- start 2023-10-06T03:06:08.667 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.666+0000 7f26c973e700 1 -- start start 2023-10-06T03:06:08.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.666+0000 7f26c973e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f26c40cba50 0x7f26c40c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.666+0000 7f26c973e700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f26c40c8150 0x7f26c40c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.666+0000 7f26c973e700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26c40c9470 con 0x7f26c40af320 2023-10-06T03:06:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.666+0000 7f26c973e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c40c9b40 con 0x7f26c40cba50 2023-10-06T03:06:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.666+0000 7f26c973e700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26c40c85b0 con 0x7f26c40c8150 2023-10-06T03:06:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.667+0000 7f26c27fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f26c40cba50 0x7f26c40c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.667+0000 7f26c2ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f26c40af320 0x7f26c40cb340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36048/0 (socket says 172.21.15.125:36048) 2023-10-06T03:06:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.667+0000 7f26c27fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f26c40cba50 0x7f26c40c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49310/0 (socket says 172.21.15.125:49310) 2023-10-06T03:06:08.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.667+0000 7f26c2ffd700 1 -- 172.21.15.125:0/1044926714 learned_addr learned my addr 172.21.15.125:0/1044926714 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.667+0000 7f26c37fe700 1 --2- 172.21.15.125:0/1044926714 >> v2:172.21.15.130:3300/0 conn(0x7f26c40c8150 0x7f26c40c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.667+0000 7f26c27fc700 1 -- 172.21.15.125:0/1044926714 >> v2:172.21.15.130:3300/0 conn(0x7f26c40c8150 msgr2=0x7f26c40c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.667+0000 7f26c27fc700 1 --2- 172.21.15.125:0/1044926714 >> v2:172.21.15.130:3300/0 conn(0x7f26c40c8150 0x7f26c40c1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.667+0000 7f26c27fc700 1 -- 172.21.15.125:0/1044926714 >> v1:172.21.15.125:6789/0 conn(0x7f26c40af320 legacy=0x7f26c40cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.667+0000 7f26c27fc700 1 -- 172.21.15.125:0/1044926714 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c40c8860 con 0x7f26c40cba50 2023-10-06T03:06:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.667+0000 7f26c1ffb700 1 -- 172.21.15.125:0/1044926714 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447026038 0 0) 0x7f26c40c9470 con 0x7f26c40af320 2023-10-06T03:06:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.667+0000 7f26c27fc700 1 --2- 172.21.15.125:0/1044926714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26c40cba50 0x7f26c40c7c10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f26c40696a0 tx=0x7f26b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63850dbcda7f1c50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.667+0000 7f26c1ffb700 1 -- 172.21.15.125:0/1044926714 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b800b6b0 con 0x7f26c40cba50 2023-10-06T03:06:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.667+0000 7f26c1ffb700 1 -- 172.21.15.125:0/1044926714 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b800b810 con 0x7f26c40cba50 2023-10-06T03:06:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.667+0000 7f26c1ffb700 1 -- 172.21.15.125:0/1044926714 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b800bbb0 con 0x7f26c40cba50 2023-10-06T03:06:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.668+0000 7f26c973e700 1 -- 172.21.15.125:0/1044926714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26c40cba50 msgr2=0x7f26c40c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:08.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.668+0000 7f26c973e700 1 --2- 172.21.15.125:0/1044926714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26c40cba50 0x7f26c40c7c10 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f26c40696a0 tx=0x7f26b80091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.668+0000 7f26c973e700 1 -- 172.21.15.125:0/1044926714 shutdown_connections 2023-10-06T03:06:08.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.668+0000 7f26c973e700 1 --2- 172.21.15.125:0/1044926714 >> v2:172.21.15.130:3300/0 conn(0x7f26c40c8150 0x7f26c40c1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.668+0000 7f26c973e700 1 --2- 172.21.15.125:0/1044926714 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26c40cba50 0x7f26c40c7c10 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.668+0000 7f26c973e700 1 -- 172.21.15.125:0/1044926714 >> 172.21.15.125:0/1044926714 conn(0x7f26c4096120 msgr2=0x7f26c4068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:08.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.668+0000 7f26c973e700 1 -- 172.21.15.125:0/1044926714 shutdown_connections 2023-10-06T03:06:08.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.668+0000 7f26c973e700 1 -- 172.21.15.125:0/1044926714 wait complete. 2023-10-06T03:06:08.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.669+0000 7f26c973e700 1 Processor -- start 2023-10-06T03:06:08.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.669+0000 7f26c973e700 1 -- start start 2023-10-06T03:06:08.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c973e700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26c40af320 0x7f26c4151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:08.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c973e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26c40c8150 0x7f26c416aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:08.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c973e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26c40cba50 0x7f26c40c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:08.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c973e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c40c6a10 con 0x7f26c40c8150 2023-10-06T03:06:08.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c973e700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c41523a0 con 0x7f26c40af320 2023-10-06T03:06:08.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c973e700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c415ae30 con 0x7f26c40cba50 2023-10-06T03:06:08.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c27fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26c40c8150 0x7f26c416aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:08.675 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c27fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26c40c8150 0x7f26c416aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49314/0 (socket says 172.21.15.125:49314) 2023-10-06T03:06:08.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c27fc700 1 -- 172.21.15.125:0/1865165583 learned_addr learned my addr 172.21.15.125:0/1865165583 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:08.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c2ffd700 1 --2- 172.21.15.125:0/1865165583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26c40af320 0x7f26c4151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:08.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c37fe700 1 --2- 172.21.15.125:0/1865165583 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26c40cba50 0x7f26c40c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:08.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c27fc700 1 -- 172.21.15.125:0/1865165583 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26c40cba50 msgr2=0x7f26c40c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:08.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c27fc700 1 --2- 172.21.15.125:0/1865165583 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26c40cba50 0x7f26c40c3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c27fc700 1 -- 172.21.15.125:0/1865165583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26c40af320 msgr2=0x7f26c4151e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:08.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c27fc700 1 --2- 172.21.15.125:0/1865165583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26c40af320 0x7f26c4151e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:08.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c27fc700 1 -- 172.21.15.125:0/1865165583 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b8009420 con 0x7f26c40c8150 2023-10-06T03:06:08.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c2ffd700 1 --2- 172.21.15.125:0/1865165583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26c40af320 0x7f26c4151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:08.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c27fc700 1 --2- 172.21.15.125:0/1865165583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26c40c8150 0x7f26c416aa40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f26c406df40 tx=0x7f26b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:08.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26aaffd700 1 -- 172.21.15.125:0/1865165583 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b8011420 con 0x7f26c40c8150 2023-10-06T03:06:08.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26aaffd700 1 -- 172.21.15.125:0/1865165583 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26b8011580 con 0x7f26c40c8150 2023-10-06T03:06:08.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c973e700 1 -- 172.21.15.125:0/1865165583 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c416b4e0 con 0x7f26c40c8150 2023-10-06T03:06:08.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26aaffd700 1 -- 172.21.15.125:0/1865165583 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b8011940 con 0x7f26c40c8150 2023-10-06T03:06:08.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.670+0000 7f26c973e700 1 -- 172.21.15.125:0/1865165583 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c415aac0 con 0x7f26c40c8150 2023-10-06T03:06:08.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.671+0000 7f26c973e700 1 -- 172.21.15.125:0/1865165583 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26c4066510 con 0x7f26c40c8150 2023-10-06T03:06:08.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.672+0000 7f26aaffd700 1 -- 172.21.15.125:0/1865165583 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26b8011d30 con 0x7f26c40c8150 2023-10-06T03:06:08.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.672+0000 7f26aaffd700 1 --2- 172.21.15.125:0/1865165583 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f26b0066f30 0x7f26b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:08.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.672+0000 7f26aaffd700 1 -- 172.21.15.125:0/1865165583 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6859+0+0 (secure 0 0 0) 0x7f26b8086380 con 0x7f26c40c8150 2023-10-06T03:06:08.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.672+0000 7f26c2ffd700 1 --2- 172.21.15.125:0/1865165583 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f26b0066f30 0x7f26b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:08.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.673+0000 7f26c2ffd700 1 --2- 172.21.15.125:0/1865165583 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f26b0066f30 0x7f26b00693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f26b4001360 tx=0x7f26b4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:08.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.676+0000 7f26aaffd700 1 -- 172.21.15.125:0/1865165583 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26b8053170 con 0x7f26c40c8150 2023-10-06T03:06:08.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:08.900+0000 7f26c973e700 1 -- 172.21.15.125:0/1865165583 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f26c40c8b70 con 0x7f26c40c8150 2023-10-06T03:06:09.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.532+0000 7f26aaffd700 1 -- 172.21.15.125:0/1865165583 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f26b8056790 con 0x7f26c40c8150 2023-10-06T03:06:09.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.534+0000 7f26c973e700 1 -- 172.21.15.125:0/1865165583 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f26b0066f30 msgr2=0x7f26b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:09.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.534+0000 7f26c973e700 1 --2- 172.21.15.125:0/1865165583 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f26b0066f30 0x7f26b00693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f26b4001360 tx=0x7f26b4009040 comp rx=0 tx=0).stop 2023-10-06T03:06:09.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.534+0000 7f26c973e700 1 -- 172.21.15.125:0/1865165583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26c40c8150 msgr2=0x7f26c416aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:09.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.535+0000 7f26c973e700 1 --2- 172.21.15.125:0/1865165583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26c40c8150 0x7f26c416aa40 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f26c406df40 tx=0x7f26b8017000 comp rx=0 tx=0).stop 2023-10-06T03:06:09.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.535+0000 7f26c973e700 1 -- 172.21.15.125:0/1865165583 shutdown_connections 2023-10-06T03:06:09.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.535+0000 7f26c973e700 1 --2- 172.21.15.125:0/1865165583 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f26b0066f30 0x7f26b00693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:09.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.535+0000 7f26c973e700 1 --2- 172.21.15.125:0/1865165583 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f26c40cba50 0x7f26c40c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:09.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.535+0000 7f26c973e700 1 --2- 172.21.15.125:0/1865165583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f26c40af320 0x7f26c4151e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:09.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.535+0000 7f26c973e700 1 --2- 172.21.15.125:0/1865165583 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f26c40c8150 0x7f26c416aa40 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:09.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.535+0000 7f26c973e700 1 -- 172.21.15.125:0/1865165583 >> 172.21.15.125:0/1865165583 conn(0x7f26c4096120 msgr2=0x7f26c40c9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:09.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.535+0000 7f26c973e700 1 -- 172.21.15.125:0/1865165583 shutdown_connections 2023-10-06T03:06:09.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.535+0000 7f26c973e700 1 -- 172.21.15.125:0/1865165583 wait complete. 2023-10-06T03:06:09.549 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:06:09.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.712+0000 7f3d194ae700 1 Processor -- start 2023-10-06T03:06:09.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.712+0000 7f3d194ae700 1 -- start start 2023-10-06T03:06:09.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.712+0000 7f3d194ae700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d140691b0 0x7f3d14159530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:09.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.712+0000 7f3d194ae700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d140cb910 con 0x7f3d140cb490 2023-10-06T03:06:09.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.712+0000 7f3d194ae700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d140cfa80 con 0x7f3d14068de0 2023-10-06T03:06:09.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.712+0000 7f3d194ae700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140cff10 con 0x7f3d140691b0 2023-10-06T03:06:09.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d137fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3d140cb490 0x7f3d140afe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36062/0 (socket says 172.21.15.125:36062) 2023-10-06T03:06:09.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d137fe700 1 -- 172.21.15.125:0/493436382 learned_addr learned my addr 172.21.15.125:0/493436382 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:09.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d127fc700 1 --2- 172.21.15.125:0/493436382 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d140691b0 0x7f3d14159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:09.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d11ffb700 1 -- 172.21.15.125:0/493436382 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028803308 0 0) 0x7f3d0c001490 con 0x7f3d140cb490 2023-10-06T03:06:09.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d11ffb700 1 -- 172.21.15.125:0/493436382 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cfc003570 con 0x7f3d140cb490 2023-10-06T03:06:09.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d11ffb700 1 -- 172.21.15.125:0/493436382 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162332987 0 0) 0x7f3d140cfa80 con 0x7f3d14068de0 2023-10-06T03:06:09.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d11ffb700 1 -- 172.21.15.125:0/493436382 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d0c001490 con 0x7f3d14068de0 2023-10-06T03:06:09.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d11ffb700 1 -- 172.21.15.125:0/493436382 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3558476442 0 0) 0x7f3cfc003570 con 0x7f3d140cb490 2023-10-06T03:06:09.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d11ffb700 1 -- 172.21.15.125:0/493436382 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d140691b0 msgr2=0x7f3d14159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:09.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d11ffb700 1 --2- 172.21.15.125:0/493436382 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d140691b0 0x7f3d14159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:09.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d11ffb700 1 -- 172.21.15.125:0/493436382 >> v1:172.21.15.130:6789/0 conn(0x7f3d14068de0 legacy=0x7f3d14158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:09.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d11ffb700 1 -- 172.21.15.125:0/493436382 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d140cee70 con 0x7f3d140cb490 2023-10-06T03:06:09.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d11ffb700 1 -- 172.21.15.125:0/493436382 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f3d0c001980 con 0x7f3d140cb490 2023-10-06T03:06:09.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d11ffb700 1 -- 172.21.15.125:0/493436382 >> v1:172.21.15.125:6789/0 conn(0x7f3d140cb490 legacy=0x7f3d140afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:09.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d11ffb700 1 --2- 172.21.15.125:0/493436382 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d140691b0 0x7f3cfc003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:09.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d11ffb700 1 --2- 172.21.15.125:0/493436382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cfc0041d0 0x7f3cfc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:09.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d11ffb700 1 --2- 172.21.15.125:0/493436382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cfc004d50 0x7f3cfc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:09.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d11ffb700 1 -- 172.21.15.125:0/493436382 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d140cff10 con 0x7f3cfc004d50 2023-10-06T03:06:09.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d11ffb700 1 -- 172.21.15.125:0/493436382 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc00bbf0 con 0x7f3cfc0041d0 2023-10-06T03:06:09.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d11ffb700 1 -- 172.21.15.125:0/493436382 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cfc00bdb0 con 0x7f3d140691b0 2023-10-06T03:06:09.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d137fe700 1 --2- 172.21.15.125:0/493436382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cfc004d50 0x7f3cfc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:09.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d12ffd700 1 --2- 172.21.15.125:0/493436382 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d140691b0 0x7f3cfc003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:09.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.713+0000 7f3d127fc700 1 --2- 172.21.15.125:0/493436382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cfc0041d0 0x7f3cfc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:09.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.714+0000 7f3d137fe700 1 -- 172.21.15.125:0/493436382 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d140691b0 msgr2=0x7f3cfc003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:09.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.714+0000 7f3d137fe700 1 --2- 172.21.15.125:0/493436382 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d140691b0 0x7f3cfc003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:09.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.714+0000 7f3d137fe700 1 -- 172.21.15.125:0/493436382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cfc0041d0 msgr2=0x7f3cfc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:09.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.714+0000 7f3d137fe700 1 --2- 172.21.15.125:0/493436382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cfc0041d0 0x7f3cfc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:09.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.714+0000 7f3d137fe700 1 -- 172.21.15.125:0/493436382 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cfc003570 con 0x7f3cfc004d50 2023-10-06T03:06:09.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.714+0000 7f3d127fc700 1 --2- 172.21.15.125:0/493436382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cfc0041d0 0x7f3cfc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:09.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.714+0000 7f3d137fe700 1 --2- 172.21.15.125:0/493436382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cfc004d50 0x7f3cfc0051c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00a980 tx=0x7f3d140cf9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ad2fc12d823889 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:09.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.714+0000 7f3d11ffb700 1 -- 172.21.15.125:0/493436382 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0070f0 con 0x7f3cfc004d50 2023-10-06T03:06:09.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.714+0000 7f3d11ffb700 1 -- 172.21.15.125:0/493436382 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c007270 con 0x7f3cfc004d50 2023-10-06T03:06:09.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.714+0000 7f3d11ffb700 1 -- 172.21.15.125:0/493436382 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c007630 con 0x7f3cfc004d50 2023-10-06T03:06:09.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.714+0000 7f3d194ae700 1 -- 172.21.15.125:0/493436382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cfc004d50 msgr2=0x7f3cfc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:09.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.714+0000 7f3d194ae700 1 --2- 172.21.15.125:0/493436382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3cfc004d50 0x7f3cfc0051c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00a980 tx=0x7f3d140cf9f0 comp rx=0 tx=0).stop 2023-10-06T03:06:09.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.714+0000 7f3d137fe700 1 -- 172.21.15.125:0/493436382 reap_dead start 2023-10-06T03:06:09.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.714+0000 7f3d194ae700 1 -- 172.21.15.125:0/493436382 shutdown_connections 2023-10-06T03:06:09.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.714+0000 7f3d194ae700 1 -- 172.21.15.125:0/493436382 >> 172.21.15.125:0/493436382 conn(0x7f3d1406f7b0 msgr2=0x7f3d140d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:09.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.714+0000 7f3d194ae700 1 -- 172.21.15.125:0/493436382 shutdown_connections 2023-10-06T03:06:09.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.714+0000 7f3d194ae700 1 -- 172.21.15.125:0/493436382 wait complete. 2023-10-06T03:06:09.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.716+0000 7f3d194ae700 1 Processor -- start 2023-10-06T03:06:09.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.716+0000 7f3d194ae700 1 -- start start 2023-10-06T03:06:09.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.716+0000 7f3d194ae700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d14143b60 0x7f3d1416a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:09.723 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.716+0000 7f3d194ae700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d14143f30 0x7f3d140c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:09.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.716+0000 7f3d194ae700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d1415b780 0x7f3d140c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:09.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.716+0000 7f3d194ae700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1415acd0 con 0x7f3d1415b780 2023-10-06T03:06:09.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.716+0000 7f3d194ae700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1416aab0 con 0x7f3d14143b60 2023-10-06T03:06:09.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.716+0000 7f3d194ae700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1415a840 con 0x7f3d14143f30 2023-10-06T03:06:09.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.717+0000 7f3d137fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d1415b780 0x7f3d140c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:09.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.717+0000 7f3d137fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d1415b780 0x7f3d140c67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49324/0 (socket says 172.21.15.125:49324) 2023-10-06T03:06:09.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.717+0000 7f3d137fe700 1 -- 172.21.15.125:0/24183562 learned_addr learned my addr 172.21.15.125:0/24183562 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:09.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.717+0000 7f3d12ffd700 1 --2- 172.21.15.125:0/24183562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d14143b60 0x7f3d1416a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:09.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.717+0000 7f3d127fc700 1 --2- 172.21.15.125:0/24183562 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d14143f30 0x7f3d140c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:09.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.717+0000 7f3d137fe700 1 -- 172.21.15.125:0/24183562 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d14143f30 msgr2=0x7f3d140c62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:09.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.717+0000 7f3d137fe700 1 --2- 172.21.15.125:0/24183562 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d14143f30 0x7f3d140c62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:09.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.717+0000 7f3d137fe700 1 -- 172.21.15.125:0/24183562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d14143b60 msgr2=0x7f3d1416a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:09.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.717+0000 7f3d137fe700 1 --2- 172.21.15.125:0/24183562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d14143b60 0x7f3d1416a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:09.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.717+0000 7f3d137fe700 1 -- 172.21.15.125:0/24183562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d14159c30 con 0x7f3d1415b780 2023-10-06T03:06:09.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.717+0000 7f3d137fe700 1 --2- 172.21.15.125:0/24183562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d1415b780 0x7f3d140c67f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c004c10 tx=0x7f3d0c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:09.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.717+0000 7f3cfaffd700 1 -- 172.21.15.125:0/24183562 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c002090 con 0x7f3d1415b780 2023-10-06T03:06:09.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.717+0000 7f3cfaffd700 1 -- 172.21.15.125:0/24183562 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c007070 con 0x7f3d1415b780 2023-10-06T03:06:09.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.717+0000 7f3cfaffd700 1 -- 172.21.15.125:0/24183562 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0011c0 con 0x7f3d1415b780 2023-10-06T03:06:09.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.717+0000 7f3d194ae700 1 -- 172.21.15.125:0/24183562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d14159f10 con 0x7f3d1415b780 2023-10-06T03:06:09.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.717+0000 7f3d194ae700 1 -- 172.21.15.125:0/24183562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1415a4d0 con 0x7f3d1415b780 2023-10-06T03:06:09.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.718+0000 7f3d194ae700 1 -- 172.21.15.125:0/24183562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1415a9d0 con 0x7f3d1415b780 2023-10-06T03:06:09.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.719+0000 7f3cfaffd700 1 -- 172.21.15.125:0/24183562 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d0c024070 con 0x7f3d1415b780 2023-10-06T03:06:09.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.719+0000 7f3cfaffd700 1 --2- 172.21.15.125:0/24183562 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3d00066f30 0x7f3d000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:09.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.719+0000 7f3cfaffd700 1 -- 172.21.15.125:0/24183562 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6859+0+0 (secure 0 0 0) 0x7f3d0c0866e0 con 0x7f3d1415b780 2023-10-06T03:06:09.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.719+0000 7f3d12ffd700 1 --2- 172.21.15.125:0/24183562 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3d00066f30 0x7f3d000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:09.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.719+0000 7f3d12ffd700 1 --2- 172.21.15.125:0/24183562 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3d00066f30 0x7f3d000693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3d04000c00 tx=0x7f3d04007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:09.726 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.723+0000 7f3cfaffd700 1 -- 172.21.15.125:0/24183562 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d0c0534d0 con 0x7f3d1415b780 2023-10-06T03:06:09.910 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:09.908+0000 7f3d194ae700 1 -- 172.21.15.125:0/24183562 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3d140cb910 con 0x7f3d1415b780 2023-10-06T03:06:10.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.535+0000 7f3cfaffd700 1 -- 172.21.15.125:0/24183562 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v46) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3d140cb910 con 0x7f3d1415b780 2023-10-06T03:06:10.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.537+0000 7f3d194ae700 1 -- 172.21.15.125:0/24183562 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3d00066f30 msgr2=0x7f3d000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:10.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.537+0000 7f3d194ae700 1 --2- 172.21.15.125:0/24183562 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3d00066f30 0x7f3d000693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3d04000c00 tx=0x7f3d04007d30 comp rx=0 tx=0).stop 2023-10-06T03:06:10.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.538+0000 7f3d194ae700 1 -- 172.21.15.125:0/24183562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d1415b780 msgr2=0x7f3d140c67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:10.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.538+0000 7f3d194ae700 1 --2- 172.21.15.125:0/24183562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d1415b780 0x7f3d140c67f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c004c10 tx=0x7f3d0c016000 comp rx=0 tx=0).stop 2023-10-06T03:06:10.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.538+0000 7f3d194ae700 1 -- 172.21.15.125:0/24183562 shutdown_connections 2023-10-06T03:06:10.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.538+0000 7f3d194ae700 1 --2- 172.21.15.125:0/24183562 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3d00066f30 0x7f3d000693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:10.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.538+0000 7f3d194ae700 1 --2- 172.21.15.125:0/24183562 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d1415b780 0x7f3d140c67f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:10.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.538+0000 7f3d194ae700 1 --2- 172.21.15.125:0/24183562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d14143b60 0x7f3d1416a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:10.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.538+0000 7f3d194ae700 1 --2- 172.21.15.125:0/24183562 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d14143f30 0x7f3d140c62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:10.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.538+0000 7f3d194ae700 1 -- 172.21.15.125:0/24183562 >> 172.21.15.125:0/24183562 conn(0x7f3d1406f7b0 msgr2=0x7f3d14153640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:10.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.538+0000 7f3d194ae700 1 -- 172.21.15.125:0/24183562 shutdown_connections 2023-10-06T03:06:10.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.538+0000 7f3d194ae700 1 -- 172.21.15.125:0/24183562 wait complete. 2023-10-06T03:06:10.541 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:06:10.555 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:06:10.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.680+0000 7f420aa6f700 1 Processor -- start 2023-10-06T03:06:10.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.680+0000 7f420aa6f700 1 -- start start 2023-10-06T03:06:10.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.681+0000 7f420aa6f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42040b0260 0x7f420415ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:10.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.681+0000 7f420aa6f700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f420415ba50 0x7f42040c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:10.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.681+0000 7f420aa6f700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42040c3d80 con 0x7f42040b0630 2023-10-06T03:06:10.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.681+0000 7f420aa6f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42040ca300 con 0x7f42040b0260 2023-10-06T03:06:10.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.681+0000 7f420aa6f700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4204068420 con 0x7f420415ba50 2023-10-06T03:06:10.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.681+0000 7f420880b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42040b0260 0x7f420415ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:10.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.681+0000 7f420880b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f42040b0260 0x7f420415ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49330/0 (socket says 172.21.15.125:49330) 2023-10-06T03:06:10.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.681+0000 7f420880b700 1 -- 172.21.15.125:0/4186568382 learned_addr learned my addr 172.21.15.125:0/4186568382 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:10.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.681+0000 7f420880b700 1 -- 172.21.15.125:0/4186568382 >> v2:172.21.15.130:3300/0 conn(0x7f420415ba50 msgr2=0x7f42040c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:10.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.681+0000 7f420880b700 1 --2- 172.21.15.125:0/4186568382 >> v2:172.21.15.130:3300/0 conn(0x7f420415ba50 0x7f42040c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:10.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.681+0000 7f420880b700 1 -- 172.21.15.125:0/4186568382 >> v1:172.21.15.130:6789/0 conn(0x7f42040b0630 legacy=0x7f420415b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:10.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.681+0000 7f420880b700 1 -- 172.21.15.125:0/4186568382 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42040cea90 con 0x7f42040b0260 2023-10-06T03:06:10.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.682+0000 7f420880b700 1 --2- 172.21.15.125:0/4186568382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42040b0260 0x7f420415ae00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f42040c8d00 tx=0x7f41f8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d3a891767519a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:10.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.682+0000 7f42037fe700 1 -- 172.21.15.125:0/4186568382 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f8005c10 con 0x7f42040b0260 2023-10-06T03:06:10.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.682+0000 7f42037fe700 1 -- 172.21.15.125:0/4186568382 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f8005d70 con 0x7f42040b0260 2023-10-06T03:06:10.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.682+0000 7f42037fe700 1 -- 172.21.15.125:0/4186568382 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f800b840 con 0x7f42040b0260 2023-10-06T03:06:10.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.682+0000 7f420aa6f700 1 -- 172.21.15.125:0/4186568382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42040b0260 msgr2=0x7f420415ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:10.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.682+0000 7f420aa6f700 1 --2- 172.21.15.125:0/4186568382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42040b0260 0x7f420415ae00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f42040c8d00 tx=0x7f41f8009220 comp rx=0 tx=0).stop 2023-10-06T03:06:10.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.682+0000 7f420aa6f700 1 -- 172.21.15.125:0/4186568382 shutdown_connections 2023-10-06T03:06:10.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.682+0000 7f420aa6f700 1 --2- 172.21.15.125:0/4186568382 >> v2:172.21.15.130:3300/0 conn(0x7f420415ba50 0x7f42040c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:10.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.682+0000 7f420aa6f700 1 --2- 172.21.15.125:0/4186568382 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42040b0260 0x7f420415ae00 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:10.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.682+0000 7f420aa6f700 1 -- 172.21.15.125:0/4186568382 >> 172.21.15.125:0/4186568382 conn(0x7f4204067df0 msgr2=0x7f42040cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:10.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.682+0000 7f420aa6f700 1 -- 172.21.15.125:0/4186568382 shutdown_connections 2023-10-06T03:06:10.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.682+0000 7f420aa6f700 1 -- 172.21.15.125:0/4186568382 wait complete. 2023-10-06T03:06:10.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.683+0000 7f420aa6f700 1 Processor -- start 2023-10-06T03:06:10.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.684+0000 7f420aa6f700 1 -- start start 2023-10-06T03:06:10.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.684+0000 7f420aa6f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42040b0260 0x7f4204157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:10.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.684+0000 7f420aa6f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42040b0630 0x7f4204159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:10.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.684+0000 7f420aa6f700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f420415ba50 0x7f420415ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:10.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.684+0000 7f420aa6f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420415a970 con 0x7f42040b0630 2023-10-06T03:06:10.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.684+0000 7f420aa6f700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42041580d0 con 0x7f420415ba50 2023-10-06T03:06:10.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.684+0000 7f420aa6f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4204159aa0 con 0x7f42040b0260 2023-10-06T03:06:10.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.684+0000 7f4203fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42040b0630 0x7f4204159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:10.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.684+0000 7f4203fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42040b0630 0x7f4204159560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49340/0 (socket says 172.21.15.125:49340) 2023-10-06T03:06:10.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.684+0000 7f4203fff700 1 -- 172.21.15.125:0/1945261518 learned_addr learned my addr 172.21.15.125:0/1945261518 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:10.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.685+0000 7f420880b700 1 --2- 172.21.15.125:0/1945261518 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42040b0260 0x7f4204157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:10.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.685+0000 7f420900c700 1 --2- 172.21.15.125:0/1945261518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f420415ba50 0x7f420415ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:10.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.685+0000 7f4203fff700 1 -- 172.21.15.125:0/1945261518 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42040b0260 msgr2=0x7f4204157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:10.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.685+0000 7f4203fff700 1 --2- 172.21.15.125:0/1945261518 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42040b0260 0x7f4204157b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:10.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.685+0000 7f4203fff700 1 -- 172.21.15.125:0/1945261518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f420415ba50 msgr2=0x7f420415ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:10.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.685+0000 7f4203fff700 1 --2- 172.21.15.125:0/1945261518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f420415ba50 0x7f420415ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:10.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.685+0000 7f4203fff700 1 -- 172.21.15.125:0/1945261518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f8009480 con 0x7f42040b0630 2023-10-06T03:06:10.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.685+0000 7f420900c700 1 --2- 172.21.15.125:0/1945261518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f420415ba50 0x7f420415ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:10.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.685+0000 7f4203fff700 1 --2- 172.21.15.125:0/1945261518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42040b0630 0x7f4204159560 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f41f000b600 tx=0x7f41f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:10.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.685+0000 7f4200ff9700 1 -- 172.21.15.125:0/1945261518 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f000f510 con 0x7f42040b0630 2023-10-06T03:06:10.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.685+0000 7f4200ff9700 1 -- 172.21.15.125:0/1945261518 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f000f670 con 0x7f42040b0630 2023-10-06T03:06:10.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.685+0000 7f420aa6f700 1 -- 172.21.15.125:0/1945261518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4204159d60 con 0x7f42040b0630 2023-10-06T03:06:10.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.685+0000 7f4200ff9700 1 -- 172.21.15.125:0/1945261518 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f000fa30 con 0x7f42040b0630 2023-10-06T03:06:10.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.685+0000 7f420aa6f700 1 -- 172.21.15.125:0/1945261518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420415a320 con 0x7f42040b0630 2023-10-06T03:06:10.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.686+0000 7f420aa6f700 1 -- 172.21.15.125:0/1945261518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420415ab20 con 0x7f42040b0630 2023-10-06T03:06:10.692 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.686+0000 7f4200ff9700 1 -- 172.21.15.125:0/1945261518 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f41f001a400 con 0x7f42040b0630 2023-10-06T03:06:10.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.687+0000 7f4200ff9700 1 --2- 172.21.15.125:0/1945261518 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f41e8066f30 0x7f41e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:10.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.687+0000 7f4200ff9700 1 -- 172.21.15.125:0/1945261518 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6479+0+0 (secure 0 0 0) 0x7f41f0084350 con 0x7f42040b0630 2023-10-06T03:06:10.693 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.687+0000 7f420880b700 1 --2- 172.21.15.125:0/1945261518 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f41e8066f30 0x7f41e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:10.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.687+0000 7f420880b700 1 --2- 172.21.15.125:0/1945261518 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f41e8066f30 0x7f41e80693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f41f8003080 tx=0x7f41f8015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:10.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.691+0000 7f4200ff9700 1 -- 172.21.15.125:0/1945261518 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f420415ab20 con 0x7f42040b0630 2023-10-06T03:06:10.875 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:10.873+0000 7f420aa6f700 1 -- 172.21.15.125:0/1945261518 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f420415aab0 con 0x7f42040b0630 2023-10-06T03:06:11.540 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.538+0000 7f4200ff9700 1 -- 172.21.15.125:0/1945261518 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v47) v1 ==== 169+0+0 (secure 0 0 0) 0x7f41f0054dd0 con 0x7f42040b0630 2023-10-06T03:06:11.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.543+0000 7f420aa6f700 1 -- 172.21.15.125:0/1945261518 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f41e8066f30 msgr2=0x7f41e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:11.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.543+0000 7f420aa6f700 1 --2- 172.21.15.125:0/1945261518 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f41e8066f30 0x7f41e80693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f41f8003080 tx=0x7f41f8015000 comp rx=0 tx=0).stop 2023-10-06T03:06:11.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.543+0000 7f420aa6f700 1 -- 172.21.15.125:0/1945261518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42040b0630 msgr2=0x7f4204159560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:11.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.543+0000 7f420aa6f700 1 --2- 172.21.15.125:0/1945261518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42040b0630 0x7f4204159560 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f41f000b600 tx=0x7f41f00091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:11.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.543+0000 7f420aa6f700 1 -- 172.21.15.125:0/1945261518 shutdown_connections 2023-10-06T03:06:11.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.543+0000 7f420aa6f700 1 --2- 172.21.15.125:0/1945261518 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f41e8066f30 0x7f41e80693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:11.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.543+0000 7f420aa6f700 1 --2- 172.21.15.125:0/1945261518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f420415ba50 0x7f420415ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:11.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.543+0000 7f420aa6f700 1 --2- 172.21.15.125:0/1945261518 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42040b0260 0x7f4204157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:11.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.543+0000 7f420aa6f700 1 --2- 172.21.15.125:0/1945261518 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42040b0630 0x7f4204159560 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:11.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.543+0000 7f420aa6f700 1 -- 172.21.15.125:0/1945261518 >> 172.21.15.125:0/1945261518 conn(0x7f4204067df0 msgr2=0x7f420406c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:11.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.543+0000 7f420aa6f700 1 -- 172.21.15.125:0/1945261518 shutdown_connections 2023-10-06T03:06:11.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.543+0000 7f420aa6f700 1 -- 172.21.15.125:0/1945261518 wait complete. 2023-10-06T03:06:11.546 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data' removed 2023-10-06T03:06:11.558 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm data_new data_new --yes-i-really-really-mean-it 2023-10-06T03:06:11.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.679+0000 7f2365ed4700 1 Processor -- start 2023-10-06T03:06:11.680 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.679+0000 7f2365ed4700 1 -- start start 2023-10-06T03:06:11.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.679+0000 7f2365ed4700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f236015ad30 0x7f23600c9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:11.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.679+0000 7f2365ed4700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f23600c8860 0x7f23600c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:11.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.679+0000 7f2365ed4700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23600ac520 con 0x7f2360156ec0 2023-10-06T03:06:11.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.679+0000 7f2365ed4700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23600c7410 con 0x7f23600c8860 2023-10-06T03:06:11.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.679+0000 7f2365ed4700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23600ab800 con 0x7f236015ad30 2023-10-06T03:06:11.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.680+0000 7f235ffff700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f23600c8860 0x7f23600c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:11.681 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.680+0000 7f235effd700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f236015ad30 0x7f23600c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:11.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.680+0000 7f235f7fe700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f2360156ec0 0x7f23600ab0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:41632/0 (socket says 172.21.15.125:41632) 2023-10-06T03:06:11.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.680+0000 7f235f7fe700 1 -- 172.21.15.125:0/812791536 learned_addr learned my addr 172.21.15.125:0/812791536 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:11.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.680+0000 7f235ffff700 1 -- 172.21.15.125:0/812791536 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f236015ad30 msgr2=0x7f23600c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:11.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.680+0000 7f235ffff700 1 --2- 172.21.15.125:0/812791536 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f236015ad30 0x7f23600c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:11.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.680+0000 7f235ffff700 1 -- 172.21.15.125:0/812791536 >> v1:172.21.15.130:6789/0 conn(0x7f2360156ec0 legacy=0x7f23600ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:11.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.680+0000 7f235e7fc700 1 -- 172.21.15.125:0/812791536 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928807642 0 0) 0x7f2348001160 con 0x7f2360156ec0 2023-10-06T03:06:11.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.680+0000 7f235ffff700 1 -- 172.21.15.125:0/812791536 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236015b230 con 0x7f23600c8860 2023-10-06T03:06:11.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.680+0000 7f235ffff700 1 --2- 172.21.15.125:0/812791536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23600c8860 0x7f23600c9db0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2358009e60 tx=0x7f2358009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a63dddb9b66c6da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:11.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.681+0000 7f235e7fc700 1 -- 172.21.15.125:0/812791536 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235800e070 con 0x7f23600c8860 2023-10-06T03:06:11.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.681+0000 7f235e7fc700 1 -- 172.21.15.125:0/812791536 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235800bb60 con 0x7f23600c8860 2023-10-06T03:06:11.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.681+0000 7f235e7fc700 1 -- 172.21.15.125:0/812791536 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2358012430 con 0x7f23600c8860 2023-10-06T03:06:11.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.681+0000 7f2365ed4700 1 -- 172.21.15.125:0/812791536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23600c8860 msgr2=0x7f23600c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:11.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.681+0000 7f2365ed4700 1 --2- 172.21.15.125:0/812791536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23600c8860 0x7f23600c9db0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2358009e60 tx=0x7f2358009780 comp rx=0 tx=0).stop 2023-10-06T03:06:11.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.681+0000 7f2365ed4700 1 -- 172.21.15.125:0/812791536 shutdown_connections 2023-10-06T03:06:11.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.681+0000 7f2365ed4700 1 --2- 172.21.15.125:0/812791536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f23600c8860 0x7f23600c9db0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:11.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.681+0000 7f2365ed4700 1 --2- 172.21.15.125:0/812791536 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f236015ad30 0x7f23600c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:11.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.681+0000 7f2365ed4700 1 -- 172.21.15.125:0/812791536 >> 172.21.15.125:0/812791536 conn(0x7f23600960c0 msgr2=0x7f2360068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:11.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.681+0000 7f2365ed4700 1 -- 172.21.15.125:0/812791536 shutdown_connections 2023-10-06T03:06:11.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.681+0000 7f2365ed4700 1 -- 172.21.15.125:0/812791536 wait complete. 2023-10-06T03:06:11.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.682+0000 7f2365ed4700 1 Processor -- start 2023-10-06T03:06:11.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.682+0000 7f2365ed4700 1 -- start start 2023-10-06T03:06:11.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.683+0000 7f2365ed4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23600c8860 0x7f236014a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:11.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.683+0000 7f2365ed4700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2360156ec0 0x7f2360067610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:11.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.683+0000 7f2365ed4700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f236015ad30 0x7f2360067b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:11.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.683+0000 7f2365ed4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2360158010 con 0x7f23600c8860 2023-10-06T03:06:11.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.683+0000 7f2365ed4700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23600af570 con 0x7f236015ad30 2023-10-06T03:06:11.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.683+0000 7f2365ed4700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2360168300 con 0x7f2360156ec0 2023-10-06T03:06:11.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.683+0000 7f235f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23600c8860 0x7f236014a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:11.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.683+0000 7f235f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23600c8860 0x7f236014a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49352/0 (socket says 172.21.15.125:49352) 2023-10-06T03:06:11.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.683+0000 7f235f7fe700 1 -- 172.21.15.125:0/1842973564 learned_addr learned my addr 172.21.15.125:0/1842973564 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:11.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.683+0000 7f235ffff700 1 --2- 172.21.15.125:0/1842973564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f236015ad30 0x7f2360067b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:11.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.683+0000 7f235effd700 1 --2- 172.21.15.125:0/1842973564 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2360156ec0 0x7f2360067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:11.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.684+0000 7f235f7fe700 1 -- 172.21.15.125:0/1842973564 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2360156ec0 msgr2=0x7f2360067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:11.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.684+0000 7f235f7fe700 1 --2- 172.21.15.125:0/1842973564 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2360156ec0 0x7f2360067610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:11.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.684+0000 7f235f7fe700 1 -- 172.21.15.125:0/1842973564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f236015ad30 msgr2=0x7f2360067b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:11.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.684+0000 7f235f7fe700 1 --2- 172.21.15.125:0/1842973564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f236015ad30 0x7f2360067b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:11.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.684+0000 7f235f7fe700 1 -- 172.21.15.125:0/1842973564 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2358009a20 con 0x7f23600c8860 2023-10-06T03:06:11.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.684+0000 7f235f7fe700 1 --2- 172.21.15.125:0/1842973564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23600c8860 0x7f236014a2c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f234800c810 tx=0x7f2348007c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:11.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.684+0000 7f23577fe700 1 -- 172.21.15.125:0/1842973564 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2348005b80 con 0x7f23600c8860 2023-10-06T03:06:11.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.684+0000 7f23577fe700 1 -- 172.21.15.125:0/1842973564 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2348005d00 con 0x7f23600c8860 2023-10-06T03:06:11.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.684+0000 7f2365ed4700 1 -- 172.21.15.125:0/1842973564 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236014a800 con 0x7f23600c8860 2023-10-06T03:06:11.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.684+0000 7f23577fe700 1 -- 172.21.15.125:0/1842973564 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2348007320 con 0x7f23600c8860 2023-10-06T03:06:11.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.684+0000 7f2365ed4700 1 -- 172.21.15.125:0/1842973564 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2360167820 con 0x7f23600c8860 2023-10-06T03:06:11.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.685+0000 7f2365ed4700 1 -- 172.21.15.125:0/1842973564 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f236006d4b0 con 0x7f23600c8860 2023-10-06T03:06:11.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.685+0000 7f23577fe700 1 -- 172.21.15.125:0/1842973564 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2348007750 con 0x7f23600c8860 2023-10-06T03:06:11.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.686+0000 7f23577fe700 1 --2- 172.21.15.125:0/1842973564 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2340066f30 0x7f23400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:11.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.686+0000 7f23577fe700 1 -- 172.21.15.125:0/1842973564 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6007+0+0 (secure 0 0 0) 0x7f2348083a40 con 0x7f23600c8860 2023-10-06T03:06:11.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.686+0000 7f235effd700 1 --2- 172.21.15.125:0/1842973564 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2340066f30 0x7f23400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:11.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.686+0000 7f235effd700 1 --2- 172.21.15.125:0/1842973564 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2340066f30 0x7f23400693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f236015b160 tx=0x7f23500091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:11.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.690+0000 7f23577fe700 1 -- 172.21.15.125:0/1842973564 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2348085e60 con 0x7f23600c8860 2023-10-06T03:06:11.873 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:11.871+0000 7f2365ed4700 1 -- 172.21.15.125:0/1842973564 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f23600ad680 con 0x7f23600c8860 2023-10-06T03:06:12.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.539+0000 7f23577fe700 1 -- 172.21.15.125:0/1842973564 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "data_new", "pool2": "data_new", "yes_i_really_really_mean_it": true}]=0 pool 'data_new' removed v48) v1 ==== 160+0+0 (secure 0 0 0) 0x7f2348017020 con 0x7f23600c8860 2023-10-06T03:06:12.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.543+0000 7f2365ed4700 1 -- 172.21.15.125:0/1842973564 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2340066f30 msgr2=0x7f23400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:12.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.543+0000 7f2365ed4700 1 --2- 172.21.15.125:0/1842973564 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2340066f30 0x7f23400693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f236015b160 tx=0x7f23500091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:12.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.543+0000 7f2365ed4700 1 -- 172.21.15.125:0/1842973564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23600c8860 msgr2=0x7f236014a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:12.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.543+0000 7f2365ed4700 1 --2- 172.21.15.125:0/1842973564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23600c8860 0x7f236014a2c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f234800c810 tx=0x7f2348007c40 comp rx=0 tx=0).stop 2023-10-06T03:06:12.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.543+0000 7f2365ed4700 1 -- 172.21.15.125:0/1842973564 shutdown_connections 2023-10-06T03:06:12.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.543+0000 7f2365ed4700 1 --2- 172.21.15.125:0/1842973564 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2340066f30 0x7f23400693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:12.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.543+0000 7f2365ed4700 1 --2- 172.21.15.125:0/1842973564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f236015ad30 0x7f2360067b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:12.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.543+0000 7f2365ed4700 1 --2- 172.21.15.125:0/1842973564 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f23600c8860 0x7f236014a2c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:12.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.543+0000 7f2365ed4700 1 --2- 172.21.15.125:0/1842973564 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2360156ec0 0x7f2360067610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:12.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.543+0000 7f2365ed4700 1 -- 172.21.15.125:0/1842973564 >> 172.21.15.125:0/1842973564 conn(0x7f23600960c0 msgr2=0x7f23601562c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:12.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.543+0000 7f2365ed4700 1 -- 172.21.15.125:0/1842973564 shutdown_connections 2023-10-06T03:06:12.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.543+0000 7f2365ed4700 1 -- 172.21.15.125:0/1842973564 wait complete. 2023-10-06T03:06:12.546 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'data_new' removed 2023-10-06T03:06:12.559 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T03:06:12.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.677+0000 7f77fec7c700 1 Processor -- start 2023-10-06T03:06:12.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.677+0000 7f77fec7c700 1 -- start start 2023-10-06T03:06:12.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.677+0000 7f77fec7c700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f8156270 0x7f77f8156640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:12.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.677+0000 7f77fec7c700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f77f80b0240 0x7f77f80c1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:12.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.677+0000 7f77fec7c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f8068710 con 0x7f77f80c1b50 2023-10-06T03:06:12.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.677+0000 7f77fec7c700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f80c7350 con 0x7f77f80b0240 2023-10-06T03:06:12.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.677+0000 7f77fec7c700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f8068150 con 0x7f77f8156270 2023-10-06T03:06:12.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77fd219700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f77f80c1b50 0x7f77f80c9220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36072/0 (socket says 172.21.15.125:36072) 2023-10-06T03:06:12.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77fd219700 1 -- 172.21.15.125:0/3558240807 learned_addr learned my addr 172.21.15.125:0/3558240807 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:12.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77f7fff700 1 --2- 172.21.15.125:0/3558240807 >> v2:172.21.15.130:3300/0 conn(0x7f77f80b0240 0x7f77f80c1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:12.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77fca18700 1 --2- 172.21.15.125:0/3558240807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f8156270 0x7f77f8156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:12.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77f77fe700 1 -- 172.21.15.125:0/3558240807 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2400683507 0 0) 0x7f77f8068710 con 0x7f77f80c1b50 2023-10-06T03:06:12.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77f77fe700 1 -- 172.21.15.125:0/3558240807 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77e8003570 con 0x7f77f80c1b50 2023-10-06T03:06:12.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77f77fe700 1 -- 172.21.15.125:0/3558240807 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3140905901 0 0) 0x7f77e8003570 con 0x7f77f80c1b50 2023-10-06T03:06:12.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77f77fe700 1 -- 172.21.15.125:0/3558240807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f8156270 msgr2=0x7f77f8156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:12.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77f77fe700 1 --2- 172.21.15.125:0/3558240807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f8156270 0x7f77f8156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:12.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77f77fe700 1 -- 172.21.15.125:0/3558240807 >> v2:172.21.15.130:3300/0 conn(0x7f77f80b0240 msgr2=0x7f77f80c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:12.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77f77fe700 1 --2- 172.21.15.125:0/3558240807 >> v2:172.21.15.130:3300/0 conn(0x7f77f80b0240 0x7f77f80c1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:12.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77f77fe700 1 -- 172.21.15.125:0/3558240807 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f8068430 con 0x7f77f80c1b50 2023-10-06T03:06:12.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77f77fe700 1 -- 172.21.15.125:0/3558240807 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f77f00017f0 con 0x7f77f80c1b50 2023-10-06T03:06:12.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77f7fff700 1 --2- 172.21.15.125:0/3558240807 >> v2:172.21.15.130:3300/0 conn(0x7f77f80b0240 0x7f77f80c1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:06:12.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77f77fe700 1 -- 172.21.15.125:0/3558240807 >> v1:172.21.15.125:6789/0 conn(0x7f77f80c1b50 legacy=0x7f77f80c9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:12.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77f77fe700 1 --2- 172.21.15.125:0/3558240807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f8156270 0x7f77e8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:12.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77f77fe700 1 --2- 172.21.15.125:0/3558240807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77e8003fe0 0x7f77e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:12.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77f77fe700 1 --2- 172.21.15.125:0/3558240807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77e8004d50 0x7f77e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:12.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77f77fe700 1 -- 172.21.15.125:0/3558240807 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f80c7350 con 0x7f77e8003fe0 2023-10-06T03:06:12.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77f77fe700 1 -- 172.21.15.125:0/3558240807 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f8068150 con 0x7f77e8004d50 2023-10-06T03:06:12.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77f77fe700 1 -- 172.21.15.125:0/3558240807 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e800ba90 con 0x7f77f8156270 2023-10-06T03:06:12.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77f7fff700 1 --2- 172.21.15.125:0/3558240807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77e8003fe0 0x7f77e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:12.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77fd219700 1 --2- 172.21.15.125:0/3558240807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77e8004d50 0x7f77e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:12.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.678+0000 7f77fca18700 1 --2- 172.21.15.125:0/3558240807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f8156270 0x7f77e8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:12.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.679+0000 7f77f7fff700 1 -- 172.21.15.125:0/3558240807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f8156270 msgr2=0x7f77e8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:12.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.679+0000 7f77f7fff700 1 --2- 172.21.15.125:0/3558240807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f8156270 0x7f77e8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:12.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.679+0000 7f77f7fff700 1 -- 172.21.15.125:0/3558240807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77e8004d50 msgr2=0x7f77e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:12.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.679+0000 7f77f7fff700 1 --2- 172.21.15.125:0/3558240807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77e8004d50 0x7f77e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:12.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.679+0000 7f77f7fff700 1 -- 172.21.15.125:0/3558240807 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e8003570 con 0x7f77e8003fe0 2023-10-06T03:06:12.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.679+0000 7f77fca18700 1 --2- 172.21.15.125:0/3558240807 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77f8156270 0x7f77e8003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:12.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.679+0000 7f77f7fff700 1 --2- 172.21.15.125:0/3558240807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77e8003fe0 0x7f77e8004810 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009df0 tx=0x7f77e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73086b170f3d77e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:12.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.679+0000 7f77f77fe700 1 -- 172.21.15.125:0/3558240807 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e400e8c0 con 0x7f77e8003fe0 2023-10-06T03:06:12.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.679+0000 7f77f77fe700 1 -- 172.21.15.125:0/3558240807 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e400ea20 con 0x7f77e8003fe0 2023-10-06T03:06:12.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.679+0000 7f77f77fe700 1 -- 172.21.15.125:0/3558240807 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e400edc0 con 0x7f77e8003fe0 2023-10-06T03:06:12.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.679+0000 7f77fec7c700 1 -- 172.21.15.125:0/3558240807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77e8003fe0 msgr2=0x7f77e8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:12.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.679+0000 7f77fec7c700 1 --2- 172.21.15.125:0/3558240807 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77e8003fe0 0x7f77e8004810 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009df0 tx=0x7f77e40091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:12.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.679+0000 7f77fd219700 1 -- 172.21.15.125:0/3558240807 reap_dead start 2023-10-06T03:06:12.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.679+0000 7f77fec7c700 1 -- 172.21.15.125:0/3558240807 shutdown_connections 2023-10-06T03:06:12.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.679+0000 7f77fec7c700 1 -- 172.21.15.125:0/3558240807 >> 172.21.15.125:0/3558240807 conn(0x7f77f80af730 msgr2=0x7f77f80afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:12.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.680+0000 7f77fec7c700 1 -- 172.21.15.125:0/3558240807 shutdown_connections 2023-10-06T03:06:12.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.680+0000 7f77fec7c700 1 -- 172.21.15.125:0/3558240807 wait complete. 2023-10-06T03:06:12.686 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.681+0000 7f77fec7c700 1 Processor -- start 2023-10-06T03:06:12.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.681+0000 7f77fec7c700 1 -- start start 2023-10-06T03:06:12.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.681+0000 7f77fec7c700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77e8003fe0 0x7f77f8096fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:12.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77fec7c700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77f8148180 0x7f77f8099610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:12.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77fec7c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77f81485f0 0x7f77f8099b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:12.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77fec7c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f809a440 con 0x7f77f81485f0 2023-10-06T03:06:12.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77fec7c700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f809a160 con 0x7f77f8148180 2023-10-06T03:06:12.688 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77fec7c700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f80964f0 con 0x7f77e8003fe0 2023-10-06T03:06:12.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77fd219700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77f81485f0 0x7f77f8099b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:12.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77fd219700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77f81485f0 0x7f77f8099b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49374/0 (socket says 172.21.15.125:49374) 2023-10-06T03:06:12.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77fd219700 1 -- 172.21.15.125:0/2381755856 learned_addr learned my addr 172.21.15.125:0/2381755856 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:12.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77fca18700 1 --2- 172.21.15.125:0/2381755856 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77e8003fe0 0x7f77f8096fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:12.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77f7fff700 1 --2- 172.21.15.125:0/2381755856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77f8148180 0x7f77f8099610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:12.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77fd219700 1 -- 172.21.15.125:0/2381755856 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77e8003fe0 msgr2=0x7f77f8096fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:12.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77fd219700 1 --2- 172.21.15.125:0/2381755856 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77e8003fe0 0x7f77f8096fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:12.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77fd219700 1 -- 172.21.15.125:0/2381755856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77f8148180 msgr2=0x7f77f8099610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:12.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77fd219700 1 --2- 172.21.15.125:0/2381755856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77f8148180 0x7f77f8099610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:12.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77fd219700 1 -- 172.21.15.125:0/2381755856 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f80967d0 con 0x7f77f81485f0 2023-10-06T03:06:12.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77fd219700 1 --2- 172.21.15.125:0/2381755856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77f81485f0 0x7f77f8099b50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f77f806e5b0 tx=0x7f77f0002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:12.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77f4ff9700 1 -- 172.21.15.125:0/2381755856 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f000ad80 con 0x7f77f81485f0 2023-10-06T03:06:12.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77f4ff9700 1 -- 172.21.15.125:0/2381755856 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f00133f0 con 0x7f77f81485f0 2023-10-06T03:06:12.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77f4ff9700 1 -- 172.21.15.125:0/2381755856 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f00137b0 con 0x7f77f81485f0 2023-10-06T03:06:12.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77fec7c700 1 -- 172.21.15.125:0/2381755856 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f8096ab0 con 0x7f77f81485f0 2023-10-06T03:06:12.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.682+0000 7f77fec7c700 1 -- 172.21.15.125:0/2381755856 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f80c52b0 con 0x7f77f81485f0 2023-10-06T03:06:12.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.683+0000 7f77fec7c700 1 -- 172.21.15.125:0/2381755856 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f8066510 con 0x7f77f81485f0 2023-10-06T03:06:12.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.684+0000 7f77f4ff9700 1 -- 172.21.15.125:0/2381755856 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77f0013b60 con 0x7f77f81485f0 2023-10-06T03:06:12.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.684+0000 7f77f4ff9700 1 --2- 172.21.15.125:0/2381755856 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f77dc066f30 0x7f77dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:12.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.684+0000 7f77f4ff9700 1 -- 172.21.15.125:0/2381755856 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f77f0084c60 con 0x7f77f81485f0 2023-10-06T03:06:12.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.684+0000 7f77fca18700 1 --2- 172.21.15.125:0/2381755856 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f77dc066f30 0x7f77dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:12.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.684+0000 7f77fca18700 1 --2- 172.21.15.125:0/2381755856 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f77dc066f30 0x7f77dc0693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009d60 tx=0x7f77ec008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:12.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.688+0000 7f77f4ff9700 1 -- 172.21.15.125:0/2381755856 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77f0051ff0 con 0x7f77f81485f0 2023-10-06T03:06:12.876 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.875+0000 7f77fec7c700 1 -- 172.21.15.125:0/2381755856 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f77f80c6fe0 con 0x7f77f81485f0 2023-10-06T03:06:12.879 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.878+0000 7f77f4ff9700 1 -- 172.21.15.125:0/2381755856 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f77f0055610 con 0x7f77f81485f0 2023-10-06T03:06:12.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.880+0000 7f77fec7c700 1 -- 172.21.15.125:0/2381755856 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f77dc066f30 msgr2=0x7f77dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:12.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.880+0000 7f77fec7c700 1 --2- 172.21.15.125:0/2381755856 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f77dc066f30 0x7f77dc0693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f77ec009d60 tx=0x7f77ec008040 comp rx=0 tx=0).stop 2023-10-06T03:06:12.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.880+0000 7f77fec7c700 1 -- 172.21.15.125:0/2381755856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77f81485f0 msgr2=0x7f77f8099b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:12.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.880+0000 7f77fec7c700 1 --2- 172.21.15.125:0/2381755856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77f81485f0 0x7f77f8099b50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f77f806e5b0 tx=0x7f77f0002210 comp rx=0 tx=0).stop 2023-10-06T03:06:12.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.880+0000 7f77fec7c700 1 -- 172.21.15.125:0/2381755856 shutdown_connections 2023-10-06T03:06:12.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.880+0000 7f77fec7c700 1 --2- 172.21.15.125:0/2381755856 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f77dc066f30 0x7f77dc0693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:12.882 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.880+0000 7f77fec7c700 1 --2- 172.21.15.125:0/2381755856 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f77f81485f0 0x7f77f8099b50 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:12.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.880+0000 7f77fec7c700 1 --2- 172.21.15.125:0/2381755856 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f77e8003fe0 0x7f77f8096fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:12.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.880+0000 7f77fec7c700 1 --2- 172.21.15.125:0/2381755856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f77f8148180 0x7f77f8099610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:12.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.880+0000 7f77fec7c700 1 -- 172.21.15.125:0/2381755856 >> 172.21.15.125:0/2381755856 conn(0x7f77f80af730 msgr2=0x7f77f814c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:12.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.880+0000 7f77fec7c700 1 -- 172.21.15.125:0/2381755856 shutdown_connections 2023-10-06T03:06:12.883 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:12.880+0000 7f77fec7c700 1 -- 172.21.15.125:0/2381755856 wait complete. 2023-10-06T03:06:12.893 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification' 2023-10-06T03:06:13.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.010+0000 7f7bc2be3700 1 Processor -- start 2023-10-06T03:06:13.012 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.010+0000 7f7bc2be3700 1 -- start start 2023-10-06T03:06:13.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.011+0000 7f7bc2be3700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7bbc0ac670 0x7f7bbc0c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:13.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.011+0000 7f7bc2be3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7bbc06afd0 0x7f7bbc0c7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:13.014 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.011+0000 7f7bc2be3700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bbc067c70 con 0x7f7bbc1590d0 2023-10-06T03:06:13.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.011+0000 7f7bc2be3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bbc0c75c0 con 0x7f7bbc06afd0 2023-10-06T03:06:13.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.011+0000 7f7bc2be3700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bbc069110 con 0x7f7bbc0ac670 2023-10-06T03:06:13.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.011+0000 7f7bc1180700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7bbc06afd0 0x7f7bbc0c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:13.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.011+0000 7f7bc1180700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7bbc06afd0 0x7f7bbc0c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49386/0 (socket says 172.21.15.125:49386) 2023-10-06T03:06:13.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.011+0000 7f7bc1180700 1 -- 172.21.15.125:0/2018127028 learned_addr learned my addr 172.21.15.125:0/2018127028 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:13.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.011+0000 7f7bbbfff700 1 --2- 172.21.15.125:0/2018127028 >> v2:172.21.15.130:3300/0 conn(0x7f7bbc0ac670 0x7f7bbc0c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:13.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.011+0000 7f7bc1180700 1 -- 172.21.15.125:0/2018127028 >> v2:172.21.15.130:3300/0 conn(0x7f7bbc0ac670 msgr2=0x7f7bbc0c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:13.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.011+0000 7f7bc1180700 1 --2- 172.21.15.125:0/2018127028 >> v2:172.21.15.130:3300/0 conn(0x7f7bbc0ac670 0x7f7bbc0c6b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:13.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.011+0000 7f7bc1180700 1 -- 172.21.15.125:0/2018127028 >> v1:172.21.15.130:6789/0 conn(0x7f7bbc1590d0 legacy=0x7f7bbc06a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:13.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.011+0000 7f7bc1180700 1 -- 172.21.15.125:0/2018127028 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bbc0c77e0 con 0x7f7bbc06afd0 2023-10-06T03:06:13.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.011+0000 7f7bbbfff700 1 --2- 172.21.15.125:0/2018127028 >> v2:172.21.15.130:3300/0 conn(0x7f7bbc0ac670 0x7f7bbc0c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:13.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.011+0000 7f7bc1180700 1 --2- 172.21.15.125:0/2018127028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bbc06afd0 0x7f7bbc0c7080 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc0722e0 tx=0x7f7bb4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641c752e0032183b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:13.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.011+0000 7f7bbb7fe700 1 -- 172.21.15.125:0/2018127028 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb400e070 con 0x7f7bbc06afd0 2023-10-06T03:06:13.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.011+0000 7f7bbb7fe700 1 -- 172.21.15.125:0/2018127028 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb400ba00 con 0x7f7bbc06afd0 2023-10-06T03:06:13.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.012+0000 7f7bbb7fe700 1 -- 172.21.15.125:0/2018127028 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb40092e0 con 0x7f7bbc06afd0 2023-10-06T03:06:13.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.012+0000 7f7bc2be3700 1 -- 172.21.15.125:0/2018127028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bbc06afd0 msgr2=0x7f7bbc0c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:13.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.012+0000 7f7bc2be3700 1 --2- 172.21.15.125:0/2018127028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bbc06afd0 0x7f7bbc0c7080 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc0722e0 tx=0x7f7bb4009840 comp rx=0 tx=0).stop 2023-10-06T03:06:13.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.012+0000 7f7bc2be3700 1 -- 172.21.15.125:0/2018127028 shutdown_connections 2023-10-06T03:06:13.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.012+0000 7f7bc2be3700 1 --2- 172.21.15.125:0/2018127028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bbc06afd0 0x7f7bbc0c7080 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:13.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.012+0000 7f7bc2be3700 1 --2- 172.21.15.125:0/2018127028 >> v2:172.21.15.130:3300/0 conn(0x7f7bbc0ac670 0x7f7bbc0c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:13.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.012+0000 7f7bc2be3700 1 -- 172.21.15.125:0/2018127028 >> 172.21.15.125:0/2018127028 conn(0x7f7bbc0cc5a0 msgr2=0x7f7bbc0cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:13.016 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.012+0000 7f7bc2be3700 1 -- 172.21.15.125:0/2018127028 shutdown_connections 2023-10-06T03:06:13.017 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.012+0000 7f7bc2be3700 1 -- 172.21.15.125:0/2018127028 wait complete. 2023-10-06T03:06:13.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.014+0000 7f7bc2be3700 1 Processor -- start 2023-10-06T03:06:13.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.014+0000 7f7bc2be3700 1 -- start start 2023-10-06T03:06:13.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bc2be3700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bbc06afd0 0x7f7bbc153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:13.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bc2be3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bbc0ac670 0x7f7bbc15a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:13.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bc2be3700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7bbc1590d0 0x7f7bbc0a9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:13.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bc2be3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bbc15b530 con 0x7f7bbc0ac670 2023-10-06T03:06:13.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bc2be3700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bbc154060 con 0x7f7bbc06afd0 2023-10-06T03:06:13.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bc2be3700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bbc0af820 con 0x7f7bbc1590d0 2023-10-06T03:06:13.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bbbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bbc0ac670 0x7f7bbc15a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:13.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bbbfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bbc0ac670 0x7f7bbc15a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49400/0 (socket says 172.21.15.125:49400) 2023-10-06T03:06:13.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bbbfff700 1 -- 172.21.15.125:0/4151531697 learned_addr learned my addr 172.21.15.125:0/4151531697 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:13.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bc097f700 1 --2- 172.21.15.125:0/4151531697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bbc06afd0 0x7f7bbc153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:13.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bc1180700 1 --2- 172.21.15.125:0/4151531697 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7bbc1590d0 0x7f7bbc0a9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:13.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bbbfff700 1 -- 172.21.15.125:0/4151531697 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7bbc1590d0 msgr2=0x7f7bbc0a9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:13.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bbbfff700 1 --2- 172.21.15.125:0/4151531697 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7bbc1590d0 0x7f7bbc0a9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:13.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bbbfff700 1 -- 172.21.15.125:0/4151531697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bbc06afd0 msgr2=0x7f7bbc153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:13.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bbbfff700 1 --2- 172.21.15.125:0/4151531697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bbc06afd0 0x7f7bbc153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:13.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bbbfff700 1 -- 172.21.15.125:0/4151531697 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb4009ae0 con 0x7f7bbc0ac670 2023-10-06T03:06:13.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bc1180700 1 --2- 172.21.15.125:0/4151531697 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7bbc1590d0 0x7f7bbc0a9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:13.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bbbfff700 1 --2- 172.21.15.125:0/4151531697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bbc0ac670 0x7f7bbc15a470 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c8b0 tx=0x7f7ba8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:13.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bb8ff9700 1 -- 172.21.15.125:0/4151531697 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8011600 con 0x7f7bbc0ac670 2023-10-06T03:06:13.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bb8ff9700 1 -- 172.21.15.125:0/4151531697 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba8011760 con 0x7f7bbc0ac670 2023-10-06T03:06:13.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bc2be3700 1 -- 172.21.15.125:0/4151531697 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bbc0af4f0 con 0x7f7bbc0ac670 2023-10-06T03:06:13.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bb8ff9700 1 -- 172.21.15.125:0/4151531697 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8011b00 con 0x7f7bbc0ac670 2023-10-06T03:06:13.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.015+0000 7f7bc2be3700 1 -- 172.21.15.125:0/4151531697 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bbc15b250 con 0x7f7bbc0ac670 2023-10-06T03:06:13.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.016+0000 7f7bc2be3700 1 -- 172.21.15.125:0/4151531697 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bbc066510 con 0x7f7bbc0ac670 2023-10-06T03:06:13.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.017+0000 7f7bb8ff9700 1 -- 172.21.15.125:0/4151531697 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ba80193b0 con 0x7f7bbc0ac670 2023-10-06T03:06:13.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.017+0000 7f7bb8ff9700 1 --2- 172.21.15.125:0/4151531697 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7ba0066f30 0x7f7ba00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:13.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.017+0000 7f7bc097f700 1 --2- 172.21.15.125:0/4151531697 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7ba0066f30 0x7f7ba00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:13.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.017+0000 7f7bb8ff9700 1 -- 172.21.15.125:0/4151531697 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f7ba8084460 con 0x7f7bbc0ac670 2023-10-06T03:06:13.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.018+0000 7f7bc097f700 1 --2- 172.21.15.125:0/4151531697 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7ba0066f30 0x7f7ba00693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009af0 tx=0x7f7bb0009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:13.023 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.021+0000 7f7bb8ff9700 1 -- 172.21.15.125:0/4151531697 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ba8051730 con 0x7f7bbc0ac670 2023-10-06T03:06:13.278 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.277+0000 7f7bc2be3700 1 -- 172.21.15.125:0/4151531697 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]} v 0) v1 -- 0x7f7bbc0c7ac0 con 0x7f7bbc0ac670 2023-10-06T03:06:13.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.552+0000 7f7bb8ff9700 1 -- 172.21.15.125:0/4151531697 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_forbidden_modification"]}]=0 v115) v1 ==== 147+0+0 (secure 0 0 0) 0x7f7ba8054d50 con 0x7f7bbc0ac670 2023-10-06T03:06:13.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.554+0000 7f7bc2be3700 1 -- 172.21.15.125:0/4151531697 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7ba0066f30 msgr2=0x7f7ba00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:13.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.554+0000 7f7bc2be3700 1 --2- 172.21.15.125:0/4151531697 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7ba0066f30 0x7f7ba00693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009af0 tx=0x7f7bb0009060 comp rx=0 tx=0).stop 2023-10-06T03:06:13.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.554+0000 7f7bc2be3700 1 -- 172.21.15.125:0/4151531697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bbc0ac670 msgr2=0x7f7bbc15a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:13.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.554+0000 7f7bc2be3700 1 --2- 172.21.15.125:0/4151531697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bbc0ac670 0x7f7bbc15a470 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c8b0 tx=0x7f7ba8008040 comp rx=0 tx=0).stop 2023-10-06T03:06:13.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.554+0000 7f7bc2be3700 1 -- 172.21.15.125:0/4151531697 shutdown_connections 2023-10-06T03:06:13.556 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.554+0000 7f7bc2be3700 1 --2- 172.21.15.125:0/4151531697 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7ba0066f30 0x7f7ba00693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:13.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.554+0000 7f7bc2be3700 1 --2- 172.21.15.125:0/4151531697 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7bbc1590d0 0x7f7bbc0a9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:13.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.554+0000 7f7bc2be3700 1 --2- 172.21.15.125:0/4151531697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bbc06afd0 0x7f7bbc153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:13.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.554+0000 7f7bc2be3700 1 --2- 172.21.15.125:0/4151531697 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7bbc0ac670 0x7f7bbc15a470 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:13.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.554+0000 7f7bc2be3700 1 -- 172.21.15.125:0/4151531697 >> 172.21.15.125:0/4151531697 conn(0x7f7bbc0cc5a0 msgr2=0x7f7bbc154970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:13.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.555+0000 7f7bc2be3700 1 -- 172.21.15.125:0/4151531697 shutdown_connections 2023-10-06T03:06:13.557 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.555+0000 7f7bc2be3700 1 -- 172.21.15.125:0/4151531697 wait complete. 2023-10-06T03:06:13.568 INFO:tasks.cephfs_test_runner:That a client who does not have the capability for setting ... ok 2023-10-06T03:06:13.568 INFO:tasks.cephfs_test_runner:Starting test: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-10-06T03:06:13.569 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2023-10-06T03:06:13.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.685+0000 7f5852585700 1 Processor -- start 2023-10-06T03:06:13.687 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.685+0000 7f5852585700 1 -- start start 2023-10-06T03:06:13.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.686+0000 7f5852585700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f584c0cb150 0x7f584c0c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:13.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.686+0000 7f5852585700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584c0c2910 con 0x7f584c0cbf20 2023-10-06T03:06:13.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.686+0000 7f5852585700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584c0c1d40 con 0x7f584c0cbb50 2023-10-06T03:06:13.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.686+0000 7f5852585700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f584c0aa0b0 con 0x7f584c0cb150 2023-10-06T03:06:13.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.686+0000 7f5850b22700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f584c0cb150 0x7f584c0c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:13.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.686+0000 7f584b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f584c0cbf20 0x7f584c0caa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36088/0 (socket says 172.21.15.125:36088) 2023-10-06T03:06:13.689 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.686+0000 7f5850b22700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f584c0cb150 0x7f584c0c8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49404/0 (socket says 172.21.15.125:49404) 2023-10-06T03:06:13.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.686+0000 7f584b7fe700 1 -- 172.21.15.125:0/3116445735 learned_addr learned my addr 172.21.15.125:0/3116445735 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:13.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.687+0000 7f5850b22700 1 -- 172.21.15.125:0/3116445735 >> v1:172.21.15.130:6789/0 conn(0x7f584c0cbb50 legacy=0x7f584c0a99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:13.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.687+0000 7f5850b22700 1 -- 172.21.15.125:0/3116445735 >> v1:172.21.15.125:6789/0 conn(0x7f584c0cbf20 legacy=0x7f584c0caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:13.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.687+0000 7f5850b22700 1 -- 172.21.15.125:0/3116445735 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c0c1fe0 con 0x7f584c0cb150 2023-10-06T03:06:13.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.687+0000 7f5850b22700 1 --2- 172.21.15.125:0/3116445735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f584c0cb150 0x7f584c0c8cf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5844009e60 tx=0x7f5844009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7663ae90bb266a99 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:13.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.687+0000 7f584affd700 1 -- 172.21.15.125:0/3116445735 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584400e070 con 0x7f584c0cb150 2023-10-06T03:06:13.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.687+0000 7f584affd700 1 -- 172.21.15.125:0/3116445735 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584400bbf0 con 0x7f584c0cb150 2023-10-06T03:06:13.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.687+0000 7f584affd700 1 -- 172.21.15.125:0/3116445735 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5844012430 con 0x7f584c0cb150 2023-10-06T03:06:13.690 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.687+0000 7f5852585700 1 -- 172.21.15.125:0/3116445735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f584c0cb150 msgr2=0x7f584c0c8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:13.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.687+0000 7f5852585700 1 --2- 172.21.15.125:0/3116445735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f584c0cb150 0x7f584c0c8cf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5844009e60 tx=0x7f5844009780 comp rx=0 tx=0).stop 2023-10-06T03:06:13.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.687+0000 7f5852585700 1 -- 172.21.15.125:0/3116445735 shutdown_connections 2023-10-06T03:06:13.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.687+0000 7f5852585700 1 --2- 172.21.15.125:0/3116445735 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f584c0cb150 0x7f584c0c8cf0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:13.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.687+0000 7f5852585700 1 -- 172.21.15.125:0/3116445735 >> 172.21.15.125:0/3116445735 conn(0x7f584c068f00 msgr2=0x7f584c0cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:13.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.687+0000 7f5852585700 1 -- 172.21.15.125:0/3116445735 shutdown_connections 2023-10-06T03:06:13.691 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.687+0000 7f5852585700 1 -- 172.21.15.125:0/3116445735 wait complete. 2023-10-06T03:06:13.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.688+0000 7f5852585700 1 Processor -- start 2023-10-06T03:06:13.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.689+0000 7f5852585700 1 -- start start 2023-10-06T03:06:13.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.689+0000 7f5852585700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f584c0cb150 0x7f584c166520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:13.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.689+0000 7f5852585700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f584c0cbb50 0x7f584c16a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:13.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.689+0000 7f5852585700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f584c0cbf20 0x7f584c0ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:13.694 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.689+0000 7f5852585700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c0b0de0 con 0x7f584c0cb150 2023-10-06T03:06:13.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.689+0000 7f5852585700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c1694a0 con 0x7f584c0cbb50 2023-10-06T03:06:13.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.689+0000 7f5852585700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584c0c9170 con 0x7f584c0cbf20 2023-10-06T03:06:13.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.689+0000 7f584bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f584c0cb150 0x7f584c166520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:13.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.690+0000 7f584bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f584c0cb150 0x7f584c166520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49414/0 (socket says 172.21.15.125:49414) 2023-10-06T03:06:13.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.690+0000 7f584bfff700 1 -- 172.21.15.125:0/1354521616 learned_addr learned my addr 172.21.15.125:0/1354521616 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:13.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.690+0000 7f584b7fe700 1 --2- 172.21.15.125:0/1354521616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f584c0cbb50 0x7f584c16a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:13.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.690+0000 7f5850b22700 1 --2- 172.21.15.125:0/1354521616 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f584c0cbf20 0x7f584c0ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:13.695 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.690+0000 7f584bfff700 1 -- 172.21.15.125:0/1354521616 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f584c0cbf20 msgr2=0x7f584c0ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:13.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.690+0000 7f584bfff700 1 --2- 172.21.15.125:0/1354521616 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f584c0cbf20 0x7f584c0ae600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:13.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.690+0000 7f584bfff700 1 -- 172.21.15.125:0/1354521616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f584c0cbb50 msgr2=0x7f584c16a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:13.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.690+0000 7f584bfff700 1 --2- 172.21.15.125:0/1354521616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f584c0cbb50 0x7f584c16a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:13.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.690+0000 7f584bfff700 1 -- 172.21.15.125:0/1354521616 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5844009a20 con 0x7f584c0cb150 2023-10-06T03:06:13.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.690+0000 7f584b7fe700 1 --2- 172.21.15.125:0/1354521616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f584c0cbb50 0x7f584c16a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:13.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.690+0000 7f5850b22700 1 --2- 172.21.15.125:0/1354521616 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f584c0cbf20 0x7f584c0ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:13.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.690+0000 7f584bfff700 1 --2- 172.21.15.125:0/1354521616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f584c0cb150 0x7f584c166520 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f584000c5e0 tx=0x7f58400020e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:13.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.690+0000 7f5833fff700 1 -- 172.21.15.125:0/1354521616 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5840006870 con 0x7f584c0cb150 2023-10-06T03:06:13.696 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.690+0000 7f5833fff700 1 -- 172.21.15.125:0/1354521616 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58400069d0 con 0x7f584c0cb150 2023-10-06T03:06:13.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.690+0000 7f5852585700 1 -- 172.21.15.125:0/1354521616 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584c0c9710 con 0x7f584c0cb150 2023-10-06T03:06:13.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.690+0000 7f5833fff700 1 -- 172.21.15.125:0/1354521616 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5840006d70 con 0x7f584c0cb150 2023-10-06T03:06:13.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.690+0000 7f5852585700 1 -- 172.21.15.125:0/1354521616 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584c0c93a0 con 0x7f584c0cb150 2023-10-06T03:06:13.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.691+0000 7f5852585700 1 -- 172.21.15.125:0/1354521616 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f584c066510 con 0x7f584c0cb150 2023-10-06T03:06:13.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.692+0000 7f5833fff700 1 -- 172.21.15.125:0/1354521616 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5840007240 con 0x7f584c0cb150 2023-10-06T03:06:13.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.692+0000 7f5833fff700 1 --2- 172.21.15.125:0/1354521616 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5838066f30 0x7f58380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:13.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.692+0000 7f5833fff700 1 -- 172.21.15.125:0/1354521616 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f5840084d10 con 0x7f584c0cb150 2023-10-06T03:06:13.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.692+0000 7f584b7fe700 1 --2- 172.21.15.125:0/1354521616 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5838066f30 0x7f58380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:13.697 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.693+0000 7f584b7fe700 1 --2- 172.21.15.125:0/1354521616 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5838066f30 0x7f58380693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f584c150f40 tx=0x7f583c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:13.698 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.696+0000 7f5833fff700 1 -- 172.21.15.125:0/1354521616 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5840052060 con 0x7f584c0cb150 2023-10-06T03:06:13.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:13.949+0000 7f5852585700 1 -- 172.21.15.125:0/1354521616 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7f584c0c22c0 con 0x7f584c0cb150 2023-10-06T03:06:14.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.559+0000 7f5833fff700 1 -- 172.21.15.125:0/1354521616 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v116) v1 ==== 137+0+0 (secure 0 0 0) 0x7f5840055680 con 0x7f584c0cb150 2023-10-06T03:06:14.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.562+0000 7f5852585700 1 -- 172.21.15.125:0/1354521616 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5838066f30 msgr2=0x7f58380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:14.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.562+0000 7f5852585700 1 --2- 172.21.15.125:0/1354521616 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5838066f30 0x7f58380693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f584c150f40 tx=0x7f583c009040 comp rx=0 tx=0).stop 2023-10-06T03:06:14.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.562+0000 7f5852585700 1 -- 172.21.15.125:0/1354521616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f584c0cb150 msgr2=0x7f584c166520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:14.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.562+0000 7f5852585700 1 --2- 172.21.15.125:0/1354521616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f584c0cb150 0x7f584c166520 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f584000c5e0 tx=0x7f58400020e0 comp rx=0 tx=0).stop 2023-10-06T03:06:14.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.562+0000 7f5852585700 1 -- 172.21.15.125:0/1354521616 shutdown_connections 2023-10-06T03:06:14.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.562+0000 7f5852585700 1 --2- 172.21.15.125:0/1354521616 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5838066f30 0x7f58380693e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:14.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.562+0000 7f5852585700 1 --2- 172.21.15.125:0/1354521616 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f584c0cbf20 0x7f584c0ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:14.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.562+0000 7f5852585700 1 --2- 172.21.15.125:0/1354521616 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f584c0cb150 0x7f584c166520 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:14.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.562+0000 7f5852585700 1 --2- 172.21.15.125:0/1354521616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f584c0cbb50 0x7f584c16a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:14.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.562+0000 7f5852585700 1 -- 172.21.15.125:0/1354521616 >> 172.21.15.125:0/1354521616 conn(0x7f584c068f00 msgr2=0x7f584c156bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:14.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.562+0000 7f5852585700 1 -- 172.21.15.125:0/1354521616 shutdown_connections 2023-10-06T03:06:14.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.562+0000 7f5852585700 1 -- 172.21.15.125:0/1354521616 wait complete. 2023-10-06T03:06:14.578 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T03:06:14.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.702+0000 7fa87ba35700 1 Processor -- start 2023-10-06T03:06:14.704 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.702+0000 7fa87ba35700 1 -- start start 2023-10-06T03:06:14.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.703+0000 7fa87ba35700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa8741571b0 0x7fa8740cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:14.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.703+0000 7fa87ba35700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8740cd300 con 0x7fa874156de0 2023-10-06T03:06:14.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.703+0000 7fa87ba35700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8740cc6f0 con 0x7fa8740cd790 2023-10-06T03:06:14.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.703+0000 7fa87ba35700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8740cc9d0 con 0x7fa8741571b0 2023-10-06T03:06:14.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.703+0000 7fa878fd0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa8741571b0 0x7fa8740cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:14.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.703+0000 7fa8797d1700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fa874156de0 0x7fa87415b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36098/0 (socket says 172.21.15.125:36098) 2023-10-06T03:06:14.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.703+0000 7fa8797d1700 1 -- 172.21.15.125:0/90144941 learned_addr learned my addr 172.21.15.125:0/90144941 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:14.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.704+0000 7fa86bfff700 1 -- 172.21.15.125:0/90144941 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615573670 0 0) 0x7fa8740cd300 con 0x7fa874156de0 2023-10-06T03:06:14.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.704+0000 7fa86bfff700 1 -- 172.21.15.125:0/90144941 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa860003570 con 0x7fa874156de0 2023-10-06T03:06:14.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.704+0000 7fa878fd0700 1 -- 172.21.15.125:0/90144941 >> v1:172.21.15.130:6789/0 conn(0x7fa8740cd790 legacy=0x7fa8740ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:14.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.704+0000 7fa878fd0700 1 -- 172.21.15.125:0/90144941 >> v1:172.21.15.125:6789/0 conn(0x7fa874156de0 legacy=0x7fa87415b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:14.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.704+0000 7fa878fd0700 1 -- 172.21.15.125:0/90144941 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8740cccb0 con 0x7fa8741571b0 2023-10-06T03:06:14.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.704+0000 7fa878fd0700 1 --2- 172.21.15.125:0/90144941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8741571b0 0x7fa8740cc060 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa8700098e0 tx=0x7fa8700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46a3d07a3f3d4a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:14.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.704+0000 7fa86bfff700 1 -- 172.21.15.125:0/90144941 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870011630 con 0x7fa8741571b0 2023-10-06T03:06:14.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.704+0000 7fa86bfff700 1 -- 172.21.15.125:0/90144941 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa870011790 con 0x7fa8741571b0 2023-10-06T03:06:14.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.704+0000 7fa86bfff700 1 -- 172.21.15.125:0/90144941 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870011b30 con 0x7fa8741571b0 2023-10-06T03:06:14.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.704+0000 7fa87ba35700 1 -- 172.21.15.125:0/90144941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8741571b0 msgr2=0x7fa8740cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:14.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.704+0000 7fa87ba35700 1 --2- 172.21.15.125:0/90144941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8741571b0 0x7fa8740cc060 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa8700098e0 tx=0x7fa8700091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:14.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.705+0000 7fa87ba35700 1 -- 172.21.15.125:0/90144941 shutdown_connections 2023-10-06T03:06:14.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.705+0000 7fa87ba35700 1 --2- 172.21.15.125:0/90144941 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8741571b0 0x7fa8740cc060 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:14.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.705+0000 7fa87ba35700 1 -- 172.21.15.125:0/90144941 >> 172.21.15.125:0/90144941 conn(0x7fa8740cdf80 msgr2=0x7fa8740ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:14.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.705+0000 7fa87ba35700 1 -- 172.21.15.125:0/90144941 shutdown_connections 2023-10-06T03:06:14.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.705+0000 7fa87ba35700 1 -- 172.21.15.125:0/90144941 wait complete. 2023-10-06T03:06:14.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.706+0000 7fa87ba35700 1 Processor -- start 2023-10-06T03:06:14.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.706+0000 7fa87ba35700 1 -- start start 2023-10-06T03:06:14.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa87ba35700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8740cd790 0x7fa8740c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:14.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa87ba35700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa874156de0 0x7fa874159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:14.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa87ba35700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8741571b0 0x7fa8740b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:14.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa87ba35700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8740b3b50 con 0x7fa8741571b0 2023-10-06T03:06:14.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa87ba35700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8740c61c0 con 0x7fa874156de0 2023-10-06T03:06:14.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa87ba35700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8740b3870 con 0x7fa8740cd790 2023-10-06T03:06:14.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa879fd2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8741571b0 0x7fa8740b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:14.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa879fd2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8741571b0 0x7fa8740b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49428/0 (socket says 172.21.15.125:49428) 2023-10-06T03:06:14.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa879fd2700 1 -- 172.21.15.125:0/1310142739 learned_addr learned my addr 172.21.15.125:0/1310142739 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:14.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa878fd0700 1 --2- 172.21.15.125:0/1310142739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa874156de0 0x7fa874159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:14.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa8797d1700 1 --2- 172.21.15.125:0/1310142739 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8740cd790 0x7fa8740c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:14.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa879fd2700 1 -- 172.21.15.125:0/1310142739 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8740cd790 msgr2=0x7fa8740c6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:14.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa879fd2700 1 --2- 172.21.15.125:0/1310142739 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8740cd790 0x7fa8740c6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:14.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa879fd2700 1 -- 172.21.15.125:0/1310142739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa874156de0 msgr2=0x7fa874159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:14.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa879fd2700 1 --2- 172.21.15.125:0/1310142739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa874156de0 0x7fa874159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:14.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa879fd2700 1 -- 172.21.15.125:0/1310142739 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa870009420 con 0x7fa8741571b0 2023-10-06T03:06:14.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa8797d1700 1 --2- 172.21.15.125:0/1310142739 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8740cd790 0x7fa8740c6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:14.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa879fd2700 1 --2- 172.21.15.125:0/1310142739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8741571b0 0x7fa8740b0d20 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa86c00c960 tx=0x7fa86c0026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:14.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa8697fa700 1 -- 172.21.15.125:0/1310142739 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c00cea0 con 0x7fa8741571b0 2023-10-06T03:06:14.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa8697fa700 1 -- 172.21.15.125:0/1310142739 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c00a7a0 con 0x7fa8741571b0 2023-10-06T03:06:14.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa8697fa700 1 -- 172.21.15.125:0/1310142739 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c00ab60 con 0x7fa8741571b0 2023-10-06T03:06:14.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa87ba35700 1 -- 172.21.15.125:0/1310142739 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8740c5b70 con 0x7fa8741571b0 2023-10-06T03:06:14.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.707+0000 7fa87ba35700 1 -- 172.21.15.125:0/1310142739 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87415a420 con 0x7fa8741571b0 2023-10-06T03:06:14.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.708+0000 7fa87ba35700 1 -- 172.21.15.125:0/1310142739 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8740c59a0 con 0x7fa8741571b0 2023-10-06T03:06:14.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.709+0000 7fa8697fa700 1 -- 172.21.15.125:0/1310142739 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa86c012420 con 0x7fa8741571b0 2023-10-06T03:06:14.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.709+0000 7fa8697fa700 1 --2- 172.21.15.125:0/1310142739 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa858066f30 0x7fa8580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:14.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.709+0000 7fa8697fa700 1 -- 172.21.15.125:0/1310142739 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fa86c0848f0 con 0x7fa8741571b0 2023-10-06T03:06:14.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.709+0000 7fa8797d1700 1 --2- 172.21.15.125:0/1310142739 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa858066f30 0x7fa8580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:14.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.710+0000 7fa8797d1700 1 --2- 172.21.15.125:0/1310142739 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa858066f30 0x7fa8580693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa864007fd0 tx=0x7fa864009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:14.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.713+0000 7fa8697fa700 1 -- 172.21.15.125:0/1310142739 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa86c051bc0 con 0x7fa8741571b0 2023-10-06T03:06:14.899 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.897+0000 7fa87ba35700 1 -- 172.21.15.125:0/1310142739 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa874066510 con 0x7fa8741571b0 2023-10-06T03:06:14.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.903+0000 7fa8697fa700 1 -- 172.21.15.125:0/1310142739 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa86c0551e0 con 0x7fa8741571b0 2023-10-06T03:06:14.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.905+0000 7fa87ba35700 1 -- 172.21.15.125:0/1310142739 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa858066f30 msgr2=0x7fa8580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:14.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.905+0000 7fa87ba35700 1 --2- 172.21.15.125:0/1310142739 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa858066f30 0x7fa8580693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa864007fd0 tx=0x7fa864009040 comp rx=0 tx=0).stop 2023-10-06T03:06:14.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.905+0000 7fa87ba35700 1 -- 172.21.15.125:0/1310142739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8741571b0 msgr2=0x7fa8740b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:14.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.905+0000 7fa87ba35700 1 --2- 172.21.15.125:0/1310142739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8741571b0 0x7fa8740b0d20 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa86c00c960 tx=0x7fa86c0026e0 comp rx=0 tx=0).stop 2023-10-06T03:06:14.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.905+0000 7fa87ba35700 1 -- 172.21.15.125:0/1310142739 shutdown_connections 2023-10-06T03:06:14.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.905+0000 7fa87ba35700 1 --2- 172.21.15.125:0/1310142739 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa858066f30 0x7fa8580693e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:14.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.905+0000 7fa87ba35700 1 --2- 172.21.15.125:0/1310142739 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa8741571b0 0x7fa8740b0d20 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:14.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.905+0000 7fa87ba35700 1 --2- 172.21.15.125:0/1310142739 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa8740cd790 0x7fa8740c6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:14.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.905+0000 7fa87ba35700 1 --2- 172.21.15.125:0/1310142739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa874156de0 0x7fa874159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:14.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.905+0000 7fa87ba35700 1 -- 172.21.15.125:0/1310142739 >> 172.21.15.125:0/1310142739 conn(0x7fa8740cdf80 msgr2=0x7fa874150200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:14.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.906+0000 7fa87ba35700 1 -- 172.21.15.125:0/1310142739 shutdown_connections 2023-10-06T03:06:14.908 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:14.906+0000 7fa87ba35700 1 -- 172.21.15.125:0/1310142739 wait complete. 2023-10-06T03:06:14.918 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:06:14.919 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:06:14.964 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:06:15.010 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:06:15.010 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T03:06:15.010 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:06:15.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.127+0000 7f6b481d3700 1 Processor -- start 2023-10-06T03:06:15.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.127+0000 7f6b481d3700 1 -- start start 2023-10-06T03:06:15.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.128+0000 7f6b481d3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6b4013f6a0 0x7f6b4013fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:15.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.128+0000 7f6b481d3700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6b4006bd10 0x7f6b400cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:15.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.128+0000 7f6b481d3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b400c74c0 con 0x7f6b40159c10 2023-10-06T03:06:15.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.128+0000 7f6b481d3700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b400c7710 con 0x7f6b4013f6a0 2023-10-06T03:06:15.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.128+0000 7f6b481d3700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b400c79f0 con 0x7f6b4006bd10 2023-10-06T03:06:15.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.128+0000 7f6b45f6f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6b4013f6a0 0x7f6b4013fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:15.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.128+0000 7f6b46770700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6b40159c10 0x7f6b40068720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:36100/0 (socket says 172.21.15.125:36100) 2023-10-06T03:06:15.131 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.128+0000 7f6b46770700 1 -- 172.21.15.125:0/1301117162 learned_addr learned my addr 172.21.15.125:0/1301117162 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:15.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.128+0000 7f6b4576e700 1 --2- 172.21.15.125:0/1301117162 >> v2:172.21.15.130:3300/0 conn(0x7f6b4006bd10 0x7f6b400cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:15.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.128+0000 7f6b45f6f700 1 -- 172.21.15.125:0/1301117162 >> v2:172.21.15.130:3300/0 conn(0x7f6b4006bd10 msgr2=0x7f6b400cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:15.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.128+0000 7f6b45f6f700 1 --2- 172.21.15.125:0/1301117162 >> v2:172.21.15.130:3300/0 conn(0x7f6b4006bd10 0x7f6b400cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:15.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.128+0000 7f6b45f6f700 1 -- 172.21.15.125:0/1301117162 >> v1:172.21.15.125:6789/0 conn(0x7f6b40159c10 legacy=0x7f6b40068720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:15.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.128+0000 7f6b45f6f700 1 -- 172.21.15.125:0/1301117162 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b400c9b40 con 0x7f6b4013f6a0 2023-10-06T03:06:15.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.128+0000 7f6b44f6d700 1 -- 172.21.15.125:0/1301117162 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677629695 0 0) 0x7f6b400c74c0 con 0x7f6b40159c10 2023-10-06T03:06:15.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.128+0000 7f6b4576e700 1 --2- 172.21.15.125:0/1301117162 >> v2:172.21.15.130:3300/0 conn(0x7f6b4006bd10 0x7f6b400cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:15.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.128+0000 7f6b45f6f700 1 --2- 172.21.15.125:0/1301117162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b4013f6a0 0x7f6b4013fa70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6b4013ffb0 tx=0x7f6b3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d578655fd0b0d935 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:15.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.129+0000 7f6b44f6d700 1 -- 172.21.15.125:0/1301117162 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c00b6b0 con 0x7f6b4013f6a0 2023-10-06T03:06:15.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.129+0000 7f6b44f6d700 1 -- 172.21.15.125:0/1301117162 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3c00b810 con 0x7f6b4013f6a0 2023-10-06T03:06:15.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.129+0000 7f6b44f6d700 1 -- 172.21.15.125:0/1301117162 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c00bbb0 con 0x7f6b4013f6a0 2023-10-06T03:06:15.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.129+0000 7f6b481d3700 1 -- 172.21.15.125:0/1301117162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b4013f6a0 msgr2=0x7f6b4013fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:15.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.129+0000 7f6b481d3700 1 --2- 172.21.15.125:0/1301117162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b4013f6a0 0x7f6b4013fa70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6b4013ffb0 tx=0x7f6b3c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:15.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.129+0000 7f6b481d3700 1 -- 172.21.15.125:0/1301117162 shutdown_connections 2023-10-06T03:06:15.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.129+0000 7f6b481d3700 1 --2- 172.21.15.125:0/1301117162 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b4013f6a0 0x7f6b4013fa70 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:15.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.129+0000 7f6b481d3700 1 --2- 172.21.15.125:0/1301117162 >> v2:172.21.15.130:3300/0 conn(0x7f6b4006bd10 0x7f6b400cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:15.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.129+0000 7f6b481d3700 1 -- 172.21.15.125:0/1301117162 >> 172.21.15.125:0/1301117162 conn(0x7f6b4006b190 msgr2=0x7f6b4006b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:15.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.129+0000 7f6b481d3700 1 -- 172.21.15.125:0/1301117162 shutdown_connections 2023-10-06T03:06:15.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.129+0000 7f6b481d3700 1 -- 172.21.15.125:0/1301117162 wait complete. 2023-10-06T03:06:15.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.131+0000 7f6b481d3700 1 Processor -- start 2023-10-06T03:06:15.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.131+0000 7f6b481d3700 1 -- start start 2023-10-06T03:06:15.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b481d3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b4006bd10 0x7f6b40155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:15.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b481d3700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b4013f6a0 0x7f6b40156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:15.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b481d3700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b40159c10 0x7f6b400b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:15.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b481d3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b400aff60 con 0x7f6b4006bd10 2023-10-06T03:06:15.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b481d3700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b40159360 con 0x7f6b4013f6a0 2023-10-06T03:06:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b481d3700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b40159640 con 0x7f6b40159c10 2023-10-06T03:06:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b45f6f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b4006bd10 0x7f6b40155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b45f6f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b4006bd10 0x7f6b40155d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:49446/0 (socket says 172.21.15.125:49446) 2023-10-06T03:06:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b45f6f700 1 -- 172.21.15.125:0/203664556 learned_addr learned my addr 172.21.15.125:0/203664556 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b46770700 1 --2- 172.21.15.125:0/203664556 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b40159c10 0x7f6b400b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b4576e700 1 --2- 172.21.15.125:0/203664556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b4013f6a0 0x7f6b40156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b45f6f700 1 -- 172.21.15.125:0/203664556 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b40159c10 msgr2=0x7f6b400b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b45f6f700 1 --2- 172.21.15.125:0/203664556 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b40159c10 0x7f6b400b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b45f6f700 1 -- 172.21.15.125:0/203664556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b4013f6a0 msgr2=0x7f6b40156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b45f6f700 1 --2- 172.21.15.125:0/203664556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b4013f6a0 0x7f6b40156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b45f6f700 1 -- 172.21.15.125:0/203664556 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c009420 con 0x7f6b4006bd10 2023-10-06T03:06:15.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b45f6f700 1 --2- 172.21.15.125:0/203664556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b4006bd10 0x7f6b40155d40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6b4006a550 tx=0x7f6b3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:15.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b35ffb700 1 -- 172.21.15.125:0/203664556 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c00bb90 con 0x7f6b4006bd10 2023-10-06T03:06:15.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b35ffb700 1 -- 172.21.15.125:0/203664556 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3c011420 con 0x7f6b4006bd10 2023-10-06T03:06:15.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b35ffb700 1 -- 172.21.15.125:0/203664556 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c0117a0 con 0x7f6b4006bd10 2023-10-06T03:06:15.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.132+0000 7f6b481d3700 1 -- 172.21.15.125:0/203664556 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b400b0170 con 0x7f6b4006bd10 2023-10-06T03:06:15.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.133+0000 7f6b481d3700 1 -- 172.21.15.125:0/203664556 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b40156280 con 0x7f6b4006bd10 2023-10-06T03:06:15.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.133+0000 7f6b481d3700 1 -- 172.21.15.125:0/203664556 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b400b0690 con 0x7f6b4006bd10 2023-10-06T03:06:15.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.134+0000 7f6b35ffb700 1 -- 172.21.15.125:0/203664556 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b3c011b90 con 0x7f6b4006bd10 2023-10-06T03:06:15.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.134+0000 7f6b35ffb700 1 --2- 172.21.15.125:0/203664556 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6b24066f30 0x7f6b240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:15.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.134+0000 7f6b35ffb700 1 -- 172.21.15.125:0/203664556 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f6b3c085b20 con 0x7f6b4006bd10 2023-10-06T03:06:15.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.134+0000 7f6b4576e700 1 --2- 172.21.15.125:0/203664556 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6b24066f30 0x7f6b240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:15.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.135+0000 7f6b4576e700 1 --2- 172.21.15.125:0/203664556 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6b24066f30 0x7f6b240693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6b400c1d20 tx=0x7f6b30008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:15.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.138+0000 7f6b35ffb700 1 -- 172.21.15.125:0/203664556 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b400b0690 con 0x7f6b4006bd10 2023-10-06T03:06:15.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.361+0000 7f6b481d3700 1 -- 172.21.15.125:0/203664556 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b400b0690 con 0x7f6b4006bd10 2023-10-06T03:06:15.363 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.362+0000 7f6b35ffb700 1 -- 172.21.15.125:0/203664556 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f6b3c015df0 con 0x7f6b4006bd10 2023-10-06T03:06:15.363 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:15.363 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/3042542444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":3042542444},{"type":"v1","addr":"172.21.15.130:6835","nonce":3042542444}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4966,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/2110429483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2110429483},{"type":"v1","addr":"172.21.15.130:6833","nonce":2110429483}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5082,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/1710838785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":1710838785},{"type":"v1","addr":"172.21.15.125:6836","nonce":1710838785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/1459755389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":1459755389},{"type":"v1","addr":"172.21.15.125:6837","nonce":1459755389}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[]} 2023-10-06T03:06:15.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.364+0000 7f6b481d3700 1 -- 172.21.15.125:0/203664556 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6b24066f30 msgr2=0x7f6b240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:15.365 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.364+0000 7f6b481d3700 1 --2- 172.21.15.125:0/203664556 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6b24066f30 0x7f6b240693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6b400c1d20 tx=0x7f6b30008040 comp rx=0 tx=0).stop 2023-10-06T03:06:15.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.364+0000 7f6b481d3700 1 -- 172.21.15.125:0/203664556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b4006bd10 msgr2=0x7f6b40155d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:15.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.364+0000 7f6b481d3700 1 --2- 172.21.15.125:0/203664556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b4006bd10 0x7f6b40155d40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6b4006a550 tx=0x7f6b3c017000 comp rx=0 tx=0).stop 2023-10-06T03:06:15.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.364+0000 7f6b481d3700 1 -- 172.21.15.125:0/203664556 shutdown_connections 2023-10-06T03:06:15.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.364+0000 7f6b481d3700 1 --2- 172.21.15.125:0/203664556 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6b24066f30 0x7f6b240693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:15.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.364+0000 7f6b481d3700 1 --2- 172.21.15.125:0/203664556 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b40159c10 0x7f6b400b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:15.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.364+0000 7f6b481d3700 1 --2- 172.21.15.125:0/203664556 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b4006bd10 0x7f6b40155d40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:15.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.364+0000 7f6b481d3700 1 --2- 172.21.15.125:0/203664556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b4013f6a0 0x7f6b40156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:15.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.364+0000 7f6b481d3700 1 -- 172.21.15.125:0/203664556 >> 172.21.15.125:0/203664556 conn(0x7f6b4006b190 msgr2=0x7f6b400cc190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:15.366 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.364+0000 7f6b481d3700 1 -- 172.21.15.125:0/203664556 shutdown_connections 2023-10-06T03:06:15.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.364+0000 7f6b481d3700 1 -- 172.21.15.125:0/203664556 wait complete. 2023-10-06T03:06:15.367 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 21 2023-10-06T03:06:15.377 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T03:06:15.377 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T03:06:15.378 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:06:15.378 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:06:15.378 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T03:06:15.378 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T03:06:15.378 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:06:15.378 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:06:15.378 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T03:06:15.379 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T03:06:15.379 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:06:15.379 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:06:15.379 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T03:06:15.379 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T03:06:15.379 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:06:15.379 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:06:15.386 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:06:15.386 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T03:06:15.387 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:06:15.387 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T03:06:15.391 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:06:15.391 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T03:06:15.392 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:06:15.392 DEBUG:teuthology.orchestra.run.smithi130:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T03:06:15.428 INFO:tasks.ceph.mds.a:Started 2023-10-06T03:06:15.428 DEBUG:teuthology.parallel:result is None 2023-10-06T03:06:15.429 INFO:tasks.ceph.mds.c:Started 2023-10-06T03:06:15.429 DEBUG:teuthology.parallel:result is None 2023-10-06T03:06:15.433 INFO:tasks.ceph.mds.b:Started 2023-10-06T03:06:15.433 DEBUG:teuthology.parallel:result is None 2023-10-06T03:06:15.434 INFO:tasks.ceph.mds.d:Started 2023-10-06T03:06:15.434 DEBUG:teuthology.parallel:result is None 2023-10-06T03:06:15.434 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T03:06:15.504 INFO:tasks.ceph.mds.a.smithi125.stdout:starting mds.a at 2023-10-06T03:06:15.505 INFO:tasks.ceph.mds.c.smithi125.stdout:starting mds.c at 2023-10-06T03:06:15.515 INFO:tasks.ceph.mds.b.smithi130.stdout:starting mds.b at 2023-10-06T03:06:15.515 INFO:tasks.ceph.mds.d.smithi130.stdout:starting mds.d at 2023-10-06T03:06:15.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.557+0000 7f9ae4b40700 1 Processor -- start 2023-10-06T03:06:15.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.558+0000 7f9ae4b40700 1 -- start start 2023-10-06T03:06:15.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.559+0000 7f9ae4b40700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9ae00ccf80 0x7f9ae0067f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:15.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.559+0000 7f9ae4b40700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae00c1d50 con 0x7f9ae01558e0 2023-10-06T03:06:15.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.559+0000 7f9ae4b40700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae00ca1b0 con 0x7f9ae0155cb0 2023-10-06T03:06:15.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.559+0000 7f9ae4b40700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae00c1740 con 0x7f9ae00ccf80 2023-10-06T03:06:15.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.559+0000 7f9aded9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9ae00ccf80 0x7f9ae0067f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:15.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.559+0000 7f9aded9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9ae00ccf80 0x7f9ae0067f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41474/0 (socket says 172.21.15.125:41474) 2023-10-06T03:06:15.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.559+0000 7f9ade59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9ae01558e0 0x7f9ae00cc870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57394/0 (socket says 172.21.15.125:57394) 2023-10-06T03:06:15.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.559+0000 7f9aded9d700 1 -- 172.21.15.125:0/1368667661 learned_addr learned my addr 172.21.15.125:0/1368667661 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:15.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.559+0000 7f9aded9d700 1 -- 172.21.15.125:0/1368667661 >> v1:172.21.15.130:6789/0 conn(0x7f9ae0155cb0 legacy=0x7f9ae0067850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:15.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.559+0000 7f9aded9d700 1 -- 172.21.15.125:0/1368667661 >> v1:172.21.15.125:6789/0 conn(0x7f9ae01558e0 legacy=0x7f9ae00cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:15.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.559+0000 7f9aded9d700 1 -- 172.21.15.125:0/1368667661 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae00c9ed0 con 0x7f9ae00ccf80 2023-10-06T03:06:15.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.559+0000 7f9aded9d700 1 --2- 172.21.15.125:0/1368667661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae00ccf80 0x7f9ae0067f60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f9ad800d1a0 tx=0x7f9ad800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a94678cc028c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:15.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.562+0000 7f9add59a700 1 -- 172.21.15.125:0/1368667661 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8010070 con 0x7f9ae00ccf80 2023-10-06T03:06:15.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.562+0000 7f9add59a700 1 -- 172.21.15.125:0/1368667661 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad800dcb0 con 0x7f9ae00ccf80 2023-10-06T03:06:15.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.562+0000 7f9add59a700 1 -- 172.21.15.125:0/1368667661 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8016650 con 0x7f9ae00ccf80 2023-10-06T03:06:15.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.563+0000 7f9ae4b40700 1 -- 172.21.15.125:0/1368667661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae00ccf80 msgr2=0x7f9ae0067f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:15.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.563+0000 7f9ae4b40700 1 --2- 172.21.15.125:0/1368667661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae00ccf80 0x7f9ae0067f60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f9ad800d1a0 tx=0x7f9ad800ba50 comp rx=0 tx=0).stop 2023-10-06T03:06:15.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.563+0000 7f9ae4b40700 1 -- 172.21.15.125:0/1368667661 shutdown_connections 2023-10-06T03:06:15.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.563+0000 7f9ae4b40700 1 --2- 172.21.15.125:0/1368667661 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae00ccf80 0x7f9ae0067f60 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:15.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.563+0000 7f9ae4b40700 1 -- 172.21.15.125:0/1368667661 >> 172.21.15.125:0/1368667661 conn(0x7f9ae00af730 msgr2=0x7f9ae00afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:15.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.563+0000 7f9ae4b40700 1 -- 172.21.15.125:0/1368667661 shutdown_connections 2023-10-06T03:06:15.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.563+0000 7f9ae4b40700 1 -- 172.21.15.125:0/1368667661 wait complete. 2023-10-06T03:06:15.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.564+0000 7f9ae4b40700 1 Processor -- start 2023-10-06T03:06:15.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.564+0000 7f9ae4b40700 1 -- start start 2023-10-06T03:06:15.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.565+0000 7f9ae4b40700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ae00ccf80 0x7f9ae0097b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:15.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.565+0000 7f9ae4b40700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ae01558e0 0x7f9ae013c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:15.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.565+0000 7f9ae4b40700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae014f5d0 0x7f9ae014fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:15.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.565+0000 7f9ae4b40700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae01548e0 con 0x7f9ae014f5d0 2023-10-06T03:06:15.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.565+0000 7f9ae4b40700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae0098090 con 0x7f9ae00ccf80 2023-10-06T03:06:15.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.565+0000 7f9ae4b40700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae01523f0 con 0x7f9ae01558e0 2023-10-06T03:06:15.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.565+0000 7f9aded9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae014f5d0 0x7f9ae014fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:15.567 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.565+0000 7f9aded9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae014f5d0 0x7f9ae014fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41478/0 (socket says 172.21.15.125:41478) 2023-10-06T03:06:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.565+0000 7f9aded9d700 1 -- 172.21.15.125:0/1773619048 learned_addr learned my addr 172.21.15.125:0/1773619048 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.565+0000 7f9ade59c700 1 --2- 172.21.15.125:0/1773619048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ae00ccf80 0x7f9ae0097b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.565+0000 7f9addd9b700 1 --2- 172.21.15.125:0/1773619048 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ae01558e0 0x7f9ae013c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.565+0000 7f9aded9d700 1 -- 172.21.15.125:0/1773619048 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ae01558e0 msgr2=0x7f9ae013c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.565+0000 7f9aded9d700 1 --2- 172.21.15.125:0/1773619048 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ae01558e0 0x7f9ae013c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.565+0000 7f9aded9d700 1 -- 172.21.15.125:0/1773619048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ae00ccf80 msgr2=0x7f9ae0097b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.565+0000 7f9aded9d700 1 --2- 172.21.15.125:0/1773619048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ae00ccf80 0x7f9ae0097b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.565+0000 7f9aded9d700 1 -- 172.21.15.125:0/1773619048 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad800bcf0 con 0x7f9ae014f5d0 2023-10-06T03:06:15.568 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.565+0000 7f9aded9d700 1 --2- 172.21.15.125:0/1773619048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae014f5d0 0x7f9ae014fa70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8016000 tx=0x7f9ad801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:15.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.571+0000 7f9ad67fc700 1 -- 172.21.15.125:0/1773619048 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8007170 con 0x7f9ae014f5d0 2023-10-06T03:06:15.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.571+0000 7f9ae4b40700 1 -- 172.21.15.125:0/1773619048 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae0154b30 con 0x7f9ae014f5d0 2023-10-06T03:06:15.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.571+0000 7f9ad67fc700 1 -- 172.21.15.125:0/1773619048 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad8015840 con 0x7f9ae014f5d0 2023-10-06T03:06:15.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.571+0000 7f9ae4b40700 1 -- 172.21.15.125:0/1773619048 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae0152080 con 0x7f9ae014f5d0 2023-10-06T03:06:15.572 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.571+0000 7f9ad67fc700 1 -- 172.21.15.125:0/1773619048 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad80159b0 con 0x7f9ae014f5d0 2023-10-06T03:06:15.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.572+0000 7f9ae4b40700 1 -- 172.21.15.125:0/1773619048 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae0066510 con 0x7f9ae014f5d0 2023-10-06T03:06:15.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.572+0000 7f9ad67fc700 1 -- 172.21.15.125:0/1773619048 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ad8003040 con 0x7f9ae014f5d0 2023-10-06T03:06:15.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.573+0000 7f9ad67fc700 1 --2- 172.21.15.125:0/1773619048 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9ac0066f30 0x7f9ac00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:15.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.573+0000 7f9ad67fc700 1 -- 172.21.15.125:0/1773619048 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f9ad8088a20 con 0x7f9ae014f5d0 2023-10-06T03:06:15.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.573+0000 7f9ade59c700 1 --2- 172.21.15.125:0/1773619048 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9ac0066f30 0x7f9ac00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:15.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.573+0000 7f9ade59c700 1 --2- 172.21.15.125:0/1773619048 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9ac0066f30 0x7f9ac00693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80029f0 tx=0x7f9ac8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:15.578 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.577+0000 7f9ad67fc700 1 -- 172.21.15.125:0/1773619048 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ad8055cf0 con 0x7f9ae014f5d0 2023-10-06T03:06:15.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:15.777+0000 7f9ae4b40700 1 -- 172.21.15.125:0/1773619048 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9ae00c19e0 con 0x7f9ae014f5d0 2023-10-06T03:06:16.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.590+0000 7f9ad67fc700 1 -- 172.21.15.125:0/1773619048 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v53) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9ad8059310 con 0x7f9ae014f5d0 2023-10-06T03:06:16.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.592+0000 7f9ae4b40700 1 -- 172.21.15.125:0/1773619048 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9ac0066f30 msgr2=0x7f9ac00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:16.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.592+0000 7f9ae4b40700 1 --2- 172.21.15.125:0/1773619048 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9ac0066f30 0x7f9ac00693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80029f0 tx=0x7f9ac8009040 comp rx=0 tx=0).stop 2023-10-06T03:06:16.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.592+0000 7f9ae4b40700 1 -- 172.21.15.125:0/1773619048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae014f5d0 msgr2=0x7f9ae014fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:16.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.592+0000 7f9ae4b40700 1 --2- 172.21.15.125:0/1773619048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae014f5d0 0x7f9ae014fa70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8016000 tx=0x7f9ad801c000 comp rx=0 tx=0).stop 2023-10-06T03:06:16.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.592+0000 7f9ae4b40700 1 -- 172.21.15.125:0/1773619048 shutdown_connections 2023-10-06T03:06:16.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.592+0000 7f9ae4b40700 1 --2- 172.21.15.125:0/1773619048 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9ac0066f30 0x7f9ac00693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:16.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.592+0000 7f9ae4b40700 1 --2- 172.21.15.125:0/1773619048 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9ae014f5d0 0x7f9ae014fa70 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:16.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.592+0000 7f9ae4b40700 1 --2- 172.21.15.125:0/1773619048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ae00ccf80 0x7f9ae0097b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:16.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.592+0000 7f9ae4b40700 1 --2- 172.21.15.125:0/1773619048 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9ae01558e0 0x7f9ae013c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:16.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.592+0000 7f9ae4b40700 1 -- 172.21.15.125:0/1773619048 >> 172.21.15.125:0/1773619048 conn(0x7f9ae00af730 msgr2=0x7f9ae006b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:16.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.592+0000 7f9ae4b40700 1 -- 172.21.15.125:0/1773619048 shutdown_connections 2023-10-06T03:06:16.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.592+0000 7f9ae4b40700 1 -- 172.21.15.125:0/1773619048 wait complete. 2023-10-06T03:06:16.595 INFO:teuthology.orchestra.run.smithi125.stderr: removed all blocklist entries 2023-10-06T03:06:16.605 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T03:06:16.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.722+0000 7fad699fe700 1 Processor -- start 2023-10-06T03:06:16.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.722+0000 7fad699fe700 1 -- start start 2023-10-06T03:06:16.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.724+0000 7fad699fe700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad64155670 0x7fad641592e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:16.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.724+0000 7fad699fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad6406f4e0 0x7fad6406a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:16.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.724+0000 7fad699fe700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad64068290 con 0x7fad6406f070 2023-10-06T03:06:16.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.724+0000 7fad699fe700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad64159930 con 0x7fad6406f4e0 2023-10-06T03:06:16.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.724+0000 7fad699fe700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad64159c10 con 0x7fad64155670 2023-10-06T03:06:16.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.724+0000 7fad627fc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fad6406f070 0x7fad640ace80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57408/0 (socket says 172.21.15.125:57408) 2023-10-06T03:06:16.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.724+0000 7fad637fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fad6406f4e0 0x7fad6406a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:16.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.724+0000 7fad627fc700 1 -- 172.21.15.125:0/3028699669 learned_addr learned my addr 172.21.15.125:0/3028699669 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:16.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.724+0000 7fad62ffd700 1 --2- 172.21.15.125:0/3028699669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad64155670 0x7fad641592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:16.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.724+0000 7fad637fe700 1 -- 172.21.15.125:0/3028699669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad64155670 msgr2=0x7fad641592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:16.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.724+0000 7fad637fe700 1 --2- 172.21.15.125:0/3028699669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad64155670 0x7fad641592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:16.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.724+0000 7fad637fe700 1 -- 172.21.15.125:0/3028699669 >> v1:172.21.15.125:6789/0 conn(0x7fad6406f070 legacy=0x7fad640ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:16.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.724+0000 7fad61ffb700 1 -- 172.21.15.125:0/3028699669 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947860954 0 0) 0x7fad64068290 con 0x7fad6406f070 2023-10-06T03:06:16.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.724+0000 7fad637fe700 1 -- 172.21.15.125:0/3028699669 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad64159ef0 con 0x7fad6406f4e0 2023-10-06T03:06:16.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.724+0000 7fad62ffd700 1 --2- 172.21.15.125:0/3028699669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad64155670 0x7fad641592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:16.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.724+0000 7fad637fe700 1 --2- 172.21.15.125:0/3028699669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad6406f4e0 0x7fad6406a8c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00afa0 tx=0x7fad5c00a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a5b0a2f94b8c91 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:16.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.724+0000 7fad61ffb700 1 -- 172.21.15.125:0/3028699669 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c00f070 con 0x7fad6406f4e0 2023-10-06T03:06:16.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.724+0000 7fad61ffb700 1 -- 172.21.15.125:0/3028699669 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c00a2e0 con 0x7fad6406f4e0 2023-10-06T03:06:16.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.724+0000 7fad61ffb700 1 -- 172.21.15.125:0/3028699669 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c00cd10 con 0x7fad6406f4e0 2023-10-06T03:06:16.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.725+0000 7fad699fe700 1 -- 172.21.15.125:0/3028699669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad6406f4e0 msgr2=0x7fad6406a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:16.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.725+0000 7fad699fe700 1 --2- 172.21.15.125:0/3028699669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad6406f4e0 0x7fad6406a8c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00afa0 tx=0x7fad5c00a890 comp rx=0 tx=0).stop 2023-10-06T03:06:16.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.725+0000 7fad699fe700 1 -- 172.21.15.125:0/3028699669 shutdown_connections 2023-10-06T03:06:16.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.725+0000 7fad699fe700 1 --2- 172.21.15.125:0/3028699669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad6406f4e0 0x7fad6406a8c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:16.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.725+0000 7fad699fe700 1 --2- 172.21.15.125:0/3028699669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad64155670 0x7fad641592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:16.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.725+0000 7fad699fe700 1 -- 172.21.15.125:0/3028699669 >> 172.21.15.125:0/3028699669 conn(0x7fad640cc5a0 msgr2=0x7fad640cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:16.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.725+0000 7fad699fe700 1 -- 172.21.15.125:0/3028699669 shutdown_connections 2023-10-06T03:06:16.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.725+0000 7fad699fe700 1 -- 172.21.15.125:0/3028699669 wait complete. 2023-10-06T03:06:16.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.726+0000 7fad699fe700 1 Processor -- start 2023-10-06T03:06:16.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.726+0000 7fad699fe700 1 -- start start 2023-10-06T03:06:16.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.727+0000 7fad699fe700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad6406f070 0x7fad640c2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:16.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.727+0000 7fad699fe700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad6406f4e0 0x7fad64152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:16.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.727+0000 7fad699fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad64155670 0x7fad64152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:16.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.727+0000 7fad699fe700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad640cb7c0 con 0x7fad64155670 2023-10-06T03:06:16.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.727+0000 7fad699fe700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad641667b0 con 0x7fad6406f070 2023-10-06T03:06:16.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.727+0000 7fad699fe700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad640cb4e0 con 0x7fad6406f4e0 2023-10-06T03:06:16.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.727+0000 7fad637fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad64155670 0x7fad64152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:16.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.727+0000 7fad637fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad64155670 0x7fad64152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41504/0 (socket says 172.21.15.125:41504) 2023-10-06T03:06:16.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.727+0000 7fad637fe700 1 -- 172.21.15.125:0/4026340022 learned_addr learned my addr 172.21.15.125:0/4026340022 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.727+0000 7fad627fc700 1 --2- 172.21.15.125:0/4026340022 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad6406f4e0 0x7fad64152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.727+0000 7fad62ffd700 1 --2- 172.21.15.125:0/4026340022 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad6406f070 0x7fad640c2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.727+0000 7fad637fe700 1 -- 172.21.15.125:0/4026340022 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad6406f4e0 msgr2=0x7fad64152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.727+0000 7fad637fe700 1 --2- 172.21.15.125:0/4026340022 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad6406f4e0 0x7fad64152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.727+0000 7fad637fe700 1 -- 172.21.15.125:0/4026340022 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad6406f070 msgr2=0x7fad640c2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.727+0000 7fad637fe700 1 --2- 172.21.15.125:0/4026340022 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad6406f070 0x7fad640c2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.727+0000 7fad637fe700 1 -- 172.21.15.125:0/4026340022 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5c00ab30 con 0x7fad64155670 2023-10-06T03:06:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.727+0000 7fad62ffd700 1 --2- 172.21.15.125:0/4026340022 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad6406f070 0x7fad640c2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.728+0000 7fad637fe700 1 --2- 172.21.15.125:0/4026340022 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad64155670 0x7fad64152ab0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fad6406fa60 tx=0x7fad5c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:16.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.728+0000 7fad4affd700 1 -- 172.21.15.125:0/4026340022 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c009de0 con 0x7fad64155670 2023-10-06T03:06:16.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.728+0000 7fad4affd700 1 -- 172.21.15.125:0/4026340022 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c027410 con 0x7fad64155670 2023-10-06T03:06:16.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.728+0000 7fad699fe700 1 -- 172.21.15.125:0/4026340022 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad64166160 con 0x7fad64155670 2023-10-06T03:06:16.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.728+0000 7fad4affd700 1 -- 172.21.15.125:0/4026340022 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c0277d0 con 0x7fad64155670 2023-10-06T03:06:16.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.728+0000 7fad699fe700 1 -- 172.21.15.125:0/4026340022 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad640ca7b0 con 0x7fad64155670 2023-10-06T03:06:16.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.729+0000 7fad699fe700 1 -- 172.21.15.125:0/4026340022 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad64166600 con 0x7fad64155670 2023-10-06T03:06:16.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.729+0000 7fad4affd700 1 -- 172.21.15.125:0/4026340022 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad5c027bc0 con 0x7fad64155670 2023-10-06T03:06:16.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.729+0000 7fad4affd700 1 --2- 172.21.15.125:0/4026340022 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fad50066fb0 0x7fad50069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:16.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.730+0000 7fad4affd700 1 -- 172.21.15.125:0/4026340022 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fad5c0863b0 con 0x7fad64155670 2023-10-06T03:06:16.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.730+0000 7fad62ffd700 1 --2- 172.21.15.125:0/4026340022 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fad50066fb0 0x7fad50069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:16.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.730+0000 7fad62ffd700 1 --2- 172.21.15.125:0/4026340022 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fad50066fb0 0x7fad50069460 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fad58006fd0 tx=0x7fad58008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:16.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.734+0000 7fad4affd700 1 -- 172.21.15.125:0/4026340022 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad5c053630 con 0x7fad64155670 2023-10-06T03:06:16.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.987+0000 7fad699fe700 1 -- 172.21.15.125:0/4026340022 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fad64066510 con 0x7fad64155670 2023-10-06T03:06:16.988 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.987+0000 7fad4affd700 1 -- 172.21.15.125:0/4026340022 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5298 (secure 0 0 0) 0x7fad5c056c50 con 0x7fad64155670 2023-10-06T03:06:16.989 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:16.989 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:06:16.989 INFO:teuthology.orchestra.run.smithi125.stdout: "auth_dump": [ 2023-10-06T03:06:16.989 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:16.989 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.a", 2023-10-06T03:06:16.989 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQACeR9lloXSNBAAkd4p8EX8hsbmaj2RtvpTfQ==", 2023-10-06T03:06:16.989 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:06:16.989 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-06T03:06:16.990 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-10-06T03:06:16.990 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-10-06T03:06:16.990 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:06:16.990 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:16.990 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:16.990 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:16.990 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.b", 2023-10-06T03:06:16.990 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQADeR9laBRSBRAAz9jzUg+VFVG1z9PAO0Bcpw==", 2023-10-06T03:06:16.990 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:06:16.990 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-06T03:06:16.991 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-10-06T03:06:16.991 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-10-06T03:06:16.991 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:06:16.991 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:16.991 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:16.991 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:16.991 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.c", 2023-10-06T03:06:16.991 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQADeR9lBnBUABAA2iux/fQycX1zhICh6deYGw==", 2023-10-06T03:06:16.991 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:06:16.991 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-06T03:06:16.991 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-10-06T03:06:16.991 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-10-06T03:06:16.992 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:06:16.992 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:16.992 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:16.992 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:16.992 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mds.d", 2023-10-06T03:06:16.992 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQADeR9l9PCGDBAAl8luWnwki83v799sqGJFDA==", 2023-10-06T03:06:16.992 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:06:16.992 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-06T03:06:16.992 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-10-06T03:06:16.992 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-10-06T03:06:16.992 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:06:16.992 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:16.993 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:16.993 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:16.993 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.0", 2023-10-06T03:06:16.993 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAGeR9lUBtFJBAAFWDaLc1yPAPAiE/b9XQz6Q==", 2023-10-06T03:06:16.993 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:06:16.993 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-06T03:06:16.993 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-06T03:06:16.993 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:06:16.993 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:16.993 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:16.993 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:16.993 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.1", 2023-10-06T03:06:16.994 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAJeR9lzLNAIxAAZvAeW1kgSS22S2ODNu9t5g==", 2023-10-06T03:06:16.994 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:06:16.994 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-06T03:06:16.994 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-06T03:06:16.994 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:06:16.994 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:16.994 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:16.994 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:16.994 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.2", 2023-10-06T03:06:16.994 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAMeR9lzW7lIRAAoTH53SsCdqg2Eqa6usyNsw==", 2023-10-06T03:06:16.994 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:06:16.994 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-06T03:06:16.995 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-06T03:06:16.995 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:06:16.995 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:16.995 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:16.995 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:16.995 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.3", 2023-10-06T03:06:16.995 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAPeR9lMHoBIBAABNg2tnpIkx1vAzE5Kyu2RA==", 2023-10-06T03:06:16.995 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:06:16.995 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-06T03:06:16.995 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-06T03:06:16.996 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:06:16.996 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:16.996 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:16.996 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:16.996 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.4", 2023-10-06T03:06:16.996 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAVeR9lprxMIRAA15Qi61mgKUyCpIS1XsYQRQ==", 2023-10-06T03:06:16.996 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:06:16.996 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-06T03:06:16.996 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-06T03:06:16.997 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:06:16.997 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:16.997 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:16.997 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:16.997 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.5", 2023-10-06T03:06:16.997 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAYeR9lk5hfIBAAI/Z6Z6sckq0MUvmXtEqCXg==", 2023-10-06T03:06:16.997 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:06:16.997 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-06T03:06:16.997 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-06T03:06:16.997 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:06:16.997 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:16.997 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:16.998 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:16.998 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.6", 2023-10-06T03:06:16.998 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAbeR9l8yLBHhAARHwk/X1wTrgZILmOilO4Zw==", 2023-10-06T03:06:16.998 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:06:16.998 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-06T03:06:16.998 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-06T03:06:16.998 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:06:16.998 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:16.998 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:16.998 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:16.998 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "osd.7", 2023-10-06T03:06:16.999 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQAeeR9l9oGIHRAAtNRSqb/lHdSUjkTc+8iCOw==", 2023-10-06T03:06:16.999 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:06:16.999 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow profile osd", 2023-10-06T03:06:16.999 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile osd", 2023-10-06T03:06:16.999 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:06:16.999 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:16.999 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:16.999 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:16.999 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.0", 2023-10-06T03:06:16.999 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQADeR9lYyykEBAAbm74uo9KpHwsa7BJ80s73Q==", 2023-10-06T03:06:16.999 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:06:16.999 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-06T03:06:17.000 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow r", 2023-10-06T03:06:17.000 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rw pool=cephfs_data" 2023-10-06T03:06:17.000 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:17.000 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:17.000 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:17.000 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.1", 2023-10-06T03:06:17.000 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQADeR9lyE1DGRAA6/HFA4rX/Gas70IcoIieBw==", 2023-10-06T03:06:17.000 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:06:17.000 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-06T03:06:17.000 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-10-06T03:06:17.000 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-10-06T03:06:17.000 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-10-06T03:06:17.001 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:17.001 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:17.001 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:17.001 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.2", 2023-10-06T03:06:17.001 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQADeR9lugwkFhAABBonfXirjsQIY76fNW79Uw==", 2023-10-06T03:06:17.001 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:06:17.001 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-06T03:06:17.001 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-10-06T03:06:17.001 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-10-06T03:06:17.001 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-10-06T03:06:17.001 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:17.001 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:17.002 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:17.002 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.3", 2023-10-06T03:06:17.002 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQADeR9lnA7NHhAAfuAxtddpoSbQzk57JvpbuQ==", 2023-10-06T03:06:17.002 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:06:17.002 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow", 2023-10-06T03:06:17.002 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow r", 2023-10-06T03:06:17.002 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow rw", 2023-10-06T03:06:17.002 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow rwx" 2023-10-06T03:06:17.002 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:17.002 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:17.002 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:17.002 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "client.admin", 2023-10-06T03:06:17.003 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQACeR9lXYu3FRAA08TQNHv7b235IJ0IT51DdQ==", 2023-10-06T03:06:17.003 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:06:17.003 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow *", 2023-10-06T03:06:17.003 INFO:teuthology.orchestra.run.smithi125.stdout: "mgr": "allow *", 2023-10-06T03:06:17.003 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow *", 2023-10-06T03:06:17.003 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:06:17.003 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:17.003 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:17.003 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:17.003 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mgr.x", 2023-10-06T03:06:17.003 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQACeR9lEgqqMRAANWCEvP6tlNAHrd170s3xTw==", 2023-10-06T03:06:17.003 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:06:17.004 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow *", 2023-10-06T03:06:17.004 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile mgr", 2023-10-06T03:06:17.004 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:06:17.004 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:17.004 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:17.004 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:17.004 INFO:teuthology.orchestra.run.smithi125.stdout: "entity": "mgr.y", 2023-10-06T03:06:17.004 INFO:teuthology.orchestra.run.smithi125.stdout: "key": "AQACeR9lMBVuKxAA79aCZvxIP8SQ0uAHUhMoTw==", 2023-10-06T03:06:17.004 INFO:teuthology.orchestra.run.smithi125.stdout: "caps": { 2023-10-06T03:06:17.004 INFO:teuthology.orchestra.run.smithi125.stdout: "mds": "allow *", 2023-10-06T03:06:17.004 INFO:teuthology.orchestra.run.smithi125.stdout: "mon": "allow profile mgr", 2023-10-06T03:06:17.004 INFO:teuthology.orchestra.run.smithi125.stdout: "osd": "allow *" 2023-10-06T03:06:17.005 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:17.005 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:17.005 INFO:teuthology.orchestra.run.smithi125.stdout: ] 2023-10-06T03:06:17.005 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:06:17.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.989+0000 7fad699fe700 1 -- 172.21.15.125:0/4026340022 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fad50066fb0 msgr2=0x7fad50069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.989+0000 7fad699fe700 1 --2- 172.21.15.125:0/4026340022 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fad50066fb0 0x7fad50069460 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fad58006fd0 tx=0x7fad58008040 comp rx=0 tx=0).stop 2023-10-06T03:06:17.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.989+0000 7fad699fe700 1 -- 172.21.15.125:0/4026340022 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad64155670 msgr2=0x7fad64152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.989+0000 7fad699fe700 1 --2- 172.21.15.125:0/4026340022 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad64155670 0x7fad64152ab0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fad6406fa60 tx=0x7fad5c019000 comp rx=0 tx=0).stop 2023-10-06T03:06:17.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.989+0000 7fad699fe700 1 -- 172.21.15.125:0/4026340022 shutdown_connections 2023-10-06T03:06:17.006 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.989+0000 7fad699fe700 1 --2- 172.21.15.125:0/4026340022 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fad50066fb0 0x7fad50069460 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.989+0000 7fad699fe700 1 --2- 172.21.15.125:0/4026340022 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fad64155670 0x7fad64152ab0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.989+0000 7fad699fe700 1 --2- 172.21.15.125:0/4026340022 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad6406f070 0x7fad640c2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.989+0000 7fad699fe700 1 --2- 172.21.15.125:0/4026340022 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fad6406f4e0 0x7fad64152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.989+0000 7fad699fe700 1 -- 172.21.15.125:0/4026340022 >> 172.21.15.125:0/4026340022 conn(0x7fad640cc5a0 msgr2=0x7fad640b1360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:17.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.989+0000 7fad699fe700 1 -- 172.21.15.125:0/4026340022 shutdown_connections 2023-10-06T03:06:17.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:16.989+0000 7fad699fe700 1 -- 172.21.15.125:0/4026340022 wait complete. 2023-10-06T03:06:17.007 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:06:17.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.123+0000 7f4caf0c4700 1 Processor -- start 2023-10-06T03:06:17.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.123+0000 7f4caf0c4700 1 -- start start 2023-10-06T03:06:17.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.124+0000 7f4caf0c4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4ca80ca9f0 0x7f4ca806e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.124+0000 7f4caf0c4700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4ca80c8ea0 0x7f4ca80cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.124+0000 7f4caf0c4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca806e860 con 0x7f4ca80cadc0 2023-10-06T03:06:17.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.124+0000 7f4caf0c4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca80cd010 con 0x7f4ca80ca9f0 2023-10-06T03:06:17.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.124+0000 7f4caf0c4700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca80cc400 con 0x7f4ca80c8ea0 2023-10-06T03:06:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.124+0000 7f4cace60700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4ca80ca9f0 0x7f4ca806e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.124+0000 7f4cad661700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4ca80cadc0 0x7f4ca80adaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57418/0 (socket says 172.21.15.125:57418) 2023-10-06T03:06:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.124+0000 7f4cad661700 1 -- 172.21.15.125:0/3501969552 learned_addr learned my addr 172.21.15.125:0/3501969552 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.124+0000 7f4ca7fff700 1 --2- 172.21.15.125:0/3501969552 >> v2:172.21.15.130:3300/0 conn(0x7f4ca80c8ea0 0x7f4ca80cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.124+0000 7f4cace60700 1 -- 172.21.15.125:0/3501969552 >> v2:172.21.15.130:3300/0 conn(0x7f4ca80c8ea0 msgr2=0x7f4ca80cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.124+0000 7f4cace60700 1 --2- 172.21.15.125:0/3501969552 >> v2:172.21.15.130:3300/0 conn(0x7f4ca80c8ea0 0x7f4ca80cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.124+0000 7f4cace60700 1 -- 172.21.15.125:0/3501969552 >> v1:172.21.15.125:6789/0 conn(0x7f4ca80cadc0 legacy=0x7f4ca80adaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.124+0000 7f4ca77fe700 1 -- 172.21.15.125:0/3501969552 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544069973 0 0) 0x7f4ca806e860 con 0x7f4ca80cadc0 2023-10-06T03:06:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.124+0000 7f4cace60700 1 -- 172.21.15.125:0/3501969552 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca80cc6e0 con 0x7f4ca80ca9f0 2023-10-06T03:06:17.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.124+0000 7f4ca7fff700 1 --2- 172.21.15.125:0/3501969552 >> v2:172.21.15.130:3300/0 conn(0x7f4ca80c8ea0 0x7f4ca80cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:17.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.124+0000 7f4cace60700 1 --2- 172.21.15.125:0/3501969552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ca80ca9f0 0x7f4ca806e320 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4ca815bd70 tx=0x7f4c9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8868b0b703f7d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:17.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.125+0000 7f4ca77fe700 1 -- 172.21.15.125:0/3501969552 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c00b6b0 con 0x7f4ca80ca9f0 2023-10-06T03:06:17.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.125+0000 7f4ca77fe700 1 -- 172.21.15.125:0/3501969552 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c00b810 con 0x7f4ca80ca9f0 2023-10-06T03:06:17.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.125+0000 7f4ca77fe700 1 -- 172.21.15.125:0/3501969552 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c00bbb0 con 0x7f4ca80ca9f0 2023-10-06T03:06:17.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.125+0000 7f4caf0c4700 1 -- 172.21.15.125:0/3501969552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ca80ca9f0 msgr2=0x7f4ca806e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.125+0000 7f4caf0c4700 1 --2- 172.21.15.125:0/3501969552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ca80ca9f0 0x7f4ca806e320 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4ca815bd70 tx=0x7f4c9c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.125+0000 7f4caf0c4700 1 -- 172.21.15.125:0/3501969552 shutdown_connections 2023-10-06T03:06:17.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.125+0000 7f4caf0c4700 1 --2- 172.21.15.125:0/3501969552 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ca80ca9f0 0x7f4ca806e320 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.125+0000 7f4caf0c4700 1 --2- 172.21.15.125:0/3501969552 >> v2:172.21.15.130:3300/0 conn(0x7f4ca80c8ea0 0x7f4ca80cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.125+0000 7f4caf0c4700 1 -- 172.21.15.125:0/3501969552 >> 172.21.15.125:0/3501969552 conn(0x7f4ca806c380 msgr2=0x7f4ca806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:17.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.125+0000 7f4caf0c4700 1 -- 172.21.15.125:0/3501969552 shutdown_connections 2023-10-06T03:06:17.130 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.125+0000 7f4caf0c4700 1 -- 172.21.15.125:0/3501969552 wait complete. 2023-10-06T03:06:17.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.126+0000 7f4caf0c4700 1 Processor -- start 2023-10-06T03:06:17.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.126+0000 7f4caf0c4700 1 -- start start 2023-10-06T03:06:17.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.127+0000 7f4caf0c4700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ca80c8ea0 0x7f4ca80b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.127+0000 7f4caf0c4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ca80ca9f0 0x7f4ca814d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.127+0000 7f4caf0c4700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ca80cadc0 0x7f4ca814ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.127+0000 7f4caf0c4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca80b3c90 con 0x7f4ca80ca9f0 2023-10-06T03:06:17.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.127+0000 7f4caf0c4700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca80b2c90 con 0x7f4ca80cadc0 2023-10-06T03:06:17.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.127+0000 7f4caf0c4700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca814d6d0 con 0x7f4ca80c8ea0 2023-10-06T03:06:17.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.127+0000 7f4ca7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ca80ca9f0 0x7f4ca814d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.127+0000 7f4ca7fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ca80ca9f0 0x7f4ca814d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41532/0 (socket says 172.21.15.125:41532) 2023-10-06T03:06:17.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.127+0000 7f4ca7fff700 1 -- 172.21.15.125:0/2839137323 learned_addr learned my addr 172.21.15.125:0/2839137323 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:17.133 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.128+0000 7f4ca7fff700 1 -- 172.21.15.125:0/2839137323 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ca80c8ea0 msgr2=0x7f4ca80b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.128+0000 7f4ca7fff700 1 --2- 172.21.15.125:0/2839137323 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ca80c8ea0 0x7f4ca80b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.128+0000 7f4ca7fff700 1 -- 172.21.15.125:0/2839137323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ca80cadc0 msgr2=0x7f4ca814ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.128+0000 7f4ca7fff700 1 --2- 172.21.15.125:0/2839137323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ca80cadc0 0x7f4ca814ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.128+0000 7f4ca7fff700 1 -- 172.21.15.125:0/2839137323 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9c009420 con 0x7f4ca80ca9f0 2023-10-06T03:06:17.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.128+0000 7f4ca7fff700 1 --2- 172.21.15.125:0/2839137323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ca80ca9f0 0x7f4ca814d190 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4c9400c830 tx=0x7f4c94008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:17.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.128+0000 7f4ca4ff9700 1 -- 172.21.15.125:0/2839137323 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c94011600 con 0x7f4ca80ca9f0 2023-10-06T03:06:17.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.128+0000 7f4ca4ff9700 1 -- 172.21.15.125:0/2839137323 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c94011760 con 0x7f4ca80ca9f0 2023-10-06T03:06:17.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.128+0000 7f4caf0c4700 1 -- 172.21.15.125:0/2839137323 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca80b1c80 con 0x7f4ca80ca9f0 2023-10-06T03:06:17.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.128+0000 7f4ca4ff9700 1 -- 172.21.15.125:0/2839137323 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c94011b20 con 0x7f4ca80ca9f0 2023-10-06T03:06:17.134 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.128+0000 7f4caf0c4700 1 -- 172.21.15.125:0/2839137323 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca80b2f50 con 0x7f4ca80ca9f0 2023-10-06T03:06:17.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.129+0000 7f4caf0c4700 1 -- 172.21.15.125:0/2839137323 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca8066510 con 0x7f4ca80ca9f0 2023-10-06T03:06:17.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.129+0000 7f4ca4ff9700 1 -- 172.21.15.125:0/2839137323 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c9400a3e0 con 0x7f4ca80ca9f0 2023-10-06T03:06:17.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.130+0000 7f4ca4ff9700 1 --2- 172.21.15.125:0/2839137323 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4c8c066f30 0x7f4c8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.130+0000 7f4ca4ff9700 1 -- 172.21.15.125:0/2839137323 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f4c94084620 con 0x7f4ca80ca9f0 2023-10-06T03:06:17.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.130+0000 7f4cace60700 1 --2- 172.21.15.125:0/2839137323 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4c8c066f30 0x7f4c8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.130+0000 7f4cace60700 1 --2- 172.21.15.125:0/2839137323 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4c8c066f30 0x7f4c8c0693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0091e0 tx=0x7f4c9c017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:17.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.134+0000 7f4ca4ff9700 1 -- 172.21.15.125:0/2839137323 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c940518a0 con 0x7f4ca80ca9f0 2023-10-06T03:06:17.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.317+0000 7f4caf0c4700 1 -- 172.21.15.125:0/2839137323 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ca80cbcd0 con 0x7f4ca80ca9f0 2023-10-06T03:06:17.319 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.318+0000 7f4ca4ff9700 1 -- 172.21.15.125:0/2839137323 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+13999 (secure 0 0 0) 0x7f4c94054ec0 con 0x7f4ca80ca9f0 2023-10-06T03:06:17.319 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:17.320 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":53,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:06:16.586661+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:06:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.320+0000 7f4caf0c4700 1 -- 172.21.15.125:0/2839137323 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4c8c066f30 msgr2=0x7f4c8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.320+0000 7f4caf0c4700 1 --2- 172.21.15.125:0/2839137323 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4c8c066f30 0x7f4c8c0693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c0091e0 tx=0x7f4c9c017000 comp rx=0 tx=0).stop 2023-10-06T03:06:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.320+0000 7f4caf0c4700 1 -- 172.21.15.125:0/2839137323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ca80ca9f0 msgr2=0x7f4ca814d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.320+0000 7f4caf0c4700 1 --2- 172.21.15.125:0/2839137323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ca80ca9f0 0x7f4ca814d190 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4c9400c830 tx=0x7f4c94008040 comp rx=0 tx=0).stop 2023-10-06T03:06:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.320+0000 7f4caf0c4700 1 -- 172.21.15.125:0/2839137323 shutdown_connections 2023-10-06T03:06:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.320+0000 7f4caf0c4700 1 --2- 172.21.15.125:0/2839137323 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4c8c066f30 0x7f4c8c0693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.320+0000 7f4caf0c4700 1 --2- 172.21.15.125:0/2839137323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ca80cadc0 0x7f4ca814ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.320+0000 7f4caf0c4700 1 --2- 172.21.15.125:0/2839137323 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4ca80c8ea0 0x7f4ca80b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.320+0000 7f4caf0c4700 1 --2- 172.21.15.125:0/2839137323 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4ca80ca9f0 0x7f4ca814d190 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.320+0000 7f4caf0c4700 1 -- 172.21.15.125:0/2839137323 >> 172.21.15.125:0/2839137323 conn(0x7f4ca806c380 msgr2=0x7f4ca80c4540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:17.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.320+0000 7f4caf0c4700 1 -- 172.21.15.125:0/2839137323 shutdown_connections 2023-10-06T03:06:17.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.320+0000 7f4caf0c4700 1 -- 172.21.15.125:0/2839137323 wait complete. 2023-10-06T03:06:17.333 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:04:15.845430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:04:22.729795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T03:06:17.334 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:06:17.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.453+0000 7fddd5500700 1 Processor -- start 2023-10-06T03:06:17.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.453+0000 7fddd5500700 1 -- start start 2023-10-06T03:06:17.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.454+0000 7fddd5500700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fddd01571b0 0x7fddd00cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.454+0000 7fddd5500700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fddd00cd790 0x7fddd00ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.454+0000 7fddd5500700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd00cd300 con 0x7fddd0156de0 2023-10-06T03:06:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.454+0000 7fddd5500700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd00cc6f0 con 0x7fddd00cd790 2023-10-06T03:06:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.454+0000 7fddd5500700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00cc9d0 con 0x7fddd01571b0 2023-10-06T03:06:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.454+0000 7fddceffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fddd0156de0 0x7fddd015b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57434/0 (socket says 172.21.15.125:57434) 2023-10-06T03:06:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.454+0000 7fddceffd700 1 -- 172.21.15.125:0/2295258302 learned_addr learned my addr 172.21.15.125:0/2295258302 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.454+0000 7fddcdffb700 1 -- 172.21.15.125:0/2295258302 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415072529 0 0) 0x7fddd00cd300 con 0x7fddd0156de0 2023-10-06T03:06:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.454+0000 7fddcdffb700 1 -- 172.21.15.125:0/2295258302 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddb8003570 con 0x7fddd0156de0 2023-10-06T03:06:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.454+0000 7fddce7fc700 1 --2- 172.21.15.125:0/2295258302 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fddd01571b0 0x7fddd00cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.454+0000 7fddcf7fe700 1 --2- 172.21.15.125:0/2295258302 >> v2:172.21.15.130:3300/0 conn(0x7fddd00cd790 0x7fddd00ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcdffb700 1 -- 172.21.15.125:0/2295258302 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1513994736 0 0) 0x7fddb8003570 con 0x7fddd0156de0 2023-10-06T03:06:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcdffb700 1 -- 172.21.15.125:0/2295258302 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fddd01571b0 msgr2=0x7fddd00cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcdffb700 1 --2- 172.21.15.125:0/2295258302 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fddd01571b0 0x7fddd00cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcdffb700 1 -- 172.21.15.125:0/2295258302 >> v2:172.21.15.130:3300/0 conn(0x7fddd00cd790 msgr2=0x7fddd00ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcdffb700 1 --2- 172.21.15.125:0/2295258302 >> v2:172.21.15.130:3300/0 conn(0x7fddd00cd790 0x7fddd00ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcdffb700 1 -- 172.21.15.125:0/2295258302 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd00cccb0 con 0x7fddd0156de0 2023-10-06T03:06:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcdffb700 1 -- 172.21.15.125:0/2295258302 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7fddc4001470 con 0x7fddd0156de0 2023-10-06T03:06:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcdffb700 1 -- 172.21.15.125:0/2295258302 >> v1:172.21.15.125:6789/0 conn(0x7fddd0156de0 legacy=0x7fddd015b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcdffb700 1 --2- 172.21.15.125:0/2295258302 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fddd01571b0 0x7fddb8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcdffb700 1 --2- 172.21.15.125:0/2295258302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddb8003fe0 0x7fddb8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcdffb700 1 --2- 172.21.15.125:0/2295258302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddb8004d50 0x7fddb80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcdffb700 1 -- 172.21.15.125:0/2295258302 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00cc6f0 con 0x7fddb8004d50 2023-10-06T03:06:17.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcdffb700 1 -- 172.21.15.125:0/2295258302 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00cc9d0 con 0x7fddb8003fe0 2023-10-06T03:06:17.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcdffb700 1 -- 172.21.15.125:0/2295258302 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb800ba90 con 0x7fddd01571b0 2023-10-06T03:06:17.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcf7fe700 1 --2- 172.21.15.125:0/2295258302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddb8004d50 0x7fddb80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddce7fc700 1 --2- 172.21.15.125:0/2295258302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddb8003fe0 0x7fddb8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddceffd700 1 --2- 172.21.15.125:0/2295258302 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fddd01571b0 0x7fddb8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcf7fe700 1 -- 172.21.15.125:0/2295258302 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fddd01571b0 msgr2=0x7fddb8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:17.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcf7fe700 1 --2- 172.21.15.125:0/2295258302 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fddd01571b0 0x7fddb8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcf7fe700 1 -- 172.21.15.125:0/2295258302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddb8003fe0 msgr2=0x7fddb8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:17.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcf7fe700 1 --2- 172.21.15.125:0/2295258302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddb8003fe0 0x7fddb8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcf7fe700 1 -- 172.21.15.125:0/2295258302 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb8003570 con 0x7fddb8004d50 2023-10-06T03:06:17.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcf7fe700 1 --2- 172.21.15.125:0/2295258302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddb8004d50 0x7fddb80051c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fddc800e210 tx=0x7fddc800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1c4e873c6085c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:17.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.455+0000 7fddcdffb700 1 -- 172.21.15.125:0/2295258302 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc800ea60 con 0x7fddb8004d50 2023-10-06T03:06:17.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.456+0000 7fddcdffb700 1 -- 172.21.15.125:0/2295258302 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc800f040 con 0x7fddb8004d50 2023-10-06T03:06:17.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.456+0000 7fddcdffb700 1 -- 172.21.15.125:0/2295258302 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc800ee10 con 0x7fddb8004d50 2023-10-06T03:06:17.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.456+0000 7fddd5500700 1 -- 172.21.15.125:0/2295258302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddb8004d50 msgr2=0x7fddb80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.456+0000 7fddd5500700 1 --2- 172.21.15.125:0/2295258302 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddb8004d50 0x7fddb80051c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fddc800e210 tx=0x7fddc800b040 comp rx=0 tx=0).stop 2023-10-06T03:06:17.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.456+0000 7fddcf7fe700 1 -- 172.21.15.125:0/2295258302 reap_dead start 2023-10-06T03:06:17.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.456+0000 7fddd5500700 1 -- 172.21.15.125:0/2295258302 shutdown_connections 2023-10-06T03:06:17.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.456+0000 7fddd5500700 1 -- 172.21.15.125:0/2295258302 >> 172.21.15.125:0/2295258302 conn(0x7fddd00cdf80 msgr2=0x7fddd00ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:17.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.456+0000 7fddd5500700 1 -- 172.21.15.125:0/2295258302 shutdown_connections 2023-10-06T03:06:17.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.456+0000 7fddd5500700 1 -- 172.21.15.125:0/2295258302 wait complete. 2023-10-06T03:06:17.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.457+0000 7fddd5500700 1 Processor -- start 2023-10-06T03:06:17.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.457+0000 7fddd5500700 1 -- start start 2023-10-06T03:06:17.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.458+0000 7fddd5500700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fddb8004d50 0x7fddd0157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.458+0000 7fddd5500700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddd016b7a0 0x7fddd013a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.458+0000 7fddd5500700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddd016ab80 0x7fddd016b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.458+0000 7fddd5500700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd016b540 con 0x7fddd016b7a0 2023-10-06T03:06:17.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.458+0000 7fddd5500700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00c6920 con 0x7fddd016ab80 2023-10-06T03:06:17.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.458+0000 7fddd5500700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd00c5ff0 con 0x7fddb8004d50 2023-10-06T03:06:17.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.458+0000 7fddce7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddd016b7a0 0x7fddd013a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.458+0000 7fddce7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddd016b7a0 0x7fddd013a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41548/0 (socket says 172.21.15.125:41548) 2023-10-06T03:06:17.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.458+0000 7fddce7fc700 1 -- 172.21.15.125:0/2775245173 learned_addr learned my addr 172.21.15.125:0/2775245173 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:17.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.458+0000 7fddcf7fe700 1 --2- 172.21.15.125:0/2775245173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddd016ab80 0x7fddd016b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.458+0000 7fddceffd700 1 --2- 172.21.15.125:0/2775245173 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fddb8004d50 0x7fddd0157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.458+0000 7fddce7fc700 1 -- 172.21.15.125:0/2775245173 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fddb8004d50 msgr2=0x7fddd0157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.458+0000 7fddce7fc700 1 --2- 172.21.15.125:0/2775245173 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fddb8004d50 0x7fddd0157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.459+0000 7fddce7fc700 1 -- 172.21.15.125:0/2775245173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddd016ab80 msgr2=0x7fddd016b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.459+0000 7fddce7fc700 1 --2- 172.21.15.125:0/2775245173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddd016ab80 0x7fddd016b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.459+0000 7fddce7fc700 1 -- 172.21.15.125:0/2775245173 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd00c62d0 con 0x7fddd016b7a0 2023-10-06T03:06:17.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.459+0000 7fddcf7fe700 1 --2- 172.21.15.125:0/2775245173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddd016ab80 0x7fddd016b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:17.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.459+0000 7fddce7fc700 1 --2- 172.21.15.125:0/2775245173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddd016b7a0 0x7fddd013a4f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fddc0006ac0 tx=0x7fddc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:17.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.459+0000 7fddb6ffd700 1 -- 172.21.15.125:0/2775245173 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc000fa10 con 0x7fddd016b7a0 2023-10-06T03:06:17.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.459+0000 7fddb6ffd700 1 -- 172.21.15.125:0/2775245173 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc000fb70 con 0x7fddd016b7a0 2023-10-06T03:06:17.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.459+0000 7fddd5500700 1 -- 172.21.15.125:0/2775245173 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd00c65b0 con 0x7fddd016b7a0 2023-10-06T03:06:17.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.459+0000 7fddb6ffd700 1 -- 172.21.15.125:0/2775245173 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc0014440 con 0x7fddd016b7a0 2023-10-06T03:06:17.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.459+0000 7fddd5500700 1 -- 172.21.15.125:0/2775245173 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd0157c70 con 0x7fddd016b7a0 2023-10-06T03:06:17.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.460+0000 7fddd5500700 1 -- 172.21.15.125:0/2775245173 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd00c6ab0 con 0x7fddd016b7a0 2023-10-06T03:06:17.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.460+0000 7fddb6ffd700 1 -- 172.21.15.125:0/2775245173 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fddc0014870 con 0x7fddd016b7a0 2023-10-06T03:06:17.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.460+0000 7fddb6ffd700 1 --2- 172.21.15.125:0/2775245173 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fddbc066f30 0x7fddbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.461+0000 7fddb6ffd700 1 -- 172.21.15.125:0/2775245173 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fddc0018030 con 0x7fddd016b7a0 2023-10-06T03:06:17.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.461+0000 7fddceffd700 1 --2- 172.21.15.125:0/2775245173 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fddbc066f30 0x7fddbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.467 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.461+0000 7fddceffd700 1 --2- 172.21.15.125:0/2775245173 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fddbc066f30 0x7fddbc0693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fddc4001d20 tx=0x7fddc4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:17.468 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.465+0000 7fddb6ffd700 1 -- 172.21.15.125:0/2775245173 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddc0088030 con 0x7fddd016b7a0 2023-10-06T03:06:17.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.644+0000 7fddd5500700 1 -- 172.21.15.125:0/2775245173 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fddd0066510 con 0x7fddd016b7a0 2023-10-06T03:06:17.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.645+0000 7fddb6ffd700 1 -- 172.21.15.125:0/2775245173 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7fddc00522b0 con 0x7fddd016b7a0 2023-10-06T03:06:17.646 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-06T03:06:17.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.646+0000 7fddd5500700 1 -- 172.21.15.125:0/2775245173 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fddbc066f30 msgr2=0x7fddbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.646+0000 7fddd5500700 1 --2- 172.21.15.125:0/2775245173 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fddbc066f30 0x7fddbc0693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fddc4001d20 tx=0x7fddc4009040 comp rx=0 tx=0).stop 2023-10-06T03:06:17.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.646+0000 7fddd5500700 1 -- 172.21.15.125:0/2775245173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddd016b7a0 msgr2=0x7fddd013a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.646+0000 7fddd5500700 1 --2- 172.21.15.125:0/2775245173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddd016b7a0 0x7fddd013a4f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fddc0006ac0 tx=0x7fddc00091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.647+0000 7fddd5500700 1 -- 172.21.15.125:0/2775245173 shutdown_connections 2023-10-06T03:06:17.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.647+0000 7fddd5500700 1 --2- 172.21.15.125:0/2775245173 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fddbc066f30 0x7fddbc0693e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.647+0000 7fddd5500700 1 --2- 172.21.15.125:0/2775245173 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddd016ab80 0x7fddd016b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.647+0000 7fddd5500700 1 --2- 172.21.15.125:0/2775245173 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fddb8004d50 0x7fddd0157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.647+0000 7fddd5500700 1 --2- 172.21.15.125:0/2775245173 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fddd016b7a0 0x7fddd013a4f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.647+0000 7fddd5500700 1 -- 172.21.15.125:0/2775245173 >> 172.21.15.125:0/2775245173 conn(0x7fddd00cdf80 msgr2=0x7fddd00ae190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:17.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.647+0000 7fddd5500700 1 -- 172.21.15.125:0/2775245173 shutdown_connections 2023-10-06T03:06:17.649 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.647+0000 7fddd5500700 1 -- 172.21.15.125:0/2775245173 wait complete. 2023-10-06T03:06:17.660 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:06:17.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.780+0000 7f7c3b588700 1 Processor -- start 2023-10-06T03:06:17.782 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.780+0000 7f7c3b588700 1 -- start start 2023-10-06T03:06:17.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.781+0000 7f7c3b588700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7c34067d20 0x7f7c340caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.781+0000 7f7c3b588700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c340cafe0 con 0x7f7c340ca190 2023-10-06T03:06:17.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.781+0000 7f7c3b588700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c340c3b40 con 0x7f7c340af320 2023-10-06T03:06:17.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.781+0000 7f7c3b588700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c340ca710 con 0x7f7c34067d20 2023-10-06T03:06:17.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.781+0000 7f7c39b25700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7c340ca190 0x7f7c340c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57440/0 (socket says 172.21.15.125:57440) 2023-10-06T03:06:17.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.781+0000 7f7c39b25700 1 -- 172.21.15.125:0/4242810866 learned_addr learned my addr 172.21.15.125:0/4242810866 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:17.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.781+0000 7f7c2bfff700 1 -- 172.21.15.125:0/4242810866 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445856050 0 0) 0x7f7c2c001490 con 0x7f7c340ca190 2023-10-06T03:06:17.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.781+0000 7f7c38b23700 1 --2- 172.21.15.125:0/4242810866 >> v2:172.21.15.130:3300/0 conn(0x7f7c34067d20 0x7f7c340caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.781+0000 7f7c2bfff700 1 -- 172.21.15.125:0/4242810866 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c20003570 con 0x7f7c340ca190 2023-10-06T03:06:17.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c2bfff700 1 -- 172.21.15.125:0/4242810866 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3297328332 0 0) 0x7f7c20003570 con 0x7f7c340ca190 2023-10-06T03:06:17.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c2bfff700 1 -- 172.21.15.125:0/4242810866 >> v2:172.21.15.130:3300/0 conn(0x7f7c34067d20 msgr2=0x7f7c340caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:17.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c2bfff700 1 --2- 172.21.15.125:0/4242810866 >> v2:172.21.15.130:3300/0 conn(0x7f7c34067d20 0x7f7c340caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c2bfff700 1 -- 172.21.15.125:0/4242810866 >> v1:172.21.15.130:6789/0 conn(0x7f7c340af320 legacy=0x7f7c34067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c2bfff700 1 -- 172.21.15.125:0/4242810866 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c340cc750 con 0x7f7c340ca190 2023-10-06T03:06:17.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c2bfff700 1 -- 172.21.15.125:0/4242810866 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f7c2c001980 con 0x7f7c340ca190 2023-10-06T03:06:17.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c2bfff700 1 -- 172.21.15.125:0/4242810866 >> v1:172.21.15.125:6789/0 conn(0x7f7c340ca190 legacy=0x7f7c340c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c2bfff700 1 --2- 172.21.15.125:0/4242810866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c20003a60 0x7f7c20003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c2bfff700 1 --2- 172.21.15.125:0/4242810866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c20004810 0x7f7c20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c2bfff700 1 --2- 172.21.15.125:0/4242810866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c200052e0 0x7f7c2000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c2bfff700 1 -- 172.21.15.125:0/4242810866 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340ca710 con 0x7f7c200052e0 2023-10-06T03:06:17.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c2bfff700 1 -- 172.21.15.125:0/4242810866 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2000c2a0 con 0x7f7c20004810 2023-10-06T03:06:17.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c2bfff700 1 -- 172.21.15.125:0/4242810866 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2000c460 con 0x7f7c20003a60 2023-10-06T03:06:17.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c38b23700 1 --2- 172.21.15.125:0/4242810866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c20004810 0x7f7c20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c39b25700 1 --2- 172.21.15.125:0/4242810866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c200052e0 0x7f7c2000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c39324700 1 --2- 172.21.15.125:0/4242810866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c20003a60 0x7f7c20003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c39b25700 1 -- 172.21.15.125:0/4242810866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c20003a60 msgr2=0x7f7c20003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:17.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c39b25700 1 --2- 172.21.15.125:0/4242810866 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c20003a60 0x7f7c20003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c39b25700 1 -- 172.21.15.125:0/4242810866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c20004810 msgr2=0x7f7c20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:17.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c39b25700 1 --2- 172.21.15.125:0/4242810866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c20004810 0x7f7c20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c39b25700 1 -- 172.21.15.125:0/4242810866 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c20003570 con 0x7f7c200052e0 2023-10-06T03:06:17.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c39b25700 1 -- 172.21.15.125:0/4242810866 reap_dead start 2023-10-06T03:06:17.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c39b25700 1 --2- 172.21.15.125:0/4242810866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c200052e0 0x7f7c2000ba60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00aaa0 tx=0x7f7c2c00a170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d3ed81f7cd8b30 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:17.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c2bfff700 1 -- 172.21.15.125:0/4242810866 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c00c5d0 con 0x7f7c200052e0 2023-10-06T03:06:17.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c2bfff700 1 -- 172.21.15.125:0/4242810866 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c00c750 con 0x7f7c200052e0 2023-10-06T03:06:17.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.782+0000 7f7c2bfff700 1 -- 172.21.15.125:0/4242810866 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c00cb10 con 0x7f7c200052e0 2023-10-06T03:06:17.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.783+0000 7f7c3b588700 1 -- 172.21.15.125:0/4242810866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c200052e0 msgr2=0x7f7c2000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.783+0000 7f7c3b588700 1 --2- 172.21.15.125:0/4242810866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c200052e0 0x7f7c2000ba60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00aaa0 tx=0x7f7c2c00a170 comp rx=0 tx=0).stop 2023-10-06T03:06:17.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.783+0000 7f7c3b588700 1 -- 172.21.15.125:0/4242810866 shutdown_connections 2023-10-06T03:06:17.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.783+0000 7f7c3b588700 1 --2- 172.21.15.125:0/4242810866 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c200052e0 0x7f7c2000ba60 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.783+0000 7f7c3b588700 1 -- 172.21.15.125:0/4242810866 >> 172.21.15.125:0/4242810866 conn(0x7f7c34096120 msgr2=0x7f7c34068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:17.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.783+0000 7f7c3b588700 1 -- 172.21.15.125:0/4242810866 shutdown_connections 2023-10-06T03:06:17.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.783+0000 7f7c3b588700 1 -- 172.21.15.125:0/4242810866 wait complete. 2023-10-06T03:06:17.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.784+0000 7f7c3b588700 1 Processor -- start 2023-10-06T03:06:17.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.784+0000 7f7c3b588700 1 -- start start 2023-10-06T03:06:17.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.785+0000 7f7c3b588700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c200052e0 0x7f7c340c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.785+0000 7f7c3b588700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c3415c220 0x7f7c3415b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.785+0000 7f7c3b588700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c341573a0 0x7f7c3415b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.785+0000 7f7c3b588700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c34147690 con 0x7f7c341573a0 2023-10-06T03:06:17.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.785+0000 7f7c3b588700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340c55c0 con 0x7f7c200052e0 2023-10-06T03:06:17.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.785+0000 7f7c3b588700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340c58a0 con 0x7f7c3415c220 2023-10-06T03:06:17.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.785+0000 7f7c39b25700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c341573a0 0x7f7c3415b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.785+0000 7f7c39b25700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c341573a0 0x7f7c3415b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41570/0 (socket says 172.21.15.125:41570) 2023-10-06T03:06:17.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.785+0000 7f7c39b25700 1 -- 172.21.15.125:0/2897501078 learned_addr learned my addr 172.21.15.125:0/2897501078 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:17.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.785+0000 7f7c39324700 1 --2- 172.21.15.125:0/2897501078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c200052e0 0x7f7c340c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.785+0000 7f7c38b23700 1 --2- 172.21.15.125:0/2897501078 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c3415c220 0x7f7c3415b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.785+0000 7f7c39b25700 1 -- 172.21.15.125:0/2897501078 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c3415c220 msgr2=0x7f7c3415b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.785+0000 7f7c39b25700 1 --2- 172.21.15.125:0/2897501078 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c3415c220 0x7f7c3415b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.785+0000 7f7c39b25700 1 -- 172.21.15.125:0/2897501078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c200052e0 msgr2=0x7f7c340c4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.785+0000 7f7c39b25700 1 --2- 172.21.15.125:0/2897501078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c200052e0 0x7f7c340c4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.785+0000 7f7c39b25700 1 -- 172.21.15.125:0/2897501078 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c340c5b80 con 0x7f7c341573a0 2023-10-06T03:06:17.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.786+0000 7f7c39b25700 1 --2- 172.21.15.125:0/2897501078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c341573a0 0x7f7c3415b570 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c000f80 tx=0x7f7c2c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:17.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.786+0000 7f7c297fa700 1 -- 172.21.15.125:0/2897501078 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c023070 con 0x7f7c341573a0 2023-10-06T03:06:17.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.786+0000 7f7c297fa700 1 -- 172.21.15.125:0/2897501078 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c00c5d0 con 0x7f7c341573a0 2023-10-06T03:06:17.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.786+0000 7f7c3b588700 1 -- 172.21.15.125:0/2897501078 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c34147950 con 0x7f7c341573a0 2023-10-06T03:06:17.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.786+0000 7f7c297fa700 1 -- 172.21.15.125:0/2897501078 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c01e870 con 0x7f7c341573a0 2023-10-06T03:06:17.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.786+0000 7f7c3b588700 1 -- 172.21.15.125:0/2897501078 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3415bab0 con 0x7f7c341573a0 2023-10-06T03:06:17.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.787+0000 7f7c3b588700 1 -- 172.21.15.125:0/2897501078 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c34063540 con 0x7f7c341573a0 2023-10-06T03:06:17.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.787+0000 7f7c297fa700 1 -- 172.21.15.125:0/2897501078 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c2c01ec20 con 0x7f7c341573a0 2023-10-06T03:06:17.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.788+0000 7f7c297fa700 1 --2- 172.21.15.125:0/2897501078 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7c18066f30 0x7f7c180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:17.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.788+0000 7f7c39324700 1 --2- 172.21.15.125:0/2897501078 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7c18066f30 0x7f7c180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:17.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.788+0000 7f7c297fa700 1 -- 172.21.15.125:0/2897501078 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5526+0+0 (secure 0 0 0) 0x7f7c2c085f30 con 0x7f7c341573a0 2023-10-06T03:06:17.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.788+0000 7f7c39324700 1 --2- 172.21.15.125:0/2897501078 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7c18066f30 0x7f7c180693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7c30000c00 tx=0x7f7c30009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:17.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.792+0000 7f7c297fa700 1 -- 172.21.15.125:0/2897501078 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c2c053250 con 0x7f7c341573a0 2023-10-06T03:06:17.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.974+0000 7f7c3b588700 1 -- 172.21.15.125:0/2897501078 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7c340cafe0 con 0x7f7c341573a0 2023-10-06T03:06:17.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.974+0000 7f7c297fa700 1 -- 172.21.15.125:0/2897501078 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v53) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7c340cafe0 con 0x7f7c341573a0 2023-10-06T03:06:17.976 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-06T03:06:17.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.976+0000 7f7c3b588700 1 -- 172.21.15.125:0/2897501078 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7c18066f30 msgr2=0x7f7c180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.976+0000 7f7c3b588700 1 --2- 172.21.15.125:0/2897501078 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7c18066f30 0x7f7c180693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7c30000c00 tx=0x7f7c30009040 comp rx=0 tx=0).stop 2023-10-06T03:06:17.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.976+0000 7f7c3b588700 1 -- 172.21.15.125:0/2897501078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c341573a0 msgr2=0x7f7c3415b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:17.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.976+0000 7f7c3b588700 1 --2- 172.21.15.125:0/2897501078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c341573a0 0x7f7c3415b570 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c000f80 tx=0x7f7c2c016000 comp rx=0 tx=0).stop 2023-10-06T03:06:17.978 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.976+0000 7f7c3b588700 1 -- 172.21.15.125:0/2897501078 shutdown_connections 2023-10-06T03:06:17.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.976+0000 7f7c3b588700 1 --2- 172.21.15.125:0/2897501078 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7c18066f30 0x7f7c180693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.976+0000 7f7c3b588700 1 --2- 172.21.15.125:0/2897501078 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7c341573a0 0x7f7c3415b570 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.976+0000 7f7c3b588700 1 --2- 172.21.15.125:0/2897501078 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c200052e0 0x7f7c340c4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.976+0000 7f7c3b588700 1 --2- 172.21.15.125:0/2897501078 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7c3415c220 0x7f7c3415b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:17.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.976+0000 7f7c3b588700 1 -- 172.21.15.125:0/2897501078 >> 172.21.15.125:0/2897501078 conn(0x7f7c34096120 msgr2=0x7f7c340c30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:17.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.976+0000 7f7c3b588700 1 -- 172.21.15.125:0/2897501078 shutdown_connections 2023-10-06T03:06:17.979 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:17.977+0000 7f7c3b588700 1 -- 172.21.15.125:0/2897501078 wait complete. 2023-10-06T03:06:17.990 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T03:06:18.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.106+0000 7fc22a23a700 1 Processor -- start 2023-10-06T03:06:18.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.106+0000 7fc22a23a700 1 -- start start 2023-10-06T03:06:18.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.107+0000 7fc22a23a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc224159350 0x7fc2240a88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:18.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.107+0000 7fc22a23a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc224159720 0x7fc2240684f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:18.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.107+0000 7fc22a23a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc224068d80 con 0x7fc224067610 2023-10-06T03:06:18.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.107+0000 7fc22a23a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2240af8a0 con 0x7fc224159350 2023-10-06T03:06:18.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.107+0000 7fc22a23a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2240cb420 con 0x7fc224159720 2023-10-06T03:06:18.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.107+0000 7fc2237fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fc224159350 0x7fc2240a88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:18.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.107+0000 7fc223fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc224067610 0x7fc2240c97b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57442/0 (socket says 172.21.15.125:57442) 2023-10-06T03:06:18.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.107+0000 7fc223fff700 1 -- 172.21.15.125:0/3142858150 learned_addr learned my addr 172.21.15.125:0/3142858150 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:18.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.108+0000 7fc222ffd700 1 --2- 172.21.15.125:0/3142858150 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc224159720 0x7fc2240684f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:18.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.108+0000 7fc2237fe700 1 -- 172.21.15.125:0/3142858150 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc224159720 msgr2=0x7fc2240684f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:18.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.108+0000 7fc2237fe700 1 --2- 172.21.15.125:0/3142858150 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc224159720 0x7fc2240684f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:18.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.108+0000 7fc2237fe700 1 -- 172.21.15.125:0/3142858150 >> v1:172.21.15.125:6789/0 conn(0x7fc224067610 legacy=0x7fc2240c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:18.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.108+0000 7fc2237fe700 1 -- 172.21.15.125:0/3142858150 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2240caaf0 con 0x7fc224159350 2023-10-06T03:06:18.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.108+0000 7fc2227fc700 1 -- 172.21.15.125:0/3142858150 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936894769 0 0) 0x7fc224068d80 con 0x7fc224067610 2023-10-06T03:06:18.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.108+0000 7fc2237fe700 1 --2- 172.21.15.125:0/3142858150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc224159350 0x7fc2240a88a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc2140098e0 tx=0x7fc2140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13b40388d014369 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:18.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.108+0000 7fc2227fc700 1 -- 172.21.15.125:0/3142858150 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc214009e80 con 0x7fc224159350 2023-10-06T03:06:18.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.108+0000 7fc2227fc700 1 -- 172.21.15.125:0/3142858150 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21400b860 con 0x7fc224159350 2023-10-06T03:06:18.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.108+0000 7fc2227fc700 1 -- 172.21.15.125:0/3142858150 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21400bbe0 con 0x7fc224159350 2023-10-06T03:06:18.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.108+0000 7fc22a23a700 1 -- 172.21.15.125:0/3142858150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc224159350 msgr2=0x7fc2240a88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:18.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.108+0000 7fc22a23a700 1 --2- 172.21.15.125:0/3142858150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc224159350 0x7fc2240a88a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc2140098e0 tx=0x7fc2140091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:18.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.109+0000 7fc22a23a700 1 -- 172.21.15.125:0/3142858150 shutdown_connections 2023-10-06T03:06:18.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.109+0000 7fc22a23a700 1 --2- 172.21.15.125:0/3142858150 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc224159350 0x7fc2240a88a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:18.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.109+0000 7fc22a23a700 1 --2- 172.21.15.125:0/3142858150 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc224159720 0x7fc2240684f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:18.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.109+0000 7fc22a23a700 1 -- 172.21.15.125:0/3142858150 >> 172.21.15.125:0/3142858150 conn(0x7fc22406b190 msgr2=0x7fc22406b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:18.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.109+0000 7fc22a23a700 1 -- 172.21.15.125:0/3142858150 shutdown_connections 2023-10-06T03:06:18.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.109+0000 7fc22a23a700 1 -- 172.21.15.125:0/3142858150 wait complete. 2023-10-06T03:06:18.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.110+0000 7fc22a23a700 1 Processor -- start 2023-10-06T03:06:18.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.110+0000 7fc22a23a700 1 -- start start 2023-10-06T03:06:18.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc22a23a700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc224067610 0x7fc224156190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:18.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc22a23a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc224159350 0x7fc2240adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:18.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc22a23a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc224159720 0x7fc2240ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:18.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc22a23a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2240afc20 con 0x7fc224159720 2023-10-06T03:06:18.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc22a23a700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2240aff00 con 0x7fc224067610 2023-10-06T03:06:18.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc22a23a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2240b01e0 con 0x7fc224159350 2023-10-06T03:06:18.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc223fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc224159720 0x7fc2240ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:18.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc223fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc224159720 0x7fc2240ac6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41580/0 (socket says 172.21.15.125:41580) 2023-10-06T03:06:18.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc223fff700 1 -- 172.21.15.125:0/2097602335 learned_addr learned my addr 172.21.15.125:0/2097602335 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:18.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc222ffd700 1 --2- 172.21.15.125:0/2097602335 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc224159350 0x7fc2240adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:18.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc2237fe700 1 --2- 172.21.15.125:0/2097602335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc224067610 0x7fc224156190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:18.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc223fff700 1 -- 172.21.15.125:0/2097602335 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc224159350 msgr2=0x7fc2240adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:18.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc223fff700 1 --2- 172.21.15.125:0/2097602335 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc224159350 0x7fc2240adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:18.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc223fff700 1 -- 172.21.15.125:0/2097602335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc224067610 msgr2=0x7fc224156190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:18.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc223fff700 1 --2- 172.21.15.125:0/2097602335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc224067610 0x7fc224156190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:18.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc223fff700 1 -- 172.21.15.125:0/2097602335 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc214009420 con 0x7fc224159720 2023-10-06T03:06:18.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc2237fe700 1 --2- 172.21.15.125:0/2097602335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc224067610 0x7fc224156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:18.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc223fff700 1 --2- 172.21.15.125:0/2097602335 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc224159720 0x7fc2240ac6e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00cc90 tx=0x7fc21c001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:18.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc20b7fe700 1 -- 172.21.15.125:0/2097602335 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c00a960 con 0x7fc224159720 2023-10-06T03:06:18.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc20b7fe700 1 -- 172.21.15.125:0/2097602335 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21c00aac0 con 0x7fc224159720 2023-10-06T03:06:18.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc22a23a700 1 -- 172.21.15.125:0/2097602335 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2240b04c0 con 0x7fc224159720 2023-10-06T03:06:18.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc20b7fe700 1 -- 172.21.15.125:0/2097602335 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c00ae80 con 0x7fc224159720 2023-10-06T03:06:18.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.111+0000 7fc22a23a700 1 -- 172.21.15.125:0/2097602335 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2240b0850 con 0x7fc224159720 2023-10-06T03:06:18.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.112+0000 7fc22a23a700 1 -- 172.21.15.125:0/2097602335 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc22406be50 con 0x7fc224159720 2023-10-06T03:06:18.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.113+0000 7fc20b7fe700 1 -- 172.21.15.125:0/2097602335 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc21c007300 con 0x7fc224159720 2023-10-06T03:06:18.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.113+0000 7fc20b7fe700 1 --2- 172.21.15.125:0/2097602335 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc210066f60 0x7fc210069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:18.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.113+0000 7fc20b7fe700 1 -- 172.21.15.125:0/2097602335 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fc21c084800 con 0x7fc224159720 2023-10-06T03:06:18.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.113+0000 7fc2237fe700 1 --2- 172.21.15.125:0/2097602335 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc210066f60 0x7fc210069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:18.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.114+0000 7fc2237fe700 1 --2- 172.21.15.125:0/2097602335 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc210066f60 0x7fc210069410 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc2140091e0 tx=0x7fc214017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:18.119 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.117+0000 7fc20b7fe700 1 -- 172.21.15.125:0/2097602335 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc21c051ba0 con 0x7fc224159720 2023-10-06T03:06:18.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.302+0000 7fc22a23a700 1 -- 172.21.15.125:0/2097602335 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc224066510 con 0x7fc224159720 2023-10-06T03:06:18.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.302+0000 7fc20b7fe700 1 -- 172.21.15.125:0/2097602335 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v53) v1 ==== 84+0+126 (secure 0 0 0) 0x7fc21c0551c0 con 0x7fc224159720 2023-10-06T03:06:18.306 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:18.306 INFO:teuthology.orchestra.run.smithi125.stdout:[ 2023-10-06T03:06:18.306 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:18.306 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 1, 2023-10-06T03:06:18.306 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": ".mgr" 2023-10-06T03:06:18.306 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:18.306 INFO:teuthology.orchestra.run.smithi125.stdout: { 2023-10-06T03:06:18.307 INFO:teuthology.orchestra.run.smithi125.stdout: "poolnum": 2, 2023-10-06T03:06:18.307 INFO:teuthology.orchestra.run.smithi125.stdout: "poolname": "rbd" 2023-10-06T03:06:18.307 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:18.307 INFO:teuthology.orchestra.run.smithi125.stdout:] 2023-10-06T03:06:18.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.304+0000 7fc22a23a700 1 -- 172.21.15.125:0/2097602335 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc210066f60 msgr2=0x7fc210069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:18.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.304+0000 7fc22a23a700 1 --2- 172.21.15.125:0/2097602335 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc210066f60 0x7fc210069410 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc2140091e0 tx=0x7fc214017000 comp rx=0 tx=0).stop 2023-10-06T03:06:18.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.304+0000 7fc22a23a700 1 -- 172.21.15.125:0/2097602335 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc224159720 msgr2=0x7fc2240ac6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:18.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.304+0000 7fc22a23a700 1 --2- 172.21.15.125:0/2097602335 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc224159720 0x7fc2240ac6e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc21c00cc90 tx=0x7fc21c001a80 comp rx=0 tx=0).stop 2023-10-06T03:06:18.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.304+0000 7fc22a23a700 1 -- 172.21.15.125:0/2097602335 shutdown_connections 2023-10-06T03:06:18.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.304+0000 7fc22a23a700 1 --2- 172.21.15.125:0/2097602335 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc210066f60 0x7fc210069410 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:18.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.304+0000 7fc22a23a700 1 --2- 172.21.15.125:0/2097602335 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc224159720 0x7fc2240ac6e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:18.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.304+0000 7fc22a23a700 1 --2- 172.21.15.125:0/2097602335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc224067610 0x7fc224156190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:18.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.304+0000 7fc22a23a700 1 --2- 172.21.15.125:0/2097602335 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc224159350 0x7fc2240adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:18.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.304+0000 7fc22a23a700 1 -- 172.21.15.125:0/2097602335 >> 172.21.15.125:0/2097602335 conn(0x7fc22406b190 msgr2=0x7fc2241549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:18.308 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.305+0000 7fc22a23a700 1 -- 172.21.15.125:0/2097602335 shutdown_connections 2023-10-06T03:06:18.309 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.305+0000 7fc22a23a700 1 -- 172.21.15.125:0/2097602335 wait complete. 2023-10-06T03:06:18.318 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T03:06:18.318 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T03:06:18.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.437+0000 7fec933f4700 1 Processor -- start 2023-10-06T03:06:18.439 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.438+0000 7fec933f4700 1 -- start start 2023-10-06T03:06:18.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.438+0000 7fec933f4700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fec8c0b0260 0x7fec8c15ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:18.440 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.438+0000 7fec933f4700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8c0c3d80 con 0x7fec8c15ba50 2023-10-06T03:06:18.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.438+0000 7fec933f4700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8c0cea90 con 0x7fec8c0b0630 2023-10-06T03:06:18.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.438+0000 7fec933f4700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8c068420 con 0x7fec8c0b0260 2023-10-06T03:06:18.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.438+0000 7fec91190700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fec8c0b0260 0x7fec8c15ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:18.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.439+0000 7fec91991700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fec8c15ba50 0x7fec8c0c8db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57456/0 (socket says 172.21.15.125:57456) 2023-10-06T03:06:18.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.439+0000 7fec91991700 1 -- 172.21.15.125:0/3351634538 learned_addr learned my addr 172.21.15.125:0/3351634538 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:18.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.439+0000 7fec91190700 1 -- 172.21.15.125:0/3351634538 >> v1:172.21.15.130:6789/0 conn(0x7fec8c0b0630 legacy=0x7fec8c15b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:18.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.439+0000 7fec91190700 1 -- 172.21.15.125:0/3351634538 >> v1:172.21.15.125:6789/0 conn(0x7fec8c15ba50 legacy=0x7fec8c0c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:18.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.439+0000 7fec91190700 1 -- 172.21.15.125:0/3351634538 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c0ced70 con 0x7fec8c0b0260 2023-10-06T03:06:18.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.439+0000 7fec91190700 1 --2- 172.21.15.125:0/3351634538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec8c0b0260 0x7fec8c15ae00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0098d0 tx=0x7fec7c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8266916c307848 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:18.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.439+0000 7fec83fff700 1 -- 172.21.15.125:0/3351634538 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c009e70 con 0x7fec8c0b0260 2023-10-06T03:06:18.441 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.439+0000 7fec83fff700 1 -- 172.21.15.125:0/3351634538 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c005c10 con 0x7fec8c0b0260 2023-10-06T03:06:18.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.439+0000 7fec83fff700 1 -- 172.21.15.125:0/3351634538 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c00b650 con 0x7fec8c0b0260 2023-10-06T03:06:18.442 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.440+0000 7fec933f4700 1 -- 172.21.15.125:0/3351634538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec8c0b0260 msgr2=0x7fec8c15ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:18.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.440+0000 7fec933f4700 1 --2- 172.21.15.125:0/3351634538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec8c0b0260 0x7fec8c15ae00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0098d0 tx=0x7fec7c009120 comp rx=0 tx=0).stop 2023-10-06T03:06:18.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.440+0000 7fec933f4700 1 -- 172.21.15.125:0/3351634538 shutdown_connections 2023-10-06T03:06:18.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.440+0000 7fec933f4700 1 --2- 172.21.15.125:0/3351634538 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec8c0b0260 0x7fec8c15ae00 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:18.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.440+0000 7fec933f4700 1 -- 172.21.15.125:0/3351634538 >> 172.21.15.125:0/3351634538 conn(0x7fec8c067df0 msgr2=0x7fec8c0cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:18.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.440+0000 7fec933f4700 1 -- 172.21.15.125:0/3351634538 shutdown_connections 2023-10-06T03:06:18.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.440+0000 7fec933f4700 1 -- 172.21.15.125:0/3351634538 wait complete. 2023-10-06T03:06:18.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.441+0000 7fec933f4700 1 Processor -- start 2023-10-06T03:06:18.443 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.441+0000 7fec933f4700 1 -- start start 2023-10-06T03:06:18.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec933f4700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec8c0b0260 0x7fec8c0b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:18.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec933f4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec8c0b0630 0x7fec8c0b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:18.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec933f4700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec8c15ba50 0x7fec8c0c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:18.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec933f4700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c0b1740 con 0x7fec8c0b0630 2023-10-06T03:06:18.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec933f4700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c069980 con 0x7fec8c15ba50 2023-10-06T03:06:18.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec933f4700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c0b0e10 con 0x7fec8c0b0260 2023-10-06T03:06:18.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec9098f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec8c0b0630 0x7fec8c0b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:18.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec9098f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec8c0b0630 0x7fec8c0b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41588/0 (socket says 172.21.15.125:41588) 2023-10-06T03:06:18.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec9098f700 1 -- 172.21.15.125:0/2025227512 learned_addr learned my addr 172.21.15.125:0/2025227512 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:18.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec91190700 1 --2- 172.21.15.125:0/2025227512 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec8c0b0260 0x7fec8c0b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:18.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec91991700 1 --2- 172.21.15.125:0/2025227512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec8c15ba50 0x7fec8c0c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:18.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec9098f700 1 -- 172.21.15.125:0/2025227512 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec8c0b0260 msgr2=0x7fec8c0b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:18.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec9098f700 1 --2- 172.21.15.125:0/2025227512 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec8c0b0260 0x7fec8c0b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:18.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec9098f700 1 -- 172.21.15.125:0/2025227512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec8c15ba50 msgr2=0x7fec8c0c7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:18.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec9098f700 1 --2- 172.21.15.125:0/2025227512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec8c15ba50 0x7fec8c0c7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:18.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec9098f700 1 -- 172.21.15.125:0/2025227512 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c0093c0 con 0x7fec8c0b0630 2023-10-06T03:06:18.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec9098f700 1 --2- 172.21.15.125:0/2025227512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec8c0b0630 0x7fec8c0b2240 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fec8800c5d0 tx=0x7fec88007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:18.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec817fa700 1 -- 172.21.15.125:0/2025227512 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec88011590 con 0x7fec8c0b0630 2023-10-06T03:06:18.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec817fa700 1 -- 172.21.15.125:0/2025227512 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec88011710 con 0x7fec8c0b0630 2023-10-06T03:06:18.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec933f4700 1 -- 172.21.15.125:0/2025227512 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8c0b10f0 con 0x7fec8c0b0630 2023-10-06T03:06:18.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.442+0000 7fec817fa700 1 -- 172.21.15.125:0/2025227512 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec88011ad0 con 0x7fec8c0b0630 2023-10-06T03:06:18.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.443+0000 7fec933f4700 1 -- 172.21.15.125:0/2025227512 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec8c0b2d00 con 0x7fec8c0b0630 2023-10-06T03:06:18.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.444+0000 7fec933f4700 1 -- 172.21.15.125:0/2025227512 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec8c0b1590 con 0x7fec8c0b0630 2023-10-06T03:06:18.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.444+0000 7fec817fa700 1 -- 172.21.15.125:0/2025227512 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec8801c460 con 0x7fec8c0b0630 2023-10-06T03:06:18.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.444+0000 7fec817fa700 1 --2- 172.21.15.125:0/2025227512 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fec70066f30 0x7fec700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:18.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.444+0000 7fec91190700 1 --2- 172.21.15.125:0/2025227512 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fec70066f30 0x7fec700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:18.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.444+0000 7fec817fa700 1 -- 172.21.15.125:0/2025227512 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5526+0+0 (secure 0 0 0) 0x7fec88084140 con 0x7fec8c0b0630 2023-10-06T03:06:18.448 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.445+0000 7fec91190700 1 --2- 172.21.15.125:0/2025227512 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fec70066f30 0x7fec700693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fec7c003080 tx=0x7fec7c015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:18.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.448+0000 7fec817fa700 1 -- 172.21.15.125:0/2025227512 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec88051460 con 0x7fec8c0b0630 2023-10-06T03:06:18.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:18.632+0000 7fec933f4700 1 -- 172.21.15.125:0/2025227512 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fec8c0b1880 con 0x7fec8c0b0630 2023-10-06T03:06:19.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.601+0000 7fec817fa700 1 -- 172.21.15.125:0/2025227512 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v54) v1 ==== 138+0+0 (secure 0 0 0) 0x7fec88054a80 con 0x7fec8c0b0630 2023-10-06T03:06:19.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.607+0000 7fec933f4700 1 -- 172.21.15.125:0/2025227512 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fec70066f30 msgr2=0x7fec700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:19.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.607+0000 7fec933f4700 1 --2- 172.21.15.125:0/2025227512 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fec70066f30 0x7fec700693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fec7c003080 tx=0x7fec7c015000 comp rx=0 tx=0).stop 2023-10-06T03:06:19.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.607+0000 7fec933f4700 1 -- 172.21.15.125:0/2025227512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec8c0b0630 msgr2=0x7fec8c0b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:19.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.607+0000 7fec933f4700 1 --2- 172.21.15.125:0/2025227512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec8c0b0630 0x7fec8c0b2240 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fec8800c5d0 tx=0x7fec88007f60 comp rx=0 tx=0).stop 2023-10-06T03:06:19.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.608+0000 7fec933f4700 1 -- 172.21.15.125:0/2025227512 shutdown_connections 2023-10-06T03:06:19.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.608+0000 7fec933f4700 1 --2- 172.21.15.125:0/2025227512 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fec70066f30 0x7fec700693e0 secure :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fec7c003080 tx=0x7fec7c015000 comp rx=0 tx=0).stop 2023-10-06T03:06:19.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.608+0000 7fec933f4700 1 --2- 172.21.15.125:0/2025227512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec8c15ba50 0x7fec8c0c7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:19.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.608+0000 7fec933f4700 1 --2- 172.21.15.125:0/2025227512 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fec8c0b0260 0x7fec8c0b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:19.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.608+0000 7fec933f4700 1 --2- 172.21.15.125:0/2025227512 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fec8c0b0630 0x7fec8c0b2240 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:19.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.608+0000 7fec933f4700 1 -- 172.21.15.125:0/2025227512 >> 172.21.15.125:0/2025227512 conn(0x7fec8c067df0 msgr2=0x7fec8c06c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:19.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.608+0000 7fec933f4700 1 -- 172.21.15.125:0/2025227512 shutdown_connections 2023-10-06T03:06:19.610 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.608+0000 7fec933f4700 1 -- 172.21.15.125:0/2025227512 wait complete. 2023-10-06T03:06:19.611 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_metadata' created 2023-10-06T03:06:19.624 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T03:06:19.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.752+0000 7f9b3813b700 1 Processor -- start 2023-10-06T03:06:19.754 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.752+0000 7f9b3813b700 1 -- start start 2023-10-06T03:06:19.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.753+0000 7f9b3813b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9b300c9d40 0x7f9b300cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:19.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.753+0000 7f9b3813b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b30158570 con 0x7f9b30140c50 2023-10-06T03:06:19.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.753+0000 7f9b3813b700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b30158920 con 0x7f9b300c98a0 2023-10-06T03:06:19.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.753+0000 7f9b3813b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b30157770 con 0x7f9b300c9d40 2023-10-06T03:06:19.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.753+0000 7f9b366d8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9b300c9d40 0x7f9b300cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:19.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.753+0000 7f9b35ed7700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9b30140c50 0x7f9b300cc470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57466/0 (socket says 172.21.15.125:57466) 2023-10-06T03:06:19.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.753+0000 7f9b366d8700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f9b300c9d40 0x7f9b300cb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41594/0 (socket says 172.21.15.125:41594) 2023-10-06T03:06:19.756 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.753+0000 7f9b35ed7700 1 -- 172.21.15.125:0/2060204278 learned_addr learned my addr 172.21.15.125:0/2060204278 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:19.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.753+0000 7f9b366d8700 1 -- 172.21.15.125:0/2060204278 >> v1:172.21.15.130:6789/0 conn(0x7f9b300c98a0 legacy=0x7f9b300caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:19.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.754+0000 7f9b366d8700 1 -- 172.21.15.125:0/2060204278 >> v1:172.21.15.125:6789/0 conn(0x7f9b30140c50 legacy=0x7f9b300cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:19.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.754+0000 7f9b366d8700 1 -- 172.21.15.125:0/2060204278 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b30157960 con 0x7f9b300c9d40 2023-10-06T03:06:19.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.754+0000 7f9b366d8700 1 --2- 172.21.15.125:0/2060204278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b300c9d40 0x7f9b300cb2b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9b28009e60 tx=0x7f9b28009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b475fb068b50a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:19.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.754+0000 7f9b34ed5700 1 -- 172.21.15.125:0/2060204278 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2800e070 con 0x7f9b300c9d40 2023-10-06T03:06:19.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.754+0000 7f9b34ed5700 1 -- 172.21.15.125:0/2060204278 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2800bc30 con 0x7f9b300c9d40 2023-10-06T03:06:19.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.754+0000 7f9b34ed5700 1 -- 172.21.15.125:0/2060204278 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b28012430 con 0x7f9b300c9d40 2023-10-06T03:06:19.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.754+0000 7f9b3813b700 1 -- 172.21.15.125:0/2060204278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b300c9d40 msgr2=0x7f9b300cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:19.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.754+0000 7f9b3813b700 1 --2- 172.21.15.125:0/2060204278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b300c9d40 0x7f9b300cb2b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9b28009e60 tx=0x7f9b28009780 comp rx=0 tx=0).stop 2023-10-06T03:06:19.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.754+0000 7f9b3813b700 1 -- 172.21.15.125:0/2060204278 shutdown_connections 2023-10-06T03:06:19.757 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.754+0000 7f9b3813b700 1 --2- 172.21.15.125:0/2060204278 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b300c9d40 0x7f9b300cb2b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:19.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.754+0000 7f9b3813b700 1 -- 172.21.15.125:0/2060204278 >> 172.21.15.125:0/2060204278 conn(0x7f9b30096120 msgr2=0x7f9b30068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:19.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.755+0000 7f9b3813b700 1 -- 172.21.15.125:0/2060204278 shutdown_connections 2023-10-06T03:06:19.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.755+0000 7f9b3813b700 1 -- 172.21.15.125:0/2060204278 wait complete. 2023-10-06T03:06:19.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.756+0000 7f9b3813b700 1 Processor -- start 2023-10-06T03:06:19.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.756+0000 7f9b3813b700 1 -- start start 2023-10-06T03:06:19.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.756+0000 7f9b3813b700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b300c98a0 0x7f9b3013c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:19.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.756+0000 7f9b3813b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b300c9d40 0x7f9b30159b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:19.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.756+0000 7f9b3813b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b30140c50 0x7f9b3015a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:19.760 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.756+0000 7f9b3813b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3016d220 con 0x7f9b30140c50 2023-10-06T03:06:19.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.756+0000 7f9b3813b700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3016d6b0 con 0x7f9b300c98a0 2023-10-06T03:06:19.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.756+0000 7f9b3813b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3016a140 con 0x7f9b300c9d40 2023-10-06T03:06:19.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.757+0000 7f9b366d8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b30140c50 0x7f9b3015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:19.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.757+0000 7f9b366d8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b30140c50 0x7f9b3015a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41596/0 (socket says 172.21.15.125:41596) 2023-10-06T03:06:19.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.757+0000 7f9b366d8700 1 -- 172.21.15.125:0/3623451939 learned_addr learned my addr 172.21.15.125:0/3623451939 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:19.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.757+0000 7f9b35ed7700 1 --2- 172.21.15.125:0/3623451939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b300c98a0 0x7f9b3013c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:19.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.757+0000 7f9b356d6700 1 --2- 172.21.15.125:0/3623451939 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b300c9d40 0x7f9b30159b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:19.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.757+0000 7f9b366d8700 1 -- 172.21.15.125:0/3623451939 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b300c9d40 msgr2=0x7f9b30159b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:19.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.757+0000 7f9b366d8700 1 --2- 172.21.15.125:0/3623451939 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b300c9d40 0x7f9b30159b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:19.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.757+0000 7f9b366d8700 1 -- 172.21.15.125:0/3623451939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b300c98a0 msgr2=0x7f9b3013c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:19.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.757+0000 7f9b366d8700 1 --2- 172.21.15.125:0/3623451939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b300c98a0 0x7f9b3013c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:19.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.757+0000 7f9b366d8700 1 -- 172.21.15.125:0/3623451939 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b28009a20 con 0x7f9b30140c50 2023-10-06T03:06:19.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.757+0000 7f9b366d8700 1 --2- 172.21.15.125:0/3623451939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b30140c50 0x7f9b3015a050 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9b28003000 tx=0x7f9b28018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:19.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.757+0000 7f9b25ffb700 1 -- 172.21.15.125:0/3623451939 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b28012e90 con 0x7f9b30140c50 2023-10-06T03:06:19.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.757+0000 7f9b25ffb700 1 -- 172.21.15.125:0/3623451939 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2801e640 con 0x7f9b30140c50 2023-10-06T03:06:19.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.757+0000 7f9b3813b700 1 -- 172.21.15.125:0/3623451939 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3016c8f0 con 0x7f9b30140c50 2023-10-06T03:06:19.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.757+0000 7f9b25ffb700 1 -- 172.21.15.125:0/3623451939 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2801e9e0 con 0x7f9b30140c50 2023-10-06T03:06:19.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.757+0000 7f9b3813b700 1 -- 172.21.15.125:0/3623451939 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3016ceb0 con 0x7f9b30140c50 2023-10-06T03:06:19.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.758+0000 7f9b3813b700 1 -- 172.21.15.125:0/3623451939 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b3016d3d0 con 0x7f9b30140c50 2023-10-06T03:06:19.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.759+0000 7f9b25ffb700 1 -- 172.21.15.125:0/3623451939 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b28024070 con 0x7f9b30140c50 2023-10-06T03:06:19.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.759+0000 7f9b25ffb700 1 --2- 172.21.15.125:0/3623451939 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9b14066f30 0x7f9b140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:19.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.759+0000 7f9b25ffb700 1 -- 172.21.15.125:0/3623451939 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5896+0+0 (secure 0 0 0) 0x7f9b28087080 con 0x7f9b30140c50 2023-10-06T03:06:19.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.759+0000 7f9b35ed7700 1 --2- 172.21.15.125:0/3623451939 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9b14066f30 0x7f9b140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:19.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.760+0000 7f9b35ed7700 1 --2- 172.21.15.125:0/3623451939 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9b14066f30 0x7f9b140693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9b20007fd0 tx=0x7f9b20009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:19.765 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.764+0000 7f9b25ffb700 1 -- 172.21.15.125:0/3623451939 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b3016d3d0 con 0x7f9b30140c50 2023-10-06T03:06:19.946 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:19.945+0000 7f9b3813b700 1 -- 172.21.15.125:0/3623451939 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9b30066510 con 0x7f9b30140c50 2023-10-06T03:06:20.609 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.608+0000 7f9b25ffb700 1 -- 172.21.15.125:0/3623451939 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v55) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9b2802c0d0 con 0x7f9b30140c50 2023-10-06T03:06:20.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.612+0000 7f9b3813b700 1 -- 172.21.15.125:0/3623451939 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9b14066f30 msgr2=0x7f9b140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:20.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.612+0000 7f9b3813b700 1 --2- 172.21.15.125:0/3623451939 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9b14066f30 0x7f9b140693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9b20007fd0 tx=0x7f9b20009040 comp rx=0 tx=0).stop 2023-10-06T03:06:20.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.612+0000 7f9b3813b700 1 -- 172.21.15.125:0/3623451939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b30140c50 msgr2=0x7f9b3015a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:20.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.612+0000 7f9b3813b700 1 --2- 172.21.15.125:0/3623451939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b30140c50 0x7f9b3015a050 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9b28003000 tx=0x7f9b28018000 comp rx=0 tx=0).stop 2023-10-06T03:06:20.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.612+0000 7f9b3813b700 1 -- 172.21.15.125:0/3623451939 shutdown_connections 2023-10-06T03:06:20.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.612+0000 7f9b3813b700 1 --2- 172.21.15.125:0/3623451939 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9b14066f30 0x7f9b140693e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:20.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.612+0000 7f9b3813b700 1 --2- 172.21.15.125:0/3623451939 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9b30140c50 0x7f9b3015a050 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:20.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.612+0000 7f9b3813b700 1 --2- 172.21.15.125:0/3623451939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b300c98a0 0x7f9b3013c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:20.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.612+0000 7f9b3813b700 1 --2- 172.21.15.125:0/3623451939 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9b300c9d40 0x7f9b30159b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:20.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.612+0000 7f9b3813b700 1 -- 172.21.15.125:0/3623451939 >> 172.21.15.125:0/3623451939 conn(0x7f9b30096120 msgr2=0x7f9b3006bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:20.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.613+0000 7f9b3813b700 1 -- 172.21.15.125:0/3623451939 shutdown_connections 2023-10-06T03:06:20.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.613+0000 7f9b3813b700 1 -- 172.21.15.125:0/3623451939 wait complete. 2023-10-06T03:06:20.620 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data' created 2023-10-06T03:06:20.637 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T03:06:20.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.757+0000 7fd478126700 1 Processor -- start 2023-10-06T03:06:20.758 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.757+0000 7fd478126700 1 -- start start 2023-10-06T03:06:20.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.758+0000 7fd478126700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd47015cef0 0x7fd4700b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:20.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.758+0000 7fd478126700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47015d360 con 0x7fd4700cc4d0 2023-10-06T03:06:20.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.758+0000 7fd478126700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47015d640 con 0x7fd4700b01a0 2023-10-06T03:06:20.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.758+0000 7fd478126700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd470068e60 con 0x7fd47015cef0 2023-10-06T03:06:20.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.758+0000 7fd4766c3700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd4700cc4d0 0x7fd4700cc930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57470/0 (socket says 172.21.15.125:57470) 2023-10-06T03:06:20.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.758+0000 7fd4766c3700 1 -- 172.21.15.125:0/3722634069 learned_addr learned my addr 172.21.15.125:0/3722634069 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:20.761 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.758+0000 7fd4756c1700 1 --2- 172.21.15.125:0/3722634069 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd47015cef0 0x7fd4700b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:20.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.758+0000 7fd474ec0700 1 -- 172.21.15.125:0/3722634069 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835352067 0 0) 0x7fd47015d360 con 0x7fd4700cc4d0 2023-10-06T03:06:20.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.758+0000 7fd474ec0700 1 -- 172.21.15.125:0/3722634069 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd45c003570 con 0x7fd4700cc4d0 2023-10-06T03:06:20.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.758+0000 7fd474ec0700 1 -- 172.21.15.125:0/3722634069 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423975978 0 0) 0x7fd47015d640 con 0x7fd4700b01a0 2023-10-06T03:06:20.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.759+0000 7fd474ec0700 1 -- 172.21.15.125:0/3722634069 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd47015d360 con 0x7fd4700b01a0 2023-10-06T03:06:20.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.759+0000 7fd4756c1700 1 -- 172.21.15.125:0/3722634069 >> v1:172.21.15.130:6789/0 conn(0x7fd4700b01a0 legacy=0x7fd47015a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:20.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.759+0000 7fd4756c1700 1 -- 172.21.15.125:0/3722634069 >> v1:172.21.15.125:6789/0 conn(0x7fd4700cc4d0 legacy=0x7fd4700cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:20.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.759+0000 7fd474ec0700 1 -- 172.21.15.125:0/3722634069 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3261588407 0 0) 0x7fd45c003570 con 0x7fd4700cc4d0 2023-10-06T03:06:20.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.759+0000 7fd4756c1700 1 -- 172.21.15.125:0/3722634069 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47015d920 con 0x7fd47015cef0 2023-10-06T03:06:20.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.759+0000 7fd4756c1700 1 --2- 172.21.15.125:0/3722634069 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd47015cef0 0x7fd4700b0570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd460009910 tx=0x7fd4600091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b23a924a7dcd2d0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:20.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.759+0000 7fd474ec0700 1 -- 172.21.15.125:0/3722634069 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4680017f0 con 0x7fd47015cef0 2023-10-06T03:06:20.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.759+0000 7fd474ec0700 1 -- 172.21.15.125:0/3722634069 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd460011420 con 0x7fd47015cef0 2023-10-06T03:06:20.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.759+0000 7fd474ec0700 1 -- 172.21.15.125:0/3722634069 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4600117c0 con 0x7fd47015cef0 2023-10-06T03:06:20.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.759+0000 7fd478126700 1 -- 172.21.15.125:0/3722634069 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd47015cef0 msgr2=0x7fd4700b0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:20.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.759+0000 7fd478126700 1 --2- 172.21.15.125:0/3722634069 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd47015cef0 0x7fd4700b0570 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd460009910 tx=0x7fd4600091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:20.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.759+0000 7fd478126700 1 -- 172.21.15.125:0/3722634069 shutdown_connections 2023-10-06T03:06:20.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.760+0000 7fd478126700 1 --2- 172.21.15.125:0/3722634069 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd47015cef0 0x7fd4700b0570 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:20.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.760+0000 7fd478126700 1 -- 172.21.15.125:0/3722634069 >> 172.21.15.125:0/3722634069 conn(0x7fd4700cdf80 msgr2=0x7fd4700ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:20.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.760+0000 7fd478126700 1 -- 172.21.15.125:0/3722634069 shutdown_connections 2023-10-06T03:06:20.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.760+0000 7fd478126700 1 -- 172.21.15.125:0/3722634069 wait complete. 2023-10-06T03:06:20.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.761+0000 7fd478126700 1 Processor -- start 2023-10-06T03:06:20.766 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.761+0000 7fd478126700 1 -- start start 2023-10-06T03:06:20.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.761+0000 7fd478126700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4700b01a0 0x7fd4700b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:20.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.761+0000 7fd478126700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4700cc4d0 0x7fd470152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:20.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.761+0000 7fd478126700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd47015cef0 0x7fd470069860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:20.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.761+0000 7fd478126700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4700c6220 con 0x7fd4700cc4d0 2023-10-06T03:06:20.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.761+0000 7fd478126700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd470156d50 con 0x7fd4700b01a0 2023-10-06T03:06:20.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.761+0000 7fd478126700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4700b16b0 con 0x7fd47015cef0 2023-10-06T03:06:20.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.761+0000 7fd4756c1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4700cc4d0 0x7fd470152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:20.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.762+0000 7fd4756c1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4700cc4d0 0x7fd470152300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41612/0 (socket says 172.21.15.125:41612) 2023-10-06T03:06:20.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.762+0000 7fd4756c1700 1 -- 172.21.15.125:0/3933578657 learned_addr learned my addr 172.21.15.125:0/3933578657 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:20.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.762+0000 7fd475ec2700 1 --2- 172.21.15.125:0/3933578657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4700b01a0 0x7fd4700b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:20.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.762+0000 7fd4766c3700 1 --2- 172.21.15.125:0/3933578657 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd47015cef0 0x7fd470069860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:20.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.762+0000 7fd4756c1700 1 -- 172.21.15.125:0/3933578657 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd47015cef0 msgr2=0x7fd470069860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:20.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.762+0000 7fd4756c1700 1 --2- 172.21.15.125:0/3933578657 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd47015cef0 0x7fd470069860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:20.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.762+0000 7fd4756c1700 1 -- 172.21.15.125:0/3933578657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4700b01a0 msgr2=0x7fd4700b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:20.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.762+0000 7fd4756c1700 1 --2- 172.21.15.125:0/3933578657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4700b01a0 0x7fd4700b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:20.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.762+0000 7fd4756c1700 1 -- 172.21.15.125:0/3933578657 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd460009420 con 0x7fd4700cc4d0 2023-10-06T03:06:20.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.762+0000 7fd4756c1700 1 --2- 172.21.15.125:0/3933578657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4700cc4d0 0x7fd470152300 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd4600091e0 tx=0x7fd460016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:20.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.762+0000 7fd465ffb700 1 -- 172.21.15.125:0/3933578657 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46001cb30 con 0x7fd4700cc4d0 2023-10-06T03:06:20.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.762+0000 7fd465ffb700 1 -- 172.21.15.125:0/3933578657 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46001cc90 con 0x7fd4700cc4d0 2023-10-06T03:06:20.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.762+0000 7fd478126700 1 -- 172.21.15.125:0/3933578657 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4700b1990 con 0x7fd4700cc4d0 2023-10-06T03:06:20.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.762+0000 7fd465ffb700 1 -- 172.21.15.125:0/3933578657 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46001a6a0 con 0x7fd4700cc4d0 2023-10-06T03:06:20.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.762+0000 7fd478126700 1 -- 172.21.15.125:0/3933578657 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4700b1f50 con 0x7fd4700cc4d0 2023-10-06T03:06:20.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.763+0000 7fd478126700 1 -- 172.21.15.125:0/3933578657 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd470066510 con 0x7fd4700cc4d0 2023-10-06T03:06:20.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.764+0000 7fd465ffb700 1 -- 172.21.15.125:0/3933578657 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd46001aa90 con 0x7fd4700cc4d0 2023-10-06T03:06:20.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.764+0000 7fd465ffb700 1 --2- 172.21.15.125:0/3933578657 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd454066f30 0x7fd4540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:20.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.764+0000 7fd465ffb700 1 -- 172.21.15.125:0/3933578657 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6278+0+0 (secure 0 0 0) 0x7fd460086510 con 0x7fd4700cc4d0 2023-10-06T03:06:20.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.764+0000 7fd475ec2700 1 --2- 172.21.15.125:0/3933578657 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd454066f30 0x7fd4540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:20.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.764+0000 7fd475ec2700 1 --2- 172.21.15.125:0/3933578657 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd454066f30 0x7fd4540693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd470152b90 tx=0x7fd46c007d50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:20.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.768+0000 7fd465ffb700 1 -- 172.21.15.125:0/3933578657 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd460053540 con 0x7fd4700cc4d0 2023-10-06T03:06:20.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:20.994+0000 7fd478126700 1 -- 172.21.15.125:0/3933578657 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd47015dc00 con 0x7fd4700cc4d0 2023-10-06T03:06:21.612 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.611+0000 7fd465ffb700 1 -- 172.21.15.125:0/3933578657 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v23) v1 ==== 173+0+0 (secure 0 0 0) 0x7fd460056b60 con 0x7fd4700cc4d0 2023-10-06T03:06:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.617+0000 7fd478126700 1 -- 172.21.15.125:0/3933578657 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd454066f30 msgr2=0x7fd4540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.617+0000 7fd478126700 1 --2- 172.21.15.125:0/3933578657 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd454066f30 0x7fd4540693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd470152b90 tx=0x7fd46c007d50 comp rx=0 tx=0).stop 2023-10-06T03:06:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.617+0000 7fd478126700 1 -- 172.21.15.125:0/3933578657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4700cc4d0 msgr2=0x7fd470152300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.617+0000 7fd478126700 1 --2- 172.21.15.125:0/3933578657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4700cc4d0 0x7fd470152300 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd4600091e0 tx=0x7fd460016000 comp rx=0 tx=0).stop 2023-10-06T03:06:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.617+0000 7fd478126700 1 -- 172.21.15.125:0/3933578657 shutdown_connections 2023-10-06T03:06:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.617+0000 7fd478126700 1 --2- 172.21.15.125:0/3933578657 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd454066f30 0x7fd4540693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.617+0000 7fd478126700 1 --2- 172.21.15.125:0/3933578657 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd47015cef0 0x7fd470069860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.617+0000 7fd478126700 1 --2- 172.21.15.125:0/3933578657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd4700b01a0 0x7fd4700b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:21.619 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.617+0000 7fd478126700 1 --2- 172.21.15.125:0/3933578657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4700cc4d0 0x7fd470152300 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:21.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.617+0000 7fd478126700 1 -- 172.21.15.125:0/3933578657 >> 172.21.15.125:0/3933578657 conn(0x7fd4700cdf80 msgr2=0x7fd4700c9b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:21.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.617+0000 7fd478126700 1 -- 172.21.15.125:0/3933578657 shutdown_connections 2023-10-06T03:06:21.620 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.618+0000 7fd478126700 1 -- 172.21.15.125:0/3933578657 wait complete. 2023-10-06T03:06:21.620 INFO:teuthology.orchestra.run.smithi125.stderr:new fs with metadata pool 9 and data pool 10 2023-10-06T03:06:21.641 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:06:21.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.758+0000 7f5775f96700 1 Processor -- start 2023-10-06T03:06:21.759 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.758+0000 7f5775f96700 1 -- start start 2023-10-06T03:06:21.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.758+0000 7f5775f96700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f57700cc4b0 0x7f57700c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:21.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.758+0000 7f5775f96700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f57700c3d30 0x7f5770069510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:21.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.758+0000 7f5775f96700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57700c4230 con 0x7f57700ce8a0 2023-10-06T03:06:21.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.758+0000 7f5775f96700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57700cd290 con 0x7f57700cc4b0 2023-10-06T03:06:21.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.758+0000 7f5775f96700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57700cd570 con 0x7f57700c3d30 2023-10-06T03:06:21.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.759+0000 7f576f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f57700cc4b0 0x7f57700c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:21.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.759+0000 7f576f7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f57700cc4b0 0x7f57700c85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41626/0 (socket says 172.21.15.125:41626) 2023-10-06T03:06:21.762 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.759+0000 7f576effd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f57700ce8a0 0x7f57700cc880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57472/0 (socket says 172.21.15.125:57472) 2023-10-06T03:06:21.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.759+0000 7f576f7fe700 1 -- 172.21.15.125:0/163192395 learned_addr learned my addr 172.21.15.125:0/163192395 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:21.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.759+0000 7f576f7fe700 1 -- 172.21.15.125:0/163192395 >> v2:172.21.15.130:3300/0 conn(0x7f57700c3d30 msgr2=0x7f5770069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:21.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.759+0000 7f576f7fe700 1 --2- 172.21.15.125:0/163192395 >> v2:172.21.15.130:3300/0 conn(0x7f57700c3d30 0x7f5770069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:21.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.759+0000 7f576f7fe700 1 -- 172.21.15.125:0/163192395 >> v1:172.21.15.125:6789/0 conn(0x7f57700ce8a0 legacy=0x7f57700cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:21.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.759+0000 7f576f7fe700 1 -- 172.21.15.125:0/163192395 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57700ccf90 con 0x7f57700cc4b0 2023-10-06T03:06:21.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.759+0000 7f576e7fc700 1 -- 172.21.15.125:0/163192395 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54353792 0 0) 0x7f57700c4230 con 0x7f57700ce8a0 2023-10-06T03:06:21.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.759+0000 7f576f7fe700 1 --2- 172.21.15.125:0/163192395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57700cc4b0 0x7f57700c85c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5770088300 tx=0x7f5760009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba804a8d0f3e8040 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:21.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.759+0000 7f576e7fc700 1 -- 172.21.15.125:0/163192395 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576000b860 con 0x7f57700cc4b0 2023-10-06T03:06:21.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.759+0000 7f576e7fc700 1 -- 172.21.15.125:0/163192395 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576000b9c0 con 0x7f57700cc4b0 2023-10-06T03:06:21.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.759+0000 7f576e7fc700 1 -- 172.21.15.125:0/163192395 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576000bd60 con 0x7f57700cc4b0 2023-10-06T03:06:21.763 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.760+0000 7f5775f96700 1 -- 172.21.15.125:0/163192395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57700cc4b0 msgr2=0x7f57700c85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:21.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.760+0000 7f5775f96700 1 --2- 172.21.15.125:0/163192395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57700cc4b0 0x7f57700c85c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5770088300 tx=0x7f5760009250 comp rx=0 tx=0).stop 2023-10-06T03:06:21.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.760+0000 7f5775f96700 1 -- 172.21.15.125:0/163192395 shutdown_connections 2023-10-06T03:06:21.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.760+0000 7f5775f96700 1 --2- 172.21.15.125:0/163192395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57700cc4b0 0x7f57700c85c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:21.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.760+0000 7f5775f96700 1 --2- 172.21.15.125:0/163192395 >> v2:172.21.15.130:3300/0 conn(0x7f57700c3d30 0x7f5770069510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:21.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.760+0000 7f5775f96700 1 -- 172.21.15.125:0/163192395 >> 172.21.15.125:0/163192395 conn(0x7f5770067df0 msgr2=0x7f57700cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:21.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.760+0000 7f5775f96700 1 -- 172.21.15.125:0/163192395 shutdown_connections 2023-10-06T03:06:21.764 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.760+0000 7f5775f96700 1 -- 172.21.15.125:0/163192395 wait complete. 2023-10-06T03:06:21.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.761+0000 7f5775f96700 1 Processor -- start 2023-10-06T03:06:21.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.761+0000 7f5775f96700 1 -- start start 2023-10-06T03:06:21.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.762+0000 7f5775f96700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57700c3d30 0x7f577016c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:21.767 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.762+0000 7f5775f96700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57700cc4b0 0x7f57700b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:21.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.762+0000 7f5775f96700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57700ce8a0 0x7f57700b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:21.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.762+0000 7f5775f96700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577014c810 con 0x7f57700cc4b0 2023-10-06T03:06:21.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.762+0000 7f5775f96700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577014bc00 con 0x7f57700ce8a0 2023-10-06T03:06:21.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.762+0000 7f5775f96700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f577014bee0 con 0x7f57700c3d30 2023-10-06T03:06:21.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.762+0000 7f576effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57700cc4b0 0x7f57700b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:21.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.762+0000 7f576effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57700cc4b0 0x7f57700b2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41634/0 (socket says 172.21.15.125:41634) 2023-10-06T03:06:21.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.762+0000 7f576effd700 1 -- 172.21.15.125:0/2411952979 learned_addr learned my addr 172.21.15.125:0/2411952979 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:21.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.762+0000 7f576f7fe700 1 --2- 172.21.15.125:0/2411952979 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57700c3d30 0x7f577016c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:21.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.762+0000 7f576ffff700 1 --2- 172.21.15.125:0/2411952979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57700ce8a0 0x7f57700b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:21.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.763+0000 7f576effd700 1 -- 172.21.15.125:0/2411952979 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57700c3d30 msgr2=0x7f577016c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:21.768 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.763+0000 7f576effd700 1 --2- 172.21.15.125:0/2411952979 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57700c3d30 0x7f577016c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:21.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.763+0000 7f576effd700 1 -- 172.21.15.125:0/2411952979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57700ce8a0 msgr2=0x7f57700b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:21.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.763+0000 7f576effd700 1 --2- 172.21.15.125:0/2411952979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57700ce8a0 0x7f57700b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:21.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.763+0000 7f576effd700 1 -- 172.21.15.125:0/2411952979 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57600094f0 con 0x7f57700cc4b0 2023-10-06T03:06:21.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.763+0000 7f576ffff700 1 --2- 172.21.15.125:0/2411952979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57700ce8a0 0x7f57700b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:21.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.763+0000 7f576effd700 1 --2- 172.21.15.125:0/2411952979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57700cc4b0 0x7f57700b2da0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f576400c5b0 tx=0x7f5764001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:21.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.763+0000 7f57577fe700 1 -- 172.21.15.125:0/2411952979 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5764005a70 con 0x7f57700cc4b0 2023-10-06T03:06:21.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.763+0000 7f57577fe700 1 -- 172.21.15.125:0/2411952979 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5764005bd0 con 0x7f57700cc4b0 2023-10-06T03:06:21.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.763+0000 7f5775f96700 1 -- 172.21.15.125:0/2411952979 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f577014c1c0 con 0x7f57700cc4b0 2023-10-06T03:06:21.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.763+0000 7f57577fe700 1 -- 172.21.15.125:0/2411952979 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57640070d0 con 0x7f57700cc4b0 2023-10-06T03:06:21.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.763+0000 7f5775f96700 1 -- 172.21.15.125:0/2411952979 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577016cb80 con 0x7f57700cc4b0 2023-10-06T03:06:21.769 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.764+0000 7f5775f96700 1 -- 172.21.15.125:0/2411952979 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577014c950 con 0x7f57700cc4b0 2023-10-06T03:06:21.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.764+0000 7f57577fe700 1 -- 172.21.15.125:0/2411952979 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5764007480 con 0x7f57700cc4b0 2023-10-06T03:06:21.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.764+0000 7f57577fe700 1 --2- 172.21.15.125:0/2411952979 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f575c066f30 0x7f575c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:21.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.765+0000 7f57577fe700 1 -- 172.21.15.125:0/2411952979 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5764083cb0 con 0x7f57700cc4b0 2023-10-06T03:06:21.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.765+0000 7f576f7fe700 1 --2- 172.21.15.125:0/2411952979 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f575c066f30 0x7f575c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:21.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.765+0000 7f576f7fe700 1 --2- 172.21.15.125:0/2411952979 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f575c066f30 0x7f575c0693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5770088300 tx=0x7f5760017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:21.770 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.769+0000 7f57577fe700 1 -- 172.21.15.125:0/2411952979 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f577014c950 con 0x7f57700cc4b0 2023-10-06T03:06:21.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.953+0000 7f5775f96700 1 -- 172.21.15.125:0/2411952979 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f577014c950 con 0x7f57700cc4b0 2023-10-06T03:06:21.955 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.954+0000 7f57577fe700 1 -- 172.21.15.125:0/2411952979 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+17230 (secure 0 0 0) 0x7f577014c950 con 0x7f57700cc4b0 2023-10-06T03:06:21.956 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:21.956 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":56,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:06:20.995826+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:06:18.650188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T03:06:19.963528+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:06:21.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.956+0000 7f5775f96700 1 -- 172.21.15.125:0/2411952979 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f575c066f30 msgr2=0x7f575c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:21.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.956+0000 7f5775f96700 1 --2- 172.21.15.125:0/2411952979 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f575c066f30 0x7f575c0693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5770088300 tx=0x7f5760017000 comp rx=0 tx=0).stop 2023-10-06T03:06:21.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.956+0000 7f5775f96700 1 -- 172.21.15.125:0/2411952979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57700cc4b0 msgr2=0x7f57700b2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:21.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.956+0000 7f5775f96700 1 --2- 172.21.15.125:0/2411952979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57700cc4b0 0x7f57700b2da0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f576400c5b0 tx=0x7f5764001040 comp rx=0 tx=0).stop 2023-10-06T03:06:21.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.956+0000 7f5775f96700 1 -- 172.21.15.125:0/2411952979 shutdown_connections 2023-10-06T03:06:21.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.956+0000 7f5775f96700 1 --2- 172.21.15.125:0/2411952979 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f575c066f30 0x7f575c0693e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:21.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.956+0000 7f5775f96700 1 --2- 172.21.15.125:0/2411952979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f57700ce8a0 0x7f57700b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:21.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.956+0000 7f5775f96700 1 --2- 172.21.15.125:0/2411952979 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f57700c3d30 0x7f577016c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:21.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.956+0000 7f5775f96700 1 --2- 172.21.15.125:0/2411952979 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f57700cc4b0 0x7f57700b2da0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:21.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.956+0000 7f5775f96700 1 -- 172.21.15.125:0/2411952979 >> 172.21.15.125:0/2411952979 conn(0x7f5770067df0 msgr2=0x7f57700ca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:21.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.956+0000 7f5775f96700 1 -- 172.21.15.125:0/2411952979 shutdown_connections 2023-10-06T03:06:21.959 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:21.956+0000 7f5775f96700 1 -- 172.21.15.125:0/2411952979 wait complete. 2023-10-06T03:06:21.970 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:06:22.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.086+0000 7fd0a737f700 1 Processor -- start 2023-10-06T03:06:22.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.086+0000 7fd0a737f700 1 -- start start 2023-10-06T03:06:22.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.086+0000 7fd0a737f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd0a00ac670 0x7fd0a00c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:22.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.086+0000 7fd0a737f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a0067c70 con 0x7fd0a01590d0 2023-10-06T03:06:22.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.087+0000 7fd0a737f700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a00c77e0 con 0x7fd0a006afd0 2023-10-06T03:06:22.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.087+0000 7fd0a737f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a00c7ac0 con 0x7fd0a00ac670 2023-10-06T03:06:22.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.087+0000 7fd0a491a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fd0a00ac670 0x7fd0a00c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:22.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.087+0000 7fd0a511b700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd0a01590d0 0x7fd0a006a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57474/0 (socket says 172.21.15.125:57474) 2023-10-06T03:06:22.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.087+0000 7fd0a511b700 1 -- 172.21.15.125:0/25102634 learned_addr learned my addr 172.21.15.125:0/25102634 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:22.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.087+0000 7fd0a491a700 1 -- 172.21.15.125:0/25102634 >> v1:172.21.15.130:6789/0 conn(0x7fd0a006afd0 legacy=0x7fd0a0068100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:22.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.087+0000 7fd0a491a700 1 -- 172.21.15.125:0/25102634 >> v1:172.21.15.125:6789/0 conn(0x7fd0a01590d0 legacy=0x7fd0a006a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:22.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.087+0000 7fd0a491a700 1 -- 172.21.15.125:0/25102634 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a00c7da0 con 0x7fd0a00ac670 2023-10-06T03:06:22.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.087+0000 7fd0a491a700 1 --2- 172.21.15.125:0/25102634 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a00ac670 0x7fd0a00c6b40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0098e0 tx=0x7fd09c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b56ac1ae120408f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:22.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.087+0000 7fd093fff700 1 -- 172.21.15.125:0/25102634 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c009e80 con 0x7fd0a00ac670 2023-10-06T03:06:22.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.087+0000 7fd093fff700 1 -- 172.21.15.125:0/25102634 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09c00b860 con 0x7fd0a00ac670 2023-10-06T03:06:22.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.087+0000 7fd093fff700 1 -- 172.21.15.125:0/25102634 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c00bbe0 con 0x7fd0a00ac670 2023-10-06T03:06:22.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.088+0000 7fd0a737f700 1 -- 172.21.15.125:0/25102634 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a00ac670 msgr2=0x7fd0a00c6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:22.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.088+0000 7fd0a737f700 1 --2- 172.21.15.125:0/25102634 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a00ac670 0x7fd0a00c6b40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0098e0 tx=0x7fd09c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:22.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.088+0000 7fd0a737f700 1 -- 172.21.15.125:0/25102634 shutdown_connections 2023-10-06T03:06:22.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.088+0000 7fd0a737f700 1 --2- 172.21.15.125:0/25102634 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a00ac670 0x7fd0a00c6b40 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:22.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.088+0000 7fd0a737f700 1 -- 172.21.15.125:0/25102634 >> 172.21.15.125:0/25102634 conn(0x7fd0a00cc5a0 msgr2=0x7fd0a00cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:22.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.088+0000 7fd0a737f700 1 -- 172.21.15.125:0/25102634 shutdown_connections 2023-10-06T03:06:22.091 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.088+0000 7fd0a737f700 1 -- 172.21.15.125:0/25102634 wait complete. 2023-10-06T03:06:22.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.089+0000 7fd0a737f700 1 Processor -- start 2023-10-06T03:06:22.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.089+0000 7fd0a737f700 1 -- start start 2023-10-06T03:06:22.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.090+0000 7fd0a737f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a006afd0 0x7fd0a0149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:22.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.090+0000 7fd0a737f700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0a00ac670 0x7fd0a015a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:22.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.090+0000 7fd0a737f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0a01590d0 0x7fd0a015c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:22.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.090+0000 7fd0a737f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a015d100 con 0x7fd0a006afd0 2023-10-06T03:06:22.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.090+0000 7fd0a737f700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a00aa440 con 0x7fd0a00ac670 2023-10-06T03:06:22.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.090+0000 7fd0a737f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a00a9b10 con 0x7fd0a01590d0 2023-10-06T03:06:22.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.090+0000 7fd0a511b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a006afd0 0x7fd0a0149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:22.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.090+0000 7fd0a511b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a006afd0 0x7fd0a0149b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41656/0 (socket says 172.21.15.125:41656) 2023-10-06T03:06:22.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.090+0000 7fd0a511b700 1 -- 172.21.15.125:0/2353445958 learned_addr learned my addr 172.21.15.125:0/2353445958 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:22.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.090+0000 7fd0a491a700 1 --2- 172.21.15.125:0/2353445958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0a00ac670 0x7fd0a015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:22.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.090+0000 7fd0a591c700 1 --2- 172.21.15.125:0/2353445958 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0a01590d0 0x7fd0a015c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:22.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.090+0000 7fd0a511b700 1 -- 172.21.15.125:0/2353445958 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0a01590d0 msgr2=0x7fd0a015c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:22.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.090+0000 7fd0a511b700 1 --2- 172.21.15.125:0/2353445958 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0a01590d0 0x7fd0a015c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:22.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.090+0000 7fd0a511b700 1 -- 172.21.15.125:0/2353445958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0a00ac670 msgr2=0x7fd0a015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:22.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.090+0000 7fd0a511b700 1 --2- 172.21.15.125:0/2353445958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0a00ac670 0x7fd0a015a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:22.095 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.090+0000 7fd0a511b700 1 -- 172.21.15.125:0/2353445958 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c009420 con 0x7fd0a006afd0 2023-10-06T03:06:22.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.090+0000 7fd0a591c700 1 --2- 172.21.15.125:0/2353445958 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0a01590d0 0x7fd0a015c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:22.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.090+0000 7fd0a511b700 1 --2- 172.21.15.125:0/2353445958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a006afd0 0x7fd0a0149b40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd09400c560 tx=0x7fd094001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:22.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.091+0000 7fd0917fa700 1 -- 172.21.15.125:0/2353445958 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd094005b30 con 0x7fd0a006afd0 2023-10-06T03:06:22.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.091+0000 7fd0917fa700 1 -- 172.21.15.125:0/2353445958 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd094005cb0 con 0x7fd0a006afd0 2023-10-06T03:06:22.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.091+0000 7fd0a737f700 1 -- 172.21.15.125:0/2353445958 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a00a9df0 con 0x7fd0a006afd0 2023-10-06T03:06:22.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.091+0000 7fd0917fa700 1 -- 172.21.15.125:0/2353445958 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd094007320 con 0x7fd0a006afd0 2023-10-06T03:06:22.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.091+0000 7fd0a737f700 1 -- 172.21.15.125:0/2353445958 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a015cda0 con 0x7fd0a006afd0 2023-10-06T03:06:22.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.092+0000 7fd0a737f700 1 -- 172.21.15.125:0/2353445958 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a0066510 con 0x7fd0a006afd0 2023-10-06T03:06:22.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.092+0000 7fd0917fa700 1 -- 172.21.15.125:0/2353445958 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd09401b3b0 con 0x7fd0a006afd0 2023-10-06T03:06:22.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.092+0000 7fd0917fa700 1 --2- 172.21.15.125:0/2353445958 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd084066f30 0x7fd0840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:22.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.092+0000 7fd0917fa700 1 -- 172.21.15.125:0/2353445958 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd094083cf0 con 0x7fd0a006afd0 2023-10-06T03:06:22.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.092+0000 7fd0a491a700 1 --2- 172.21.15.125:0/2353445958 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd084066f30 0x7fd0840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:22.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.093+0000 7fd0a491a700 1 --2- 172.21.15.125:0/2353445958 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd084066f30 0x7fd0840693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00aca70 tx=0x7fd09c017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:22.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.096+0000 7fd0917fa700 1 -- 172.21.15.125:0/2353445958 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd094088070 con 0x7fd0a006afd0 2023-10-06T03:06:22.279 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.278+0000 7fd0a737f700 1 -- 172.21.15.125:0/2353445958 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0a006ac40 con 0x7fd0a006afd0 2023-10-06T03:06:22.280 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.279+0000 7fd0917fa700 1 -- 172.21.15.125:0/2353445958 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+17230 (secure 0 0 0) 0x7fd094017020 con 0x7fd0a006afd0 2023-10-06T03:06:22.280 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:22.281 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":56,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:06:20.995826+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:06:18.650188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T03:06:19.963528+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:06:22.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.281+0000 7fd0a737f700 1 -- 172.21.15.125:0/2353445958 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd084066f30 msgr2=0x7fd0840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:22.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.281+0000 7fd0a737f700 1 --2- 172.21.15.125:0/2353445958 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd084066f30 0x7fd0840693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00aca70 tx=0x7fd09c017000 comp rx=0 tx=0).stop 2023-10-06T03:06:22.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.281+0000 7fd0a737f700 1 -- 172.21.15.125:0/2353445958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a006afd0 msgr2=0x7fd0a0149b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:22.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.281+0000 7fd0a737f700 1 --2- 172.21.15.125:0/2353445958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a006afd0 0x7fd0a0149b40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd09400c560 tx=0x7fd094001020 comp rx=0 tx=0).stop 2023-10-06T03:06:22.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.281+0000 7fd0a737f700 1 -- 172.21.15.125:0/2353445958 shutdown_connections 2023-10-06T03:06:22.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.281+0000 7fd0a737f700 1 --2- 172.21.15.125:0/2353445958 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd084066f30 0x7fd0840693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:22.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.281+0000 7fd0a737f700 1 --2- 172.21.15.125:0/2353445958 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0a01590d0 0x7fd0a015c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:22.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.281+0000 7fd0a737f700 1 --2- 172.21.15.125:0/2353445958 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0a006afd0 0x7fd0a0149b40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:22.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.281+0000 7fd0a737f700 1 --2- 172.21.15.125:0/2353445958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0a00ac670 0x7fd0a015a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:22.283 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.281+0000 7fd0a737f700 1 -- 172.21.15.125:0/2353445958 >> 172.21.15.125:0/2353445958 conn(0x7fd0a00cc5a0 msgr2=0x7fd0a0158370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:22.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.281+0000 7fd0a737f700 1 -- 172.21.15.125:0/2353445958 shutdown_connections 2023-10-06T03:06:22.284 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.281+0000 7fd0a737f700 1 -- 172.21.15.125:0/2353445958 wait complete. 2023-10-06T03:06:22.295 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T03:06:22.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.414+0000 7f79012cd700 1 Processor -- start 2023-10-06T03:06:22.416 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.414+0000 7f79012cd700 1 -- start start 2023-10-06T03:06:22.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.415+0000 7f79012cd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f78fc0b01a0 0x7f78fc0b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:22.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.415+0000 7f79012cd700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f78fc15cef0 0x7f78fc15a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:22.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.415+0000 7f79012cd700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78fc15a850 con 0x7f78fc0cc4d0 2023-10-06T03:06:22.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.415+0000 7f79012cd700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78fc068e60 con 0x7f78fc0b01a0 2023-10-06T03:06:22.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.415+0000 7f79012cd700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78fc15d360 con 0x7f78fc15cef0 2023-10-06T03:06:22.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.415+0000 7f78faffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f78fc0b01a0 0x7f78fc0b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:22.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.415+0000 7f78fb7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f78fc0cc4d0 0x7f78fc0cc930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57478/0 (socket says 172.21.15.125:57478) 2023-10-06T03:06:22.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.415+0000 7f78fb7fe700 1 -- 172.21.15.125:0/2211538549 learned_addr learned my addr 172.21.15.125:0/2211538549 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:22.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.415+0000 7f78faffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f78fc0b01a0 0x7f78fc0b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41670/0 (socket says 172.21.15.125:41670) 2023-10-06T03:06:22.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.416+0000 7f78fa7fc700 1 --2- 172.21.15.125:0/2211538549 >> v2:172.21.15.130:3300/0 conn(0x7f78fc15cef0 0x7f78fc15a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:22.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.416+0000 7f78faffd700 1 -- 172.21.15.125:0/2211538549 >> v2:172.21.15.130:3300/0 conn(0x7f78fc15cef0 msgr2=0x7f78fc15a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:22.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.416+0000 7f78faffd700 1 --2- 172.21.15.125:0/2211538549 >> v2:172.21.15.130:3300/0 conn(0x7f78fc15cef0 0x7f78fc15a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:22.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.416+0000 7f78faffd700 1 -- 172.21.15.125:0/2211538549 >> v1:172.21.15.125:6789/0 conn(0x7f78fc0cc4d0 legacy=0x7f78fc0cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:22.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.416+0000 7f78faffd700 1 -- 172.21.15.125:0/2211538549 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc15d640 con 0x7f78fc0b01a0 2023-10-06T03:06:22.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.416+0000 7f78f9ffb700 1 -- 172.21.15.125:0/2211538549 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2398867635 0 0) 0x7f78fc15a850 con 0x7f78fc0cc4d0 2023-10-06T03:06:22.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.416+0000 7f78faffd700 1 --2- 172.21.15.125:0/2211538549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78fc0b01a0 0x7f78fc0b0570 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0ceff0 tx=0x7f78f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2833eb423065739d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:22.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.416+0000 7f78f9ffb700 1 -- 172.21.15.125:0/2211538549 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f000b6b0 con 0x7f78fc0b01a0 2023-10-06T03:06:22.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.416+0000 7f78f9ffb700 1 -- 172.21.15.125:0/2211538549 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f000b810 con 0x7f78fc0b01a0 2023-10-06T03:06:22.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.416+0000 7f78f9ffb700 1 -- 172.21.15.125:0/2211538549 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f000bbb0 con 0x7f78fc0b01a0 2023-10-06T03:06:22.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.417+0000 7f79012cd700 1 -- 172.21.15.125:0/2211538549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78fc0b01a0 msgr2=0x7f78fc0b0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:22.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.417+0000 7f79012cd700 1 --2- 172.21.15.125:0/2211538549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78fc0b01a0 0x7f78fc0b0570 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f78fc0ceff0 tx=0x7f78f00091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:22.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.417+0000 7f79012cd700 1 -- 172.21.15.125:0/2211538549 shutdown_connections 2023-10-06T03:06:22.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.417+0000 7f79012cd700 1 --2- 172.21.15.125:0/2211538549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78fc0b01a0 0x7f78fc0b0570 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:22.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.417+0000 7f79012cd700 1 --2- 172.21.15.125:0/2211538549 >> v2:172.21.15.130:3300/0 conn(0x7f78fc15cef0 0x7f78fc15a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:22.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.417+0000 7f79012cd700 1 -- 172.21.15.125:0/2211538549 >> 172.21.15.125:0/2211538549 conn(0x7f78fc0cdf80 msgr2=0x7f78fc0ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:22.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.417+0000 7f79012cd700 1 -- 172.21.15.125:0/2211538549 shutdown_connections 2023-10-06T03:06:22.421 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.417+0000 7f79012cd700 1 -- 172.21.15.125:0/2211538549 wait complete. 2023-10-06T03:06:22.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.418+0000 7f79012cd700 1 Processor -- start 2023-10-06T03:06:22.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.418+0000 7f79012cd700 1 -- start start 2023-10-06T03:06:22.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f79012cd700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78fc0b01a0 0x7f78fc0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:22.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f79012cd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78fc0cc4d0 0x7f78fc0b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:22.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f79012cd700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78fc15cef0 0x7f78fc16a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:22.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f79012cd700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0b3a30 con 0x7f78fc0cc4d0 2023-10-06T03:06:22.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f79012cd700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc16a5d0 con 0x7f78fc0b01a0 2023-10-06T03:06:22.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f79012cd700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0b2470 con 0x7f78fc15cef0 2023-10-06T03:06:22.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f78fa7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78fc0cc4d0 0x7f78fc0b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:22.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f78fa7fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78fc0cc4d0 0x7f78fc0b34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41678/0 (socket says 172.21.15.125:41678) 2023-10-06T03:06:22.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f78fa7fc700 1 -- 172.21.15.125:0/3333372950 learned_addr learned my addr 172.21.15.125:0/3333372950 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:22.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f78fb7fe700 1 --2- 172.21.15.125:0/3333372950 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78fc15cef0 0x7f78fc16a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:22.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f78faffd700 1 --2- 172.21.15.125:0/3333372950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78fc0b01a0 0x7f78fc0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:22.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f78fa7fc700 1 -- 172.21.15.125:0/3333372950 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78fc15cef0 msgr2=0x7f78fc16a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:22.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f78fa7fc700 1 --2- 172.21.15.125:0/3333372950 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78fc15cef0 0x7f78fc16a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:22.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f78fa7fc700 1 -- 172.21.15.125:0/3333372950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78fc0b01a0 msgr2=0x7f78fc0b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:22.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f78fa7fc700 1 --2- 172.21.15.125:0/3333372950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78fc0b01a0 0x7f78fc0b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:22.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f78fa7fc700 1 -- 172.21.15.125:0/3333372950 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f0009420 con 0x7f78fc0cc4d0 2023-10-06T03:06:22.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f78faffd700 1 --2- 172.21.15.125:0/3333372950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78fc0b01a0 0x7f78fc0b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:22.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f78fa7fc700 1 --2- 172.21.15.125:0/3333372950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78fc0cc4d0 0x7f78fc0b34f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00d860 tx=0x7f78ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:22.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f78e2ffd700 1 -- 172.21.15.125:0/3333372950 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec0125f0 con 0x7f78fc0cc4d0 2023-10-06T03:06:22.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f78e2ffd700 1 -- 172.21.15.125:0/3333372950 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec012750 con 0x7f78fc0cc4d0 2023-10-06T03:06:22.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f78e2ffd700 1 -- 172.21.15.125:0/3333372950 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec012b10 con 0x7f78fc0cc4d0 2023-10-06T03:06:22.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f79012cd700 1 -- 172.21.15.125:0/3333372950 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78fc0b2730 con 0x7f78fc0cc4d0 2023-10-06T03:06:22.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.419+0000 7f79012cd700 1 -- 172.21.15.125:0/3333372950 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78fc0b2cf0 con 0x7f78fc0cc4d0 2023-10-06T03:06:22.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.420+0000 7f79012cd700 1 -- 172.21.15.125:0/3333372950 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78fc066510 con 0x7f78fc0cc4d0 2023-10-06T03:06:22.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.421+0000 7f78e2ffd700 1 -- 172.21.15.125:0/3333372950 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f78ec01e460 con 0x7f78fc0cc4d0 2023-10-06T03:06:22.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.421+0000 7f78e2ffd700 1 --2- 172.21.15.125:0/3333372950 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f78e8066f30 0x7f78e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:22.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.421+0000 7f78e2ffd700 1 -- 172.21.15.125:0/3333372950 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f78ec084d70 con 0x7f78fc0cc4d0 2023-10-06T03:06:22.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.421+0000 7f78faffd700 1 --2- 172.21.15.125:0/3333372950 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f78e8066f30 0x7f78e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:22.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.421+0000 7f78faffd700 1 --2- 172.21.15.125:0/3333372950 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f78e8066f30 0x7f78e80693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f78f00093f0 tx=0x7f78f0017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:22.427 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.425+0000 7f78e2ffd700 1 -- 172.21.15.125:0/3333372950 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78ec051d40 con 0x7f78fc0cc4d0 2023-10-06T03:06:22.656 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:22.655+0000 7f79012cd700 1 -- 172.21.15.125:0/3333372950 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f78fc15d920 con 0x7f78fc0cc4d0 2023-10-06T03:06:23.638 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.636+0000 7f78e2ffd700 1 -- 172.21.15.125:0/3333372950 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v26) v1 ==== 118+0+0 (secure 0 0 0) 0x7f78ec055360 con 0x7f78fc0cc4d0 2023-10-06T03:06:23.640 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.639+0000 7f79012cd700 1 -- 172.21.15.125:0/3333372950 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f78e8066f30 msgr2=0x7f78e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:23.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.639+0000 7f79012cd700 1 --2- 172.21.15.125:0/3333372950 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f78e8066f30 0x7f78e80693e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f78f00093f0 tx=0x7f78f0017000 comp rx=0 tx=0).stop 2023-10-06T03:06:23.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.639+0000 7f79012cd700 1 -- 172.21.15.125:0/3333372950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78fc0cc4d0 msgr2=0x7f78fc0b34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:23.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.639+0000 7f79012cd700 1 --2- 172.21.15.125:0/3333372950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78fc0cc4d0 0x7f78fc0b34f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f78ec00d860 tx=0x7f78ec008040 comp rx=0 tx=0).stop 2023-10-06T03:06:23.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.639+0000 7f79012cd700 1 -- 172.21.15.125:0/3333372950 shutdown_connections 2023-10-06T03:06:23.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.639+0000 7f79012cd700 1 --2- 172.21.15.125:0/3333372950 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f78e8066f30 0x7f78e80693e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:23.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.639+0000 7f79012cd700 1 --2- 172.21.15.125:0/3333372950 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f78fc15cef0 0x7f78fc16a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:23.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.639+0000 7f79012cd700 1 --2- 172.21.15.125:0/3333372950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f78fc0b01a0 0x7f78fc0b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:23.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.639+0000 7f79012cd700 1 --2- 172.21.15.125:0/3333372950 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f78fc0cc4d0 0x7f78fc0b34f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:23.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.639+0000 7f79012cd700 1 -- 172.21.15.125:0/3333372950 >> 172.21.15.125:0/3333372950 conn(0x7f78fc0cdf80 msgr2=0x7f78fc0cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:23.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.639+0000 7f79012cd700 1 -- 172.21.15.125:0/3333372950 shutdown_connections 2023-10-06T03:06:23.641 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.639+0000 7f79012cd700 1 -- 172.21.15.125:0/3333372950 wait complete. 2023-10-06T03:06:23.655 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T03:06:23.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.780+0000 7f9a173ca700 1 Processor -- start 2023-10-06T03:06:23.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.780+0000 7f9a173ca700 1 -- start start 2023-10-06T03:06:23.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.781+0000 7f9a173ca700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f9a10157300 0x7f9a100b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:23.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.781+0000 7f9a173ca700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a101576d0 0x7f9a100684c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:23.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.781+0000 7f9a173ca700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a100aa760 con 0x7f9a10068a00 2023-10-06T03:06:23.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.781+0000 7f9a173ca700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a10068e80 con 0x7f9a10157300 2023-10-06T03:06:23.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.781+0000 7f9a173ca700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100aaa40 con 0x7f9a101576d0 2023-10-06T03:06:23.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.781+0000 7f9a15967700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9a10068a00 0x7f9a100a92e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57484/0 (socket says 172.21.15.125:57484) 2023-10-06T03:06:23.788 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.781+0000 7f9a15967700 1 -- 172.21.15.125:0/2566948280 learned_addr learned my addr 172.21.15.125:0/2566948280 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.781+0000 7f9a14965700 1 --2- 172.21.15.125:0/2566948280 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a101576d0 0x7f9a100684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.781+0000 7f9a15166700 1 --2- 172.21.15.125:0/2566948280 >> v2:172.21.15.130:3300/0 conn(0x7f9a10157300 0x7f9a100b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.781+0000 7f9a07fff700 1 -- 172.21.15.125:0/2566948280 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1717437460 0 0) 0x7f9a100aa760 con 0x7f9a10068a00 2023-10-06T03:06:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.781+0000 7f9a07fff700 1 -- 172.21.15.125:0/2566948280 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99fc003570 con 0x7f9a10068a00 2023-10-06T03:06:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.781+0000 7f9a07fff700 1 -- 172.21.15.125:0/2566948280 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 508285538 0 0) 0x7f99fc003570 con 0x7f9a10068a00 2023-10-06T03:06:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.781+0000 7f9a07fff700 1 -- 172.21.15.125:0/2566948280 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a101576d0 msgr2=0x7f9a100684c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.781+0000 7f9a07fff700 1 --2- 172.21.15.125:0/2566948280 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a101576d0 0x7f9a100684c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.781+0000 7f9a07fff700 1 -- 172.21.15.125:0/2566948280 >> v2:172.21.15.130:3300/0 conn(0x7f9a10157300 msgr2=0x7f9a100b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.781+0000 7f9a07fff700 1 --2- 172.21.15.125:0/2566948280 >> v2:172.21.15.130:3300/0 conn(0x7f9a10157300 0x7f9a100b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.781+0000 7f9a07fff700 1 -- 172.21.15.125:0/2566948280 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a100aad20 con 0x7f9a10068a00 2023-10-06T03:06:23.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a07fff700 1 -- 172.21.15.125:0/2566948280 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f9a080017f0 con 0x7f9a10068a00 2023-10-06T03:06:23.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a07fff700 1 -- 172.21.15.125:0/2566948280 >> v1:172.21.15.125:6789/0 conn(0x7f9a10068a00 legacy=0x7f9a100a92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:23.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a07fff700 1 --2- 172.21.15.125:0/2566948280 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a101576d0 0x7f99fc003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:23.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a07fff700 1 --2- 172.21.15.125:0/2566948280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99fc003fe0 0x7f99fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:23.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a07fff700 1 --2- 172.21.15.125:0/2566948280 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99fc004d50 0x7f99fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:23.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a07fff700 1 -- 172.21.15.125:0/2566948280 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a10068e80 con 0x7f99fc004d50 2023-10-06T03:06:23.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a07fff700 1 -- 172.21.15.125:0/2566948280 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100aaa40 con 0x7f99fc003fe0 2023-10-06T03:06:23.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a07fff700 1 -- 172.21.15.125:0/2566948280 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc00ba90 con 0x7f9a101576d0 2023-10-06T03:06:23.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a15967700 1 --2- 172.21.15.125:0/2566948280 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99fc004d50 0x7f99fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:23.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a15166700 1 --2- 172.21.15.125:0/2566948280 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a101576d0 0x7f99fc003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:23.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a14965700 1 --2- 172.21.15.125:0/2566948280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99fc003fe0 0x7f99fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:23.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a15967700 1 -- 172.21.15.125:0/2566948280 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a101576d0 msgr2=0x7f99fc003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:23.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a15967700 1 --2- 172.21.15.125:0/2566948280 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a101576d0 0x7f99fc003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:23.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a15967700 1 -- 172.21.15.125:0/2566948280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99fc003fe0 msgr2=0x7f99fc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:23.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a15967700 1 --2- 172.21.15.125:0/2566948280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99fc003fe0 0x7f99fc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:23.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a15967700 1 -- 172.21.15.125:0/2566948280 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc003570 con 0x7f99fc004d50 2023-10-06T03:06:23.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a15967700 1 --2- 172.21.15.125:0/2566948280 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99fc004d50 0x7f99fc0051c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800a970 tx=0x7f9a08002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ba71978e07c47f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:23.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a07fff700 1 -- 172.21.15.125:0/2566948280 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08012440 con 0x7f99fc004d50 2023-10-06T03:06:23.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a07fff700 1 -- 172.21.15.125:0/2566948280 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a080125c0 con 0x7f99fc004d50 2023-10-06T03:06:23.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.782+0000 7f9a07fff700 1 -- 172.21.15.125:0/2566948280 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08012980 con 0x7f99fc004d50 2023-10-06T03:06:23.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.783+0000 7f9a173ca700 1 -- 172.21.15.125:0/2566948280 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99fc004d50 msgr2=0x7f99fc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:23.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.783+0000 7f9a173ca700 1 --2- 172.21.15.125:0/2566948280 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99fc004d50 0x7f99fc0051c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800a970 tx=0x7f9a08002210 comp rx=0 tx=0).stop 2023-10-06T03:06:23.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.783+0000 7f9a15967700 1 -- 172.21.15.125:0/2566948280 reap_dead start 2023-10-06T03:06:23.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.783+0000 7f9a173ca700 1 -- 172.21.15.125:0/2566948280 shutdown_connections 2023-10-06T03:06:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.783+0000 7f9a173ca700 1 -- 172.21.15.125:0/2566948280 >> 172.21.15.125:0/2566948280 conn(0x7f9a100af730 msgr2=0x7f9a100afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.783+0000 7f9a173ca700 1 -- 172.21.15.125:0/2566948280 shutdown_connections 2023-10-06T03:06:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.783+0000 7f9a173ca700 1 -- 172.21.15.125:0/2566948280 wait complete. 2023-10-06T03:06:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.784+0000 7f9a173ca700 1 Processor -- start 2023-10-06T03:06:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.784+0000 7f9a173ca700 1 -- start start 2023-10-06T03:06:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.785+0000 7f9a173ca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99fc004d50 0x7f9a101404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.785+0000 7f9a173ca700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a100c5930 0x7f9a100c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.785+0000 7f9a173ca700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a100ae320 0x7f9a100ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.785+0000 7f9a173ca700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a101531a0 con 0x7f99fc004d50 2023-10-06T03:06:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.785+0000 7f9a173ca700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100c62e0 con 0x7f9a100c5930 2023-10-06T03:06:23.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.785+0000 7f9a173ca700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100ab240 con 0x7f9a100ae320 2023-10-06T03:06:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.785+0000 7f9a15166700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99fc004d50 0x7f9a101404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.785+0000 7f9a15166700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99fc004d50 0x7f9a101404f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41690/0 (socket says 172.21.15.125:41690) 2023-10-06T03:06:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.785+0000 7f9a15166700 1 -- 172.21.15.125:0/3412162238 learned_addr learned my addr 172.21.15.125:0/3412162238 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.785+0000 7f9a14965700 1 --2- 172.21.15.125:0/3412162238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a100c5930 0x7f9a100c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.785+0000 7f9a15967700 1 --2- 172.21.15.125:0/3412162238 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a100ae320 0x7f9a100ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.785+0000 7f9a15166700 1 -- 172.21.15.125:0/3412162238 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a100ae320 msgr2=0x7f9a100ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.785+0000 7f9a15166700 1 --2- 172.21.15.125:0/3412162238 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a100ae320 0x7f9a100ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.785+0000 7f9a15166700 1 -- 172.21.15.125:0/3412162238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a100c5930 msgr2=0x7f9a100c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:23.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.785+0000 7f9a15166700 1 --2- 172.21.15.125:0/3412162238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a100c5930 0x7f9a100c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:23.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.785+0000 7f9a15166700 1 -- 172.21.15.125:0/3412162238 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a10140a30 con 0x7f99fc004d50 2023-10-06T03:06:23.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.785+0000 7f9a14965700 1 --2- 172.21.15.125:0/3412162238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a100c5930 0x7f9a100c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:23.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.785+0000 7f9a15166700 1 --2- 172.21.15.125:0/3412162238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99fc004d50 0x7f9a101404f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c011a40 tx=0x7f9a0c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:23.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.786+0000 7f9a057fa700 1 -- 172.21.15.125:0/3412162238 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c005c10 con 0x7f99fc004d50 2023-10-06T03:06:23.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.786+0000 7f9a057fa700 1 -- 172.21.15.125:0/3412162238 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0c005d70 con 0x7f99fc004d50 2023-10-06T03:06:23.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.786+0000 7f9a057fa700 1 -- 172.21.15.125:0/3412162238 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c00f960 con 0x7f99fc004d50 2023-10-06T03:06:23.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.786+0000 7f9a173ca700 1 -- 172.21.15.125:0/3412162238 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a100aefe0 con 0x7f99fc004d50 2023-10-06T03:06:23.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.786+0000 7f9a173ca700 1 -- 172.21.15.125:0/3412162238 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a100ab770 con 0x7f99fc004d50 2023-10-06T03:06:23.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.787+0000 7f9a173ca700 1 -- 172.21.15.125:0/3412162238 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a10066510 con 0x7f99fc004d50 2023-10-06T03:06:23.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.787+0000 7f9a057fa700 1 -- 172.21.15.125:0/3412162238 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a0c00fd90 con 0x7f99fc004d50 2023-10-06T03:06:23.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.787+0000 7f9a057fa700 1 --2- 172.21.15.125:0/3412162238 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f99f4066f60 0x7f99f4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:23.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.787+0000 7f9a057fa700 1 -- 172.21.15.125:0/3412162238 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9a0c085150 con 0x7f99fc004d50 2023-10-06T03:06:23.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.788+0000 7f9a14965700 1 --2- 172.21.15.125:0/3412162238 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f99f4066f60 0x7f99f4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:23.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.788+0000 7f9a14965700 1 --2- 172.21.15.125:0/3412162238 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f99f4066f60 0x7f99f4069410 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9a00006eb0 tx=0x7f9a00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:23.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:23.792+0000 7f9a057fa700 1 -- 172.21.15.125:0/3412162238 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a0c052120 con 0x7f99fc004d50 2023-10-06T03:06:24.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.017+0000 7f9a173ca700 1 -- 172.21.15.125:0/3412162238 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9a100ab000 con 0x7f99fc004d50 2023-10-06T03:06:24.644 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.643+0000 7f9a057fa700 1 -- 172.21.15.125:0/3412162238 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v27) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9a0c055740 con 0x7f99fc004d50 2023-10-06T03:06:24.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.645+0000 7f9a173ca700 1 -- 172.21.15.125:0/3412162238 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f99f4066f60 msgr2=0x7f99f4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:24.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.645+0000 7f9a173ca700 1 --2- 172.21.15.125:0/3412162238 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f99f4066f60 0x7f99f4069410 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9a00006eb0 tx=0x7f9a00008040 comp rx=0 tx=0).stop 2023-10-06T03:06:24.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.645+0000 7f9a173ca700 1 -- 172.21.15.125:0/3412162238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99fc004d50 msgr2=0x7f9a101404f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:24.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.645+0000 7f9a173ca700 1 --2- 172.21.15.125:0/3412162238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99fc004d50 0x7f9a101404f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c011a40 tx=0x7f9a0c009120 comp rx=0 tx=0).stop 2023-10-06T03:06:24.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.645+0000 7f9a173ca700 1 -- 172.21.15.125:0/3412162238 shutdown_connections 2023-10-06T03:06:24.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.645+0000 7f9a173ca700 1 --2- 172.21.15.125:0/3412162238 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f99f4066f60 0x7f99f4069410 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:24.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.645+0000 7f9a173ca700 1 --2- 172.21.15.125:0/3412162238 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9a100ae320 0x7f9a100ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:24.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.645+0000 7f9a173ca700 1 --2- 172.21.15.125:0/3412162238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f99fc004d50 0x7f9a101404f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:24.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.645+0000 7f9a173ca700 1 --2- 172.21.15.125:0/3412162238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a100c5930 0x7f9a100c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:24.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.645+0000 7f9a173ca700 1 -- 172.21.15.125:0/3412162238 >> 172.21.15.125:0/3412162238 conn(0x7f9a100af730 msgr2=0x7f9a1006c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:24.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.645+0000 7f9a173ca700 1 -- 172.21.15.125:0/3412162238 shutdown_connections 2023-10-06T03:06:24.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.646+0000 7f9a173ca700 1 -- 172.21.15.125:0/3412162238 wait complete. 2023-10-06T03:06:24.660 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:06:24.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.779+0000 7fe8e4c95700 1 Processor -- start 2023-10-06T03:06:24.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.779+0000 7fe8e4c95700 1 -- start start 2023-10-06T03:06:24.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8e4c95700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe8e00af320 0x7fe8e00c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:24.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8e4c95700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8e00cc5a0 0x7fe8e0067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:24.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8e4c95700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe8e0067b50 0x7fe8e00c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:24.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8e4c95700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e0067fd0 con 0x7fe8e00af320 2023-10-06T03:06:24.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8e4c95700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e00caa40 con 0x7fe8e0067b50 2023-10-06T03:06:24.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8e4c95700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e00c1ca0 con 0x7fe8e00cc5a0 2023-10-06T03:06:24.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8de59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe8e00af320 0x7fe8e00c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:24.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8de59c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe8e00af320 0x7fe8e00c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41696/0 (socket says 172.21.15.125:41696) 2023-10-06T03:06:24.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8de59c700 1 -- 172.21.15.125:0/617028338 learned_addr learned my addr 172.21.15.125:0/617028338 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:24.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8ddd9b700 1 --2- 172.21.15.125:0/617028338 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8e00cc5a0 0x7fe8e0067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:24.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8ded9d700 1 --2- 172.21.15.125:0/617028338 >> v2:172.21.15.130:3300/0 conn(0x7fe8e0067b50 0x7fe8e00c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:24.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8de59c700 1 -- 172.21.15.125:0/617028338 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8e00cc5a0 msgr2=0x7fe8e0067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:24.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8de59c700 1 --2- 172.21.15.125:0/617028338 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8e00cc5a0 0x7fe8e0067610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:24.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8de59c700 1 -- 172.21.15.125:0/617028338 >> v2:172.21.15.130:3300/0 conn(0x7fe8e0067b50 msgr2=0x7fe8e00c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:24.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8de59c700 1 --2- 172.21.15.125:0/617028338 >> v2:172.21.15.130:3300/0 conn(0x7fe8e0067b50 0x7fe8e00c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:24.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8de59c700 1 -- 172.21.15.125:0/617028338 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e00cca60 con 0x7fe8e00af320 2023-10-06T03:06:24.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8de59c700 1 --2- 172.21.15.125:0/617028338 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8e00af320 0x7fe8e00c8ed0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0087210 tx=0x7fe8d0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63dc160f7ce9fda8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:24.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8dd59a700 1 -- 172.21.15.125:0/617028338 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0005c10 con 0x7fe8e00af320 2023-10-06T03:06:24.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8dd59a700 1 -- 172.21.15.125:0/617028338 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d0005d70 con 0x7fe8e00af320 2023-10-06T03:06:24.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.780+0000 7fe8dd59a700 1 -- 172.21.15.125:0/617028338 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d000b880 con 0x7fe8e00af320 2023-10-06T03:06:24.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.781+0000 7fe8e4c95700 1 -- 172.21.15.125:0/617028338 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8e00af320 msgr2=0x7fe8e00c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:24.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.781+0000 7fe8e4c95700 1 --2- 172.21.15.125:0/617028338 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8e00af320 0x7fe8e00c8ed0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0087210 tx=0x7fe8d0009220 comp rx=0 tx=0).stop 2023-10-06T03:06:24.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.781+0000 7fe8e4c95700 1 -- 172.21.15.125:0/617028338 shutdown_connections 2023-10-06T03:06:24.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.781+0000 7fe8e4c95700 1 --2- 172.21.15.125:0/617028338 >> v2:172.21.15.130:3300/0 conn(0x7fe8e0067b50 0x7fe8e00c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:24.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.781+0000 7fe8e4c95700 1 --2- 172.21.15.125:0/617028338 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8e00af320 0x7fe8e00c8ed0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:24.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.781+0000 7fe8e4c95700 1 --2- 172.21.15.125:0/617028338 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8e00cc5a0 0x7fe8e0067610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:24.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.781+0000 7fe8e4c95700 1 -- 172.21.15.125:0/617028338 >> 172.21.15.125:0/617028338 conn(0x7fe8e0068f00 msgr2=0x7fe8e00cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:24.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.781+0000 7fe8e4c95700 1 -- 172.21.15.125:0/617028338 shutdown_connections 2023-10-06T03:06:24.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.781+0000 7fe8e4c95700 1 -- 172.21.15.125:0/617028338 wait complete. 2023-10-06T03:06:24.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.782+0000 7fe8e4c95700 1 Processor -- start 2023-10-06T03:06:24.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.782+0000 7fe8e4c95700 1 -- start start 2023-10-06T03:06:24.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.783+0000 7fe8e4c95700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8e0067b50 0x7fe8e016d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:24.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.783+0000 7fe8e4c95700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8e00af320 0x7fe8e00c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:24.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.783+0000 7fe8e4c95700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8e00cc5a0 0x7fe8e015c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:24.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.783+0000 7fe8e4c95700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e00c6f70 con 0x7fe8e00af320 2023-10-06T03:06:24.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.783+0000 7fe8e4c95700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e00c7180 con 0x7fe8e0067b50 2023-10-06T03:06:24.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.783+0000 7fe8e4c95700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e015cbb0 con 0x7fe8e00cc5a0 2023-10-06T03:06:24.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.783+0000 7fe8ddd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8e00af320 0x7fe8e00c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:24.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.783+0000 7fe8ddd9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8e00af320 0x7fe8e00c6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41710/0 (socket says 172.21.15.125:41710) 2023-10-06T03:06:24.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.783+0000 7fe8ddd9b700 1 -- 172.21.15.125:0/1822609344 learned_addr learned my addr 172.21.15.125:0/1822609344 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:24.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.783+0000 7fe8de59c700 1 --2- 172.21.15.125:0/1822609344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8e0067b50 0x7fe8e016d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:24.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.783+0000 7fe8ded9d700 1 --2- 172.21.15.125:0/1822609344 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8e00cc5a0 0x7fe8e015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:24.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.783+0000 7fe8ddd9b700 1 -- 172.21.15.125:0/1822609344 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8e00cc5a0 msgr2=0x7fe8e015c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:24.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.783+0000 7fe8ddd9b700 1 --2- 172.21.15.125:0/1822609344 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8e00cc5a0 0x7fe8e015c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:24.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.783+0000 7fe8ddd9b700 1 -- 172.21.15.125:0/1822609344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8e0067b50 msgr2=0x7fe8e016d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:24.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.783+0000 7fe8ddd9b700 1 --2- 172.21.15.125:0/1822609344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8e0067b50 0x7fe8e016d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:24.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.783+0000 7fe8ddd9b700 1 -- 172.21.15.125:0/1822609344 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d0009480 con 0x7fe8e00af320 2023-10-06T03:06:24.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.784+0000 7fe8ddd9b700 1 --2- 172.21.15.125:0/1822609344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8e00af320 0x7fe8e00c6a30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400d8c0 tx=0x7fe8d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:24.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.784+0000 7fe8ce7fc700 1 -- 172.21.15.125:0/1822609344 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4009550 con 0x7fe8e00af320 2023-10-06T03:06:24.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.784+0000 7fe8ce7fc700 1 -- 172.21.15.125:0/1822609344 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d40096b0 con 0x7fe8e00af320 2023-10-06T03:06:24.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.784+0000 7fe8e4c95700 1 -- 172.21.15.125:0/1822609344 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e015c1e0 con 0x7fe8e00af320 2023-10-06T03:06:24.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.784+0000 7fe8ce7fc700 1 -- 172.21.15.125:0/1822609344 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4009a70 con 0x7fe8e00af320 2023-10-06T03:06:24.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.784+0000 7fe8e4c95700 1 -- 172.21.15.125:0/1822609344 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e015b6a0 con 0x7fe8e00af320 2023-10-06T03:06:24.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.785+0000 7fe8e4c95700 1 -- 172.21.15.125:0/1822609344 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e015c370 con 0x7fe8e00af320 2023-10-06T03:06:24.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.785+0000 7fe8ce7fc700 1 -- 172.21.15.125:0/1822609344 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe8d401e460 con 0x7fe8e00af320 2023-10-06T03:06:24.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.785+0000 7fe8ce7fc700 1 --2- 172.21.15.125:0/1822609344 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe8c0066f60 0x7fe8c0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:24.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.786+0000 7fe8ce7fc700 1 -- 172.21.15.125:0/1822609344 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe8d4084d10 con 0x7fe8e00af320 2023-10-06T03:06:24.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.786+0000 7fe8de59c700 1 --2- 172.21.15.125:0/1822609344 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe8c0066f60 0x7fe8c0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:24.791 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.786+0000 7fe8de59c700 1 --2- 172.21.15.125:0/1822609344 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe8c0066f60 0x7fe8c0069410 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009260 tx=0x7fe8d0016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:24.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:24.790+0000 7fe8ce7fc700 1 -- 172.21.15.125:0/1822609344 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8d4051ce0 con 0x7fe8e00af320 2023-10-06T03:06:25.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.017+0000 7fe8e4c95700 1 -- 172.21.15.125:0/1822609344 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8e0066510 con 0x7fe8e00af320 2023-10-06T03:06:25.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.017+0000 7fe8ce7fc700 1 -- 172.21.15.125:0/1822609344 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4610 (secure 0 0 0) 0x7fe8d4055300 con 0x7fe8e00af320 2023-10-06T03:06:25.019 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:25.019 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/2151384589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2151384589},{"type":"v1","addr":"172.21.15.130:6834","nonce":2151384589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5299,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1214475159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1214475159},{"type":"v1","addr":"172.21.15.130:6835","nonce":1214475159}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/4005469649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":4005469649},{"type":"v1","addr":"172.21.15.125:6836","nonce":4005469649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:06:20.996155+0000","modified":"2023-10-06T03:06:24.636313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5556":{"gid":5556,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/1751632854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":1751632854},{"type":"v1","addr":"172.21.15.125:6837","nonce":1751632854}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:06:25.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.019+0000 7fe8e4c95700 1 -- 172.21.15.125:0/1822609344 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe8c0066f60 msgr2=0x7fe8c0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:25.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.019+0000 7fe8e4c95700 1 --2- 172.21.15.125:0/1822609344 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe8c0066f60 0x7fe8c0069410 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009260 tx=0x7fe8d0016000 comp rx=0 tx=0).stop 2023-10-06T03:06:25.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.019+0000 7fe8e4c95700 1 -- 172.21.15.125:0/1822609344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8e00af320 msgr2=0x7fe8e00c6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:25.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.019+0000 7fe8e4c95700 1 --2- 172.21.15.125:0/1822609344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8e00af320 0x7fe8e00c6a30 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400d8c0 tx=0x7fe8d4008040 comp rx=0 tx=0).stop 2023-10-06T03:06:25.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.019+0000 7fe8e4c95700 1 -- 172.21.15.125:0/1822609344 shutdown_connections 2023-10-06T03:06:25.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.019+0000 7fe8e4c95700 1 --2- 172.21.15.125:0/1822609344 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe8c0066f60 0x7fe8c0069410 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.019+0000 7fe8e4c95700 1 --2- 172.21.15.125:0/1822609344 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe8e00cc5a0 0x7fe8e015c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.019+0000 7fe8e4c95700 1 --2- 172.21.15.125:0/1822609344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8e0067b50 0x7fe8e016d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.019+0000 7fe8e4c95700 1 --2- 172.21.15.125:0/1822609344 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe8e00af320 0x7fe8e00c6a30 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.019+0000 7fe8e4c95700 1 -- 172.21.15.125:0/1822609344 >> 172.21.15.125:0/1822609344 conn(0x7fe8e0068f00 msgr2=0x7fe8e00c3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:25.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.019+0000 7fe8e4c95700 1 -- 172.21.15.125:0/1822609344 shutdown_connections 2023-10-06T03:06:25.022 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.019+0000 7fe8e4c95700 1 -- 172.21.15.125:0/1822609344 wait complete. 2023-10-06T03:06:25.023 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 27 2023-10-06T03:06:25.032 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:06:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.149+0000 7f64d0051700 1 Processor -- start 2023-10-06T03:06:25.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.149+0000 7f64d0051700 1 -- start start 2023-10-06T03:06:25.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.150+0000 7f64d0051700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64c80cbb50 0x7f64c80a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:25.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.150+0000 7f64d0051700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f64c80cbf20 0x7f64c80caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:25.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.150+0000 7f64d0051700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64c80c2910 con 0x7f64c80caf80 2023-10-06T03:06:25.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.150+0000 7f64d0051700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c80cb420 con 0x7f64c80cbf20 2023-10-06T03:06:25.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.150+0000 7f64d0051700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c80c1d40 con 0x7f64c80cbb50 2023-10-06T03:06:25.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.150+0000 7f64cd5ec700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f64c80cbf20 0x7f64c80caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:25.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.150+0000 7f64ce5ee700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f64c80caf80 0x7f64c80c2da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:57494/0 (socket says 172.21.15.125:57494) 2023-10-06T03:06:25.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.150+0000 7f64ce5ee700 1 -- 172.21.15.125:0/3630252283 learned_addr learned my addr 172.21.15.125:0/3630252283 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:25.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.150+0000 7f64cdded700 1 --2- 172.21.15.125:0/3630252283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64c80cbb50 0x7f64c80a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:25.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.150+0000 7f64cd5ec700 1 -- 172.21.15.125:0/3630252283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64c80cbb50 msgr2=0x7f64c80a99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:25.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.150+0000 7f64cd5ec700 1 --2- 172.21.15.125:0/3630252283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64c80cbb50 0x7f64c80a99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.150+0000 7f64cd5ec700 1 -- 172.21.15.125:0/3630252283 >> v1:172.21.15.125:6789/0 conn(0x7f64c80caf80 legacy=0x7f64c80c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:25.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.150+0000 7f64ccdeb700 1 -- 172.21.15.125:0/3630252283 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603764339 0 0) 0x7f64c80c2910 con 0x7f64c80caf80 2023-10-06T03:06:25.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.150+0000 7f64cd5ec700 1 -- 172.21.15.125:0/3630252283 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c80c1fe0 con 0x7f64c80cbf20 2023-10-06T03:06:25.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.151+0000 7f64cd5ec700 1 --2- 172.21.15.125:0/3630252283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80cbf20 0x7f64c80caa40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f64c40098e0 tx=0x7f64c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716162241b6086f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:25.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.151+0000 7f64ccdeb700 1 -- 172.21.15.125:0/3630252283 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c4009e80 con 0x7f64c80cbf20 2023-10-06T03:06:25.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.151+0000 7f64ccdeb700 1 -- 172.21.15.125:0/3630252283 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c400b860 con 0x7f64c80cbf20 2023-10-06T03:06:25.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.151+0000 7f64ccdeb700 1 -- 172.21.15.125:0/3630252283 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c400bbe0 con 0x7f64c80cbf20 2023-10-06T03:06:25.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.151+0000 7f64d0051700 1 -- 172.21.15.125:0/3630252283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80cbf20 msgr2=0x7f64c80caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:25.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.151+0000 7f64d0051700 1 --2- 172.21.15.125:0/3630252283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80cbf20 0x7f64c80caa40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f64c40098e0 tx=0x7f64c40091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.151+0000 7f64d0051700 1 -- 172.21.15.125:0/3630252283 shutdown_connections 2023-10-06T03:06:25.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.151+0000 7f64d0051700 1 --2- 172.21.15.125:0/3630252283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64c80cbb50 0x7f64c80a99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.151+0000 7f64d0051700 1 --2- 172.21.15.125:0/3630252283 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80cbf20 0x7f64c80caa40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.151+0000 7f64d0051700 1 -- 172.21.15.125:0/3630252283 >> 172.21.15.125:0/3630252283 conn(0x7f64c8068f00 msgr2=0x7f64c80cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:25.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.151+0000 7f64d0051700 1 -- 172.21.15.125:0/3630252283 shutdown_connections 2023-10-06T03:06:25.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.151+0000 7f64d0051700 1 -- 172.21.15.125:0/3630252283 wait complete. 2023-10-06T03:06:25.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.153+0000 7f64d0051700 1 Processor -- start 2023-10-06T03:06:25.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.153+0000 7f64d0051700 1 -- start start 2023-10-06T03:06:25.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.154+0000 7f64d0051700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64c80caf80 0x7f64c8169a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:25.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.154+0000 7f64d0051700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64c80cbb50 0x7f64c80c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:25.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.154+0000 7f64d0051700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80cbf20 0x7f64c81438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:25.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.154+0000 7f64d0051700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c816a950 con 0x7f64c80cbf20 2023-10-06T03:06:25.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.154+0000 7f64d0051700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c81525d0 con 0x7f64c80caf80 2023-10-06T03:06:25.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.154+0000 7f64d0051700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c816a0b0 con 0x7f64c80cbb50 2023-10-06T03:06:25.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.154+0000 7f64ce5ee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80cbf20 0x7f64c81438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.154+0000 7f64ce5ee700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80cbf20 0x7f64c81438f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:41728/0 (socket says 172.21.15.125:41728) 2023-10-06T03:06:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.154+0000 7f64ce5ee700 1 -- 172.21.15.125:0/2563579365 learned_addr learned my addr 172.21.15.125:0/2563579365 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.154+0000 7f64cdded700 1 --2- 172.21.15.125:0/2563579365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64c80caf80 0x7f64c8169a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.154+0000 7f64cd5ec700 1 --2- 172.21.15.125:0/2563579365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64c80cbb50 0x7f64c80c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.154+0000 7f64ce5ee700 1 -- 172.21.15.125:0/2563579365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64c80cbb50 msgr2=0x7f64c80c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.154+0000 7f64ce5ee700 1 --2- 172.21.15.125:0/2563579365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64c80cbb50 0x7f64c80c5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.154+0000 7f64ce5ee700 1 -- 172.21.15.125:0/2563579365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64c80caf80 msgr2=0x7f64c8169a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.154+0000 7f64ce5ee700 1 --2- 172.21.15.125:0/2563579365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64c80caf80 0x7f64c8169a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.154+0000 7f64ce5ee700 1 -- 172.21.15.125:0/2563579365 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c4009420 con 0x7f64c80cbf20 2023-10-06T03:06:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.154+0000 7f64ce5ee700 1 --2- 172.21.15.125:0/2563579365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80cbf20 0x7f64c81438f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f64c000cc90 tx=0x7f64c0001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:25.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.155+0000 7f64bdffb700 1 -- 172.21.15.125:0/2563579365 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c000a8b0 con 0x7f64c80cbf20 2023-10-06T03:06:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.155+0000 7f64bdffb700 1 -- 172.21.15.125:0/2563579365 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c000aa10 con 0x7f64c80cbf20 2023-10-06T03:06:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.155+0000 7f64bdffb700 1 -- 172.21.15.125:0/2563579365 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c000add0 con 0x7f64c80cbf20 2023-10-06T03:06:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.155+0000 7f64d0051700 1 -- 172.21.15.125:0/2563579365 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c816a390 con 0x7f64c80cbf20 2023-10-06T03:06:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.155+0000 7f64d0051700 1 -- 172.21.15.125:0/2563579365 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c8166420 con 0x7f64c80cbf20 2023-10-06T03:06:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.156+0000 7f64d0051700 1 -- 172.21.15.125:0/2563579365 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c8152740 con 0x7f64c80cbf20 2023-10-06T03:06:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.156+0000 7f64bdffb700 1 -- 172.21.15.125:0/2563579365 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64c0007300 con 0x7f64c80cbf20 2023-10-06T03:06:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.156+0000 7f64bdffb700 1 --2- 172.21.15.125:0/2563579365 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f64ac066f30 0x7f64ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.156+0000 7f64bdffb700 1 -- 172.21.15.125:0/2563579365 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f64c0084ac0 con 0x7f64c80cbf20 2023-10-06T03:06:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.156+0000 7f64cdded700 1 --2- 172.21.15.125:0/2563579365 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f64ac066f30 0x7f64ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:25.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.157+0000 7f64cdded700 1 --2- 172.21.15.125:0/2563579365 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f64ac066f30 0x7f64ac0693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f64b8006fd0 tx=0x7f64b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:25.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.161+0000 7f64bdffb700 1 -- 172.21.15.125:0/2563579365 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64c0051b10 con 0x7f64c80cbf20 2023-10-06T03:06:25.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.342+0000 7f64d0051700 1 -- 172.21.15.125:0/2563579365 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64c8066510 con 0x7f64c80cbf20 2023-10-06T03:06:25.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.343+0000 7f64bdffb700 1 -- 172.21.15.125:0/2563579365 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+17217 (secure 0 0 0) 0x7f64c0084e60 con 0x7f64c80cbf20 2023-10-06T03:06:25.345 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:25.345 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":57,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:06:22.618226+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:06:18.650188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T03:06:19.963528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:06:25.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.345+0000 7f64d0051700 1 -- 172.21.15.125:0/2563579365 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f64ac066f30 msgr2=0x7f64ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:25.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.345+0000 7f64d0051700 1 --2- 172.21.15.125:0/2563579365 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f64ac066f30 0x7f64ac0693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f64b8006fd0 tx=0x7f64b8008040 comp rx=0 tx=0).stop 2023-10-06T03:06:25.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.345+0000 7f64d0051700 1 -- 172.21.15.125:0/2563579365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80cbf20 msgr2=0x7f64c81438f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:25.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.345+0000 7f64d0051700 1 --2- 172.21.15.125:0/2563579365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80cbf20 0x7f64c81438f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f64c000cc90 tx=0x7f64c0001a80 comp rx=0 tx=0).stop 2023-10-06T03:06:25.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.345+0000 7f64d0051700 1 -- 172.21.15.125:0/2563579365 shutdown_connections 2023-10-06T03:06:25.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.345+0000 7f64d0051700 1 --2- 172.21.15.125:0/2563579365 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f64ac066f30 0x7f64ac0693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.345+0000 7f64d0051700 1 --2- 172.21.15.125:0/2563579365 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f64c80cbf20 0x7f64c81438f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.346+0000 7f64d0051700 1 --2- 172.21.15.125:0/2563579365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64c80caf80 0x7f64c8169a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.346+0000 7f64d0051700 1 --2- 172.21.15.125:0/2563579365 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f64c80cbb50 0x7f64c80c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.346+0000 7f64d0051700 1 -- 172.21.15.125:0/2563579365 >> 172.21.15.125:0/2563579365 conn(0x7f64c8068f00 msgr2=0x7f64c80b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:25.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.346+0000 7f64d0051700 1 -- 172.21.15.125:0/2563579365 shutdown_connections 2023-10-06T03:06:25.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.346+0000 7f64d0051700 1 -- 172.21.15.125:0/2563579365 wait complete. 2023-10-06T03:06:25.359 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T03:06:25.359 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:06:25.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.475+0000 7f489d831700 1 Processor -- start 2023-10-06T03:06:25.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.476+0000 7f489d831700 1 -- start start 2023-10-06T03:06:25.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.476+0000 7f489d831700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f489806e6b0 0x7f48981593a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:25.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.476+0000 7f489d831700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f48981598e0 0x7f48980ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:25.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.476+0000 7f489d831700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489815a140 con 0x7f48980ae2a0 2023-10-06T03:06:25.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.476+0000 7f489d831700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4898155b00 con 0x7f489806e6b0 2023-10-06T03:06:25.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.476+0000 7f489d831700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48980c6c70 con 0x7f48981598e0 2023-10-06T03:06:25.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.477+0000 7f48967fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f489806e6b0 0x7f48981593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:25.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.477+0000 7f4896ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f48980ae2a0 0x7f489806dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51590/0 (socket says 172.21.15.125:51590) 2023-10-06T03:06:25.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.477+0000 7f4896ffd700 1 -- 172.21.15.125:0/3160178874 learned_addr learned my addr 172.21.15.125:0/3160178874 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:25.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.477+0000 7f48977fe700 1 --2- 172.21.15.125:0/3160178874 >> v2:172.21.15.130:3300/0 conn(0x7f48981598e0 0x7f48980ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:25.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.477+0000 7f48967fc700 1 -- 172.21.15.125:0/3160178874 >> v2:172.21.15.130:3300/0 conn(0x7f48981598e0 msgr2=0x7f48980ac5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:25.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.477+0000 7f48967fc700 1 --2- 172.21.15.125:0/3160178874 >> v2:172.21.15.130:3300/0 conn(0x7f48981598e0 0x7f48980ac5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.477+0000 7f48967fc700 1 -- 172.21.15.125:0/3160178874 >> v1:172.21.15.125:6789/0 conn(0x7f48980ae2a0 legacy=0x7f489806dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:25.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.477+0000 7f48967fc700 1 -- 172.21.15.125:0/3160178874 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48980ae670 con 0x7f489806e6b0 2023-10-06T03:06:25.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.477+0000 7f48967fc700 1 --2- 172.21.15.125:0/3160178874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f489806e6b0 0x7f48981593a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4898068190 tx=0x7f488000a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8dadfd9effb4a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:25.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.477+0000 7f4895ffb700 1 -- 172.21.15.125:0/3160178874 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488000c970 con 0x7f489806e6b0 2023-10-06T03:06:25.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.477+0000 7f4895ffb700 1 -- 172.21.15.125:0/3160178874 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488000cad0 con 0x7f489806e6b0 2023-10-06T03:06:25.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.477+0000 7f4895ffb700 1 -- 172.21.15.125:0/3160178874 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488000ce70 con 0x7f489806e6b0 2023-10-06T03:06:25.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.478+0000 7f489d831700 1 -- 172.21.15.125:0/3160178874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f489806e6b0 msgr2=0x7f48981593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:25.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.478+0000 7f489d831700 1 --2- 172.21.15.125:0/3160178874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f489806e6b0 0x7f48981593a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4898068190 tx=0x7f488000a330 comp rx=0 tx=0).stop 2023-10-06T03:06:25.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.478+0000 7f489d831700 1 -- 172.21.15.125:0/3160178874 shutdown_connections 2023-10-06T03:06:25.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.478+0000 7f489d831700 1 --2- 172.21.15.125:0/3160178874 >> v2:172.21.15.130:3300/0 conn(0x7f48981598e0 0x7f48980ac5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.478+0000 7f489d831700 1 --2- 172.21.15.125:0/3160178874 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f489806e6b0 0x7f48981593a0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.478+0000 7f489d831700 1 -- 172.21.15.125:0/3160178874 >> 172.21.15.125:0/3160178874 conn(0x7f48980cbd00 msgr2=0x7f48980cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:25.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.478+0000 7f489d831700 1 -- 172.21.15.125:0/3160178874 shutdown_connections 2023-10-06T03:06:25.482 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.478+0000 7f489d831700 1 -- 172.21.15.125:0/3160178874 wait complete. 2023-10-06T03:06:25.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.479+0000 7f489d831700 1 Processor -- start 2023-10-06T03:06:25.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.479+0000 7f489d831700 1 -- start start 2023-10-06T03:06:25.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f489d831700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f489806e6b0 0x7f4898153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:25.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f489d831700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f48980ae2a0 0x7f4898153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:25.484 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f489d831700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48981598e0 0x7f489816cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:25.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f489d831700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4898155dc0 con 0x7f489806e6b0 2023-10-06T03:06:25.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f489d831700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48981560a0 con 0x7f48981598e0 2023-10-06T03:06:25.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f489d831700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4898156380 con 0x7f48980ae2a0 2023-10-06T03:06:25.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f4896ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f489806e6b0 0x7f4898153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:25.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f4896ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f489806e6b0 0x7f4898153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44742/0 (socket says 172.21.15.125:44742) 2023-10-06T03:06:25.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f4896ffd700 1 -- 172.21.15.125:0/4184645657 learned_addr learned my addr 172.21.15.125:0/4184645657 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:25.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f48977fe700 1 --2- 172.21.15.125:0/4184645657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48981598e0 0x7f489816cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:25.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f48967fc700 1 --2- 172.21.15.125:0/4184645657 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f48980ae2a0 0x7f4898153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:25.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f4896ffd700 1 -- 172.21.15.125:0/4184645657 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f48980ae2a0 msgr2=0x7f4898153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:25.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f4896ffd700 1 --2- 172.21.15.125:0/4184645657 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f48980ae2a0 0x7f4898153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.485 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f4896ffd700 1 -- 172.21.15.125:0/4184645657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48981598e0 msgr2=0x7f489816cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:25.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f4896ffd700 1 --2- 172.21.15.125:0/4184645657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48981598e0 0x7f489816cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f4896ffd700 1 -- 172.21.15.125:0/4184645657 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488000a5d0 con 0x7f489806e6b0 2023-10-06T03:06:25.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f48977fe700 1 --2- 172.21.15.125:0/4184645657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48981598e0 0x7f489816cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:25.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f4896ffd700 1 --2- 172.21.15.125:0/4184645657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f489806e6b0 0x7f4898153940 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f488800c560 tx=0x7f4888001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:25.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f488effd700 1 -- 172.21.15.125:0/4184645657 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4888005b30 con 0x7f489806e6b0 2023-10-06T03:06:25.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f488effd700 1 -- 172.21.15.125:0/4184645657 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4888005cb0 con 0x7f489806e6b0 2023-10-06T03:06:25.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f488effd700 1 -- 172.21.15.125:0/4184645657 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4888007320 con 0x7f489806e6b0 2023-10-06T03:06:25.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.480+0000 7f489d831700 1 -- 172.21.15.125:0/4184645657 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4898156660 con 0x7f489806e6b0 2023-10-06T03:06:25.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.481+0000 7f489d831700 1 -- 172.21.15.125:0/4184645657 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4898156e60 con 0x7f489806e6b0 2023-10-06T03:06:25.486 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.482+0000 7f489d831700 1 -- 172.21.15.125:0/4184645657 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4898156b80 con 0x7f489806e6b0 2023-10-06T03:06:25.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.482+0000 7f488effd700 1 -- 172.21.15.125:0/4184645657 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f488801b3b0 con 0x7f489806e6b0 2023-10-06T03:06:25.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.482+0000 7f488effd700 1 --2- 172.21.15.125:0/4184645657 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4878066f30 0x7f48780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:25.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.482+0000 7f488effd700 1 -- 172.21.15.125:0/4184645657 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4888083d10 con 0x7f489806e6b0 2023-10-06T03:06:25.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.482+0000 7f48967fc700 1 --2- 172.21.15.125:0/4184645657 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4878066f30 0x7f48780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:25.487 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.483+0000 7f48967fc700 1 --2- 172.21.15.125:0/4184645657 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4878066f30 0x7f48780693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f488000a370 tx=0x7f488001a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:25.488 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.487+0000 7f488effd700 1 -- 172.21.15.125:0/4184645657 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4888050ce0 con 0x7f489806e6b0 2023-10-06T03:06:25.668 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.667+0000 7f489d831700 1 -- 172.21.15.125:0/4184645657 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4898157080 con 0x7f4878066f30 2023-10-06T03:06:25.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.675+0000 7f488effd700 1 -- 172.21.15.125:0/4184645657 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307868 (secure 0 0 0) 0x7f4898157080 con 0x7f4878066f30 2023-10-06T03:06:25.680 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:25.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.678+0000 7f489d831700 1 -- 172.21.15.125:0/4184645657 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4878066f30 msgr2=0x7f48780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:25.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.678+0000 7f489d831700 1 --2- 172.21.15.125:0/4184645657 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4878066f30 0x7f48780693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f488000a370 tx=0x7f488001a000 comp rx=0 tx=0).stop 2023-10-06T03:06:25.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.678+0000 7f489d831700 1 -- 172.21.15.125:0/4184645657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f489806e6b0 msgr2=0x7f4898153940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:25.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.678+0000 7f489d831700 1 --2- 172.21.15.125:0/4184645657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f489806e6b0 0x7f4898153940 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f488800c560 tx=0x7f4888001020 comp rx=0 tx=0).stop 2023-10-06T03:06:25.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.678+0000 7f489d831700 1 -- 172.21.15.125:0/4184645657 shutdown_connections 2023-10-06T03:06:25.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.678+0000 7f489d831700 1 --2- 172.21.15.125:0/4184645657 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4878066f30 0x7f48780693e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.678+0000 7f489d831700 1 --2- 172.21.15.125:0/4184645657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f48981598e0 0x7f489816cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.678+0000 7f489d831700 1 --2- 172.21.15.125:0/4184645657 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f489806e6b0 0x7f4898153940 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.678+0000 7f489d831700 1 --2- 172.21.15.125:0/4184645657 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f48980ae2a0 0x7f4898153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.678+0000 7f489d831700 1 -- 172.21.15.125:0/4184645657 >> 172.21.15.125:0/4184645657 conn(0x7f48980cbd00 msgr2=0x7f489806b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:25.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.678+0000 7f489d831700 1 -- 172.21.15.125:0/4184645657 shutdown_connections 2023-10-06T03:06:25.683 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.678+0000 7f489d831700 1 -- 172.21.15.125:0/4184645657 wait complete. 2023-10-06T03:06:25.683 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-06T03:06:25.691 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-10-06T03:06:23.831513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384540,"kb_used_data":6236,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590180,"statfs":{"total":773094113280,"available":770652344320,"internally_reserved":0,"allocated":6385664,"data_stored":3568253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.230036"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.621689+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:21.616453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.620925+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:35.993689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.619224+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:06.942834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.610714+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:16.602275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.615026+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:59.564961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.614240+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:48:47.816353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.616110+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:57.564424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.613310+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:39.366032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.617831+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:57:23.298492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.616543+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:56.862803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.612234+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:45.483003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.617257+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:56.502283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.613399+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:48:47.816353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.618243+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:32.442537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.615744+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:44.519720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.616184+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:52:53.264923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.620712+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:01.525826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.611677+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:56.502283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.617928+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:48.542784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.611483+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:27.973305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.617287+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:39.357700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.611811+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:07.774084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.612005+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:08.911020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.614948+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:17.898762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.614513+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:04.649172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.614798+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:23.406078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.611687+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:39.357700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.622310+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:49.386862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.618600+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.481740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.616510+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:35.232626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.611477+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:35.232626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.616009+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:04.649172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.614993+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:38:00.288381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.631590+0000","last_change":"2023-10-06T03:06:20.631590+0000","last_active":"2023-10-06T03:06:20.631590+0000","last_peered":"2023-10-06T03:06:20.631590+0000","last_clean":"2023-10-06T03:06:20.631590+0000","last_became_active":"2023-10-06T03:06:20.631374+0000","last_became_peered":"2023-10-06T03:06:20.631374+0000","last_unstale":"2023-10-06T03:06:20.631590+0000","last_undegraded":"2023-10-06T03:06:20.631590+0000","last_fullsized":"2023-10-06T03:06:20.631590+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:31.775819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.610477+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:40.381565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.631772+0000","last_change":"2023-10-06T03:06:20.631772+0000","last_active":"2023-10-06T03:06:20.631772+0000","last_peered":"2023-10-06T03:06:20.631772+0000","last_clean":"2023-10-06T03:06:20.631772+0000","last_became_active":"2023-10-06T03:06:20.631522+0000","last_became_peered":"2023-10-06T03:06:20.631522+0000","last_unstale":"2023-10-06T03:06:20.631772+0000","last_undegraded":"2023-10-06T03:06:20.631772+0000","last_fullsized":"2023-10-06T03:06:20.631772+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:05.937982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.614680+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:11.598376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.628973+0000","last_change":"2023-10-06T03:06:20.628973+0000","last_active":"2023-10-06T03:06:20.628973+0000","last_peered":"2023-10-06T03:06:20.628973+0000","last_clean":"2023-10-06T03:06:20.628973+0000","last_became_active":"2023-10-06T03:06:20.628313+0000","last_became_peered":"2023-10-06T03:06:20.628313+0000","last_unstale":"2023-10-06T03:06:20.628973+0000","last_undegraded":"2023-10-06T03:06:20.628973+0000","last_fullsized":"2023-10-06T03:06:20.628973+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:46.862868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.618244+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:09.042554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.628287+0000","last_change":"2023-10-06T03:06:20.628287+0000","last_active":"2023-10-06T03:06:20.628287+0000","last_peered":"2023-10-06T03:06:20.628287+0000","last_clean":"2023-10-06T03:06:20.628287+0000","last_became_active":"2023-10-06T03:06:20.628023+0000","last_became_peered":"2023-10-06T03:06:20.628023+0000","last_unstale":"2023-10-06T03:06:20.628287+0000","last_undegraded":"2023-10-06T03:06:20.628287+0000","last_fullsized":"2023-10-06T03:06:20.628287+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:08.037702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.615688+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:12.220986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.624970+0000","last_change":"2023-10-06T03:06:20.624970+0000","last_active":"2023-10-06T03:06:20.624970+0000","last_peered":"2023-10-06T03:06:20.624970+0000","last_clean":"2023-10-06T03:06:20.624970+0000","last_became_active":"2023-10-06T03:06:20.624691+0000","last_became_peered":"2023-10-06T03:06:20.624691+0000","last_unstale":"2023-10-06T03:06:20.624970+0000","last_undegraded":"2023-10-06T03:06:20.624970+0000","last_fullsized":"2023-10-06T03:06:20.624970+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:22.401226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.621073+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:44.331596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.620568+0000","last_change":"2023-10-06T03:06:20.620568+0000","last_active":"2023-10-06T03:06:20.620568+0000","last_peered":"2023-10-06T03:06:20.620568+0000","last_clean":"2023-10-06T03:06:20.620568+0000","last_became_active":"2023-10-06T03:06:20.620321+0000","last_became_peered":"2023-10-06T03:06:20.620321+0000","last_unstale":"2023-10-06T03:06:20.620568+0000","last_undegraded":"2023-10-06T03:06:20.620568+0000","last_fullsized":"2023-10-06T03:06:20.620568+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:03.644319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.617979+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:57:01.525826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.625335+0000","last_change":"2023-10-06T03:06:20.625335+0000","last_active":"2023-10-06T03:06:20.625335+0000","last_peered":"2023-10-06T03:06:20.625335+0000","last_clean":"2023-10-06T03:06:20.625335+0000","last_became_active":"2023-10-06T03:06:20.624996+0000","last_became_peered":"2023-10-06T03:06:20.624996+0000","last_unstale":"2023-10-06T03:06:20.625335+0000","last_undegraded":"2023-10-06T03:06:20.625335+0000","last_fullsized":"2023-10-06T03:06:20.625335+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:39.376713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.611411+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:25.318899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.630249+0000","last_change":"2023-10-06T03:06:20.630249+0000","last_active":"2023-10-06T03:06:20.630249+0000","last_peered":"2023-10-06T03:06:20.630249+0000","last_clean":"2023-10-06T03:06:20.630249+0000","last_became_active":"2023-10-06T03:06:20.629958+0000","last_became_peered":"2023-10-06T03:06:20.629958+0000","last_unstale":"2023-10-06T03:06:20.630249+0000","last_undegraded":"2023-10-06T03:06:20.630249+0000","last_fullsized":"2023-10-06T03:06:20.630249+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:44.730849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.620745+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:47.426610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.633131+0000","last_change":"2023-10-06T03:06:20.633131+0000","last_active":"2023-10-06T03:06:20.633131+0000","last_peered":"2023-10-06T03:06:20.633131+0000","last_clean":"2023-10-06T03:06:20.633131+0000","last_became_active":"2023-10-06T03:06:20.632929+0000","last_became_peered":"2023-10-06T03:06:20.632929+0000","last_unstale":"2023-10-06T03:06:20.633131+0000","last_undegraded":"2023-10-06T03:06:20.633131+0000","last_fullsized":"2023-10-06T03:06:20.633131+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:48.925338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.611876+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:19.930817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.624338+0000","last_change":"2023-10-06T03:06:20.624338+0000","last_active":"2023-10-06T03:06:20.624338+0000","last_peered":"2023-10-06T03:06:20.624338+0000","last_clean":"2023-10-06T03:06:20.624338+0000","last_became_active":"2023-10-06T03:06:20.624066+0000","last_became_peered":"2023-10-06T03:06:20.624066+0000","last_unstale":"2023-10-06T03:06:20.624338+0000","last_undegraded":"2023-10-06T03:06:20.624338+0000","last_fullsized":"2023-10-06T03:06:20.624338+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:31.418752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.614719+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:07:24.773001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.632587+0000","last_change":"2023-10-06T03:06:20.632587+0000","last_active":"2023-10-06T03:06:20.632587+0000","last_peered":"2023-10-06T03:06:20.632587+0000","last_clean":"2023-10-06T03:06:20.632587+0000","last_became_active":"2023-10-06T03:06:20.632127+0000","last_became_peered":"2023-10-06T03:06:20.632127+0000","last_unstale":"2023-10-06T03:06:20.632587+0000","last_undegraded":"2023-10-06T03:06:20.632587+0000","last_fullsized":"2023-10-06T03:06:20.632587+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:00.533803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.611233+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:04.649172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.627919+0000","last_change":"2023-10-06T03:06:20.627919+0000","last_active":"2023-10-06T03:06:20.627919+0000","last_peered":"2023-10-06T03:06:20.627919+0000","last_clean":"2023-10-06T03:06:20.627919+0000","last_became_active":"2023-10-06T03:06:20.627646+0000","last_became_peered":"2023-10-06T03:06:20.627646+0000","last_unstale":"2023-10-06T03:06:20.627919+0000","last_undegraded":"2023-10-06T03:06:20.627919+0000","last_fullsized":"2023-10-06T03:06:20.627919+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:45.641976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.610447+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:11.598376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.631058+0000","last_change":"2023-10-06T03:06:20.631058+0000","last_active":"2023-10-06T03:06:20.631058+0000","last_peered":"2023-10-06T03:06:20.631058+0000","last_clean":"2023-10-06T03:06:20.631058+0000","last_became_active":"2023-10-06T03:06:20.630645+0000","last_became_peered":"2023-10-06T03:06:20.630645+0000","last_unstale":"2023-10-06T03:06:20.631058+0000","last_undegraded":"2023-10-06T03:06:20.631058+0000","last_fullsized":"2023-10-06T03:06:20.631058+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:42:08.211673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.613971+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:40.381565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.624236+0000","last_change":"2023-10-06T03:06:20.624236+0000","last_active":"2023-10-06T03:06:20.624236+0000","last_peered":"2023-10-06T03:06:20.624236+0000","last_clean":"2023-10-06T03:06:20.624236+0000","last_became_active":"2023-10-06T03:06:20.623955+0000","last_became_peered":"2023-10-06T03:06:20.623955+0000","last_unstale":"2023-10-06T03:06:20.624236+0000","last_undegraded":"2023-10-06T03:06:20.624236+0000","last_fullsized":"2023-10-06T03:06:20.624236+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:31.418752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.617535+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:24.098709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.629263+0000","last_change":"2023-10-06T03:06:20.629263+0000","last_active":"2023-10-06T03:06:20.629263+0000","last_peered":"2023-10-06T03:06:20.629263+0000","last_clean":"2023-10-06T03:06:20.629263+0000","last_became_active":"2023-10-06T03:06:20.626413+0000","last_became_peered":"2023-10-06T03:06:20.626413+0000","last_unstale":"2023-10-06T03:06:20.629263+0000","last_undegraded":"2023-10-06T03:06:20.629263+0000","last_fullsized":"2023-10-06T03:06:20.629263+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:48.412683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.620366+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:38:24.098709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.623501+0000","last_change":"2023-10-06T03:06:20.623501+0000","last_active":"2023-10-06T03:06:20.623501+0000","last_peered":"2023-10-06T03:06:20.623501+0000","last_clean":"2023-10-06T03:06:20.623501+0000","last_became_active":"2023-10-06T03:06:20.623234+0000","last_became_peered":"2023-10-06T03:06:20.623234+0000","last_unstale":"2023-10-06T03:06:20.623501+0000","last_undegraded":"2023-10-06T03:06:20.623501+0000","last_fullsized":"2023-10-06T03:06:20.623501+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:11.535511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.615047+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:40.381565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.630321+0000","last_change":"2023-10-06T03:06:20.630321+0000","last_active":"2023-10-06T03:06:20.630321+0000","last_peered":"2023-10-06T03:06:20.630321+0000","last_clean":"2023-10-06T03:06:20.630321+0000","last_became_active":"2023-10-06T03:06:20.630063+0000","last_became_peered":"2023-10-06T03:06:20.630063+0000","last_unstale":"2023-10-06T03:06:20.630321+0000","last_undegraded":"2023-10-06T03:06:20.630321+0000","last_fullsized":"2023-10-06T03:06:20.630321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:05.937982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.615047+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:25:53.528010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.622624+0000","last_change":"2023-10-06T03:06:20.622624+0000","last_active":"2023-10-06T03:06:20.622624+0000","last_peered":"2023-10-06T03:06:20.622624+0000","last_clean":"2023-10-06T03:06:20.622624+0000","last_became_active":"2023-10-06T03:06:20.622334+0000","last_became_peered":"2023-10-06T03:06:20.622334+0000","last_unstale":"2023-10-06T03:06:20.622624+0000","last_undegraded":"2023-10-06T03:06:20.622624+0000","last_fullsized":"2023-10-06T03:06:20.622624+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:03.476888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.614263+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:16.602275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.629164+0000","last_change":"2023-10-06T03:06:20.629164+0000","last_active":"2023-10-06T03:06:20.629164+0000","last_peered":"2023-10-06T03:06:20.629164+0000","last_clean":"2023-10-06T03:06:20.629164+0000","last_became_active":"2023-10-06T03:06:20.628699+0000","last_became_peered":"2023-10-06T03:06:20.628699+0000","last_unstale":"2023-10-06T03:06:20.629164+0000","last_undegraded":"2023-10-06T03:06:20.629164+0000","last_fullsized":"2023-10-06T03:06:20.629164+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:31.418752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.617526+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:15:55.101218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.624698+0000","last_change":"2023-10-06T03:06:20.624698+0000","last_active":"2023-10-06T03:06:20.624698+0000","last_peered":"2023-10-06T03:06:20.624698+0000","last_clean":"2023-10-06T03:06:20.624698+0000","last_became_active":"2023-10-06T03:06:20.624434+0000","last_became_peered":"2023-10-06T03:06:20.624434+0000","last_unstale":"2023-10-06T03:06:20.624698+0000","last_undegraded":"2023-10-06T03:06:20.624698+0000","last_fullsized":"2023-10-06T03:06:20.624698+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:58.374860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.617007+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:01:01.784149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.630511+0000","last_change":"2023-10-06T03:06:20.630511+0000","last_active":"2023-10-06T03:06:20.630511+0000","last_peered":"2023-10-06T03:06:20.630511+0000","last_clean":"2023-10-06T03:06:20.630511+0000","last_became_active":"2023-10-06T03:06:20.629748+0000","last_became_peered":"2023-10-06T03:06:20.629748+0000","last_unstale":"2023-10-06T03:06:20.630511+0000","last_undegraded":"2023-10-06T03:06:20.630511+0000","last_fullsized":"2023-10-06T03:06:20.630511+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:41.887149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.611028+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:48:47.816353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.624481+0000","last_change":"2023-10-06T03:06:20.624481+0000","last_active":"2023-10-06T03:06:20.624481+0000","last_peered":"2023-10-06T03:06:20.624481+0000","last_clean":"2023-10-06T03:06:20.624481+0000","last_became_active":"2023-10-06T03:06:20.624019+0000","last_became_peered":"2023-10-06T03:06:20.624019+0000","last_unstale":"2023-10-06T03:06:20.624481+0000","last_undegraded":"2023-10-06T03:06:20.624481+0000","last_fullsized":"2023-10-06T03:06:20.624481+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:15.597423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.620415+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:48:48.542784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.619461+0000","last_change":"2023-10-06T03:06:20.619461+0000","last_active":"2023-10-06T03:06:20.619461+0000","last_peered":"2023-10-06T03:06:20.619461+0000","last_clean":"2023-10-06T03:06:20.619461+0000","last_became_active":"2023-10-06T03:06:20.619221+0000","last_became_peered":"2023-10-06T03:06:20.619221+0000","last_unstale":"2023-10-06T03:06:20.619461+0000","last_undegraded":"2023-10-06T03:06:20.619461+0000","last_fullsized":"2023-10-06T03:06:20.619461+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:10.593523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.614679+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:39:19.403276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.627212+0000","last_change":"2023-10-06T03:06:20.627212+0000","last_active":"2023-10-06T03:06:20.627212+0000","last_peered":"2023-10-06T03:06:20.627212+0000","last_clean":"2023-10-06T03:06:20.627212+0000","last_became_active":"2023-10-06T03:06:20.625418+0000","last_became_peered":"2023-10-06T03:06:20.625418+0000","last_unstale":"2023-10-06T03:06:20.627212+0000","last_undegraded":"2023-10-06T03:06:20.627212+0000","last_fullsized":"2023-10-06T03:06:20.627212+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:58.560109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.616523+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:06.396629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.624883+0000","last_change":"2023-10-06T03:06:20.624883+0000","last_active":"2023-10-06T03:06:20.624883+0000","last_peered":"2023-10-06T03:06:20.624883+0000","last_clean":"2023-10-06T03:06:20.624883+0000","last_became_active":"2023-10-06T03:06:20.624619+0000","last_became_peered":"2023-10-06T03:06:20.624619+0000","last_unstale":"2023-10-06T03:06:20.624883+0000","last_undegraded":"2023-10-06T03:06:20.624883+0000","last_fullsized":"2023-10-06T03:06:20.624883+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:11.535511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:06:19.608735+0000","last_change":"2023-10-06T03:04:23.986472+0000","last_active":"2023-10-06T03:06:19.608735+0000","last_peered":"2023-10-06T03:06:19.608735+0000","last_clean":"2023-10-06T03:06:19.608735+0000","last_became_active":"2023-10-06T03:04:23.986228+0000","last_became_peered":"2023-10-06T03:04:23.986228+0000","last_unstale":"2023-10-06T03:06:19.608735+0000","last_undegraded":"2023-10-06T03:06:19.608735+0000","last_fullsized":"2023-10-06T03:06:19.608735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:08.739849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.615459+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:59.379712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.630137+0000","last_change":"2023-10-06T03:06:20.630137+0000","last_active":"2023-10-06T03:06:20.630137+0000","last_peered":"2023-10-06T03:06:20.630137+0000","last_clean":"2023-10-06T03:06:20.630137+0000","last_became_active":"2023-10-06T03:06:20.629832+0000","last_became_peered":"2023-10-06T03:06:20.629832+0000","last_unstale":"2023-10-06T03:06:20.630137+0000","last_undegraded":"2023-10-06T03:06:20.630137+0000","last_fullsized":"2023-10-06T03:06:20.630137+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:11.535511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:06:19.611164+0000","last_change":"2023-10-06T03:04:23.814917+0000","last_active":"2023-10-06T03:06:19.611164+0000","last_peered":"2023-10-06T03:06:19.611164+0000","last_clean":"2023-10-06T03:06:19.611164+0000","last_became_active":"2023-10-06T03:04:23.814601+0000","last_became_peered":"2023-10-06T03:04:23.814601+0000","last_unstale":"2023-10-06T03:06:19.611164+0000","last_undegraded":"2023-10-06T03:06:19.611164+0000","last_fullsized":"2023-10-06T03:06:19.611164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.613415+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:11.598376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.624082+0000","last_change":"2023-10-06T03:06:20.624082+0000","last_active":"2023-10-06T03:06:20.624082+0000","last_peered":"2023-10-06T03:06:20.624082+0000","last_clean":"2023-10-06T03:06:20.624082+0000","last_became_active":"2023-10-06T03:06:20.623824+0000","last_became_peered":"2023-10-06T03:06:20.623824+0000","last_unstale":"2023-10-06T03:06:20.624082+0000","last_undegraded":"2023-10-06T03:06:20.624082+0000","last_fullsized":"2023-10-06T03:06:20.624082+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:08.037702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:06:19.604430+0000","last_change":"2023-10-06T03:04:24.314547+0000","last_active":"2023-10-06T03:06:19.604430+0000","last_peered":"2023-10-06T03:06:19.604430+0000","last_clean":"2023-10-06T03:06:19.604430+0000","last_became_active":"2023-10-06T03:04:24.314278+0000","last_became_peered":"2023-10-06T03:04:24.314278+0000","last_unstale":"2023-10-06T03:06:19.604430+0000","last_undegraded":"2023-10-06T03:06:19.604430+0000","last_fullsized":"2023-10-06T03:06:19.604430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:25.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.614504+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:14:48.569492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.627128+0000","last_change":"2023-10-06T03:06:20.627128+0000","last_active":"2023-10-06T03:06:20.627128+0000","last_peered":"2023-10-06T03:06:20.627128+0000","last_clean":"2023-10-06T03:06:20.627128+0000","last_became_active":"2023-10-06T03:06:20.626867+0000","last_became_peered":"2023-10-06T03:06:20.626867+0000","last_unstale":"2023-10-06T03:06:20.627128+0000","last_undegraded":"2023-10-06T03:06:20.627128+0000","last_fullsized":"2023-10-06T03:06:20.627128+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:34.227774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:06:19.610926+0000","last_change":"2023-10-06T03:04:23.807972+0000","last_active":"2023-10-06T03:06:19.610926+0000","last_peered":"2023-10-06T03:06:19.610926+0000","last_clean":"2023-10-06T03:06:19.610926+0000","last_became_active":"2023-10-06T03:04:23.807723+0000","last_became_peered":"2023-10-06T03:04:23.807723+0000","last_unstale":"2023-10-06T03:06:19.610926+0000","last_undegraded":"2023-10-06T03:06:19.610926+0000","last_fullsized":"2023-10-06T03:06:19.610926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":193,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:06:19.607658+0000","last_change":"2023-10-06T03:04:17.779925+0000","last_active":"2023-10-06T03:06:19.607658+0000","last_peered":"2023-10-06T03:06:19.607658+0000","last_clean":"2023-10-06T03:06:19.607658+0000","last_became_active":"2023-10-06T03:04:17.778997+0000","last_became_peered":"2023-10-06T03:04:17.778997+0000","last_unstale":"2023-10-06T03:06:19.607658+0000","last_undegraded":"2023-10-06T03:06:19.607658+0000","last_fullsized":"2023-10-06T03:06:19.607658+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_clean_scrub_stamp":"2023-10-06T03:04:16.761610+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.615550+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:16.602275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.623551+0000","last_change":"2023-10-06T03:06:20.623551+0000","last_active":"2023-10-06T03:06:20.623551+0000","last_peered":"2023-10-06T03:06:20.623551+0000","last_clean":"2023-10-06T03:06:20.623551+0000","last_became_active":"2023-10-06T03:06:20.623215+0000","last_became_peered":"2023-10-06T03:06:20.623215+0000","last_unstale":"2023-10-06T03:06:20.623551+0000","last_undegraded":"2023-10-06T03:06:20.623551+0000","last_fullsized":"2023-10-06T03:06:20.623551+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:03.476888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:06:19.607750+0000","last_change":"2023-10-06T03:04:23.814887+0000","last_active":"2023-10-06T03:06:19.607750+0000","last_peered":"2023-10-06T03:06:19.607750+0000","last_clean":"2023-10-06T03:06:19.607750+0000","last_became_active":"2023-10-06T03:04:23.814581+0000","last_became_peered":"2023-10-06T03:04:23.814581+0000","last_unstale":"2023-10-06T03:06:19.607750+0000","last_undegraded":"2023-10-06T03:06:19.607750+0000","last_fullsized":"2023-10-06T03:06:19.607750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.615888+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:32.780672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.630071+0000","last_change":"2023-10-06T03:06:20.630071+0000","last_active":"2023-10-06T03:06:20.630071+0000","last_peered":"2023-10-06T03:06:20.630071+0000","last_clean":"2023-10-06T03:06:20.630071+0000","last_became_active":"2023-10-06T03:06:20.629809+0000","last_became_peered":"2023-10-06T03:06:20.629809+0000","last_unstale":"2023-10-06T03:06:20.630071+0000","last_undegraded":"2023-10-06T03:06:20.630071+0000","last_fullsized":"2023-10-06T03:06:20.630071+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:39.342768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:06:19.607821+0000","last_change":"2023-10-06T03:04:23.986771+0000","last_active":"2023-10-06T03:06:19.607821+0000","last_peered":"2023-10-06T03:06:19.607821+0000","last_clean":"2023-10-06T03:06:19.607821+0000","last_became_active":"2023-10-06T03:04:23.986552+0000","last_became_peered":"2023-10-06T03:04:23.986552+0000","last_unstale":"2023-10-06T03:06:19.607821+0000","last_undegraded":"2023-10-06T03:06:19.607821+0000","last_fullsized":"2023-10-06T03:06:19.607821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.611139+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:23.406078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.632683+0000","last_change":"2023-10-06T03:06:20.632683+0000","last_active":"2023-10-06T03:06:20.632683+0000","last_peered":"2023-10-06T03:06:20.632683+0000","last_clean":"2023-10-06T03:06:20.632683+0000","last_became_active":"2023-10-06T03:06:20.632440+0000","last_became_peered":"2023-10-06T03:06:20.632440+0000","last_unstale":"2023-10-06T03:06:20.632683+0000","last_undegraded":"2023-10-06T03:06:20.632683+0000","last_fullsized":"2023-10-06T03:06:20.632683+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:14.207986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:06:19.608534+0000","last_change":"2023-10-06T03:04:23.813862+0000","last_active":"2023-10-06T03:06:19.608534+0000","last_peered":"2023-10-06T03:06:19.608534+0000","last_clean":"2023-10-06T03:06:19.608534+0000","last_became_active":"2023-10-06T03:04:23.813584+0000","last_became_peered":"2023-10-06T03:04:23.813584+0000","last_unstale":"2023-10-06T03:06:19.608534+0000","last_undegraded":"2023-10-06T03:06:19.608534+0000","last_fullsized":"2023-10-06T03:06:19.608534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.615704+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:46.646829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.616127+0000","last_change":"2023-10-06T03:06:20.616127+0000","last_active":"2023-10-06T03:06:20.616127+0000","last_peered":"2023-10-06T03:06:20.616127+0000","last_clean":"2023-10-06T03:06:20.616127+0000","last_became_active":"2023-10-06T03:06:20.615836+0000","last_became_peered":"2023-10-06T03:06:20.615836+0000","last_unstale":"2023-10-06T03:06:20.616127+0000","last_undegraded":"2023-10-06T03:06:20.616127+0000","last_fullsized":"2023-10-06T03:06:20.616127+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:55.497431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:06:19.604981+0000","last_change":"2023-10-06T03:04:23.805874+0000","last_active":"2023-10-06T03:06:19.604981+0000","last_peered":"2023-10-06T03:06:19.604981+0000","last_clean":"2023-10-06T03:06:19.604981+0000","last_became_active":"2023-10-06T03:04:23.805551+0000","last_became_peered":"2023-10-06T03:04:23.805551+0000","last_unstale":"2023-10-06T03:06:19.604981+0000","last_undegraded":"2023-10-06T03:06:19.604981+0000","last_fullsized":"2023-10-06T03:06:19.604981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:21.250275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":894130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.629,"15min":0.64300000000000002},"min":{"1min":0.318,"5min":0.314,"15min":0.314},"max":{"1min":0.69999999999999996,"5min":3.8860000000000001,"15min":3.8860000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.64900000000000002,"15min":0.66400000000000003},"min":{"1min":0.38700000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.69699999999999995,"5min":3.988,"15min":3.988},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.65200000000000002,"15min":0.67000000000000004},"min":{"1min":0.36199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.81899999999999995,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":0.498},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.64800000000000002,"15min":0.66400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73099999999999998,"5min":3.444,"15min":3.444},"last":0.625}]},{"osd":2,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.67000000000000004,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78800000000000003,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85599999999999998,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.68799999999999994,"15min":0.70599999999999996},"min":{"1min":0.45600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.73099999999999998,"5min":3.903,"15min":3.903},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.71499999999999997,"15min":0.73399999999999999},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.746,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":0.66800000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46800000000000003,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.55700000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.38800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65400000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.39400000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.64000000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.43099999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59899999999999998,"15min":0.60399999999999998},"min":{"1min":0.46600000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.71399999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79100000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297920,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":647168,"data_stored":296834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.79700000000000004,"15min":0.84299999999999997},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77200000000000002,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.83699999999999997,"15min":0.89300000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.64600000000000002,"5min":6.8330000000000002,"15min":6.8330000000000002},"last":0.64600000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.71599999999999997,"15min":0.74399999999999999},"min":{"1min":0.34899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.72299999999999998,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.73899999999999999,"15min":0.76500000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":3.948,"15min":3.948},"last":0.752}]},{"osd":2,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.754,"15min":0.754},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.75800000000000001,"5min":3.996,"15min":3.996},"last":0.52300000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.877},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.71799999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.71799999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.34399999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.36499999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.83099999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.50600000000000001,"15min":0.499},"min":{"1min":0.40999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.89600000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.443,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.46600000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.84999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297920,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":647168,"data_stored":296834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.38700000000000001,"15min":0.39700000000000002},"min":{"1min":0.20999999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.50900000000000001,"5min":1.159,"15min":1.159},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.375,"15min":0.379},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46999999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.374}]},{"osd":2,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.58999999999999997,"15min":0.63200000000000001},"min":{"1min":0.254,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.44500000000000001,"5min":6.056,"15min":6.056},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57499999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.40200000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.44800000000000001,"15min":0.45500000000000002},"min":{"1min":0.27700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.502,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.443,"15min":0.45100000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.56000000000000005,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.432}]},{"osd":4,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.46800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.77800000000000002,"5min":1.244,"15min":1.244},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.495,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":1.216,"15min":1.216},"last":0.78400000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.628,"15min":0.624},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82899999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.627,"15min":0.627},"min":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.76800000000000002,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.64800000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89200000000000002,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.753},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85699999999999998,"5min":1.014,"15min":1.014},"last":0.69099999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":1.099,"15min":1.099},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.79800000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.79300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298508,"kb_used_data":1220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073332,"statfs":{"total":96636764160,"available":96331091968,"internally_reserved":0,"allocated":1249280,"data_stored":893119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.35799999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.39600000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.373}]},{"osd":4,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.503},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.57299999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.53800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297920,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":647168,"data_stored":296834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":12.913,"5min":12.913,"15min":12.913},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.35199999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":3.8919999999999999,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.372},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.433}]},{"osd":3,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.371,"15min":0.371},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.33700000000000002},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":12.941000000000001,"5min":12.941000000000001,"15min":12.941000000000001},"last":0.41499999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":12.846,"5min":12.846,"15min":12.846},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.624}]},{"osd":5,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.57499999999999996},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":12.884,"5min":12.884,"15min":12.884},"last":0.498}]},{"osd":6,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51900000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.45000000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297920,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":647168,"data_stored":296834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.373,"15min":0.38400000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55000000000000004,"5min":1.361,"15min":1.361},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.311,"5min":0.34899999999999998,"15min":0.35499999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.51200000000000001,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.318}]},{"osd":1,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.376,"15min":0.38300000000000001},"min":{"1min":0.20699999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53400000000000003,"5min":1.133,"15min":1.133},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.27800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66100000000000003,"5min":1.45,"15min":1.45},"last":0.34399999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57399999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.433,"15min":0.443},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59499999999999997,"5min":1.476,"15min":1.476},"last":0.42499999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.38100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":1.649,"15min":1.649},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80200000000000005,"5min":1.054,"15min":1.054},"last":0.79000000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77300000000000002,"5min":1.401,"15min":1.401},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77800000000000002,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.73199999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78000000000000003,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.748},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.46200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83399999999999996,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.77900000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81999999999999995,"5min":1.679,"15min":1.679},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80300000000000005,"5min":1.083,"15min":1.083},"last":0.70899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297920,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":647168,"data_stored":296834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52000000000000002,"15min":0.51100000000000001},"min":{"1min":0.376,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.41099999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84999999999999998,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.64600000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82699999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80400000000000005,"5min":0.875,"15min":0.875},"last":0.627}]},{"osd":2,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.42699999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.57999999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90200000000000002,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.63800000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83899999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.33900000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.48999999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.50600000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297920,"kb_used_data":632,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073920,"statfs":{"total":96636764160,"available":96331694080,"internally_reserved":0,"allocated":647168,"data_stored":296834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68500000000000005,"5min":1.012,"15min":1.012},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74399999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.36699999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70599999999999996,"5min":1.03,"15min":1.03},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.71399999999999997,"5min":0.755,"15min":0.755},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55400000000000005,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.76800000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.437},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.71899999999999997,"5min":0.998,"15min":0.998},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.58299999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.69599999999999995,"5min":1.048,"15min":1.048},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72799999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.40500000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.745,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.50700000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61699999999999999,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.76200000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.34200000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69199999999999995,"5min":0.872,"15min":0.872},"last":0.48599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:06:25.699 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:06:25.850 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.849+0000 7f91c4616700 1 Processor -- start 2023-10-06T03:06:25.851 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.849+0000 7f91c4616700 1 -- start start 2023-10-06T03:06:25.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.850+0000 7f91c4616700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91bc157380 0x7f91bc0acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:25.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.850+0000 7f91c4616700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f91bc0ad120 0x7f91bc06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:25.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.850+0000 7f91c4616700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91bc0ac750 con 0x7f91bc156fb0 2023-10-06T03:06:25.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.850+0000 7f91c4616700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91bc068c60 con 0x7f91bc0ad120 2023-10-06T03:06:25.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.850+0000 7f91c4616700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc0abb40 con 0x7f91bc157380 2023-10-06T03:06:25.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.850+0000 7f91c2bb3700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f91bc0ad120 0x7f91bc06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:25.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.850+0000 7f91c2bb3700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f91bc0ad120 0x7f91bc06a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:59112/0 (socket says 172.21.15.125:59112) 2023-10-06T03:06:25.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.850+0000 7f91c23b2700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f91bc156fb0 0x7f91bc068550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:38800/0 (socket says 172.21.15.125:38800) 2023-10-06T03:06:25.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.850+0000 7f91c1bb1700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91bc157380 0x7f91bc0acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:25.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.850+0000 7f91c2bb3700 1 -- 172.21.15.125:0/1714062253 learned_addr learned my addr 172.21.15.125:0/1714062253 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:25.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.850+0000 7f91c1bb1700 1 -- 172.21.15.125:0/1714062253 >> v2:172.21.15.130:3300/0 conn(0x7f91bc0ad120 msgr2=0x7f91bc06a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:25.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.850+0000 7f91c1bb1700 1 --2- 172.21.15.125:0/1714062253 >> v2:172.21.15.130:3300/0 conn(0x7f91bc0ad120 0x7f91bc06a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.850+0000 7f91c1bb1700 1 -- 172.21.15.125:0/1714062253 >> v1:172.21.15.130:6789/0 conn(0x7f91bc156fb0 legacy=0x7f91bc068550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:25.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.850+0000 7f91c1bb1700 1 -- 172.21.15.125:0/1714062253 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc0abe20 con 0x7f91bc157380 2023-10-06T03:06:25.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.850+0000 7f91c2bb3700 1 --2- 172.21.15.125:0/1714062253 >> v2:172.21.15.130:3300/0 conn(0x7f91bc0ad120 0x7f91bc06a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:06:25.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.851+0000 7f91c1bb1700 1 --2- 172.21.15.125:0/1714062253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91bc157380 0x7f91bc0acbe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f91ac0098e0 tx=0x7f91ac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f62232a625d16497 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:25.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.851+0000 7f91c13b0700 1 -- 172.21.15.125:0/1714062253 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac00b640 con 0x7f91bc157380 2023-10-06T03:06:25.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.851+0000 7f91c13b0700 1 -- 172.21.15.125:0/1714062253 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ac00b7a0 con 0x7f91bc157380 2023-10-06T03:06:25.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.851+0000 7f91c13b0700 1 -- 172.21.15.125:0/1714062253 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac00bb40 con 0x7f91bc157380 2023-10-06T03:06:25.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.851+0000 7f91c4616700 1 -- 172.21.15.125:0/1714062253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91bc157380 msgr2=0x7f91bc0acbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:25.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.851+0000 7f91c4616700 1 --2- 172.21.15.125:0/1714062253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91bc157380 0x7f91bc0acbe0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f91ac0098e0 tx=0x7f91ac0091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.851+0000 7f91c4616700 1 -- 172.21.15.125:0/1714062253 shutdown_connections 2023-10-06T03:06:25.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.851+0000 7f91c4616700 1 --2- 172.21.15.125:0/1714062253 >> v2:172.21.15.130:3300/0 conn(0x7f91bc0ad120 0x7f91bc06a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.851+0000 7f91c4616700 1 --2- 172.21.15.125:0/1714062253 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91bc157380 0x7f91bc0acbe0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.851+0000 7f91c4616700 1 -- 172.21.15.125:0/1714062253 >> 172.21.15.125:0/1714062253 conn(0x7f91bc0cc5a0 msgr2=0x7f91bc0cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:25.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.851+0000 7f91c4616700 1 -- 172.21.15.125:0/1714062253 shutdown_connections 2023-10-06T03:06:25.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.852+0000 7f91c4616700 1 -- 172.21.15.125:0/1714062253 wait complete. 2023-10-06T03:06:25.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.853+0000 7f91c4616700 1 Processor -- start 2023-10-06T03:06:25.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.853+0000 7f91c4616700 1 -- start start 2023-10-06T03:06:25.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.853+0000 7f91c4616700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91bc0ad120 0x7f91bc152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:25.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.853+0000 7f91c4616700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91bc156fb0 0x7f91bc159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:25.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.853+0000 7f91c4616700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91bc0b0830 0x7f91bc0b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:25.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.853+0000 7f91c4616700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc0c5b90 con 0x7f91bc0ad120 2023-10-06T03:06:25.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.853+0000 7f91c4616700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc0b1210 con 0x7f91bc0b0830 2023-10-06T03:06:25.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.853+0000 7f91c4616700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc0c35b0 con 0x7f91bc156fb0 2023-10-06T03:06:25.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.853+0000 7f91c23b2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91bc0ad120 0x7f91bc152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:25.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.854+0000 7f91c23b2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91bc0ad120 0x7f91bc152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44756/0 (socket says 172.21.15.125:44756) 2023-10-06T03:06:25.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.854+0000 7f91c23b2700 1 -- 172.21.15.125:0/1446531231 learned_addr learned my addr 172.21.15.125:0/1446531231 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:25.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.854+0000 7f91c1bb1700 1 --2- 172.21.15.125:0/1446531231 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91bc156fb0 0x7f91bc159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:25.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.854+0000 7f91c2bb3700 1 --2- 172.21.15.125:0/1446531231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91bc0b0830 0x7f91bc0b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:25.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.854+0000 7f91c23b2700 1 -- 172.21.15.125:0/1446531231 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91bc156fb0 msgr2=0x7f91bc159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:25.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.854+0000 7f91c23b2700 1 --2- 172.21.15.125:0/1446531231 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91bc156fb0 0x7f91bc159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.854+0000 7f91c23b2700 1 -- 172.21.15.125:0/1446531231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91bc0b0830 msgr2=0x7f91bc0b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:25.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.854+0000 7f91c23b2700 1 --2- 172.21.15.125:0/1446531231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91bc0b0830 0x7f91bc0b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.854+0000 7f91c23b2700 1 -- 172.21.15.125:0/1446531231 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b80094f0 con 0x7f91bc0ad120 2023-10-06T03:06:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.854+0000 7f91c2bb3700 1 --2- 172.21.15.125:0/1446531231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91bc0b0830 0x7f91bc0b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.854+0000 7f91c23b2700 1 --2- 172.21.15.125:0/1446531231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91bc0ad120 0x7f91bc152ba0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f91b400cd80 tx=0x7f91b4001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.854+0000 7f91b27fc700 1 -- 172.21.15.125:0/1446531231 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b4005df0 con 0x7f91bc0ad120 2023-10-06T03:06:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.854+0000 7f91b27fc700 1 -- 172.21.15.125:0/1446531231 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b400a960 con 0x7f91bc0ad120 2023-10-06T03:06:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.854+0000 7f91c4616700 1 -- 172.21.15.125:0/1446531231 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91ac009420 con 0x7f91bc0ad120 2023-10-06T03:06:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.854+0000 7f91b27fc700 1 -- 172.21.15.125:0/1446531231 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b400ad20 con 0x7f91bc0ad120 2023-10-06T03:06:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.854+0000 7f91c4616700 1 -- 172.21.15.125:0/1446531231 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91bc0c3d80 con 0x7f91bc0ad120 2023-10-06T03:06:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.855+0000 7f91c4616700 1 -- 172.21.15.125:0/1446531231 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91bc066510 con 0x7f91bc0ad120 2023-10-06T03:06:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.856+0000 7f91b27fc700 1 -- 172.21.15.125:0/1446531231 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f91b4007300 con 0x7f91bc0ad120 2023-10-06T03:06:25.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.856+0000 7f91b27fc700 1 --2- 172.21.15.125:0/1446531231 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f91a0066f30 0x7f91a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:25.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.856+0000 7f91b27fc700 1 -- 172.21.15.125:0/1446531231 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f91b4084900 con 0x7f91bc0ad120 2023-10-06T03:06:25.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.856+0000 7f91c1bb1700 1 --2- 172.21.15.125:0/1446531231 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f91a0066f30 0x7f91a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:25.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.856+0000 7f91c1bb1700 1 --2- 172.21.15.125:0/1446531231 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f91a0066f30 0x7f91a00693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f91ac0093f0 tx=0x7f91ac017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:25.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:25.860+0000 7f91b27fc700 1 -- 172.21.15.125:0/1446531231 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91b4051950 con 0x7f91bc0ad120 2023-10-06T03:06:25.911 INFO:tasks.ceph.mds.a.smithi125.stderr:2023-10-06T03:06:25.910+0000 7f208dd7a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:06:26.043 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.041+0000 7f91c4616700 1 -- 172.21.15.125:0/1446531231 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91bc166f30 con 0x7f91a0066f30 2023-10-06T03:06:26.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.049+0000 7f91b27fc700 1 -- 172.21.15.125:0/1446531231 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310315 (secure 0 0 0) 0x7f91bc166f30 con 0x7f91a0066f30 2023-10-06T03:06:26.054 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:26.056 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.053+0000 7f91c4616700 1 -- 172.21.15.125:0/1446531231 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f91a0066f30 msgr2=0x7f91a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:26.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.053+0000 7f91c4616700 1 --2- 172.21.15.125:0/1446531231 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f91a0066f30 0x7f91a00693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f91ac0093f0 tx=0x7f91ac017000 comp rx=0 tx=0).stop 2023-10-06T03:06:26.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.053+0000 7f91c4616700 1 -- 172.21.15.125:0/1446531231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91bc0ad120 msgr2=0x7f91bc152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:26.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.053+0000 7f91c4616700 1 --2- 172.21.15.125:0/1446531231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91bc0ad120 0x7f91bc152ba0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f91b400cd80 tx=0x7f91b4001b90 comp rx=0 tx=0).stop 2023-10-06T03:06:26.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.053+0000 7f91c4616700 1 -- 172.21.15.125:0/1446531231 shutdown_connections 2023-10-06T03:06:26.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.053+0000 7f91c4616700 1 --2- 172.21.15.125:0/1446531231 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f91a0066f30 0x7f91a00693e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.053+0000 7f91c4616700 1 --2- 172.21.15.125:0/1446531231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f91bc0b0830 0x7f91bc0b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.053+0000 7f91c4616700 1 --2- 172.21.15.125:0/1446531231 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f91bc0ad120 0x7f91bc152ba0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.053+0000 7f91c4616700 1 --2- 172.21.15.125:0/1446531231 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f91bc156fb0 0x7f91bc159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.057 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.053+0000 7f91c4616700 1 -- 172.21.15.125:0/1446531231 >> 172.21.15.125:0/1446531231 conn(0x7f91bc0cc5a0 msgr2=0x7f91bc153a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:26.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.053+0000 7f91c4616700 1 -- 172.21.15.125:0/1446531231 shutdown_connections 2023-10-06T03:06:26.058 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.053+0000 7f91c4616700 1 -- 172.21.15.125:0/1446531231 wait complete. 2023-10-06T03:06:26.058 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-06T03:06:26.065 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-10-06T03:06:25.831879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592480,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384804,"kb_used_data":6500,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589916,"statfs":{"total":773094113280,"available":770652073984,"internally_reserved":0,"allocated":6656000,"data_stored":3700067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2112,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000936"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633100+0000","last_change":"2023-10-06T03:06:21.621607+0000","last_active":"2023-10-06T03:06:21.633100+0000","last_peered":"2023-10-06T03:06:21.633100+0000","last_clean":"2023-10-06T03:06:21.633100+0000","last_became_active":"2023-10-06T03:06:21.621336+0000","last_became_peered":"2023-10-06T03:06:21.621336+0000","last_unstale":"2023-10-06T03:06:21.633100+0000","last_undegraded":"2023-10-06T03:06:21.633100+0000","last_fullsized":"2023-10-06T03:06:21.633100+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:03.625453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639899+0000","last_change":"2023-10-06T03:06:21.638143+0000","last_active":"2023-10-06T03:06:21.639899+0000","last_peered":"2023-10-06T03:06:21.639899+0000","last_clean":"2023-10-06T03:06:21.639899+0000","last_became_active":"2023-10-06T03:06:21.637865+0000","last_became_peered":"2023-10-06T03:06:21.637865+0000","last_unstale":"2023-10-06T03:06:21.639899+0000","last_undegraded":"2023-10-06T03:06:21.639899+0000","last_fullsized":"2023-10-06T03:06:21.639899+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:12.454052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.619224+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:06.942834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639545+0000","last_change":"2023-10-06T03:06:21.632909+0000","last_active":"2023-10-06T03:06:21.639545+0000","last_peered":"2023-10-06T03:06:21.639545+0000","last_clean":"2023-10-06T03:06:21.639545+0000","last_became_active":"2023-10-06T03:06:21.632654+0000","last_became_peered":"2023-10-06T03:06:21.632654+0000","last_unstale":"2023-10-06T03:06:21.639545+0000","last_undegraded":"2023-10-06T03:06:21.639545+0000","last_fullsized":"2023-10-06T03:06:21.639545+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:34.401176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635047+0000","last_change":"2023-10-06T03:06:21.628138+0000","last_active":"2023-10-06T03:06:21.635047+0000","last_peered":"2023-10-06T03:06:21.635047+0000","last_clean":"2023-10-06T03:06:21.635047+0000","last_became_active":"2023-10-06T03:06:21.627839+0000","last_became_peered":"2023-10-06T03:06:21.627839+0000","last_unstale":"2023-10-06T03:06:21.635047+0000","last_undegraded":"2023-10-06T03:06:21.635047+0000","last_fullsized":"2023-10-06T03:06:21.635047+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:35.993689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.614240+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:48:47.816353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.643908+0000","last_change":"2023-10-06T03:06:21.636657+0000","last_active":"2023-10-06T03:06:21.643908+0000","last_peered":"2023-10-06T03:06:21.643908+0000","last_clean":"2023-10-06T03:06:21.643908+0000","last_became_active":"2023-10-06T03:06:21.636400+0000","last_became_peered":"2023-10-06T03:06:21.636400+0000","last_unstale":"2023-10-06T03:06:21.643908+0000","last_undegraded":"2023-10-06T03:06:21.643908+0000","last_fullsized":"2023-10-06T03:06:21.643908+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:45.735702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.637344+0000","last_change":"2023-10-06T03:06:21.631743+0000","last_active":"2023-10-06T03:06:21.637344+0000","last_peered":"2023-10-06T03:06:21.637344+0000","last_clean":"2023-10-06T03:06:21.637344+0000","last_became_active":"2023-10-06T03:06:21.631464+0000","last_became_peered":"2023-10-06T03:06:21.631464+0000","last_unstale":"2023-10-06T03:06:21.637344+0000","last_undegraded":"2023-10-06T03:06:21.637344+0000","last_fullsized":"2023-10-06T03:06:21.637344+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:39.677516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.617831+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:57:23.298492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.616543+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:56.862803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635263+0000","last_change":"2023-10-06T03:06:21.624427+0000","last_active":"2023-10-06T03:06:21.635263+0000","last_peered":"2023-10-06T03:06:21.635263+0000","last_clean":"2023-10-06T03:06:21.635263+0000","last_became_active":"2023-10-06T03:06:21.624098+0000","last_became_peered":"2023-10-06T03:06:21.624098+0000","last_unstale":"2023-10-06T03:06:21.635263+0000","last_undegraded":"2023-10-06T03:06:21.635263+0000","last_fullsized":"2023-10-06T03:06:21.635263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:39.677516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.634789+0000","last_change":"2023-10-06T03:06:21.629593+0000","last_active":"2023-10-06T03:06:21.634789+0000","last_peered":"2023-10-06T03:06:21.634789+0000","last_clean":"2023-10-06T03:06:21.634789+0000","last_became_active":"2023-10-06T03:06:21.629297+0000","last_became_peered":"2023-10-06T03:06:21.629297+0000","last_unstale":"2023-10-06T03:06:21.634789+0000","last_undegraded":"2023-10-06T03:06:21.634789+0000","last_fullsized":"2023-10-06T03:06:21.634789+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:15.019288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633817+0000","last_change":"2023-10-06T03:06:21.625690+0000","last_active":"2023-10-06T03:06:21.633817+0000","last_peered":"2023-10-06T03:06:21.633817+0000","last_clean":"2023-10-06T03:06:21.633817+0000","last_became_active":"2023-10-06T03:06:21.625430+0000","last_became_peered":"2023-10-06T03:06:21.625430+0000","last_unstale":"2023-10-06T03:06:21.633817+0000","last_undegraded":"2023-10-06T03:06:21.633817+0000","last_fullsized":"2023-10-06T03:06:21.633817+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:25.318899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.618243+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:32.442537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.615744+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:44.519720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636378+0000","last_change":"2023-10-06T03:06:21.633328+0000","last_active":"2023-10-06T03:06:21.636378+0000","last_peered":"2023-10-06T03:06:21.636378+0000","last_clean":"2023-10-06T03:06:21.636378+0000","last_became_active":"2023-10-06T03:06:21.633115+0000","last_became_peered":"2023-10-06T03:06:21.633115+0000","last_unstale":"2023-10-06T03:06:21.636378+0000","last_undegraded":"2023-10-06T03:06:21.636378+0000","last_fullsized":"2023-10-06T03:06:21.636378+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:46.396243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633176+0000","last_change":"2023-10-06T03:06:21.630252+0000","last_active":"2023-10-06T03:06:21.633176+0000","last_peered":"2023-10-06T03:06:21.633176+0000","last_clean":"2023-10-06T03:06:21.633176+0000","last_became_active":"2023-10-06T03:06:21.629902+0000","last_became_peered":"2023-10-06T03:06:21.629902+0000","last_unstale":"2023-10-06T03:06:21.633176+0000","last_undegraded":"2023-10-06T03:06:21.633176+0000","last_fullsized":"2023-10-06T03:06:21.633176+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:49.417536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639251+0000","last_change":"2023-10-06T03:06:21.635767+0000","last_active":"2023-10-06T03:06:21.639251+0000","last_peered":"2023-10-06T03:06:21.639251+0000","last_clean":"2023-10-06T03:06:21.639251+0000","last_became_active":"2023-10-06T03:06:21.635155+0000","last_became_peered":"2023-10-06T03:06:21.635155+0000","last_unstale":"2023-10-06T03:06:21.639251+0000","last_undegraded":"2023-10-06T03:06:21.639251+0000","last_fullsized":"2023-10-06T03:06:21.639251+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:07.774084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636920+0000","last_change":"2023-10-06T03:06:21.630222+0000","last_active":"2023-10-06T03:06:21.636920+0000","last_peered":"2023-10-06T03:06:21.636920+0000","last_clean":"2023-10-06T03:06:21.636920+0000","last_became_active":"2023-10-06T03:06:21.629971+0000","last_became_peered":"2023-10-06T03:06:21.629971+0000","last_unstale":"2023-10-06T03:06:21.636920+0000","last_undegraded":"2023-10-06T03:06:21.636920+0000","last_fullsized":"2023-10-06T03:06:21.636920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:49.386862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.631033+0000","last_change":"2023-10-06T03:06:21.625167+0000","last_active":"2023-10-06T03:06:21.631033+0000","last_peered":"2023-10-06T03:06:21.631033+0000","last_clean":"2023-10-06T03:06:21.631033+0000","last_became_active":"2023-10-06T03:06:21.624919+0000","last_became_peered":"2023-10-06T03:06:21.624919+0000","last_unstale":"2023-10-06T03:06:21.631033+0000","last_undegraded":"2023-10-06T03:06:21.631033+0000","last_fullsized":"2023-10-06T03:06:21.631033+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:34.401176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.621313+0000","last_change":"2023-10-06T03:06:21.620048+0000","last_active":"2023-10-06T03:06:21.621313+0000","last_peered":"2023-10-06T03:06:21.621313+0000","last_clean":"2023-10-06T03:06:21.621313+0000","last_became_active":"2023-10-06T03:06:21.619777+0000","last_became_peered":"2023-10-06T03:06:21.619777+0000","last_unstale":"2023-10-06T03:06:21.621313+0000","last_undegraded":"2023-10-06T03:06:21.621313+0000","last_fullsized":"2023-10-06T03:06:21.621313+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:19.930817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.631585+0000","last_change":"2023-10-06T03:06:21.627387+0000","last_active":"2023-10-06T03:06:21.631585+0000","last_peered":"2023-10-06T03:06:21.631585+0000","last_clean":"2023-10-06T03:06:21.631585+0000","last_became_active":"2023-10-06T03:06:21.627106+0000","last_became_peered":"2023-10-06T03:06:21.627106+0000","last_unstale":"2023-10-06T03:06:21.631585+0000","last_undegraded":"2023-10-06T03:06:21.631585+0000","last_fullsized":"2023-10-06T03:06:21.631585+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:03.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.630922+0000","last_change":"2023-10-06T03:06:21.626786+0000","last_active":"2023-10-06T03:06:21.630922+0000","last_peered":"2023-10-06T03:06:21.630922+0000","last_clean":"2023-10-06T03:06:21.630922+0000","last_became_active":"2023-10-06T03:06:21.626533+0000","last_became_peered":"2023-10-06T03:06:21.626533+0000","last_unstale":"2023-10-06T03:06:21.630922+0000","last_undegraded":"2023-10-06T03:06:21.630922+0000","last_fullsized":"2023-10-06T03:06:21.630922+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:39.677516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.614948+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:17.898762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639361+0000","last_change":"2023-10-06T03:06:21.632296+0000","last_active":"2023-10-06T03:06:21.639361+0000","last_peered":"2023-10-06T03:06:21.639361+0000","last_clean":"2023-10-06T03:06:21.639361+0000","last_became_active":"2023-10-06T03:06:21.631870+0000","last_became_peered":"2023-10-06T03:06:21.631870+0000","last_unstale":"2023-10-06T03:06:21.639361+0000","last_undegraded":"2023-10-06T03:06:21.639361+0000","last_fullsized":"2023-10-06T03:06:21.639361+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:45.483003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.637111+0000","last_change":"2023-10-06T03:06:21.632692+0000","last_active":"2023-10-06T03:06:21.637111+0000","last_peered":"2023-10-06T03:06:21.637111+0000","last_clean":"2023-10-06T03:06:21.637111+0000","last_became_active":"2023-10-06T03:06:21.632437+0000","last_became_peered":"2023-10-06T03:06:21.632437+0000","last_unstale":"2023-10-06T03:06:21.637111+0000","last_undegraded":"2023-10-06T03:06:21.637111+0000","last_fullsized":"2023-10-06T03:06:21.637111+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:07.774084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635412+0000","last_change":"2023-10-06T03:06:21.629002+0000","last_active":"2023-10-06T03:06:21.635412+0000","last_peered":"2023-10-06T03:06:21.635412+0000","last_clean":"2023-10-06T03:06:21.635412+0000","last_became_active":"2023-10-06T03:06:21.628770+0000","last_became_peered":"2023-10-06T03:06:21.628770+0000","last_unstale":"2023-10-06T03:06:21.635412+0000","last_undegraded":"2023-10-06T03:06:21.635412+0000","last_fullsized":"2023-10-06T03:06:21.635412+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.103354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633020+0000","last_change":"2023-10-06T03:06:21.627263+0000","last_active":"2023-10-06T03:06:21.633020+0000","last_peered":"2023-10-06T03:06:21.633020+0000","last_clean":"2023-10-06T03:06:21.633020+0000","last_became_active":"2023-10-06T03:06:21.626762+0000","last_became_peered":"2023-10-06T03:06:21.626762+0000","last_unstale":"2023-10-06T03:06:21.633020+0000","last_undegraded":"2023-10-06T03:06:21.633020+0000","last_fullsized":"2023-10-06T03:06:21.633020+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:39.231251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.618600+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.481740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.630832+0000","last_change":"2023-10-06T03:06:21.624826+0000","last_active":"2023-10-06T03:06:21.630832+0000","last_peered":"2023-10-06T03:06:21.630832+0000","last_clean":"2023-10-06T03:06:21.630832+0000","last_became_active":"2023-10-06T03:06:21.623419+0000","last_became_peered":"2023-10-06T03:06:21.623419+0000","last_unstale":"2023-10-06T03:06:21.630832+0000","last_undegraded":"2023-10-06T03:06:21.630832+0000","last_fullsized":"2023-10-06T03:06:21.630832+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:34.401176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635759+0000","last_change":"2023-10-06T03:06:21.628936+0000","last_active":"2023-10-06T03:06:21.635759+0000","last_peered":"2023-10-06T03:06:21.635759+0000","last_clean":"2023-10-06T03:06:21.635759+0000","last_became_active":"2023-10-06T03:06:21.628692+0000","last_became_peered":"2023-10-06T03:06:21.628692+0000","last_unstale":"2023-10-06T03:06:21.635759+0000","last_undegraded":"2023-10-06T03:06:21.635759+0000","last_fullsized":"2023-10-06T03:06:21.635759+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:08.911020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.616009+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:04.649172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639639+0000","last_change":"2023-10-06T03:06:21.634615+0000","last_active":"2023-10-06T03:06:21.639639+0000","last_peered":"2023-10-06T03:06:21.639639+0000","last_clean":"2023-10-06T03:06:21.639639+0000","last_became_active":"2023-10-06T03:06:21.634339+0000","last_became_peered":"2023-10-06T03:06:21.634339+0000","last_unstale":"2023-10-06T03:06:21.639639+0000","last_undegraded":"2023-10-06T03:06:21.639639+0000","last_fullsized":"2023-10-06T03:06:21.639639+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:49.417536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"56'4","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.632034+0000","last_change":"2023-10-06T03:06:20.631590+0000","last_active":"2023-10-06T03:06:21.632034+0000","last_peered":"2023-10-06T03:06:21.632034+0000","last_clean":"2023-10-06T03:06:21.632034+0000","last_became_active":"2023-10-06T03:06:20.631374+0000","last_became_peered":"2023-10-06T03:06:20.631374+0000","last_unstale":"2023-10-06T03:06:21.632034+0000","last_undegraded":"2023-10-06T03:06:21.632034+0000","last_fullsized":"2023-10-06T03:06:21.632034+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:31.775819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635285+0000","last_change":"2023-10-06T03:06:21.625608+0000","last_active":"2023-10-06T03:06:21.635285+0000","last_peered":"2023-10-06T03:06:21.635285+0000","last_clean":"2023-10-06T03:06:21.635285+0000","last_became_active":"2023-10-06T03:06:21.625355+0000","last_became_peered":"2023-10-06T03:06:21.625355+0000","last_unstale":"2023-10-06T03:06:21.635285+0000","last_undegraded":"2023-10-06T03:06:21.635285+0000","last_fullsized":"2023-10-06T03:06:21.635285+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:19.930817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.631772+0000","last_change":"2023-10-06T03:06:20.631772+0000","last_active":"2023-10-06T03:06:20.631772+0000","last_peered":"2023-10-06T03:06:20.631772+0000","last_clean":"2023-10-06T03:06:20.631772+0000","last_became_active":"2023-10-06T03:06:20.631522+0000","last_became_peered":"2023-10-06T03:06:20.631522+0000","last_unstale":"2023-10-06T03:06:20.631772+0000","last_undegraded":"2023-10-06T03:06:20.631772+0000","last_fullsized":"2023-10-06T03:06:20.631772+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:05.937982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.614680+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:11.598376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.628973+0000","last_change":"2023-10-06T03:06:20.628973+0000","last_active":"2023-10-06T03:06:20.628973+0000","last_peered":"2023-10-06T03:06:20.628973+0000","last_clean":"2023-10-06T03:06:20.628973+0000","last_became_active":"2023-10-06T03:06:20.628313+0000","last_became_peered":"2023-10-06T03:06:20.628313+0000","last_unstale":"2023-10-06T03:06:20.628973+0000","last_undegraded":"2023-10-06T03:06:20.628973+0000","last_fullsized":"2023-10-06T03:06:20.628973+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:46.862868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.618244+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:09.042554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.628287+0000","last_change":"2023-10-06T03:06:20.628287+0000","last_active":"2023-10-06T03:06:20.628287+0000","last_peered":"2023-10-06T03:06:20.628287+0000","last_clean":"2023-10-06T03:06:20.628287+0000","last_became_active":"2023-10-06T03:06:20.628023+0000","last_became_peered":"2023-10-06T03:06:20.628023+0000","last_unstale":"2023-10-06T03:06:20.628287+0000","last_undegraded":"2023-10-06T03:06:20.628287+0000","last_fullsized":"2023-10-06T03:06:20.628287+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:08.037702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636359+0000","last_change":"2023-10-06T03:06:21.632635+0000","last_active":"2023-10-06T03:06:21.636359+0000","last_peered":"2023-10-06T03:06:21.636359+0000","last_clean":"2023-10-06T03:06:21.636359+0000","last_became_active":"2023-10-06T03:06:21.632374+0000","last_became_peered":"2023-10-06T03:06:21.632374+0000","last_unstale":"2023-10-06T03:06:21.636359+0000","last_undegraded":"2023-10-06T03:06:21.636359+0000","last_fullsized":"2023-10-06T03:06:21.636359+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:23:27.639109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.625899+0000","last_change":"2023-10-06T03:06:20.624970+0000","last_active":"2023-10-06T03:06:21.625899+0000","last_peered":"2023-10-06T03:06:21.625899+0000","last_clean":"2023-10-06T03:06:21.625899+0000","last_became_active":"2023-10-06T03:06:20.624691+0000","last_became_peered":"2023-10-06T03:06:20.624691+0000","last_unstale":"2023-10-06T03:06:21.625899+0000","last_undegraded":"2023-10-06T03:06:21.625899+0000","last_fullsized":"2023-10-06T03:06:21.625899+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:22.401226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.631663+0000","last_change":"2023-10-06T03:06:21.627803+0000","last_active":"2023-10-06T03:06:21.631663+0000","last_peered":"2023-10-06T03:06:21.631663+0000","last_clean":"2023-10-06T03:06:21.631663+0000","last_became_active":"2023-10-06T03:06:21.627539+0000","last_became_peered":"2023-10-06T03:06:21.627539+0000","last_unstale":"2023-10-06T03:06:21.631663+0000","last_undegraded":"2023-10-06T03:06:21.631663+0000","last_fullsized":"2023-10-06T03:06:21.631663+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:30.851317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.625995+0000","last_change":"2023-10-06T03:06:20.620568+0000","last_active":"2023-10-06T03:06:21.625995+0000","last_peered":"2023-10-06T03:06:21.625995+0000","last_clean":"2023-10-06T03:06:21.625995+0000","last_became_active":"2023-10-06T03:06:20.620321+0000","last_became_peered":"2023-10-06T03:06:20.620321+0000","last_unstale":"2023-10-06T03:06:21.625995+0000","last_undegraded":"2023-10-06T03:06:21.625995+0000","last_fullsized":"2023-10-06T03:06:21.625995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:03.644319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639958+0000","last_change":"2023-10-06T03:06:21.638728+0000","last_active":"2023-10-06T03:06:21.639958+0000","last_peered":"2023-10-06T03:06:21.639958+0000","last_clean":"2023-10-06T03:06:21.639958+0000","last_became_active":"2023-10-06T03:06:21.638519+0000","last_became_peered":"2023-10-06T03:06:21.638519+0000","last_unstale":"2023-10-06T03:06:21.639958+0000","last_undegraded":"2023-10-06T03:06:21.639958+0000","last_fullsized":"2023-10-06T03:06:21.639958+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:39.231251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611366+0000","last_change":"2023-10-06T03:06:20.625335+0000","last_active":"2023-10-06T03:06:21.611366+0000","last_peered":"2023-10-06T03:06:21.611366+0000","last_clean":"2023-10-06T03:06:21.611366+0000","last_became_active":"2023-10-06T03:06:20.624996+0000","last_became_peered":"2023-10-06T03:06:20.624996+0000","last_unstale":"2023-10-06T03:06:21.611366+0000","last_undegraded":"2023-10-06T03:06:21.611366+0000","last_fullsized":"2023-10-06T03:06:21.611366+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:39.376713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639100+0000","last_change":"2023-10-06T03:06:21.632580+0000","last_active":"2023-10-06T03:06:21.639100+0000","last_peered":"2023-10-06T03:06:21.639100+0000","last_clean":"2023-10-06T03:06:21.639100+0000","last_became_active":"2023-10-06T03:06:21.632302+0000","last_became_peered":"2023-10-06T03:06:21.632302+0000","last_unstale":"2023-10-06T03:06:21.639100+0000","last_undegraded":"2023-10-06T03:06:21.639100+0000","last_fullsized":"2023-10-06T03:06:21.639100+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.103354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.618594+0000","last_change":"2023-10-06T03:06:20.630249+0000","last_active":"2023-10-06T03:06:21.618594+0000","last_peered":"2023-10-06T03:06:21.618594+0000","last_clean":"2023-10-06T03:06:21.618594+0000","last_became_active":"2023-10-06T03:06:20.629958+0000","last_became_peered":"2023-10-06T03:06:20.629958+0000","last_unstale":"2023-10-06T03:06:21.618594+0000","last_undegraded":"2023-10-06T03:06:21.618594+0000","last_fullsized":"2023-10-06T03:06:21.618594+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:44.730849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633002+0000","last_change":"2023-10-06T03:06:21.627049+0000","last_active":"2023-10-06T03:06:21.633002+0000","last_peered":"2023-10-06T03:06:21.633002+0000","last_clean":"2023-10-06T03:06:21.633002+0000","last_became_active":"2023-10-06T03:06:21.626407+0000","last_became_peered":"2023-10-06T03:06:21.626407+0000","last_unstale":"2023-10-06T03:06:21.633002+0000","last_undegraded":"2023-10-06T03:06:21.633002+0000","last_fullsized":"2023-10-06T03:06:21.633002+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:13.651697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.633131+0000","last_change":"2023-10-06T03:06:20.633131+0000","last_active":"2023-10-06T03:06:20.633131+0000","last_peered":"2023-10-06T03:06:20.633131+0000","last_clean":"2023-10-06T03:06:20.633131+0000","last_became_active":"2023-10-06T03:06:20.632929+0000","last_became_peered":"2023-10-06T03:06:20.632929+0000","last_unstale":"2023-10-06T03:06:20.633131+0000","last_undegraded":"2023-10-06T03:06:20.633131+0000","last_fullsized":"2023-10-06T03:06:20.633131+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:48.925338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.627674+0000","last_change":"2023-10-06T03:06:21.621046+0000","last_active":"2023-10-06T03:06:21.627674+0000","last_peered":"2023-10-06T03:06:21.627674+0000","last_clean":"2023-10-06T03:06:21.627674+0000","last_became_active":"2023-10-06T03:06:21.620800+0000","last_became_peered":"2023-10-06T03:06:21.620800+0000","last_unstale":"2023-10-06T03:06:21.627674+0000","last_undegraded":"2023-10-06T03:06:21.627674+0000","last_fullsized":"2023-10-06T03:06:21.627674+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:15.019288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.612889+0000","last_change":"2023-10-06T03:06:20.624338+0000","last_active":"2023-10-06T03:06:21.612889+0000","last_peered":"2023-10-06T03:06:21.612889+0000","last_clean":"2023-10-06T03:06:21.612889+0000","last_became_active":"2023-10-06T03:06:20.624066+0000","last_became_peered":"2023-10-06T03:06:20.624066+0000","last_unstale":"2023-10-06T03:06:21.612889+0000","last_undegraded":"2023-10-06T03:06:21.612889+0000","last_fullsized":"2023-10-06T03:06:21.612889+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:31.418752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.637057+0000","last_change":"2023-10-06T03:06:21.631917+0000","last_active":"2023-10-06T03:06:21.637057+0000","last_peered":"2023-10-06T03:06:21.637057+0000","last_clean":"2023-10-06T03:06:21.637057+0000","last_became_active":"2023-10-06T03:06:21.631618+0000","last_became_peered":"2023-10-06T03:06:21.631618+0000","last_unstale":"2023-10-06T03:06:21.637057+0000","last_undegraded":"2023-10-06T03:06:21.637057+0000","last_fullsized":"2023-10-06T03:06:21.637057+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:12.454052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.632587+0000","last_change":"2023-10-06T03:06:20.632587+0000","last_active":"2023-10-06T03:06:20.632587+0000","last_peered":"2023-10-06T03:06:20.632587+0000","last_clean":"2023-10-06T03:06:20.632587+0000","last_became_active":"2023-10-06T03:06:20.632127+0000","last_became_peered":"2023-10-06T03:06:20.632127+0000","last_unstale":"2023-10-06T03:06:20.632587+0000","last_undegraded":"2023-10-06T03:06:20.632587+0000","last_fullsized":"2023-10-06T03:06:20.632587+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:00.533803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.634705+0000","last_change":"2023-10-06T03:06:21.624727+0000","last_active":"2023-10-06T03:06:21.634705+0000","last_peered":"2023-10-06T03:06:21.634705+0000","last_clean":"2023-10-06T03:06:21.634705+0000","last_became_active":"2023-10-06T03:06:21.624412+0000","last_became_peered":"2023-10-06T03:06:21.624412+0000","last_unstale":"2023-10-06T03:06:21.634705+0000","last_undegraded":"2023-10-06T03:06:21.634705+0000","last_fullsized":"2023-10-06T03:06:21.634705+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:25.318899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"56'6","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.642652+0000","last_change":"2023-10-06T03:06:20.627919+0000","last_active":"2023-10-06T03:06:21.642652+0000","last_peered":"2023-10-06T03:06:21.642652+0000","last_clean":"2023-10-06T03:06:21.642652+0000","last_became_active":"2023-10-06T03:06:20.627646+0000","last_became_peered":"2023-10-06T03:06:20.627646+0000","last_unstale":"2023-10-06T03:06:21.642652+0000","last_undegraded":"2023-10-06T03:06:21.642652+0000","last_fullsized":"2023-10-06T03:06:21.642652+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:45.641976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639362+0000","last_change":"2023-10-06T03:06:21.634621+0000","last_active":"2023-10-06T03:06:21.639362+0000","last_peered":"2023-10-06T03:06:21.639362+0000","last_clean":"2023-10-06T03:06:21.639362+0000","last_became_active":"2023-10-06T03:06:21.633392+0000","last_became_peered":"2023-10-06T03:06:21.633392+0000","last_unstale":"2023-10-06T03:06:21.639362+0000","last_undegraded":"2023-10-06T03:06:21.639362+0000","last_fullsized":"2023-10-06T03:06:21.639362+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:15.019288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.631058+0000","last_change":"2023-10-06T03:06:20.631058+0000","last_active":"2023-10-06T03:06:20.631058+0000","last_peered":"2023-10-06T03:06:20.631058+0000","last_clean":"2023-10-06T03:06:20.631058+0000","last_became_active":"2023-10-06T03:06:20.630645+0000","last_became_peered":"2023-10-06T03:06:20.630645+0000","last_unstale":"2023-10-06T03:06:20.631058+0000","last_undegraded":"2023-10-06T03:06:20.631058+0000","last_fullsized":"2023-10-06T03:06:20.631058+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:42:08.211673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636656+0000","last_change":"2023-10-06T03:06:21.631809+0000","last_active":"2023-10-06T03:06:21.636656+0000","last_peered":"2023-10-06T03:06:21.636656+0000","last_clean":"2023-10-06T03:06:21.636656+0000","last_became_active":"2023-10-06T03:06:21.631542+0000","last_became_peered":"2023-10-06T03:06:21.631542+0000","last_unstale":"2023-10-06T03:06:21.636656+0000","last_undegraded":"2023-10-06T03:06:21.636656+0000","last_fullsized":"2023-10-06T03:06:21.636656+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:08.911020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.615758+0000","last_change":"2023-10-06T03:06:20.624236+0000","last_active":"2023-10-06T03:06:21.615758+0000","last_peered":"2023-10-06T03:06:21.615758+0000","last_clean":"2023-10-06T03:06:21.615758+0000","last_became_active":"2023-10-06T03:06:20.623955+0000","last_became_peered":"2023-10-06T03:06:20.623955+0000","last_unstale":"2023-10-06T03:06:21.615758+0000","last_undegraded":"2023-10-06T03:06:21.615758+0000","last_fullsized":"2023-10-06T03:06:21.615758+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:31.418752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.637098+0000","last_change":"2023-10-06T03:06:21.631042+0000","last_active":"2023-10-06T03:06:21.637098+0000","last_peered":"2023-10-06T03:06:21.637098+0000","last_clean":"2023-10-06T03:06:21.637098+0000","last_became_active":"2023-10-06T03:06:21.629590+0000","last_became_peered":"2023-10-06T03:06:21.629590+0000","last_unstale":"2023-10-06T03:06:21.637098+0000","last_undegraded":"2023-10-06T03:06:21.637098+0000","last_fullsized":"2023-10-06T03:06:21.637098+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:03.625453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.629263+0000","last_change":"2023-10-06T03:06:20.629263+0000","last_active":"2023-10-06T03:06:20.629263+0000","last_peered":"2023-10-06T03:06:20.629263+0000","last_clean":"2023-10-06T03:06:20.629263+0000","last_became_active":"2023-10-06T03:06:20.626413+0000","last_became_peered":"2023-10-06T03:06:20.626413+0000","last_unstale":"2023-10-06T03:06:20.629263+0000","last_undegraded":"2023-10-06T03:06:20.629263+0000","last_fullsized":"2023-10-06T03:06:20.629263+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:48.412683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.632011+0000","last_change":"2023-10-06T03:06:21.629980+0000","last_active":"2023-10-06T03:06:21.632011+0000","last_peered":"2023-10-06T03:06:21.632011+0000","last_clean":"2023-10-06T03:06:21.632011+0000","last_became_active":"2023-10-06T03:06:21.629731+0000","last_became_peered":"2023-10-06T03:06:21.629731+0000","last_unstale":"2023-10-06T03:06:21.632011+0000","last_undegraded":"2023-10-06T03:06:21.632011+0000","last_fullsized":"2023-10-06T03:06:21.632011+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:42:09.216525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"56'8","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.641321+0000","last_change":"2023-10-06T03:06:20.623501+0000","last_active":"2023-10-06T03:06:21.641321+0000","last_peered":"2023-10-06T03:06:21.641321+0000","last_clean":"2023-10-06T03:06:21.641321+0000","last_became_active":"2023-10-06T03:06:20.623234+0000","last_became_peered":"2023-10-06T03:06:20.623234+0000","last_unstale":"2023-10-06T03:06:21.641321+0000","last_undegraded":"2023-10-06T03:06:21.641321+0000","last_fullsized":"2023-10-06T03:06:21.641321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:11.535511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.615047+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:40.381565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"56'2","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.641335+0000","last_change":"2023-10-06T03:06:20.630321+0000","last_active":"2023-10-06T03:06:21.641335+0000","last_peered":"2023-10-06T03:06:21.641335+0000","last_clean":"2023-10-06T03:06:21.641335+0000","last_became_active":"2023-10-06T03:06:20.630063+0000","last_became_peered":"2023-10-06T03:06:20.630063+0000","last_unstale":"2023-10-06T03:06:21.641335+0000","last_undegraded":"2023-10-06T03:06:21.641335+0000","last_fullsized":"2023-10-06T03:06:21.641335+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:05.937982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.643971+0000","last_change":"2023-10-06T03:06:21.638984+0000","last_active":"2023-10-06T03:06:21.643971+0000","last_peered":"2023-10-06T03:06:21.643971+0000","last_clean":"2023-10-06T03:06:21.643971+0000","last_became_active":"2023-10-06T03:06:21.638719+0000","last_became_peered":"2023-10-06T03:06:21.638719+0000","last_unstale":"2023-10-06T03:06:21.643971+0000","last_undegraded":"2023-10-06T03:06:21.643971+0000","last_fullsized":"2023-10-06T03:06:21.643971+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:32.641605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"57'1","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T03:06:24.076306+0000","last_change":"2023-10-06T03:06:20.622624+0000","last_active":"2023-10-06T03:06:24.076306+0000","last_peered":"2023-10-06T03:06:24.076306+0000","last_clean":"2023-10-06T03:06:24.076306+0000","last_became_active":"2023-10-06T03:06:20.622334+0000","last_became_peered":"2023-10-06T03:06:20.622334+0000","last_unstale":"2023-10-06T03:06:24.076306+0000","last_undegraded":"2023-10-06T03:06:24.076306+0000","last_fullsized":"2023-10-06T03:06:24.076306+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:03.476888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639263+0000","last_change":"2023-10-06T03:06:21.636220+0000","last_active":"2023-10-06T03:06:21.639263+0000","last_peered":"2023-10-06T03:06:21.639263+0000","last_clean":"2023-10-06T03:06:21.639263+0000","last_became_active":"2023-10-06T03:06:21.635976+0000","last_became_peered":"2023-10-06T03:06:21.635976+0000","last_unstale":"2023-10-06T03:06:21.639263+0000","last_undegraded":"2023-10-06T03:06:21.639263+0000","last_fullsized":"2023-10-06T03:06:21.639263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.103354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.629164+0000","last_change":"2023-10-06T03:06:20.629164+0000","last_active":"2023-10-06T03:06:20.629164+0000","last_peered":"2023-10-06T03:06:20.629164+0000","last_clean":"2023-10-06T03:06:20.629164+0000","last_became_active":"2023-10-06T03:06:20.628699+0000","last_became_peered":"2023-10-06T03:06:20.628699+0000","last_unstale":"2023-10-06T03:06:20.629164+0000","last_undegraded":"2023-10-06T03:06:20.629164+0000","last_fullsized":"2023-10-06T03:06:20.629164+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:31.418752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639709+0000","last_change":"2023-10-06T03:06:21.633840+0000","last_active":"2023-10-06T03:06:21.639709+0000","last_peered":"2023-10-06T03:06:21.639709+0000","last_clean":"2023-10-06T03:06:21.639709+0000","last_became_active":"2023-10-06T03:06:21.633420+0000","last_became_peered":"2023-10-06T03:06:21.633420+0000","last_unstale":"2023-10-06T03:06:21.639709+0000","last_undegraded":"2023-10-06T03:06:21.639709+0000","last_fullsized":"2023-10-06T03:06:21.639709+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:13.651697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.614763+0000","last_change":"2023-10-06T03:06:20.624698+0000","last_active":"2023-10-06T03:06:21.614763+0000","last_peered":"2023-10-06T03:06:21.614763+0000","last_clean":"2023-10-06T03:06:21.614763+0000","last_became_active":"2023-10-06T03:06:20.624434+0000","last_became_peered":"2023-10-06T03:06:20.624434+0000","last_unstale":"2023-10-06T03:06:21.614763+0000","last_undegraded":"2023-10-06T03:06:21.614763+0000","last_fullsized":"2023-10-06T03:06:21.614763+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:58.374860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639768+0000","last_change":"2023-10-06T03:06:21.634923+0000","last_active":"2023-10-06T03:06:21.639768+0000","last_peered":"2023-10-06T03:06:21.639768+0000","last_clean":"2023-10-06T03:06:21.639768+0000","last_became_active":"2023-10-06T03:06:21.634108+0000","last_became_peered":"2023-10-06T03:06:21.634108+0000","last_unstale":"2023-10-06T03:06:21.639768+0000","last_undegraded":"2023-10-06T03:06:21.639768+0000","last_fullsized":"2023-10-06T03:06:21.639768+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:30.851317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.630511+0000","last_change":"2023-10-06T03:06:20.630511+0000","last_active":"2023-10-06T03:06:20.630511+0000","last_peered":"2023-10-06T03:06:20.630511+0000","last_clean":"2023-10-06T03:06:20.630511+0000","last_became_active":"2023-10-06T03:06:20.629748+0000","last_became_peered":"2023-10-06T03:06:20.629748+0000","last_unstale":"2023-10-06T03:06:20.630511+0000","last_undegraded":"2023-10-06T03:06:20.630511+0000","last_fullsized":"2023-10-06T03:06:20.630511+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:41.887149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635739+0000","last_change":"2023-10-06T03:06:21.628438+0000","last_active":"2023-10-06T03:06:21.635739+0000","last_peered":"2023-10-06T03:06:21.635739+0000","last_clean":"2023-10-06T03:06:21.635739+0000","last_became_active":"2023-10-06T03:06:21.628168+0000","last_became_peered":"2023-10-06T03:06:21.628168+0000","last_unstale":"2023-10-06T03:06:21.635739+0000","last_undegraded":"2023-10-06T03:06:21.635739+0000","last_fullsized":"2023-10-06T03:06:21.635739+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:03.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611503+0000","last_change":"2023-10-06T03:06:20.624481+0000","last_active":"2023-10-06T03:06:21.611503+0000","last_peered":"2023-10-06T03:06:21.611503+0000","last_clean":"2023-10-06T03:06:21.611503+0000","last_became_active":"2023-10-06T03:06:20.624019+0000","last_became_peered":"2023-10-06T03:06:20.624019+0000","last_unstale":"2023-10-06T03:06:21.611503+0000","last_undegraded":"2023-10-06T03:06:21.611503+0000","last_fullsized":"2023-10-06T03:06:21.611503+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:15.597423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.631670+0000","last_change":"2023-10-06T03:06:21.627275+0000","last_active":"2023-10-06T03:06:21.631670+0000","last_peered":"2023-10-06T03:06:21.631670+0000","last_clean":"2023-10-06T03:06:21.631670+0000","last_became_active":"2023-10-06T03:06:21.627010+0000","last_became_peered":"2023-10-06T03:06:21.627010+0000","last_unstale":"2023-10-06T03:06:21.631670+0000","last_undegraded":"2023-10-06T03:06:21.631670+0000","last_fullsized":"2023-10-06T03:06:21.631670+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:36.552543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611457+0000","last_change":"2023-10-06T03:06:20.619461+0000","last_active":"2023-10-06T03:06:21.611457+0000","last_peered":"2023-10-06T03:06:21.611457+0000","last_clean":"2023-10-06T03:06:21.611457+0000","last_became_active":"2023-10-06T03:06:20.619221+0000","last_became_peered":"2023-10-06T03:06:20.619221+0000","last_unstale":"2023-10-06T03:06:21.611457+0000","last_undegraded":"2023-10-06T03:06:21.611457+0000","last_fullsized":"2023-10-06T03:06:21.611457+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:10.593523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636177+0000","last_change":"2023-10-06T03:06:21.634948+0000","last_active":"2023-10-06T03:06:21.636177+0000","last_peered":"2023-10-06T03:06:21.636177+0000","last_clean":"2023-10-06T03:06:21.636177+0000","last_became_active":"2023-10-06T03:06:21.634723+0000","last_became_peered":"2023-10-06T03:06:21.634723+0000","last_unstale":"2023-10-06T03:06:21.636177+0000","last_undegraded":"2023-10-06T03:06:21.636177+0000","last_fullsized":"2023-10-06T03:06:21.636177+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:12.923051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.613890+0000","last_change":"2023-10-06T03:06:20.627212+0000","last_active":"2023-10-06T03:06:21.613890+0000","last_peered":"2023-10-06T03:06:21.613890+0000","last_clean":"2023-10-06T03:06:21.613890+0000","last_became_active":"2023-10-06T03:06:20.625418+0000","last_became_peered":"2023-10-06T03:06:20.625418+0000","last_unstale":"2023-10-06T03:06:21.613890+0000","last_undegraded":"2023-10-06T03:06:21.613890+0000","last_fullsized":"2023-10-06T03:06:21.613890+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:58.560109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.616523+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:06.396629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.632136+0000","last_change":"2023-10-06T03:06:20.624883+0000","last_active":"2023-10-06T03:06:21.632136+0000","last_peered":"2023-10-06T03:06:21.632136+0000","last_clean":"2023-10-06T03:06:21.632136+0000","last_became_active":"2023-10-06T03:06:20.624619+0000","last_became_peered":"2023-10-06T03:06:20.624619+0000","last_unstale":"2023-10-06T03:06:21.632136+0000","last_undegraded":"2023-10-06T03:06:21.632136+0000","last_fullsized":"2023-10-06T03:06:21.632136+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:11.535511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.614836+0000","last_change":"2023-10-06T03:04:23.986472+0000","last_active":"2023-10-06T03:06:21.614836+0000","last_peered":"2023-10-06T03:06:21.614836+0000","last_clean":"2023-10-06T03:06:21.614836+0000","last_became_active":"2023-10-06T03:04:23.986228+0000","last_became_peered":"2023-10-06T03:04:23.986228+0000","last_unstale":"2023-10-06T03:06:21.614836+0000","last_undegraded":"2023-10-06T03:06:21.614836+0000","last_fullsized":"2023-10-06T03:06:21.614836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:08.739849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639982+0000","last_change":"2023-10-06T03:06:21.638861+0000","last_active":"2023-10-06T03:06:21.639982+0000","last_peered":"2023-10-06T03:06:21.639982+0000","last_clean":"2023-10-06T03:06:21.639982+0000","last_became_active":"2023-10-06T03:06:21.638563+0000","last_became_peered":"2023-10-06T03:06:21.638563+0000","last_unstale":"2023-10-06T03:06:21.639982+0000","last_undegraded":"2023-10-06T03:06:21.639982+0000","last_fullsized":"2023-10-06T03:06:21.639982+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:47.426610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.630137+0000","last_change":"2023-10-06T03:06:20.630137+0000","last_active":"2023-10-06T03:06:20.630137+0000","last_peered":"2023-10-06T03:06:20.630137+0000","last_clean":"2023-10-06T03:06:20.630137+0000","last_became_active":"2023-10-06T03:06:20.629832+0000","last_became_peered":"2023-10-06T03:06:20.629832+0000","last_unstale":"2023-10-06T03:06:20.630137+0000","last_undegraded":"2023-10-06T03:06:20.630137+0000","last_fullsized":"2023-10-06T03:06:20.630137+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:11.535511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.616107+0000","last_change":"2023-10-06T03:04:23.814917+0000","last_active":"2023-10-06T03:06:21.616107+0000","last_peered":"2023-10-06T03:06:21.616107+0000","last_clean":"2023-10-06T03:06:21.616107+0000","last_became_active":"2023-10-06T03:04:23.814601+0000","last_became_peered":"2023-10-06T03:04:23.814601+0000","last_unstale":"2023-10-06T03:06:21.616107+0000","last_undegraded":"2023-10-06T03:06:21.616107+0000","last_fullsized":"2023-10-06T03:06:21.616107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635294+0000","last_change":"2023-10-06T03:06:21.628936+0000","last_active":"2023-10-06T03:06:21.635294+0000","last_peered":"2023-10-06T03:06:21.635294+0000","last_clean":"2023-10-06T03:06:21.635294+0000","last_became_active":"2023-10-06T03:06:21.628695+0000","last_became_peered":"2023-10-06T03:06:21.628695+0000","last_unstale":"2023-10-06T03:06:21.635294+0000","last_undegraded":"2023-10-06T03:06:21.635294+0000","last_fullsized":"2023-10-06T03:06:21.635294+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:27.973305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.615945+0000","last_change":"2023-10-06T03:06:20.624082+0000","last_active":"2023-10-06T03:06:21.615945+0000","last_peered":"2023-10-06T03:06:21.615945+0000","last_clean":"2023-10-06T03:06:21.615945+0000","last_became_active":"2023-10-06T03:06:20.623824+0000","last_became_peered":"2023-10-06T03:06:20.623824+0000","last_unstale":"2023-10-06T03:06:21.615945+0000","last_undegraded":"2023-10-06T03:06:21.615945+0000","last_fullsized":"2023-10-06T03:06:21.615945+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:08.037702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.627857+0000","last_change":"2023-10-06T03:04:24.314547+0000","last_active":"2023-10-06T03:06:21.627857+0000","last_peered":"2023-10-06T03:06:21.627857+0000","last_clean":"2023-10-06T03:06:21.627857+0000","last_became_active":"2023-10-06T03:04:24.314278+0000","last_became_peered":"2023-10-06T03:04:24.314278+0000","last_unstale":"2023-10-06T03:06:21.627857+0000","last_undegraded":"2023-10-06T03:06:21.627857+0000","last_fullsized":"2023-10-06T03:06:21.627857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:25.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639798+0000","last_change":"2023-10-06T03:06:21.636813+0000","last_active":"2023-10-06T03:06:21.639798+0000","last_peered":"2023-10-06T03:06:21.639798+0000","last_clean":"2023-10-06T03:06:21.639798+0000","last_became_active":"2023-10-06T03:06:21.634134+0000","last_became_peered":"2023-10-06T03:06:21.634134+0000","last_unstale":"2023-10-06T03:06:21.639798+0000","last_undegraded":"2023-10-06T03:06:21.639798+0000","last_fullsized":"2023-10-06T03:06:21.639798+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:36.552543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611097+0000","last_change":"2023-10-06T03:06:20.627128+0000","last_active":"2023-10-06T03:06:21.611097+0000","last_peered":"2023-10-06T03:06:21.611097+0000","last_clean":"2023-10-06T03:06:21.611097+0000","last_became_active":"2023-10-06T03:06:20.626867+0000","last_became_peered":"2023-10-06T03:06:20.626867+0000","last_unstale":"2023-10-06T03:06:21.611097+0000","last_undegraded":"2023-10-06T03:06:21.611097+0000","last_fullsized":"2023-10-06T03:06:21.611097+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:34.227774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.616072+0000","last_change":"2023-10-06T03:04:23.807972+0000","last_active":"2023-10-06T03:06:21.616072+0000","last_peered":"2023-10-06T03:06:21.616072+0000","last_clean":"2023-10-06T03:06:21.616072+0000","last_became_active":"2023-10-06T03:04:23.807723+0000","last_became_peered":"2023-10-06T03:04:23.807723+0000","last_unstale":"2023-10-06T03:06:21.616072+0000","last_undegraded":"2023-10-06T03:06:21.616072+0000","last_fullsized":"2023-10-06T03:06:21.616072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":193,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:06:19.607658+0000","last_change":"2023-10-06T03:04:17.779925+0000","last_active":"2023-10-06T03:06:19.607658+0000","last_peered":"2023-10-06T03:06:19.607658+0000","last_clean":"2023-10-06T03:06:19.607658+0000","last_became_active":"2023-10-06T03:04:17.778997+0000","last_became_peered":"2023-10-06T03:04:17.778997+0000","last_unstale":"2023-10-06T03:06:19.607658+0000","last_undegraded":"2023-10-06T03:06:19.607658+0000","last_fullsized":"2023-10-06T03:06:19.607658+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_clean_scrub_stamp":"2023-10-06T03:04:16.761610+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.615550+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:16.602275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.623551+0000","last_change":"2023-10-06T03:06:20.623551+0000","last_active":"2023-10-06T03:06:20.623551+0000","last_peered":"2023-10-06T03:06:20.623551+0000","last_clean":"2023-10-06T03:06:20.623551+0000","last_became_active":"2023-10-06T03:06:20.623215+0000","last_became_peered":"2023-10-06T03:06:20.623215+0000","last_unstale":"2023-10-06T03:06:20.623551+0000","last_undegraded":"2023-10-06T03:06:20.623551+0000","last_fullsized":"2023-10-06T03:06:20.623551+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:03.476888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:06:19.607750+0000","last_change":"2023-10-06T03:04:23.814887+0000","last_active":"2023-10-06T03:06:19.607750+0000","last_peered":"2023-10-06T03:06:19.607750+0000","last_clean":"2023-10-06T03:06:19.607750+0000","last_became_active":"2023-10-06T03:04:23.814581+0000","last_became_peered":"2023-10-06T03:04:23.814581+0000","last_unstale":"2023-10-06T03:06:19.607750+0000","last_undegraded":"2023-10-06T03:06:19.607750+0000","last_fullsized":"2023-10-06T03:06:19.607750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639813+0000","last_change":"2023-10-06T03:06:21.637853+0000","last_active":"2023-10-06T03:06:21.639813+0000","last_peered":"2023-10-06T03:06:21.639813+0000","last_clean":"2023-10-06T03:06:21.639813+0000","last_became_active":"2023-10-06T03:06:21.637605+0000","last_became_peered":"2023-10-06T03:06:21.637605+0000","last_unstale":"2023-10-06T03:06:21.639813+0000","last_undegraded":"2023-10-06T03:06:21.639813+0000","last_fullsized":"2023-10-06T03:06:21.639813+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:44.331596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.630071+0000","last_change":"2023-10-06T03:06:20.630071+0000","last_active":"2023-10-06T03:06:20.630071+0000","last_peered":"2023-10-06T03:06:20.630071+0000","last_clean":"2023-10-06T03:06:20.630071+0000","last_became_active":"2023-10-06T03:06:20.629809+0000","last_became_peered":"2023-10-06T03:06:20.629809+0000","last_unstale":"2023-10-06T03:06:20.630071+0000","last_undegraded":"2023-10-06T03:06:20.630071+0000","last_fullsized":"2023-10-06T03:06:20.630071+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:39.342768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:06:19.607821+0000","last_change":"2023-10-06T03:04:23.986771+0000","last_active":"2023-10-06T03:06:19.607821+0000","last_peered":"2023-10-06T03:06:19.607821+0000","last_clean":"2023-10-06T03:06:19.607821+0000","last_became_active":"2023-10-06T03:04:23.986552+0000","last_became_peered":"2023-10-06T03:04:23.986552+0000","last_unstale":"2023-10-06T03:06:19.607821+0000","last_undegraded":"2023-10-06T03:06:19.607821+0000","last_fullsized":"2023-10-06T03:06:19.607821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636241+0000","last_change":"2023-10-06T03:06:21.625510+0000","last_active":"2023-10-06T03:06:21.636241+0000","last_peered":"2023-10-06T03:06:21.636241+0000","last_clean":"2023-10-06T03:06:21.636241+0000","last_became_active":"2023-10-06T03:06:21.625257+0000","last_became_peered":"2023-10-06T03:06:21.625257+0000","last_unstale":"2023-10-06T03:06:21.636241+0000","last_undegraded":"2023-10-06T03:06:21.636241+0000","last_fullsized":"2023-10-06T03:06:21.636241+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:27.973305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.632683+0000","last_change":"2023-10-06T03:06:20.632683+0000","last_active":"2023-10-06T03:06:20.632683+0000","last_peered":"2023-10-06T03:06:20.632683+0000","last_clean":"2023-10-06T03:06:20.632683+0000","last_became_active":"2023-10-06T03:06:20.632440+0000","last_became_peered":"2023-10-06T03:06:20.632440+0000","last_unstale":"2023-10-06T03:06:20.632683+0000","last_undegraded":"2023-10-06T03:06:20.632683+0000","last_fullsized":"2023-10-06T03:06:20.632683+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:14.207986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.614562+0000","last_change":"2023-10-06T03:04:23.813862+0000","last_active":"2023-10-06T03:06:21.614562+0000","last_peered":"2023-10-06T03:06:21.614562+0000","last_clean":"2023-10-06T03:06:21.614562+0000","last_became_active":"2023-10-06T03:04:23.813584+0000","last_became_peered":"2023-10-06T03:04:23.813584+0000","last_unstale":"2023-10-06T03:06:21.614562+0000","last_undegraded":"2023-10-06T03:06:21.614562+0000","last_fullsized":"2023-10-06T03:06:21.614562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639687+0000","last_change":"2023-10-06T03:06:21.633661+0000","last_active":"2023-10-06T03:06:21.639687+0000","last_peered":"2023-10-06T03:06:21.639687+0000","last_clean":"2023-10-06T03:06:21.639687+0000","last_became_active":"2023-10-06T03:06:21.633117+0000","last_became_peered":"2023-10-06T03:06:21.633117+0000","last_unstale":"2023-10-06T03:06:21.639687+0000","last_undegraded":"2023-10-06T03:06:21.639687+0000","last_fullsized":"2023-10-06T03:06:21.639687+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:21.616453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611948+0000","last_change":"2023-10-06T03:06:20.616127+0000","last_active":"2023-10-06T03:06:21.611948+0000","last_peered":"2023-10-06T03:06:21.611948+0000","last_clean":"2023-10-06T03:06:21.611948+0000","last_became_active":"2023-10-06T03:06:20.615836+0000","last_became_peered":"2023-10-06T03:06:20.615836+0000","last_unstale":"2023-10-06T03:06:21.611948+0000","last_undegraded":"2023-10-06T03:06:21.611948+0000","last_fullsized":"2023-10-06T03:06:21.611948+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:55.497431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.622611+0000","last_change":"2023-10-06T03:04:23.805874+0000","last_active":"2023-10-06T03:06:21.622611+0000","last_peered":"2023-10-06T03:06:21.622611+0000","last_clean":"2023-10-06T03:06:21.622611+0000","last_became_active":"2023-10-06T03:04:23.805551+0000","last_became_peered":"2023-10-06T03:04:23.805551+0000","last_unstale":"2023-10-06T03:06:21.622611+0000","last_undegraded":"2023-10-06T03:06:21.622611+0000","last_fullsized":"2023-10-06T03:06:21.622611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:21.250275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2112,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":894130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.629,"15min":0.64300000000000002},"min":{"1min":0.318,"5min":0.314,"15min":0.314},"max":{"1min":0.69999999999999996,"5min":3.8860000000000001,"15min":3.8860000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.64900000000000002,"15min":0.66400000000000003},"min":{"1min":0.38700000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.69699999999999995,"5min":3.988,"15min":3.988},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.65200000000000002,"15min":0.67000000000000004},"min":{"1min":0.36199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.81899999999999995,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":0.498},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.64800000000000002,"15min":0.66400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73099999999999998,"5min":3.444,"15min":3.444},"last":0.625}]},{"osd":2,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.67000000000000004,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78800000000000003,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85599999999999998,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.68799999999999994,"15min":0.70599999999999996},"min":{"1min":0.45600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.73099999999999998,"5min":3.903,"15min":3.903},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.71499999999999997,"15min":0.73399999999999999},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.746,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":0.66800000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46800000000000003,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.55700000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.38800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65400000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.39400000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.64000000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.43099999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59899999999999998,"15min":0.60399999999999998},"min":{"1min":0.46600000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.71399999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79100000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297960,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073880,"statfs":{"total":96636764160,"available":96331653120,"internally_reserved":0,"allocated":688128,"data_stored":318193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.79700000000000004,"15min":0.84299999999999997},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77200000000000002,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.83699999999999997,"15min":0.89300000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.64600000000000002,"5min":6.8330000000000002,"15min":6.8330000000000002},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.71599999999999997,"15min":0.74399999999999999},"min":{"1min":0.34899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.72299999999999998,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.73899999999999999,"15min":0.76500000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":3.948,"15min":3.948},"last":0.626}]},{"osd":2,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.754,"15min":0.754},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.75800000000000001,"5min":3.996,"15min":3.996},"last":0.59999999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.71799999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.57399999999999995}]},{"osd":4,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.34399999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.36499999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55400000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.50600000000000001,"15min":0.499},"min":{"1min":0.40999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.443,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.46600000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297984,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073856,"statfs":{"total":96636764160,"available":96331628544,"internally_reserved":0,"allocated":712704,"data_stored":320431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.38700000000000001,"15min":0.39700000000000002},"min":{"1min":0.20999999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.50900000000000001,"5min":1.159,"15min":1.159},"last":0.31},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.375,"15min":0.379},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46999999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.26600000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.58999999999999997,"15min":0.63200000000000001},"min":{"1min":0.254,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.44500000000000001,"5min":6.056,"15min":6.056},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57499999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.44800000000000001,"15min":0.45500000000000002},"min":{"1min":0.27700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.502,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.443,"15min":0.45100000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.56000000000000005,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.32400000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.46800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.77800000000000002,"5min":1.244,"15min":1.244},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.495,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":1.216,"15min":1.216},"last":0.67200000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.628,"15min":0.624},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82899999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.627,"15min":0.627},"min":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.76800000000000002,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89200000000000002,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85699999999999998,"5min":1.014,"15min":1.014},"last":0.66600000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":1.099,"15min":1.099},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.79800000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298508,"kb_used_data":1220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073332,"statfs":{"total":96636764160,"available":96331091968,"internally_reserved":0,"allocated":1249280,"data_stored":893119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.35799999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.39600000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.373}]},{"osd":4,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.503},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.57299999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.53800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297956,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073884,"statfs":{"total":96636764160,"available":96331657216,"internally_reserved":0,"allocated":684032,"data_stored":318159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.80100000000000005,"15min":0.88400000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.437,"5min":12.913,"15min":12.913},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.316,"5min":0.36799999999999999,"15min":0.377},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.49199999999999999,"5min":0.997,"15min":0.997},"last":0.30399999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.51200000000000001,"15min":0.53900000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53000000000000003,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54900000000000004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.33300000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.36199999999999999,"15min":0.36799999999999999},"min":{"1min":0.252,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46200000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.88,"15min":0.96399999999999997},"min":{"1min":0.29199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57299999999999995,"5min":12.941000000000001,"15min":12.941000000000001},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":1.042,"15min":1.1200000000000001},"min":{"1min":0.40600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.76900000000000002,"5min":12.846,"15min":12.846},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.62,"15min":0.622},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.75900000000000001,"5min":1.046,"15min":1.046},"last":0.52600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76900000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":1.0620000000000001,"15min":1.141},"min":{"1min":0.47999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72799999999999998,"5min":12.884,"15min":12.884},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77100000000000002,"5min":1.071,"15min":1.071},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.62,"15min":0.622},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.73199999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.72999999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.504},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77000000000000002,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297956,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073884,"statfs":{"total":96636764160,"available":96331657216,"internally_reserved":0,"allocated":684032,"data_stored":318159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.373,"15min":0.38400000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55000000000000004,"5min":1.361,"15min":1.361},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.311,"5min":0.34899999999999998,"15min":0.35499999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.51200000000000001,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.32800000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.376,"15min":0.38300000000000001},"min":{"1min":0.20699999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53400000000000003,"5min":1.133,"15min":1.133},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.27800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66100000000000003,"5min":1.45,"15min":1.45},"last":0.312}]},{"osd":2,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57399999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.433,"15min":0.443},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59499999999999997,"5min":1.476,"15min":1.476},"last":0.34499999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.38100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":1.649,"15min":1.649},"last":0.437},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80200000000000005,"5min":1.054,"15min":1.054},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77300000000000002,"5min":1.401,"15min":1.401},"last":0.501},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77800000000000002,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.47999999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78000000000000003,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.46200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83399999999999996,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.54900000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81999999999999995,"5min":1.679,"15min":1.679},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80300000000000005,"5min":1.083,"15min":1.083},"last":0.52400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":696320,"data_stored":319695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52000000000000002,"15min":0.51100000000000001},"min":{"1min":0.376,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.41099999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84999999999999998,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.39200000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82699999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80400000000000005,"5min":0.875,"15min":0.875},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.439},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.42699999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.69699999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.503},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90200000000000002,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.622}]},{"osd":5,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83899999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.33900000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297960,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073880,"statfs":{"total":96636764160,"available":96331653120,"internally_reserved":0,"allocated":688128,"data_stored":318181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68500000000000005,"5min":1.012,"15min":1.012},"last":0.621},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74399999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70599999999999996,"5min":1.03,"15min":1.03},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.71399999999999997,"5min":0.755,"15min":0.755},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55400000000000005,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.76800000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.495},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.71899999999999997,"5min":0.998,"15min":0.998},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.58299999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.69599999999999995,"5min":1.048,"15min":1.048},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72799999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.57599999999999996}]},{"osd":4,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.45900000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.40500000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.745,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61699999999999999,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.76200000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.34200000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69199999999999995,"5min":0.872,"15min":0.872},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:06:26.072 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:06:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.222+0000 7fcb29a07700 1 Processor -- start 2023-10-06T03:06:26.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.222+0000 7fcb29a07700 1 -- start start 2023-10-06T03:06:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.223+0000 7fcb29a07700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb241591f0 0x7fcb241595c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.223+0000 7fcb29a07700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcb240b2f30 0x7fcb240b33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.223+0000 7fcb29a07700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcb240ccc30 0x7fcb240cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.223+0000 7fcb29a07700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb240afbf0 con 0x7fcb240b2f30 2023-10-06T03:06:26.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.223+0000 7fcb29a07700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb240cbb90 con 0x7fcb240ccc30 2023-10-06T03:06:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.223+0000 7fcb29a07700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb240cbe70 con 0x7fcb241591f0 2023-10-06T03:06:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.223+0000 7fcb227fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcb240b2f30 0x7fcb240b33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.223+0000 7fcb227fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fcb240b2f30 0x7fcb240b33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44760/0 (socket says 172.21.15.125:44760) 2023-10-06T03:06:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.223+0000 7fcb227fc700 1 -- 172.21.15.125:0/3083503752 learned_addr learned my addr 172.21.15.125:0/3083503752 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.223+0000 7fcb22ffd700 1 --2- 172.21.15.125:0/3083503752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb241591f0 0x7fcb241595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.223+0000 7fcb237fe700 1 --2- 172.21.15.125:0/3083503752 >> v2:172.21.15.130:3300/0 conn(0x7fcb240ccc30 0x7fcb240cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.223+0000 7fcb227fc700 1 -- 172.21.15.125:0/3083503752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb241591f0 msgr2=0x7fcb241595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.223+0000 7fcb227fc700 1 --2- 172.21.15.125:0/3083503752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb241591f0 0x7fcb241595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.223+0000 7fcb227fc700 1 -- 172.21.15.125:0/3083503752 >> v2:172.21.15.130:3300/0 conn(0x7fcb240ccc30 msgr2=0x7fcb240cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.223+0000 7fcb227fc700 1 --2- 172.21.15.125:0/3083503752 >> v2:172.21.15.130:3300/0 conn(0x7fcb240ccc30 0x7fcb240cd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.223+0000 7fcb227fc700 1 -- 172.21.15.125:0/3083503752 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb240cc150 con 0x7fcb240b2f30 2023-10-06T03:06:26.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.224+0000 7fcb237fe700 1 --2- 172.21.15.125:0/3083503752 >> v2:172.21.15.130:3300/0 conn(0x7fcb240ccc30 0x7fcb240cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.224+0000 7fcb227fc700 1 --2- 172.21.15.125:0/3083503752 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb240b2f30 0x7fcb240b33a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcb240ca660 tx=0x7fcb14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d922116f33d714 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.224+0000 7fcb21ffb700 1 -- 172.21.15.125:0/3083503752 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1400b860 con 0x7fcb240b2f30 2023-10-06T03:06:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.224+0000 7fcb21ffb700 1 -- 172.21.15.125:0/3083503752 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1400b9c0 con 0x7fcb240b2f30 2023-10-06T03:06:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.224+0000 7fcb21ffb700 1 -- 172.21.15.125:0/3083503752 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1400bd60 con 0x7fcb240b2f30 2023-10-06T03:06:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.224+0000 7fcb29a07700 1 -- 172.21.15.125:0/3083503752 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb240b2f30 msgr2=0x7fcb240b33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.224+0000 7fcb29a07700 1 --2- 172.21.15.125:0/3083503752 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb240b2f30 0x7fcb240b33a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcb240ca660 tx=0x7fcb14009250 comp rx=0 tx=0).stop 2023-10-06T03:06:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.224+0000 7fcb29a07700 1 -- 172.21.15.125:0/3083503752 shutdown_connections 2023-10-06T03:06:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.224+0000 7fcb29a07700 1 --2- 172.21.15.125:0/3083503752 >> v2:172.21.15.130:3300/0 conn(0x7fcb240ccc30 0x7fcb240cd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.224+0000 7fcb29a07700 1 --2- 172.21.15.125:0/3083503752 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb241591f0 0x7fcb241595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.224+0000 7fcb29a07700 1 --2- 172.21.15.125:0/3083503752 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb240b2f30 0x7fcb240b33a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.224+0000 7fcb29a07700 1 -- 172.21.15.125:0/3083503752 >> 172.21.15.125:0/3083503752 conn(0x7fcb2406ed40 msgr2=0x7fcb2406f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:26.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.224+0000 7fcb29a07700 1 -- 172.21.15.125:0/3083503752 shutdown_connections 2023-10-06T03:06:26.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.224+0000 7fcb29a07700 1 -- 172.21.15.125:0/3083503752 wait complete. 2023-10-06T03:06:26.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.226+0000 7fcb29a07700 1 Processor -- start 2023-10-06T03:06:26.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.226+0000 7fcb29a07700 1 -- start start 2023-10-06T03:06:26.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.226+0000 7fcb29a07700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb240b2f30 0x7fcb2415a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:26.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.226+0000 7fcb29a07700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb240ccc30 0x7fcb240cec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:26.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.226+0000 7fcb29a07700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb241591f0 0x7fcb2416cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:26.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.226+0000 7fcb29a07700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb240d0650 con 0x7fcb240b2f30 2023-10-06T03:06:26.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.226+0000 7fcb29a07700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb240cf5b0 con 0x7fcb240ccc30 2023-10-06T03:06:26.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.226+0000 7fcb29a07700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb240cf890 con 0x7fcb241591f0 2023-10-06T03:06:26.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.226+0000 7fcb22ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb240b2f30 0x7fcb2415a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:26.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.226+0000 7fcb22ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb240b2f30 0x7fcb2415a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44766/0 (socket says 172.21.15.125:44766) 2023-10-06T03:06:26.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.226+0000 7fcb22ffd700 1 -- 172.21.15.125:0/1616492259 learned_addr learned my addr 172.21.15.125:0/1616492259 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:26.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.227+0000 7fcb227fc700 1 --2- 172.21.15.125:0/1616492259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb240ccc30 0x7fcb240cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:26.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.227+0000 7fcb237fe700 1 --2- 172.21.15.125:0/1616492259 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb241591f0 0x7fcb2416cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:26.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.227+0000 7fcb22ffd700 1 -- 172.21.15.125:0/1616492259 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb241591f0 msgr2=0x7fcb2416cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:26.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.227+0000 7fcb22ffd700 1 --2- 172.21.15.125:0/1616492259 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb241591f0 0x7fcb2416cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.227+0000 7fcb22ffd700 1 -- 172.21.15.125:0/1616492259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb240ccc30 msgr2=0x7fcb240cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:26.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.227+0000 7fcb22ffd700 1 --2- 172.21.15.125:0/1616492259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb240ccc30 0x7fcb240cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.227+0000 7fcb22ffd700 1 -- 172.21.15.125:0/1616492259 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb140094f0 con 0x7fcb240b2f30 2023-10-06T03:06:26.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.227+0000 7fcb22ffd700 1 --2- 172.21.15.125:0/1616492259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb240b2f30 0x7fcb2415a0e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800c880 tx=0x7fcb18008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:26.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.227+0000 7fcb0affd700 1 -- 172.21.15.125:0/1616492259 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18011600 con 0x7fcb240b2f30 2023-10-06T03:06:26.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.227+0000 7fcb0affd700 1 -- 172.21.15.125:0/1616492259 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb18011780 con 0x7fcb240b2f30 2023-10-06T03:06:26.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.227+0000 7fcb29a07700 1 -- 172.21.15.125:0/1616492259 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb240cfb70 con 0x7fcb240b2f30 2023-10-06T03:06:26.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.227+0000 7fcb0affd700 1 -- 172.21.15.125:0/1616492259 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18011b40 con 0x7fcb240b2f30 2023-10-06T03:06:26.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.227+0000 7fcb29a07700 1 -- 172.21.15.125:0/1616492259 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb240d0130 con 0x7fcb240b2f30 2023-10-06T03:06:26.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.228+0000 7fcb29a07700 1 -- 172.21.15.125:0/1616492259 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb240d0350 con 0x7fcb240b2f30 2023-10-06T03:06:26.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.228+0000 7fcb0affd700 1 -- 172.21.15.125:0/1616492259 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb18018360 con 0x7fcb240b2f30 2023-10-06T03:06:26.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.229+0000 7fcb0affd700 1 --2- 172.21.15.125:0/1616492259 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcb10066f30 0x7fcb100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:26.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.229+0000 7fcb0affd700 1 -- 172.21.15.125:0/1616492259 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fcb180844d0 con 0x7fcb240b2f30 2023-10-06T03:06:26.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.229+0000 7fcb227fc700 1 --2- 172.21.15.125:0/1616492259 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcb10066f30 0x7fcb100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:26.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.229+0000 7fcb227fc700 1 --2- 172.21.15.125:0/1616492259 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcb10066f30 0x7fcb100693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcb240ca660 tx=0x7fcb14017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:26.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.233+0000 7fcb0affd700 1 -- 172.21.15.125:0/1616492259 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb18054f30 con 0x7fcb240b2f30 2023-10-06T03:06:26.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.409+0000 7fcb29a07700 1 -- 172.21.15.125:0/1616492259 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcb24066510 con 0x7fcb10066f30 2023-10-06T03:06:26.418 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.417+0000 7fcb0affd700 1 -- 172.21.15.125:0/1616492259 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310315 (secure 0 0 0) 0x7fcb24066510 con 0x7fcb10066f30 2023-10-06T03:06:26.422 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:26.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.420+0000 7fcb29a07700 1 -- 172.21.15.125:0/1616492259 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcb10066f30 msgr2=0x7fcb100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:26.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.420+0000 7fcb29a07700 1 --2- 172.21.15.125:0/1616492259 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcb10066f30 0x7fcb100693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcb240ca660 tx=0x7fcb14017000 comp rx=0 tx=0).stop 2023-10-06T03:06:26.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.420+0000 7fcb29a07700 1 -- 172.21.15.125:0/1616492259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb240b2f30 msgr2=0x7fcb2415a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:26.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.420+0000 7fcb29a07700 1 --2- 172.21.15.125:0/1616492259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb240b2f30 0x7fcb2415a0e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fcb1800c880 tx=0x7fcb18008040 comp rx=0 tx=0).stop 2023-10-06T03:06:26.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.421+0000 7fcb29a07700 1 -- 172.21.15.125:0/1616492259 shutdown_connections 2023-10-06T03:06:26.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.421+0000 7fcb29a07700 1 --2- 172.21.15.125:0/1616492259 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcb10066f30 0x7fcb100693e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.421+0000 7fcb29a07700 1 --2- 172.21.15.125:0/1616492259 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcb241591f0 0x7fcb2416cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.425 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.421+0000 7fcb29a07700 1 --2- 172.21.15.125:0/1616492259 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcb240b2f30 0x7fcb2415a0e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.421+0000 7fcb29a07700 1 --2- 172.21.15.125:0/1616492259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb240ccc30 0x7fcb240cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.421+0000 7fcb29a07700 1 -- 172.21.15.125:0/1616492259 >> 172.21.15.125:0/1616492259 conn(0x7fcb2406ed40 msgr2=0x7fcb240c9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:26.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.421+0000 7fcb29a07700 1 -- 172.21.15.125:0/1616492259 shutdown_connections 2023-10-06T03:06:26.426 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.421+0000 7fcb29a07700 1 -- 172.21.15.125:0/1616492259 wait complete. 2023-10-06T03:06:26.426 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-06T03:06:26.434 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-10-06T03:06:25.831879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592480,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384804,"kb_used_data":6500,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589916,"statfs":{"total":773094113280,"available":770652073984,"internally_reserved":0,"allocated":6656000,"data_stored":3700067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2112,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000936"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633100+0000","last_change":"2023-10-06T03:06:21.621607+0000","last_active":"2023-10-06T03:06:21.633100+0000","last_peered":"2023-10-06T03:06:21.633100+0000","last_clean":"2023-10-06T03:06:21.633100+0000","last_became_active":"2023-10-06T03:06:21.621336+0000","last_became_peered":"2023-10-06T03:06:21.621336+0000","last_unstale":"2023-10-06T03:06:21.633100+0000","last_undegraded":"2023-10-06T03:06:21.633100+0000","last_fullsized":"2023-10-06T03:06:21.633100+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:03.625453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639899+0000","last_change":"2023-10-06T03:06:21.638143+0000","last_active":"2023-10-06T03:06:21.639899+0000","last_peered":"2023-10-06T03:06:21.639899+0000","last_clean":"2023-10-06T03:06:21.639899+0000","last_became_active":"2023-10-06T03:06:21.637865+0000","last_became_peered":"2023-10-06T03:06:21.637865+0000","last_unstale":"2023-10-06T03:06:21.639899+0000","last_undegraded":"2023-10-06T03:06:21.639899+0000","last_fullsized":"2023-10-06T03:06:21.639899+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:12.454052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.619224+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:06.942834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639545+0000","last_change":"2023-10-06T03:06:21.632909+0000","last_active":"2023-10-06T03:06:21.639545+0000","last_peered":"2023-10-06T03:06:21.639545+0000","last_clean":"2023-10-06T03:06:21.639545+0000","last_became_active":"2023-10-06T03:06:21.632654+0000","last_became_peered":"2023-10-06T03:06:21.632654+0000","last_unstale":"2023-10-06T03:06:21.639545+0000","last_undegraded":"2023-10-06T03:06:21.639545+0000","last_fullsized":"2023-10-06T03:06:21.639545+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:34.401176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635047+0000","last_change":"2023-10-06T03:06:21.628138+0000","last_active":"2023-10-06T03:06:21.635047+0000","last_peered":"2023-10-06T03:06:21.635047+0000","last_clean":"2023-10-06T03:06:21.635047+0000","last_became_active":"2023-10-06T03:06:21.627839+0000","last_became_peered":"2023-10-06T03:06:21.627839+0000","last_unstale":"2023-10-06T03:06:21.635047+0000","last_undegraded":"2023-10-06T03:06:21.635047+0000","last_fullsized":"2023-10-06T03:06:21.635047+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:35.993689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.614240+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:48:47.816353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.643908+0000","last_change":"2023-10-06T03:06:21.636657+0000","last_active":"2023-10-06T03:06:21.643908+0000","last_peered":"2023-10-06T03:06:21.643908+0000","last_clean":"2023-10-06T03:06:21.643908+0000","last_became_active":"2023-10-06T03:06:21.636400+0000","last_became_peered":"2023-10-06T03:06:21.636400+0000","last_unstale":"2023-10-06T03:06:21.643908+0000","last_undegraded":"2023-10-06T03:06:21.643908+0000","last_fullsized":"2023-10-06T03:06:21.643908+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:45.735702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.637344+0000","last_change":"2023-10-06T03:06:21.631743+0000","last_active":"2023-10-06T03:06:21.637344+0000","last_peered":"2023-10-06T03:06:21.637344+0000","last_clean":"2023-10-06T03:06:21.637344+0000","last_became_active":"2023-10-06T03:06:21.631464+0000","last_became_peered":"2023-10-06T03:06:21.631464+0000","last_unstale":"2023-10-06T03:06:21.637344+0000","last_undegraded":"2023-10-06T03:06:21.637344+0000","last_fullsized":"2023-10-06T03:06:21.637344+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:39.677516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.617831+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:57:23.298492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.616543+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:56.862803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635263+0000","last_change":"2023-10-06T03:06:21.624427+0000","last_active":"2023-10-06T03:06:21.635263+0000","last_peered":"2023-10-06T03:06:21.635263+0000","last_clean":"2023-10-06T03:06:21.635263+0000","last_became_active":"2023-10-06T03:06:21.624098+0000","last_became_peered":"2023-10-06T03:06:21.624098+0000","last_unstale":"2023-10-06T03:06:21.635263+0000","last_undegraded":"2023-10-06T03:06:21.635263+0000","last_fullsized":"2023-10-06T03:06:21.635263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:39.677516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.634789+0000","last_change":"2023-10-06T03:06:21.629593+0000","last_active":"2023-10-06T03:06:21.634789+0000","last_peered":"2023-10-06T03:06:21.634789+0000","last_clean":"2023-10-06T03:06:21.634789+0000","last_became_active":"2023-10-06T03:06:21.629297+0000","last_became_peered":"2023-10-06T03:06:21.629297+0000","last_unstale":"2023-10-06T03:06:21.634789+0000","last_undegraded":"2023-10-06T03:06:21.634789+0000","last_fullsized":"2023-10-06T03:06:21.634789+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:15.019288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633817+0000","last_change":"2023-10-06T03:06:21.625690+0000","last_active":"2023-10-06T03:06:21.633817+0000","last_peered":"2023-10-06T03:06:21.633817+0000","last_clean":"2023-10-06T03:06:21.633817+0000","last_became_active":"2023-10-06T03:06:21.625430+0000","last_became_peered":"2023-10-06T03:06:21.625430+0000","last_unstale":"2023-10-06T03:06:21.633817+0000","last_undegraded":"2023-10-06T03:06:21.633817+0000","last_fullsized":"2023-10-06T03:06:21.633817+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:25.318899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.618243+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:32.442537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.615744+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:44.519720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636378+0000","last_change":"2023-10-06T03:06:21.633328+0000","last_active":"2023-10-06T03:06:21.636378+0000","last_peered":"2023-10-06T03:06:21.636378+0000","last_clean":"2023-10-06T03:06:21.636378+0000","last_became_active":"2023-10-06T03:06:21.633115+0000","last_became_peered":"2023-10-06T03:06:21.633115+0000","last_unstale":"2023-10-06T03:06:21.636378+0000","last_undegraded":"2023-10-06T03:06:21.636378+0000","last_fullsized":"2023-10-06T03:06:21.636378+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:46.396243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633176+0000","last_change":"2023-10-06T03:06:21.630252+0000","last_active":"2023-10-06T03:06:21.633176+0000","last_peered":"2023-10-06T03:06:21.633176+0000","last_clean":"2023-10-06T03:06:21.633176+0000","last_became_active":"2023-10-06T03:06:21.629902+0000","last_became_peered":"2023-10-06T03:06:21.629902+0000","last_unstale":"2023-10-06T03:06:21.633176+0000","last_undegraded":"2023-10-06T03:06:21.633176+0000","last_fullsized":"2023-10-06T03:06:21.633176+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:49.417536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639251+0000","last_change":"2023-10-06T03:06:21.635767+0000","last_active":"2023-10-06T03:06:21.639251+0000","last_peered":"2023-10-06T03:06:21.639251+0000","last_clean":"2023-10-06T03:06:21.639251+0000","last_became_active":"2023-10-06T03:06:21.635155+0000","last_became_peered":"2023-10-06T03:06:21.635155+0000","last_unstale":"2023-10-06T03:06:21.639251+0000","last_undegraded":"2023-10-06T03:06:21.639251+0000","last_fullsized":"2023-10-06T03:06:21.639251+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:07.774084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636920+0000","last_change":"2023-10-06T03:06:21.630222+0000","last_active":"2023-10-06T03:06:21.636920+0000","last_peered":"2023-10-06T03:06:21.636920+0000","last_clean":"2023-10-06T03:06:21.636920+0000","last_became_active":"2023-10-06T03:06:21.629971+0000","last_became_peered":"2023-10-06T03:06:21.629971+0000","last_unstale":"2023-10-06T03:06:21.636920+0000","last_undegraded":"2023-10-06T03:06:21.636920+0000","last_fullsized":"2023-10-06T03:06:21.636920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:49.386862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.631033+0000","last_change":"2023-10-06T03:06:21.625167+0000","last_active":"2023-10-06T03:06:21.631033+0000","last_peered":"2023-10-06T03:06:21.631033+0000","last_clean":"2023-10-06T03:06:21.631033+0000","last_became_active":"2023-10-06T03:06:21.624919+0000","last_became_peered":"2023-10-06T03:06:21.624919+0000","last_unstale":"2023-10-06T03:06:21.631033+0000","last_undegraded":"2023-10-06T03:06:21.631033+0000","last_fullsized":"2023-10-06T03:06:21.631033+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:34.401176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.621313+0000","last_change":"2023-10-06T03:06:21.620048+0000","last_active":"2023-10-06T03:06:21.621313+0000","last_peered":"2023-10-06T03:06:21.621313+0000","last_clean":"2023-10-06T03:06:21.621313+0000","last_became_active":"2023-10-06T03:06:21.619777+0000","last_became_peered":"2023-10-06T03:06:21.619777+0000","last_unstale":"2023-10-06T03:06:21.621313+0000","last_undegraded":"2023-10-06T03:06:21.621313+0000","last_fullsized":"2023-10-06T03:06:21.621313+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:19.930817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.631585+0000","last_change":"2023-10-06T03:06:21.627387+0000","last_active":"2023-10-06T03:06:21.631585+0000","last_peered":"2023-10-06T03:06:21.631585+0000","last_clean":"2023-10-06T03:06:21.631585+0000","last_became_active":"2023-10-06T03:06:21.627106+0000","last_became_peered":"2023-10-06T03:06:21.627106+0000","last_unstale":"2023-10-06T03:06:21.631585+0000","last_undegraded":"2023-10-06T03:06:21.631585+0000","last_fullsized":"2023-10-06T03:06:21.631585+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:03.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.630922+0000","last_change":"2023-10-06T03:06:21.626786+0000","last_active":"2023-10-06T03:06:21.630922+0000","last_peered":"2023-10-06T03:06:21.630922+0000","last_clean":"2023-10-06T03:06:21.630922+0000","last_became_active":"2023-10-06T03:06:21.626533+0000","last_became_peered":"2023-10-06T03:06:21.626533+0000","last_unstale":"2023-10-06T03:06:21.630922+0000","last_undegraded":"2023-10-06T03:06:21.630922+0000","last_fullsized":"2023-10-06T03:06:21.630922+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:39.677516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.614948+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:17.898762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639361+0000","last_change":"2023-10-06T03:06:21.632296+0000","last_active":"2023-10-06T03:06:21.639361+0000","last_peered":"2023-10-06T03:06:21.639361+0000","last_clean":"2023-10-06T03:06:21.639361+0000","last_became_active":"2023-10-06T03:06:21.631870+0000","last_became_peered":"2023-10-06T03:06:21.631870+0000","last_unstale":"2023-10-06T03:06:21.639361+0000","last_undegraded":"2023-10-06T03:06:21.639361+0000","last_fullsized":"2023-10-06T03:06:21.639361+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:45.483003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.637111+0000","last_change":"2023-10-06T03:06:21.632692+0000","last_active":"2023-10-06T03:06:21.637111+0000","last_peered":"2023-10-06T03:06:21.637111+0000","last_clean":"2023-10-06T03:06:21.637111+0000","last_became_active":"2023-10-06T03:06:21.632437+0000","last_became_peered":"2023-10-06T03:06:21.632437+0000","last_unstale":"2023-10-06T03:06:21.637111+0000","last_undegraded":"2023-10-06T03:06:21.637111+0000","last_fullsized":"2023-10-06T03:06:21.637111+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:07.774084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635412+0000","last_change":"2023-10-06T03:06:21.629002+0000","last_active":"2023-10-06T03:06:21.635412+0000","last_peered":"2023-10-06T03:06:21.635412+0000","last_clean":"2023-10-06T03:06:21.635412+0000","last_became_active":"2023-10-06T03:06:21.628770+0000","last_became_peered":"2023-10-06T03:06:21.628770+0000","last_unstale":"2023-10-06T03:06:21.635412+0000","last_undegraded":"2023-10-06T03:06:21.635412+0000","last_fullsized":"2023-10-06T03:06:21.635412+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.103354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633020+0000","last_change":"2023-10-06T03:06:21.627263+0000","last_active":"2023-10-06T03:06:21.633020+0000","last_peered":"2023-10-06T03:06:21.633020+0000","last_clean":"2023-10-06T03:06:21.633020+0000","last_became_active":"2023-10-06T03:06:21.626762+0000","last_became_peered":"2023-10-06T03:06:21.626762+0000","last_unstale":"2023-10-06T03:06:21.633020+0000","last_undegraded":"2023-10-06T03:06:21.633020+0000","last_fullsized":"2023-10-06T03:06:21.633020+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:39.231251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.618600+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.481740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.630832+0000","last_change":"2023-10-06T03:06:21.624826+0000","last_active":"2023-10-06T03:06:21.630832+0000","last_peered":"2023-10-06T03:06:21.630832+0000","last_clean":"2023-10-06T03:06:21.630832+0000","last_became_active":"2023-10-06T03:06:21.623419+0000","last_became_peered":"2023-10-06T03:06:21.623419+0000","last_unstale":"2023-10-06T03:06:21.630832+0000","last_undegraded":"2023-10-06T03:06:21.630832+0000","last_fullsized":"2023-10-06T03:06:21.630832+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:34.401176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635759+0000","last_change":"2023-10-06T03:06:21.628936+0000","last_active":"2023-10-06T03:06:21.635759+0000","last_peered":"2023-10-06T03:06:21.635759+0000","last_clean":"2023-10-06T03:06:21.635759+0000","last_became_active":"2023-10-06T03:06:21.628692+0000","last_became_peered":"2023-10-06T03:06:21.628692+0000","last_unstale":"2023-10-06T03:06:21.635759+0000","last_undegraded":"2023-10-06T03:06:21.635759+0000","last_fullsized":"2023-10-06T03:06:21.635759+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:08.911020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.616009+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:04.649172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639639+0000","last_change":"2023-10-06T03:06:21.634615+0000","last_active":"2023-10-06T03:06:21.639639+0000","last_peered":"2023-10-06T03:06:21.639639+0000","last_clean":"2023-10-06T03:06:21.639639+0000","last_became_active":"2023-10-06T03:06:21.634339+0000","last_became_peered":"2023-10-06T03:06:21.634339+0000","last_unstale":"2023-10-06T03:06:21.639639+0000","last_undegraded":"2023-10-06T03:06:21.639639+0000","last_fullsized":"2023-10-06T03:06:21.639639+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:49.417536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"56'4","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.632034+0000","last_change":"2023-10-06T03:06:20.631590+0000","last_active":"2023-10-06T03:06:21.632034+0000","last_peered":"2023-10-06T03:06:21.632034+0000","last_clean":"2023-10-06T03:06:21.632034+0000","last_became_active":"2023-10-06T03:06:20.631374+0000","last_became_peered":"2023-10-06T03:06:20.631374+0000","last_unstale":"2023-10-06T03:06:21.632034+0000","last_undegraded":"2023-10-06T03:06:21.632034+0000","last_fullsized":"2023-10-06T03:06:21.632034+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:31.775819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635285+0000","last_change":"2023-10-06T03:06:21.625608+0000","last_active":"2023-10-06T03:06:21.635285+0000","last_peered":"2023-10-06T03:06:21.635285+0000","last_clean":"2023-10-06T03:06:21.635285+0000","last_became_active":"2023-10-06T03:06:21.625355+0000","last_became_peered":"2023-10-06T03:06:21.625355+0000","last_unstale":"2023-10-06T03:06:21.635285+0000","last_undegraded":"2023-10-06T03:06:21.635285+0000","last_fullsized":"2023-10-06T03:06:21.635285+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:19.930817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.631772+0000","last_change":"2023-10-06T03:06:20.631772+0000","last_active":"2023-10-06T03:06:20.631772+0000","last_peered":"2023-10-06T03:06:20.631772+0000","last_clean":"2023-10-06T03:06:20.631772+0000","last_became_active":"2023-10-06T03:06:20.631522+0000","last_became_peered":"2023-10-06T03:06:20.631522+0000","last_unstale":"2023-10-06T03:06:20.631772+0000","last_undegraded":"2023-10-06T03:06:20.631772+0000","last_fullsized":"2023-10-06T03:06:20.631772+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:05.937982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.614680+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:11.598376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.628973+0000","last_change":"2023-10-06T03:06:20.628973+0000","last_active":"2023-10-06T03:06:20.628973+0000","last_peered":"2023-10-06T03:06:20.628973+0000","last_clean":"2023-10-06T03:06:20.628973+0000","last_became_active":"2023-10-06T03:06:20.628313+0000","last_became_peered":"2023-10-06T03:06:20.628313+0000","last_unstale":"2023-10-06T03:06:20.628973+0000","last_undegraded":"2023-10-06T03:06:20.628973+0000","last_fullsized":"2023-10-06T03:06:20.628973+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:46.862868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.618244+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:09.042554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.628287+0000","last_change":"2023-10-06T03:06:20.628287+0000","last_active":"2023-10-06T03:06:20.628287+0000","last_peered":"2023-10-06T03:06:20.628287+0000","last_clean":"2023-10-06T03:06:20.628287+0000","last_became_active":"2023-10-06T03:06:20.628023+0000","last_became_peered":"2023-10-06T03:06:20.628023+0000","last_unstale":"2023-10-06T03:06:20.628287+0000","last_undegraded":"2023-10-06T03:06:20.628287+0000","last_fullsized":"2023-10-06T03:06:20.628287+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:08.037702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636359+0000","last_change":"2023-10-06T03:06:21.632635+0000","last_active":"2023-10-06T03:06:21.636359+0000","last_peered":"2023-10-06T03:06:21.636359+0000","last_clean":"2023-10-06T03:06:21.636359+0000","last_became_active":"2023-10-06T03:06:21.632374+0000","last_became_peered":"2023-10-06T03:06:21.632374+0000","last_unstale":"2023-10-06T03:06:21.636359+0000","last_undegraded":"2023-10-06T03:06:21.636359+0000","last_fullsized":"2023-10-06T03:06:21.636359+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:23:27.639109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.625899+0000","last_change":"2023-10-06T03:06:20.624970+0000","last_active":"2023-10-06T03:06:21.625899+0000","last_peered":"2023-10-06T03:06:21.625899+0000","last_clean":"2023-10-06T03:06:21.625899+0000","last_became_active":"2023-10-06T03:06:20.624691+0000","last_became_peered":"2023-10-06T03:06:20.624691+0000","last_unstale":"2023-10-06T03:06:21.625899+0000","last_undegraded":"2023-10-06T03:06:21.625899+0000","last_fullsized":"2023-10-06T03:06:21.625899+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:22.401226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.631663+0000","last_change":"2023-10-06T03:06:21.627803+0000","last_active":"2023-10-06T03:06:21.631663+0000","last_peered":"2023-10-06T03:06:21.631663+0000","last_clean":"2023-10-06T03:06:21.631663+0000","last_became_active":"2023-10-06T03:06:21.627539+0000","last_became_peered":"2023-10-06T03:06:21.627539+0000","last_unstale":"2023-10-06T03:06:21.631663+0000","last_undegraded":"2023-10-06T03:06:21.631663+0000","last_fullsized":"2023-10-06T03:06:21.631663+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:30.851317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.625995+0000","last_change":"2023-10-06T03:06:20.620568+0000","last_active":"2023-10-06T03:06:21.625995+0000","last_peered":"2023-10-06T03:06:21.625995+0000","last_clean":"2023-10-06T03:06:21.625995+0000","last_became_active":"2023-10-06T03:06:20.620321+0000","last_became_peered":"2023-10-06T03:06:20.620321+0000","last_unstale":"2023-10-06T03:06:21.625995+0000","last_undegraded":"2023-10-06T03:06:21.625995+0000","last_fullsized":"2023-10-06T03:06:21.625995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:03.644319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639958+0000","last_change":"2023-10-06T03:06:21.638728+0000","last_active":"2023-10-06T03:06:21.639958+0000","last_peered":"2023-10-06T03:06:21.639958+0000","last_clean":"2023-10-06T03:06:21.639958+0000","last_became_active":"2023-10-06T03:06:21.638519+0000","last_became_peered":"2023-10-06T03:06:21.638519+0000","last_unstale":"2023-10-06T03:06:21.639958+0000","last_undegraded":"2023-10-06T03:06:21.639958+0000","last_fullsized":"2023-10-06T03:06:21.639958+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:39.231251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611366+0000","last_change":"2023-10-06T03:06:20.625335+0000","last_active":"2023-10-06T03:06:21.611366+0000","last_peered":"2023-10-06T03:06:21.611366+0000","last_clean":"2023-10-06T03:06:21.611366+0000","last_became_active":"2023-10-06T03:06:20.624996+0000","last_became_peered":"2023-10-06T03:06:20.624996+0000","last_unstale":"2023-10-06T03:06:21.611366+0000","last_undegraded":"2023-10-06T03:06:21.611366+0000","last_fullsized":"2023-10-06T03:06:21.611366+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:39.376713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639100+0000","last_change":"2023-10-06T03:06:21.632580+0000","last_active":"2023-10-06T03:06:21.639100+0000","last_peered":"2023-10-06T03:06:21.639100+0000","last_clean":"2023-10-06T03:06:21.639100+0000","last_became_active":"2023-10-06T03:06:21.632302+0000","last_became_peered":"2023-10-06T03:06:21.632302+0000","last_unstale":"2023-10-06T03:06:21.639100+0000","last_undegraded":"2023-10-06T03:06:21.639100+0000","last_fullsized":"2023-10-06T03:06:21.639100+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.103354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.618594+0000","last_change":"2023-10-06T03:06:20.630249+0000","last_active":"2023-10-06T03:06:21.618594+0000","last_peered":"2023-10-06T03:06:21.618594+0000","last_clean":"2023-10-06T03:06:21.618594+0000","last_became_active":"2023-10-06T03:06:20.629958+0000","last_became_peered":"2023-10-06T03:06:20.629958+0000","last_unstale":"2023-10-06T03:06:21.618594+0000","last_undegraded":"2023-10-06T03:06:21.618594+0000","last_fullsized":"2023-10-06T03:06:21.618594+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:44.730849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633002+0000","last_change":"2023-10-06T03:06:21.627049+0000","last_active":"2023-10-06T03:06:21.633002+0000","last_peered":"2023-10-06T03:06:21.633002+0000","last_clean":"2023-10-06T03:06:21.633002+0000","last_became_active":"2023-10-06T03:06:21.626407+0000","last_became_peered":"2023-10-06T03:06:21.626407+0000","last_unstale":"2023-10-06T03:06:21.633002+0000","last_undegraded":"2023-10-06T03:06:21.633002+0000","last_fullsized":"2023-10-06T03:06:21.633002+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:13.651697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.633131+0000","last_change":"2023-10-06T03:06:20.633131+0000","last_active":"2023-10-06T03:06:20.633131+0000","last_peered":"2023-10-06T03:06:20.633131+0000","last_clean":"2023-10-06T03:06:20.633131+0000","last_became_active":"2023-10-06T03:06:20.632929+0000","last_became_peered":"2023-10-06T03:06:20.632929+0000","last_unstale":"2023-10-06T03:06:20.633131+0000","last_undegraded":"2023-10-06T03:06:20.633131+0000","last_fullsized":"2023-10-06T03:06:20.633131+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:48.925338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.627674+0000","last_change":"2023-10-06T03:06:21.621046+0000","last_active":"2023-10-06T03:06:21.627674+0000","last_peered":"2023-10-06T03:06:21.627674+0000","last_clean":"2023-10-06T03:06:21.627674+0000","last_became_active":"2023-10-06T03:06:21.620800+0000","last_became_peered":"2023-10-06T03:06:21.620800+0000","last_unstale":"2023-10-06T03:06:21.627674+0000","last_undegraded":"2023-10-06T03:06:21.627674+0000","last_fullsized":"2023-10-06T03:06:21.627674+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:15.019288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.612889+0000","last_change":"2023-10-06T03:06:20.624338+0000","last_active":"2023-10-06T03:06:21.612889+0000","last_peered":"2023-10-06T03:06:21.612889+0000","last_clean":"2023-10-06T03:06:21.612889+0000","last_became_active":"2023-10-06T03:06:20.624066+0000","last_became_peered":"2023-10-06T03:06:20.624066+0000","last_unstale":"2023-10-06T03:06:21.612889+0000","last_undegraded":"2023-10-06T03:06:21.612889+0000","last_fullsized":"2023-10-06T03:06:21.612889+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:31.418752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.637057+0000","last_change":"2023-10-06T03:06:21.631917+0000","last_active":"2023-10-06T03:06:21.637057+0000","last_peered":"2023-10-06T03:06:21.637057+0000","last_clean":"2023-10-06T03:06:21.637057+0000","last_became_active":"2023-10-06T03:06:21.631618+0000","last_became_peered":"2023-10-06T03:06:21.631618+0000","last_unstale":"2023-10-06T03:06:21.637057+0000","last_undegraded":"2023-10-06T03:06:21.637057+0000","last_fullsized":"2023-10-06T03:06:21.637057+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:12.454052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.632587+0000","last_change":"2023-10-06T03:06:20.632587+0000","last_active":"2023-10-06T03:06:20.632587+0000","last_peered":"2023-10-06T03:06:20.632587+0000","last_clean":"2023-10-06T03:06:20.632587+0000","last_became_active":"2023-10-06T03:06:20.632127+0000","last_became_peered":"2023-10-06T03:06:20.632127+0000","last_unstale":"2023-10-06T03:06:20.632587+0000","last_undegraded":"2023-10-06T03:06:20.632587+0000","last_fullsized":"2023-10-06T03:06:20.632587+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:00.533803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.634705+0000","last_change":"2023-10-06T03:06:21.624727+0000","last_active":"2023-10-06T03:06:21.634705+0000","last_peered":"2023-10-06T03:06:21.634705+0000","last_clean":"2023-10-06T03:06:21.634705+0000","last_became_active":"2023-10-06T03:06:21.624412+0000","last_became_peered":"2023-10-06T03:06:21.624412+0000","last_unstale":"2023-10-06T03:06:21.634705+0000","last_undegraded":"2023-10-06T03:06:21.634705+0000","last_fullsized":"2023-10-06T03:06:21.634705+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:25.318899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"56'6","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.642652+0000","last_change":"2023-10-06T03:06:20.627919+0000","last_active":"2023-10-06T03:06:21.642652+0000","last_peered":"2023-10-06T03:06:21.642652+0000","last_clean":"2023-10-06T03:06:21.642652+0000","last_became_active":"2023-10-06T03:06:20.627646+0000","last_became_peered":"2023-10-06T03:06:20.627646+0000","last_unstale":"2023-10-06T03:06:21.642652+0000","last_undegraded":"2023-10-06T03:06:21.642652+0000","last_fullsized":"2023-10-06T03:06:21.642652+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:45.641976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639362+0000","last_change":"2023-10-06T03:06:21.634621+0000","last_active":"2023-10-06T03:06:21.639362+0000","last_peered":"2023-10-06T03:06:21.639362+0000","last_clean":"2023-10-06T03:06:21.639362+0000","last_became_active":"2023-10-06T03:06:21.633392+0000","last_became_peered":"2023-10-06T03:06:21.633392+0000","last_unstale":"2023-10-06T03:06:21.639362+0000","last_undegraded":"2023-10-06T03:06:21.639362+0000","last_fullsized":"2023-10-06T03:06:21.639362+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:15.019288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.631058+0000","last_change":"2023-10-06T03:06:20.631058+0000","last_active":"2023-10-06T03:06:20.631058+0000","last_peered":"2023-10-06T03:06:20.631058+0000","last_clean":"2023-10-06T03:06:20.631058+0000","last_became_active":"2023-10-06T03:06:20.630645+0000","last_became_peered":"2023-10-06T03:06:20.630645+0000","last_unstale":"2023-10-06T03:06:20.631058+0000","last_undegraded":"2023-10-06T03:06:20.631058+0000","last_fullsized":"2023-10-06T03:06:20.631058+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:42:08.211673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636656+0000","last_change":"2023-10-06T03:06:21.631809+0000","last_active":"2023-10-06T03:06:21.636656+0000","last_peered":"2023-10-06T03:06:21.636656+0000","last_clean":"2023-10-06T03:06:21.636656+0000","last_became_active":"2023-10-06T03:06:21.631542+0000","last_became_peered":"2023-10-06T03:06:21.631542+0000","last_unstale":"2023-10-06T03:06:21.636656+0000","last_undegraded":"2023-10-06T03:06:21.636656+0000","last_fullsized":"2023-10-06T03:06:21.636656+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:08.911020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.615758+0000","last_change":"2023-10-06T03:06:20.624236+0000","last_active":"2023-10-06T03:06:21.615758+0000","last_peered":"2023-10-06T03:06:21.615758+0000","last_clean":"2023-10-06T03:06:21.615758+0000","last_became_active":"2023-10-06T03:06:20.623955+0000","last_became_peered":"2023-10-06T03:06:20.623955+0000","last_unstale":"2023-10-06T03:06:21.615758+0000","last_undegraded":"2023-10-06T03:06:21.615758+0000","last_fullsized":"2023-10-06T03:06:21.615758+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:31.418752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.637098+0000","last_change":"2023-10-06T03:06:21.631042+0000","last_active":"2023-10-06T03:06:21.637098+0000","last_peered":"2023-10-06T03:06:21.637098+0000","last_clean":"2023-10-06T03:06:21.637098+0000","last_became_active":"2023-10-06T03:06:21.629590+0000","last_became_peered":"2023-10-06T03:06:21.629590+0000","last_unstale":"2023-10-06T03:06:21.637098+0000","last_undegraded":"2023-10-06T03:06:21.637098+0000","last_fullsized":"2023-10-06T03:06:21.637098+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:03.625453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.629263+0000","last_change":"2023-10-06T03:06:20.629263+0000","last_active":"2023-10-06T03:06:20.629263+0000","last_peered":"2023-10-06T03:06:20.629263+0000","last_clean":"2023-10-06T03:06:20.629263+0000","last_became_active":"2023-10-06T03:06:20.626413+0000","last_became_peered":"2023-10-06T03:06:20.626413+0000","last_unstale":"2023-10-06T03:06:20.629263+0000","last_undegraded":"2023-10-06T03:06:20.629263+0000","last_fullsized":"2023-10-06T03:06:20.629263+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:48.412683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.632011+0000","last_change":"2023-10-06T03:06:21.629980+0000","last_active":"2023-10-06T03:06:21.632011+0000","last_peered":"2023-10-06T03:06:21.632011+0000","last_clean":"2023-10-06T03:06:21.632011+0000","last_became_active":"2023-10-06T03:06:21.629731+0000","last_became_peered":"2023-10-06T03:06:21.629731+0000","last_unstale":"2023-10-06T03:06:21.632011+0000","last_undegraded":"2023-10-06T03:06:21.632011+0000","last_fullsized":"2023-10-06T03:06:21.632011+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:42:09.216525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"56'8","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.641321+0000","last_change":"2023-10-06T03:06:20.623501+0000","last_active":"2023-10-06T03:06:21.641321+0000","last_peered":"2023-10-06T03:06:21.641321+0000","last_clean":"2023-10-06T03:06:21.641321+0000","last_became_active":"2023-10-06T03:06:20.623234+0000","last_became_peered":"2023-10-06T03:06:20.623234+0000","last_unstale":"2023-10-06T03:06:21.641321+0000","last_undegraded":"2023-10-06T03:06:21.641321+0000","last_fullsized":"2023-10-06T03:06:21.641321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:11.535511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.615047+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:40.381565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"56'2","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.641335+0000","last_change":"2023-10-06T03:06:20.630321+0000","last_active":"2023-10-06T03:06:21.641335+0000","last_peered":"2023-10-06T03:06:21.641335+0000","last_clean":"2023-10-06T03:06:21.641335+0000","last_became_active":"2023-10-06T03:06:20.630063+0000","last_became_peered":"2023-10-06T03:06:20.630063+0000","last_unstale":"2023-10-06T03:06:21.641335+0000","last_undegraded":"2023-10-06T03:06:21.641335+0000","last_fullsized":"2023-10-06T03:06:21.641335+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:05.937982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.643971+0000","last_change":"2023-10-06T03:06:21.638984+0000","last_active":"2023-10-06T03:06:21.643971+0000","last_peered":"2023-10-06T03:06:21.643971+0000","last_clean":"2023-10-06T03:06:21.643971+0000","last_became_active":"2023-10-06T03:06:21.638719+0000","last_became_peered":"2023-10-06T03:06:21.638719+0000","last_unstale":"2023-10-06T03:06:21.643971+0000","last_undegraded":"2023-10-06T03:06:21.643971+0000","last_fullsized":"2023-10-06T03:06:21.643971+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:32.641605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"57'1","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T03:06:24.076306+0000","last_change":"2023-10-06T03:06:20.622624+0000","last_active":"2023-10-06T03:06:24.076306+0000","last_peered":"2023-10-06T03:06:24.076306+0000","last_clean":"2023-10-06T03:06:24.076306+0000","last_became_active":"2023-10-06T03:06:20.622334+0000","last_became_peered":"2023-10-06T03:06:20.622334+0000","last_unstale":"2023-10-06T03:06:24.076306+0000","last_undegraded":"2023-10-06T03:06:24.076306+0000","last_fullsized":"2023-10-06T03:06:24.076306+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:03.476888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639263+0000","last_change":"2023-10-06T03:06:21.636220+0000","last_active":"2023-10-06T03:06:21.639263+0000","last_peered":"2023-10-06T03:06:21.639263+0000","last_clean":"2023-10-06T03:06:21.639263+0000","last_became_active":"2023-10-06T03:06:21.635976+0000","last_became_peered":"2023-10-06T03:06:21.635976+0000","last_unstale":"2023-10-06T03:06:21.639263+0000","last_undegraded":"2023-10-06T03:06:21.639263+0000","last_fullsized":"2023-10-06T03:06:21.639263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.103354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.629164+0000","last_change":"2023-10-06T03:06:20.629164+0000","last_active":"2023-10-06T03:06:20.629164+0000","last_peered":"2023-10-06T03:06:20.629164+0000","last_clean":"2023-10-06T03:06:20.629164+0000","last_became_active":"2023-10-06T03:06:20.628699+0000","last_became_peered":"2023-10-06T03:06:20.628699+0000","last_unstale":"2023-10-06T03:06:20.629164+0000","last_undegraded":"2023-10-06T03:06:20.629164+0000","last_fullsized":"2023-10-06T03:06:20.629164+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:31.418752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639709+0000","last_change":"2023-10-06T03:06:21.633840+0000","last_active":"2023-10-06T03:06:21.639709+0000","last_peered":"2023-10-06T03:06:21.639709+0000","last_clean":"2023-10-06T03:06:21.639709+0000","last_became_active":"2023-10-06T03:06:21.633420+0000","last_became_peered":"2023-10-06T03:06:21.633420+0000","last_unstale":"2023-10-06T03:06:21.639709+0000","last_undegraded":"2023-10-06T03:06:21.639709+0000","last_fullsized":"2023-10-06T03:06:21.639709+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:13.651697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.614763+0000","last_change":"2023-10-06T03:06:20.624698+0000","last_active":"2023-10-06T03:06:21.614763+0000","last_peered":"2023-10-06T03:06:21.614763+0000","last_clean":"2023-10-06T03:06:21.614763+0000","last_became_active":"2023-10-06T03:06:20.624434+0000","last_became_peered":"2023-10-06T03:06:20.624434+0000","last_unstale":"2023-10-06T03:06:21.614763+0000","last_undegraded":"2023-10-06T03:06:21.614763+0000","last_fullsized":"2023-10-06T03:06:21.614763+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:58.374860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639768+0000","last_change":"2023-10-06T03:06:21.634923+0000","last_active":"2023-10-06T03:06:21.639768+0000","last_peered":"2023-10-06T03:06:21.639768+0000","last_clean":"2023-10-06T03:06:21.639768+0000","last_became_active":"2023-10-06T03:06:21.634108+0000","last_became_peered":"2023-10-06T03:06:21.634108+0000","last_unstale":"2023-10-06T03:06:21.639768+0000","last_undegraded":"2023-10-06T03:06:21.639768+0000","last_fullsized":"2023-10-06T03:06:21.639768+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:30.851317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.630511+0000","last_change":"2023-10-06T03:06:20.630511+0000","last_active":"2023-10-06T03:06:20.630511+0000","last_peered":"2023-10-06T03:06:20.630511+0000","last_clean":"2023-10-06T03:06:20.630511+0000","last_became_active":"2023-10-06T03:06:20.629748+0000","last_became_peered":"2023-10-06T03:06:20.629748+0000","last_unstale":"2023-10-06T03:06:20.630511+0000","last_undegraded":"2023-10-06T03:06:20.630511+0000","last_fullsized":"2023-10-06T03:06:20.630511+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:41.887149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635739+0000","last_change":"2023-10-06T03:06:21.628438+0000","last_active":"2023-10-06T03:06:21.635739+0000","last_peered":"2023-10-06T03:06:21.635739+0000","last_clean":"2023-10-06T03:06:21.635739+0000","last_became_active":"2023-10-06T03:06:21.628168+0000","last_became_peered":"2023-10-06T03:06:21.628168+0000","last_unstale":"2023-10-06T03:06:21.635739+0000","last_undegraded":"2023-10-06T03:06:21.635739+0000","last_fullsized":"2023-10-06T03:06:21.635739+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:03.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611503+0000","last_change":"2023-10-06T03:06:20.624481+0000","last_active":"2023-10-06T03:06:21.611503+0000","last_peered":"2023-10-06T03:06:21.611503+0000","last_clean":"2023-10-06T03:06:21.611503+0000","last_became_active":"2023-10-06T03:06:20.624019+0000","last_became_peered":"2023-10-06T03:06:20.624019+0000","last_unstale":"2023-10-06T03:06:21.611503+0000","last_undegraded":"2023-10-06T03:06:21.611503+0000","last_fullsized":"2023-10-06T03:06:21.611503+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:15.597423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.631670+0000","last_change":"2023-10-06T03:06:21.627275+0000","last_active":"2023-10-06T03:06:21.631670+0000","last_peered":"2023-10-06T03:06:21.631670+0000","last_clean":"2023-10-06T03:06:21.631670+0000","last_became_active":"2023-10-06T03:06:21.627010+0000","last_became_peered":"2023-10-06T03:06:21.627010+0000","last_unstale":"2023-10-06T03:06:21.631670+0000","last_undegraded":"2023-10-06T03:06:21.631670+0000","last_fullsized":"2023-10-06T03:06:21.631670+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:36.552543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611457+0000","last_change":"2023-10-06T03:06:20.619461+0000","last_active":"2023-10-06T03:06:21.611457+0000","last_peered":"2023-10-06T03:06:21.611457+0000","last_clean":"2023-10-06T03:06:21.611457+0000","last_became_active":"2023-10-06T03:06:20.619221+0000","last_became_peered":"2023-10-06T03:06:20.619221+0000","last_unstale":"2023-10-06T03:06:21.611457+0000","last_undegraded":"2023-10-06T03:06:21.611457+0000","last_fullsized":"2023-10-06T03:06:21.611457+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:10.593523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636177+0000","last_change":"2023-10-06T03:06:21.634948+0000","last_active":"2023-10-06T03:06:21.636177+0000","last_peered":"2023-10-06T03:06:21.636177+0000","last_clean":"2023-10-06T03:06:21.636177+0000","last_became_active":"2023-10-06T03:06:21.634723+0000","last_became_peered":"2023-10-06T03:06:21.634723+0000","last_unstale":"2023-10-06T03:06:21.636177+0000","last_undegraded":"2023-10-06T03:06:21.636177+0000","last_fullsized":"2023-10-06T03:06:21.636177+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:12.923051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.613890+0000","last_change":"2023-10-06T03:06:20.627212+0000","last_active":"2023-10-06T03:06:21.613890+0000","last_peered":"2023-10-06T03:06:21.613890+0000","last_clean":"2023-10-06T03:06:21.613890+0000","last_became_active":"2023-10-06T03:06:20.625418+0000","last_became_peered":"2023-10-06T03:06:20.625418+0000","last_unstale":"2023-10-06T03:06:21.613890+0000","last_undegraded":"2023-10-06T03:06:21.613890+0000","last_fullsized":"2023-10-06T03:06:21.613890+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:58.560109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.616523+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:06.396629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.632136+0000","last_change":"2023-10-06T03:06:20.624883+0000","last_active":"2023-10-06T03:06:21.632136+0000","last_peered":"2023-10-06T03:06:21.632136+0000","last_clean":"2023-10-06T03:06:21.632136+0000","last_became_active":"2023-10-06T03:06:20.624619+0000","last_became_peered":"2023-10-06T03:06:20.624619+0000","last_unstale":"2023-10-06T03:06:21.632136+0000","last_undegraded":"2023-10-06T03:06:21.632136+0000","last_fullsized":"2023-10-06T03:06:21.632136+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:11.535511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.614836+0000","last_change":"2023-10-06T03:04:23.986472+0000","last_active":"2023-10-06T03:06:21.614836+0000","last_peered":"2023-10-06T03:06:21.614836+0000","last_clean":"2023-10-06T03:06:21.614836+0000","last_became_active":"2023-10-06T03:04:23.986228+0000","last_became_peered":"2023-10-06T03:04:23.986228+0000","last_unstale":"2023-10-06T03:06:21.614836+0000","last_undegraded":"2023-10-06T03:06:21.614836+0000","last_fullsized":"2023-10-06T03:06:21.614836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:08.739849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639982+0000","last_change":"2023-10-06T03:06:21.638861+0000","last_active":"2023-10-06T03:06:21.639982+0000","last_peered":"2023-10-06T03:06:21.639982+0000","last_clean":"2023-10-06T03:06:21.639982+0000","last_became_active":"2023-10-06T03:06:21.638563+0000","last_became_peered":"2023-10-06T03:06:21.638563+0000","last_unstale":"2023-10-06T03:06:21.639982+0000","last_undegraded":"2023-10-06T03:06:21.639982+0000","last_fullsized":"2023-10-06T03:06:21.639982+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:47.426610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.630137+0000","last_change":"2023-10-06T03:06:20.630137+0000","last_active":"2023-10-06T03:06:20.630137+0000","last_peered":"2023-10-06T03:06:20.630137+0000","last_clean":"2023-10-06T03:06:20.630137+0000","last_became_active":"2023-10-06T03:06:20.629832+0000","last_became_peered":"2023-10-06T03:06:20.629832+0000","last_unstale":"2023-10-06T03:06:20.630137+0000","last_undegraded":"2023-10-06T03:06:20.630137+0000","last_fullsized":"2023-10-06T03:06:20.630137+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:11.535511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.616107+0000","last_change":"2023-10-06T03:04:23.814917+0000","last_active":"2023-10-06T03:06:21.616107+0000","last_peered":"2023-10-06T03:06:21.616107+0000","last_clean":"2023-10-06T03:06:21.616107+0000","last_became_active":"2023-10-06T03:04:23.814601+0000","last_became_peered":"2023-10-06T03:04:23.814601+0000","last_unstale":"2023-10-06T03:06:21.616107+0000","last_undegraded":"2023-10-06T03:06:21.616107+0000","last_fullsized":"2023-10-06T03:06:21.616107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635294+0000","last_change":"2023-10-06T03:06:21.628936+0000","last_active":"2023-10-06T03:06:21.635294+0000","last_peered":"2023-10-06T03:06:21.635294+0000","last_clean":"2023-10-06T03:06:21.635294+0000","last_became_active":"2023-10-06T03:06:21.628695+0000","last_became_peered":"2023-10-06T03:06:21.628695+0000","last_unstale":"2023-10-06T03:06:21.635294+0000","last_undegraded":"2023-10-06T03:06:21.635294+0000","last_fullsized":"2023-10-06T03:06:21.635294+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:27.973305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.615945+0000","last_change":"2023-10-06T03:06:20.624082+0000","last_active":"2023-10-06T03:06:21.615945+0000","last_peered":"2023-10-06T03:06:21.615945+0000","last_clean":"2023-10-06T03:06:21.615945+0000","last_became_active":"2023-10-06T03:06:20.623824+0000","last_became_peered":"2023-10-06T03:06:20.623824+0000","last_unstale":"2023-10-06T03:06:21.615945+0000","last_undegraded":"2023-10-06T03:06:21.615945+0000","last_fullsized":"2023-10-06T03:06:21.615945+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:08.037702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.627857+0000","last_change":"2023-10-06T03:04:24.314547+0000","last_active":"2023-10-06T03:06:21.627857+0000","last_peered":"2023-10-06T03:06:21.627857+0000","last_clean":"2023-10-06T03:06:21.627857+0000","last_became_active":"2023-10-06T03:04:24.314278+0000","last_became_peered":"2023-10-06T03:04:24.314278+0000","last_unstale":"2023-10-06T03:06:21.627857+0000","last_undegraded":"2023-10-06T03:06:21.627857+0000","last_fullsized":"2023-10-06T03:06:21.627857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:25.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639798+0000","last_change":"2023-10-06T03:06:21.636813+0000","last_active":"2023-10-06T03:06:21.639798+0000","last_peered":"2023-10-06T03:06:21.639798+0000","last_clean":"2023-10-06T03:06:21.639798+0000","last_became_active":"2023-10-06T03:06:21.634134+0000","last_became_peered":"2023-10-06T03:06:21.634134+0000","last_unstale":"2023-10-06T03:06:21.639798+0000","last_undegraded":"2023-10-06T03:06:21.639798+0000","last_fullsized":"2023-10-06T03:06:21.639798+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:36.552543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611097+0000","last_change":"2023-10-06T03:06:20.627128+0000","last_active":"2023-10-06T03:06:21.611097+0000","last_peered":"2023-10-06T03:06:21.611097+0000","last_clean":"2023-10-06T03:06:21.611097+0000","last_became_active":"2023-10-06T03:06:20.626867+0000","last_became_peered":"2023-10-06T03:06:20.626867+0000","last_unstale":"2023-10-06T03:06:21.611097+0000","last_undegraded":"2023-10-06T03:06:21.611097+0000","last_fullsized":"2023-10-06T03:06:21.611097+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:34.227774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.616072+0000","last_change":"2023-10-06T03:04:23.807972+0000","last_active":"2023-10-06T03:06:21.616072+0000","last_peered":"2023-10-06T03:06:21.616072+0000","last_clean":"2023-10-06T03:06:21.616072+0000","last_became_active":"2023-10-06T03:04:23.807723+0000","last_became_peered":"2023-10-06T03:04:23.807723+0000","last_unstale":"2023-10-06T03:06:21.616072+0000","last_undegraded":"2023-10-06T03:06:21.616072+0000","last_fullsized":"2023-10-06T03:06:21.616072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":193,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:06:19.607658+0000","last_change":"2023-10-06T03:04:17.779925+0000","last_active":"2023-10-06T03:06:19.607658+0000","last_peered":"2023-10-06T03:06:19.607658+0000","last_clean":"2023-10-06T03:06:19.607658+0000","last_became_active":"2023-10-06T03:04:17.778997+0000","last_became_peered":"2023-10-06T03:04:17.778997+0000","last_unstale":"2023-10-06T03:06:19.607658+0000","last_undegraded":"2023-10-06T03:06:19.607658+0000","last_fullsized":"2023-10-06T03:06:19.607658+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_clean_scrub_stamp":"2023-10-06T03:04:16.761610+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.615550+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:16.602275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.623551+0000","last_change":"2023-10-06T03:06:20.623551+0000","last_active":"2023-10-06T03:06:20.623551+0000","last_peered":"2023-10-06T03:06:20.623551+0000","last_clean":"2023-10-06T03:06:20.623551+0000","last_became_active":"2023-10-06T03:06:20.623215+0000","last_became_peered":"2023-10-06T03:06:20.623215+0000","last_unstale":"2023-10-06T03:06:20.623551+0000","last_undegraded":"2023-10-06T03:06:20.623551+0000","last_fullsized":"2023-10-06T03:06:20.623551+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:03.476888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:06:19.607750+0000","last_change":"2023-10-06T03:04:23.814887+0000","last_active":"2023-10-06T03:06:19.607750+0000","last_peered":"2023-10-06T03:06:19.607750+0000","last_clean":"2023-10-06T03:06:19.607750+0000","last_became_active":"2023-10-06T03:04:23.814581+0000","last_became_peered":"2023-10-06T03:04:23.814581+0000","last_unstale":"2023-10-06T03:06:19.607750+0000","last_undegraded":"2023-10-06T03:06:19.607750+0000","last_fullsized":"2023-10-06T03:06:19.607750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639813+0000","last_change":"2023-10-06T03:06:21.637853+0000","last_active":"2023-10-06T03:06:21.639813+0000","last_peered":"2023-10-06T03:06:21.639813+0000","last_clean":"2023-10-06T03:06:21.639813+0000","last_became_active":"2023-10-06T03:06:21.637605+0000","last_became_peered":"2023-10-06T03:06:21.637605+0000","last_unstale":"2023-10-06T03:06:21.639813+0000","last_undegraded":"2023-10-06T03:06:21.639813+0000","last_fullsized":"2023-10-06T03:06:21.639813+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:44.331596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.630071+0000","last_change":"2023-10-06T03:06:20.630071+0000","last_active":"2023-10-06T03:06:20.630071+0000","last_peered":"2023-10-06T03:06:20.630071+0000","last_clean":"2023-10-06T03:06:20.630071+0000","last_became_active":"2023-10-06T03:06:20.629809+0000","last_became_peered":"2023-10-06T03:06:20.629809+0000","last_unstale":"2023-10-06T03:06:20.630071+0000","last_undegraded":"2023-10-06T03:06:20.630071+0000","last_fullsized":"2023-10-06T03:06:20.630071+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:39.342768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:06:19.607821+0000","last_change":"2023-10-06T03:04:23.986771+0000","last_active":"2023-10-06T03:06:19.607821+0000","last_peered":"2023-10-06T03:06:19.607821+0000","last_clean":"2023-10-06T03:06:19.607821+0000","last_became_active":"2023-10-06T03:04:23.986552+0000","last_became_peered":"2023-10-06T03:04:23.986552+0000","last_unstale":"2023-10-06T03:06:19.607821+0000","last_undegraded":"2023-10-06T03:06:19.607821+0000","last_fullsized":"2023-10-06T03:06:19.607821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636241+0000","last_change":"2023-10-06T03:06:21.625510+0000","last_active":"2023-10-06T03:06:21.636241+0000","last_peered":"2023-10-06T03:06:21.636241+0000","last_clean":"2023-10-06T03:06:21.636241+0000","last_became_active":"2023-10-06T03:06:21.625257+0000","last_became_peered":"2023-10-06T03:06:21.625257+0000","last_unstale":"2023-10-06T03:06:21.636241+0000","last_undegraded":"2023-10-06T03:06:21.636241+0000","last_fullsized":"2023-10-06T03:06:21.636241+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:27.973305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.632683+0000","last_change":"2023-10-06T03:06:20.632683+0000","last_active":"2023-10-06T03:06:20.632683+0000","last_peered":"2023-10-06T03:06:20.632683+0000","last_clean":"2023-10-06T03:06:20.632683+0000","last_became_active":"2023-10-06T03:06:20.632440+0000","last_became_peered":"2023-10-06T03:06:20.632440+0000","last_unstale":"2023-10-06T03:06:20.632683+0000","last_undegraded":"2023-10-06T03:06:20.632683+0000","last_fullsized":"2023-10-06T03:06:20.632683+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:14.207986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.614562+0000","last_change":"2023-10-06T03:04:23.813862+0000","last_active":"2023-10-06T03:06:21.614562+0000","last_peered":"2023-10-06T03:06:21.614562+0000","last_clean":"2023-10-06T03:06:21.614562+0000","last_became_active":"2023-10-06T03:04:23.813584+0000","last_became_peered":"2023-10-06T03:04:23.813584+0000","last_unstale":"2023-10-06T03:06:21.614562+0000","last_undegraded":"2023-10-06T03:06:21.614562+0000","last_fullsized":"2023-10-06T03:06:21.614562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639687+0000","last_change":"2023-10-06T03:06:21.633661+0000","last_active":"2023-10-06T03:06:21.639687+0000","last_peered":"2023-10-06T03:06:21.639687+0000","last_clean":"2023-10-06T03:06:21.639687+0000","last_became_active":"2023-10-06T03:06:21.633117+0000","last_became_peered":"2023-10-06T03:06:21.633117+0000","last_unstale":"2023-10-06T03:06:21.639687+0000","last_undegraded":"2023-10-06T03:06:21.639687+0000","last_fullsized":"2023-10-06T03:06:21.639687+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:21.616453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611948+0000","last_change":"2023-10-06T03:06:20.616127+0000","last_active":"2023-10-06T03:06:21.611948+0000","last_peered":"2023-10-06T03:06:21.611948+0000","last_clean":"2023-10-06T03:06:21.611948+0000","last_became_active":"2023-10-06T03:06:20.615836+0000","last_became_peered":"2023-10-06T03:06:20.615836+0000","last_unstale":"2023-10-06T03:06:21.611948+0000","last_undegraded":"2023-10-06T03:06:21.611948+0000","last_fullsized":"2023-10-06T03:06:21.611948+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:55.497431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.622611+0000","last_change":"2023-10-06T03:04:23.805874+0000","last_active":"2023-10-06T03:06:21.622611+0000","last_peered":"2023-10-06T03:06:21.622611+0000","last_clean":"2023-10-06T03:06:21.622611+0000","last_became_active":"2023-10-06T03:04:23.805551+0000","last_became_peered":"2023-10-06T03:04:23.805551+0000","last_unstale":"2023-10-06T03:06:21.622611+0000","last_undegraded":"2023-10-06T03:06:21.622611+0000","last_fullsized":"2023-10-06T03:06:21.622611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:21.250275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2112,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":894130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.629,"15min":0.64300000000000002},"min":{"1min":0.318,"5min":0.314,"15min":0.314},"max":{"1min":0.69999999999999996,"5min":3.8860000000000001,"15min":3.8860000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.64900000000000002,"15min":0.66400000000000003},"min":{"1min":0.38700000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.69699999999999995,"5min":3.988,"15min":3.988},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.65200000000000002,"15min":0.67000000000000004},"min":{"1min":0.36199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.81899999999999995,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":0.498},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.64800000000000002,"15min":0.66400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73099999999999998,"5min":3.444,"15min":3.444},"last":0.625}]},{"osd":2,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.67000000000000004,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78800000000000003,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85599999999999998,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.68799999999999994,"15min":0.70599999999999996},"min":{"1min":0.45600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.73099999999999998,"5min":3.903,"15min":3.903},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.71499999999999997,"15min":0.73399999999999999},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.746,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":0.66800000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46800000000000003,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.55700000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.38800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65400000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.39400000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.64000000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.43099999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59899999999999998,"15min":0.60399999999999998},"min":{"1min":0.46600000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.71399999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79100000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297960,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073880,"statfs":{"total":96636764160,"available":96331653120,"internally_reserved":0,"allocated":688128,"data_stored":318193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.79700000000000004,"15min":0.84299999999999997},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77200000000000002,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.83699999999999997,"15min":0.89300000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.64600000000000002,"5min":6.8330000000000002,"15min":6.8330000000000002},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.71599999999999997,"15min":0.74399999999999999},"min":{"1min":0.34899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.72299999999999998,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.73899999999999999,"15min":0.76500000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":3.948,"15min":3.948},"last":0.626}]},{"osd":2,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.754,"15min":0.754},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.75800000000000001,"5min":3.996,"15min":3.996},"last":0.59999999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.71799999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.57399999999999995}]},{"osd":4,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.34399999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.36499999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55400000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.50600000000000001,"15min":0.499},"min":{"1min":0.40999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.443,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.46600000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297984,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073856,"statfs":{"total":96636764160,"available":96331628544,"internally_reserved":0,"allocated":712704,"data_stored":320431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.38700000000000001,"15min":0.39700000000000002},"min":{"1min":0.20999999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.50900000000000001,"5min":1.159,"15min":1.159},"last":0.31},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.375,"15min":0.379},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46999999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.26600000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.58999999999999997,"15min":0.63200000000000001},"min":{"1min":0.254,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.44500000000000001,"5min":6.056,"15min":6.056},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57499999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.44800000000000001,"15min":0.45500000000000002},"min":{"1min":0.27700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.502,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.443,"15min":0.45100000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.56000000000000005,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.32400000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.46800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.77800000000000002,"5min":1.244,"15min":1.244},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.495,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":1.216,"15min":1.216},"last":0.67200000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.628,"15min":0.624},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82899999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.627,"15min":0.627},"min":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.76800000000000002,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89200000000000002,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85699999999999998,"5min":1.014,"15min":1.014},"last":0.66600000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":1.099,"15min":1.099},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.79800000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298508,"kb_used_data":1220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073332,"statfs":{"total":96636764160,"available":96331091968,"internally_reserved":0,"allocated":1249280,"data_stored":893119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.35799999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.39600000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.373}]},{"osd":4,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.503},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.57299999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.53800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297956,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073884,"statfs":{"total":96636764160,"available":96331657216,"internally_reserved":0,"allocated":684032,"data_stored":318159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.80100000000000005,"15min":0.88400000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.437,"5min":12.913,"15min":12.913},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.316,"5min":0.36799999999999999,"15min":0.377},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.49199999999999999,"5min":0.997,"15min":0.997},"last":0.30399999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.51200000000000001,"15min":0.53900000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53000000000000003,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54900000000000004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.33300000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.36199999999999999,"15min":0.36799999999999999},"min":{"1min":0.252,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46200000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.88,"15min":0.96399999999999997},"min":{"1min":0.29199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57299999999999995,"5min":12.941000000000001,"15min":12.941000000000001},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":1.042,"15min":1.1200000000000001},"min":{"1min":0.40600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.76900000000000002,"5min":12.846,"15min":12.846},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.62,"15min":0.622},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.75900000000000001,"5min":1.046,"15min":1.046},"last":0.52600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76900000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":1.0620000000000001,"15min":1.141},"min":{"1min":0.47999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72799999999999998,"5min":12.884,"15min":12.884},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77100000000000002,"5min":1.071,"15min":1.071},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.62,"15min":0.622},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.73199999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.72999999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.504},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77000000000000002,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297956,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073884,"statfs":{"total":96636764160,"available":96331657216,"internally_reserved":0,"allocated":684032,"data_stored":318159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.373,"15min":0.38400000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55000000000000004,"5min":1.361,"15min":1.361},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.311,"5min":0.34899999999999998,"15min":0.35499999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.51200000000000001,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.32800000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.376,"15min":0.38300000000000001},"min":{"1min":0.20699999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53400000000000003,"5min":1.133,"15min":1.133},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.27800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66100000000000003,"5min":1.45,"15min":1.45},"last":0.312}]},{"osd":2,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57399999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.433,"15min":0.443},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59499999999999997,"5min":1.476,"15min":1.476},"last":0.34499999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.38100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":1.649,"15min":1.649},"last":0.437},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80200000000000005,"5min":1.054,"15min":1.054},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77300000000000002,"5min":1.401,"15min":1.401},"last":0.501},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77800000000000002,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.47999999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78000000000000003,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.46200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83399999999999996,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.54900000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81999999999999995,"5min":1.679,"15min":1.679},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80300000000000005,"5min":1.083,"15min":1.083},"last":0.52400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":696320,"data_stored":319695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52000000000000002,"15min":0.51100000000000001},"min":{"1min":0.376,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.41099999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84999999999999998,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.39200000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82699999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80400000000000005,"5min":0.875,"15min":0.875},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.439},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.42699999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.69699999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.503},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90200000000000002,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.622}]},{"osd":5,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83899999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.33900000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297960,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073880,"statfs":{"total":96636764160,"available":96331653120,"internally_reserved":0,"allocated":688128,"data_stored":318181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68500000000000005,"5min":1.012,"15min":1.012},"last":0.621},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74399999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70599999999999996,"5min":1.03,"15min":1.03},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.71399999999999997,"5min":0.755,"15min":0.755},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55400000000000005,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.76800000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.495},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.71899999999999997,"5min":0.998,"15min":0.998},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.58299999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.69599999999999995,"5min":1.048,"15min":1.048},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72799999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.57599999999999996}]},{"osd":4,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.45900000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.40500000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.745,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61699999999999999,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.76200000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.34200000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69199999999999995,"5min":0.872,"15min":0.872},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:06:26.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2023-10-06T03:06:26.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:06:20.600920+0000', 'last_change': '2023-10-06T03:06:20.619224+0000', 'last_active': '2023-10-06T03:06:20.600920+0000', 'last_peered': '2023-10-06T03:06:20.600920+0000', 'last_clean': '2023-10-06T03:06:20.600920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:06:20.600920+0000', 'last_undegraded': '2023-10-06T03:06:20.600920+0000', 'last_fullsized': '2023-10-06T03:06:20.600920+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_clean_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:29:06.942834+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:06:26.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3a is not active+clean 2023-10-06T03:06:26.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:06:20.600920+0000', 'last_change': '2023-10-06T03:06:20.614240+0000', 'last_active': '2023-10-06T03:06:20.600920+0000', 'last_peered': '2023-10-06T03:06:20.600920+0000', 'last_clean': '2023-10-06T03:06:20.600920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:06:20.600920+0000', 'last_undegraded': '2023-10-06T03:06:20.600920+0000', 'last_fullsized': '2023-10-06T03:06:20.600920+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_clean_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:48:47.816353+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:06:26.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2023-10-06T03:06:26.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:06:20.600920+0000', 'last_change': '2023-10-06T03:06:20.617831+0000', 'last_active': '2023-10-06T03:06:20.600920+0000', 'last_peered': '2023-10-06T03:06:20.600920+0000', 'last_clean': '2023-10-06T03:06:20.600920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:06:20.600920+0000', 'last_undegraded': '2023-10-06T03:06:20.600920+0000', 'last_fullsized': '2023-10-06T03:06:20.600920+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_clean_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T03:57:23.298492+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:06:26.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2023-10-06T03:06:26.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:06:20.600920+0000', 'last_change': '2023-10-06T03:06:20.616543+0000', 'last_active': '2023-10-06T03:06:20.600920+0000', 'last_peered': '2023-10-06T03:06:20.600920+0000', 'last_clean': '2023-10-06T03:06:20.600920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:06:20.600920+0000', 'last_undegraded': '2023-10-06T03:06:20.600920+0000', 'last_fullsized': '2023-10-06T03:06:20.600920+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_clean_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T07:10:56.862803+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:06:26.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2023-10-06T03:06:26.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:06:20.600920+0000', 'last_change': '2023-10-06T03:06:20.618243+0000', 'last_active': '2023-10-06T03:06:20.600920+0000', 'last_peered': '2023-10-06T03:06:20.600920+0000', 'last_clean': '2023-10-06T03:06:20.600920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:06:20.600920+0000', 'last_undegraded': '2023-10-06T03:06:20.600920+0000', 'last_fullsized': '2023-10-06T03:06:20.600920+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_clean_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T06:19:32.442537+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:06:26.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2023-10-06T03:06:26.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:06:20.600920+0000', 'last_change': '2023-10-06T03:06:20.615744+0000', 'last_active': '2023-10-06T03:06:20.600920+0000', 'last_peered': '2023-10-06T03:06:20.600920+0000', 'last_clean': '2023-10-06T03:06:20.600920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:06:20.600920+0000', 'last_undegraded': '2023-10-06T03:06:20.600920+0000', 'last_fullsized': '2023-10-06T03:06:20.600920+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_clean_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:15:44.519720+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:06:26.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2023-10-06T03:06:26.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:06:20.600920+0000', 'last_change': '2023-10-06T03:06:20.614948+0000', 'last_active': '2023-10-06T03:06:20.600920+0000', 'last_peered': '2023-10-06T03:06:20.600920+0000', 'last_clean': '2023-10-06T03:06:20.600920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:06:20.600920+0000', 'last_undegraded': '2023-10-06T03:06:20.600920+0000', 'last_fullsized': '2023-10-06T03:06:20.600920+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_clean_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:41:17.898762+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:06:26.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2023-10-06T03:06:26.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:06:20.600920+0000', 'last_change': '2023-10-06T03:06:20.618600+0000', 'last_active': '2023-10-06T03:06:20.600920+0000', 'last_peered': '2023-10-06T03:06:20.600920+0000', 'last_clean': '2023-10-06T03:06:20.600920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:06:20.600920+0000', 'last_undegraded': '2023-10-06T03:06:20.600920+0000', 'last_fullsized': '2023-10-06T03:06:20.600920+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_clean_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:52:04.481740+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:06:26.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.20 is not active+clean 2023-10-06T03:06:26.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:06:20.600920+0000', 'last_change': '2023-10-06T03:06:20.616009+0000', 'last_active': '2023-10-06T03:06:20.600920+0000', 'last_peered': '2023-10-06T03:06:20.600920+0000', 'last_clean': '2023-10-06T03:06:20.600920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:06:20.600920+0000', 'last_undegraded': '2023-10-06T03:06:20.600920+0000', 'last_fullsized': '2023-10-06T03:06:20.600920+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_clean_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:03:04.649172+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:06:26.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-10-06T03:06:26.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:06:20.600920+0000', 'last_change': '2023-10-06T03:06:20.614680+0000', 'last_active': '2023-10-06T03:06:20.600920+0000', 'last_peered': '2023-10-06T03:06:20.600920+0000', 'last_clean': '2023-10-06T03:06:20.600920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:06:20.600920+0000', 'last_undegraded': '2023-10-06T03:06:20.600920+0000', 'last_fullsized': '2023-10-06T03:06:20.600920+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_clean_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:50:11.598376+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:06:26.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-10-06T03:06:26.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:06:20.600920+0000', 'last_change': '2023-10-06T03:06:20.618244+0000', 'last_active': '2023-10-06T03:06:20.600920+0000', 'last_peered': '2023-10-06T03:06:20.600920+0000', 'last_clean': '2023-10-06T03:06:20.600920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:06:20.600920+0000', 'last_undegraded': '2023-10-06T03:06:20.600920+0000', 'last_fullsized': '2023-10-06T03:06:20.600920+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_clean_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T09:06:09.042554+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:06:26.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-10-06T03:06:26.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:06:20.600920+0000', 'last_change': '2023-10-06T03:06:20.615047+0000', 'last_active': '2023-10-06T03:06:20.600920+0000', 'last_peered': '2023-10-06T03:06:20.600920+0000', 'last_clean': '2023-10-06T03:06:20.600920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:06:20.600920+0000', 'last_undegraded': '2023-10-06T03:06:20.600920+0000', 'last_fullsized': '2023-10-06T03:06:20.600920+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_clean_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:05:40.381565+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:06:26.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-10-06T03:06:26.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:06:20.600920+0000', 'last_change': '2023-10-06T03:06:20.616523+0000', 'last_active': '2023-10-06T03:06:20.600920+0000', 'last_peered': '2023-10-06T03:06:20.600920+0000', 'last_clean': '2023-10-06T03:06:20.600920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:06:20.600920+0000', 'last_undegraded': '2023-10-06T03:06:20.600920+0000', 'last_fullsized': '2023-10-06T03:06:20.600920+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_clean_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T05:23:06.396629+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T03:06:26.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-10-06T03:06:26.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T03:06:20.600920+0000', 'last_change': '2023-10-06T03:06:20.615550+0000', 'last_active': '2023-10-06T03:06:20.600920+0000', 'last_peered': '2023-10-06T03:06:20.600920+0000', 'last_clean': '2023-10-06T03:06:20.600920+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T03:06:20.600920+0000', 'last_undegraded': '2023-10-06T03:06:20.600920+0000', 'last_fullsized': '2023-10-06T03:06:20.600920+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'last_clean_scrub_stamp': '2023-10-06T03:06:20.600920+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T10:38:16.602275+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T03:06:26.444 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T03:06:26.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.590+0000 7fafccfe3700 1 Processor -- start 2023-10-06T03:06:26.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.590+0000 7fafccfe3700 1 -- start start 2023-10-06T03:06:26.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.591+0000 7fafccfe3700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fafc80cbb50 0x7fafc80a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:26.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.591+0000 7fafccfe3700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafc80cbf20 0x7fafc80caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:26.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.591+0000 7fafccfe3700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc80c2910 con 0x7fafc80caf80 2023-10-06T03:06:26.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.591+0000 7fafccfe3700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc80cb420 con 0x7fafc80cbb50 2023-10-06T03:06:26.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.591+0000 7fafccfe3700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc80c1d40 con 0x7fafc80cbf20 2023-10-06T03:06:26.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.591+0000 7fafc5d9b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafc80cbf20 0x7fafc80caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:26.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.591+0000 7fafc659c700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fafc80cbb50 0x7fafc80a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:26.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.592+0000 7fafc659c700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fafc80cbb50 0x7fafc80a99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:59150/0 (socket says 172.21.15.125:59150) 2023-10-06T03:06:26.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.592+0000 7fafc5d9b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafc80cbf20 0x7fafc80caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:59172/0 (socket says 172.21.15.125:59172) 2023-10-06T03:06:26.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.592+0000 7fafc659c700 1 -- 172.21.15.125:0/3883748373 learned_addr learned my addr 172.21.15.125:0/3883748373 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:26.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.592+0000 7fafc659c700 1 -- 172.21.15.125:0/3883748373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafc80cbf20 msgr2=0x7fafc80caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:26.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.592+0000 7fafc659c700 1 --2- 172.21.15.125:0/3883748373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafc80cbf20 0x7fafc80caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.592+0000 7fafc659c700 1 -- 172.21.15.125:0/3883748373 >> v1:172.21.15.130:6789/0 conn(0x7fafc80caf80 legacy=0x7fafc80c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:26.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.592+0000 7fafc659c700 1 -- 172.21.15.125:0/3883748373 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc80c1fe0 con 0x7fafc80cbb50 2023-10-06T03:06:26.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.592+0000 7fafc5d9b700 1 --2- 172.21.15.125:0/3883748373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafc80cbf20 0x7fafc80caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:06:26.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.592+0000 7fafc659c700 1 --2- 172.21.15.125:0/3883748373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafc80cbb50 0x7fafc80a99a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009990 tx=0x7fafb8009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8399ffb9d88aaf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:26.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.592+0000 7fafc559a700 1 -- 172.21.15.125:0/3883748373 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb8009e80 con 0x7fafc80cbb50 2023-10-06T03:06:26.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.592+0000 7fafc559a700 1 -- 172.21.15.125:0/3883748373 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb8005c10 con 0x7fafc80cbb50 2023-10-06T03:06:26.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.592+0000 7fafc559a700 1 -- 172.21.15.125:0/3883748373 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb800b650 con 0x7fafc80cbb50 2023-10-06T03:06:26.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.593+0000 7fafccfe3700 1 -- 172.21.15.125:0/3883748373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafc80cbb50 msgr2=0x7fafc80a99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:26.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.593+0000 7fafccfe3700 1 --2- 172.21.15.125:0/3883748373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafc80cbb50 0x7fafc80a99a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009990 tx=0x7fafb8009220 comp rx=0 tx=0).stop 2023-10-06T03:06:26.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.593+0000 7fafccfe3700 1 -- 172.21.15.125:0/3883748373 shutdown_connections 2023-10-06T03:06:26.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.593+0000 7fafccfe3700 1 --2- 172.21.15.125:0/3883748373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafc80cbb50 0x7fafc80a99a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.593+0000 7fafccfe3700 1 --2- 172.21.15.125:0/3883748373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafc80cbf20 0x7fafc80caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.593+0000 7fafccfe3700 1 -- 172.21.15.125:0/3883748373 >> 172.21.15.125:0/3883748373 conn(0x7fafc8068f00 msgr2=0x7fafc80cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:26.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.593+0000 7fafccfe3700 1 -- 172.21.15.125:0/3883748373 shutdown_connections 2023-10-06T03:06:26.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.593+0000 7fafccfe3700 1 -- 172.21.15.125:0/3883748373 wait complete. 2023-10-06T03:06:26.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.594+0000 7fafccfe3700 1 Processor -- start 2023-10-06T03:06:26.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.594+0000 7fafccfe3700 1 -- start start 2023-10-06T03:06:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.595+0000 7fafccfe3700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafc80caf80 0x7fafc80ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.595+0000 7fafccfe3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc80cbb50 0x7fafc8096b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.595+0000 7fafccfe3700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafc80cbf20 0x7fafc8153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.595+0000 7fafccfe3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc80c9df0 con 0x7fafc80cbb50 2023-10-06T03:06:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.595+0000 7fafccfe3700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc8150600 con 0x7fafc80cbf20 2023-10-06T03:06:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.595+0000 7fafccfe3700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc80c91e0 con 0x7fafc80caf80 2023-10-06T03:06:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.595+0000 7fafc5d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc80cbb50 0x7fafc8096b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.595+0000 7fafc5d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc80cbb50 0x7fafc8096b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44782/0 (socket says 172.21.15.125:44782) 2023-10-06T03:06:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.595+0000 7fafc5d9b700 1 -- 172.21.15.125:0/1321595648 learned_addr learned my addr 172.21.15.125:0/1321595648 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:26.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.595+0000 7fafc659c700 1 --2- 172.21.15.125:0/1321595648 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafc80caf80 0x7fafc80ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.595+0000 7fafc6d9d700 1 --2- 172.21.15.125:0/1321595648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafc80cbf20 0x7fafc8153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.595+0000 7fafc5d9b700 1 -- 172.21.15.125:0/1321595648 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafc80caf80 msgr2=0x7fafc80ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.595+0000 7fafc5d9b700 1 --2- 172.21.15.125:0/1321595648 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafc80caf80 0x7fafc80ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.595+0000 7fafc5d9b700 1 -- 172.21.15.125:0/1321595648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafc80cbf20 msgr2=0x7fafc8153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.595+0000 7fafc5d9b700 1 --2- 172.21.15.125:0/1321595648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafc80cbf20 0x7fafc8153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.595+0000 7fafc5d9b700 1 -- 172.21.15.125:0/1321595648 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafbc009420 con 0x7fafc80cbb50 2023-10-06T03:06:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.595+0000 7fafc5d9b700 1 --2- 172.21.15.125:0/1321595648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc80cbb50 0x7fafc8096b30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00ec80 tx=0x7fafbc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.596+0000 7fafb67fc700 1 -- 172.21.15.125:0/1321595648 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc00c850 con 0x7fafc80cbb50 2023-10-06T03:06:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.596+0000 7fafb67fc700 1 -- 172.21.15.125:0/1321595648 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc00c9b0 con 0x7fafc80cbb50 2023-10-06T03:06:26.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.596+0000 7fafccfe3700 1 -- 172.21.15.125:0/1321595648 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb8009480 con 0x7fafc80cbb50 2023-10-06T03:06:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.596+0000 7fafb67fc700 1 -- 172.21.15.125:0/1321595648 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc00cd50 con 0x7fafc80cbb50 2023-10-06T03:06:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.596+0000 7fafccfe3700 1 -- 172.21.15.125:0/1321595648 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc80c9820 con 0x7fafc80cbb50 2023-10-06T03:06:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.597+0000 7fafccfe3700 1 -- 172.21.15.125:0/1321595648 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc806f480 con 0x7fafc80cbb50 2023-10-06T03:06:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.597+0000 7fafb67fc700 1 -- 172.21.15.125:0/1321595648 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fafbc013680 con 0x7fafc80cbb50 2023-10-06T03:06:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.597+0000 7fafb67fc700 1 --2- 172.21.15.125:0/1321595648 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fafa8066f30 0x7fafa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.597+0000 7fafb67fc700 1 -- 172.21.15.125:0/1321595648 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fafbc084720 con 0x7fafc80cbb50 2023-10-06T03:06:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.597+0000 7fafc659c700 1 --2- 172.21.15.125:0/1321595648 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fafa8066f30 0x7fafa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:26.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.598+0000 7fafc659c700 1 --2- 172.21.15.125:0/1321595648 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fafa8066f30 0x7fafa80693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009260 tx=0x7fafb8016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:26.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.601+0000 7fafb67fc700 1 -- 172.21.15.125:0/1321595648 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fafbc0516f0 con 0x7fafc80cbb50 2023-10-06T03:06:26.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.858+0000 7fafccfe3700 1 -- 172.21.15.125:0/1321595648 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fafc80c9b40 con 0x7fafc80cbb50 2023-10-06T03:06:26.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.858+0000 7fafb67fc700 1 -- 172.21.15.125:0/1321595648 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1520 (secure 0 0 0) 0x7fafbc054d10 con 0x7fafc80cbb50 2023-10-06T03:06:26.860 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:26.860 INFO:teuthology.orchestra.run.smithi125.stdout:{"fsid":"c8556660-0880-4430-a03a-c140780d46e7","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":142,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":57,"num_osds":8,"num_up_osds":8,"osd_up_since":1696561455,"num_in_osds":8,"osd_in_since":1696561446,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":91},{"state_name":"creating+peering","count":14}],"num_pgs":105,"num_pools":4,"num_objects":15,"data_bytes":592480,"bytes_used":2442039296,"bytes_avail":770652073984,"bytes_total":773094113280,"inactive_pgs_ratio":0.13333334028720856,"write_bytes_sec":853,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":27,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5556}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-10-06T03:05:19.818175+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T03:06:26.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.860+0000 7fafccfe3700 1 -- 172.21.15.125:0/1321595648 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fafa8066f30 msgr2=0x7fafa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:26.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.860+0000 7fafccfe3700 1 --2- 172.21.15.125:0/1321595648 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fafa8066f30 0x7fafa80693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009260 tx=0x7fafb8016000 comp rx=0 tx=0).stop 2023-10-06T03:06:26.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.860+0000 7fafccfe3700 1 -- 172.21.15.125:0/1321595648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc80cbb50 msgr2=0x7fafc8096b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:26.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.860+0000 7fafccfe3700 1 --2- 172.21.15.125:0/1321595648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc80cbb50 0x7fafc8096b30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fafbc00ec80 tx=0x7fafbc0091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.860+0000 7fafccfe3700 1 -- 172.21.15.125:0/1321595648 shutdown_connections 2023-10-06T03:06:26.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.860+0000 7fafccfe3700 1 --2- 172.21.15.125:0/1321595648 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fafa8066f30 0x7fafa80693e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.860+0000 7fafccfe3700 1 --2- 172.21.15.125:0/1321595648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fafc80cbf20 0x7fafc8153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.860+0000 7fafccfe3700 1 --2- 172.21.15.125:0/1321595648 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fafc80caf80 0x7fafc80ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.860+0000 7fafccfe3700 1 --2- 172.21.15.125:0/1321595648 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fafc80cbb50 0x7fafc8096b30 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.860+0000 7fafccfe3700 1 -- 172.21.15.125:0/1321595648 >> 172.21.15.125:0/1321595648 conn(0x7fafc8068f00 msgr2=0x7fafc80b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:26.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.860+0000 7fafccfe3700 1 -- 172.21.15.125:0/1321595648 shutdown_connections 2023-10-06T03:06:26.863 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.860+0000 7fafccfe3700 1 -- 172.21.15.125:0/1321595648 wait complete. 2023-10-06T03:06:26.873 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T03:06:26.873 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:06:26.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.989+0000 7fe074c92700 1 Processor -- start 2023-10-06T03:06:26.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.989+0000 7fe074c92700 1 -- start start 2023-10-06T03:06:26.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.990+0000 7fe074c92700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe0700af320 0x7fe0700c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:26.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.990+0000 7fe074c92700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe0700cc5a0 0x7fe070067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:26.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.990+0000 7fe074c92700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe070067b50 0x7fe0700c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:26.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.990+0000 7fe074c92700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe070067fd0 con 0x7fe070067b50 2023-10-06T03:06:26.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.990+0000 7fe074c92700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0700caa40 con 0x7fe0700cc5a0 2023-10-06T03:06:26.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.990+0000 7fe074c92700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0700c1ca0 con 0x7fe0700af320 2023-10-06T03:06:26.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.991+0000 7fe06ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe070067b50 0x7fe0700c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:26.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.991+0000 7fe06ed9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe070067b50 0x7fe0700c74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44786/0 (socket says 172.21.15.125:44786) 2023-10-06T03:06:26.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.991+0000 7fe06ed9d700 1 -- 172.21.15.125:0/1873423393 learned_addr learned my addr 172.21.15.125:0/1873423393 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:26.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.991+0000 7fe06ed9d700 1 -- 172.21.15.125:0/1873423393 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe0700af320 msgr2=0x7fe0700c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:26.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.991+0000 7fe06e59c700 1 --2- 172.21.15.125:0/1873423393 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe0700af320 0x7fe0700c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:26.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.991+0000 7fe06dd9b700 1 --2- 172.21.15.125:0/1873423393 >> v2:172.21.15.130:3300/0 conn(0x7fe0700cc5a0 0x7fe070067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:26.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.991+0000 7fe06ed9d700 1 --2- 172.21.15.125:0/1873423393 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe0700af320 0x7fe0700c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.991+0000 7fe06ed9d700 1 -- 172.21.15.125:0/1873423393 >> v2:172.21.15.130:3300/0 conn(0x7fe0700cc5a0 msgr2=0x7fe070067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:26.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.991+0000 7fe06ed9d700 1 --2- 172.21.15.125:0/1873423393 >> v2:172.21.15.130:3300/0 conn(0x7fe0700cc5a0 0x7fe070067610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.991+0000 7fe06ed9d700 1 -- 172.21.15.125:0/1873423393 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0700cca60 con 0x7fe070067b50 2023-10-06T03:06:26.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.991+0000 7fe06ed9d700 1 --2- 172.21.15.125:0/1873423393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe070067b50 0x7fe0700c74b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe07006e000 tx=0x7fe068009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984c7db2aa715682 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:26.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.991+0000 7fe06d59a700 1 -- 172.21.15.125:0/1873423393 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06800e070 con 0x7fe070067b50 2023-10-06T03:06:26.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.991+0000 7fe06d59a700 1 -- 172.21.15.125:0/1873423393 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06800ba50 con 0x7fe070067b50 2023-10-06T03:06:26.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.991+0000 7fe06d59a700 1 -- 172.21.15.125:0/1873423393 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0680092e0 con 0x7fe070067b50 2023-10-06T03:06:26.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.992+0000 7fe074c92700 1 -- 172.21.15.125:0/1873423393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe070067b50 msgr2=0x7fe0700c74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:26.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.992+0000 7fe074c92700 1 --2- 172.21.15.125:0/1873423393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe070067b50 0x7fe0700c74b0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe07006e000 tx=0x7fe068009840 comp rx=0 tx=0).stop 2023-10-06T03:06:26.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.992+0000 7fe074c92700 1 -- 172.21.15.125:0/1873423393 shutdown_connections 2023-10-06T03:06:26.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.992+0000 7fe074c92700 1 --2- 172.21.15.125:0/1873423393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe070067b50 0x7fe0700c74b0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.992+0000 7fe074c92700 1 --2- 172.21.15.125:0/1873423393 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe0700af320 0x7fe0700c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.992+0000 7fe074c92700 1 --2- 172.21.15.125:0/1873423393 >> v2:172.21.15.130:3300/0 conn(0x7fe0700cc5a0 0x7fe070067610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:26.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.992+0000 7fe074c92700 1 -- 172.21.15.125:0/1873423393 >> 172.21.15.125:0/1873423393 conn(0x7fe070068f00 msgr2=0x7fe0700cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:26.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.992+0000 7fe074c92700 1 -- 172.21.15.125:0/1873423393 shutdown_connections 2023-10-06T03:06:26.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.992+0000 7fe074c92700 1 -- 172.21.15.125:0/1873423393 wait complete. 2023-10-06T03:06:26.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.993+0000 7fe074c92700 1 Processor -- start 2023-10-06T03:06:26.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.993+0000 7fe074c92700 1 -- start start 2023-10-06T03:06:26.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe074c92700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe070067b50 0x7fe070169da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:26.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe074c92700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe0700af320 0x7fe070157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:26.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe074c92700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0700cc5a0 0x7fe07015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:26.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe074c92700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07016a2e0 con 0x7fe0700cc5a0 2023-10-06T03:06:26.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe074c92700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07015e3e0 con 0x7fe070067b50 2023-10-06T03:06:26.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe074c92700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07015e6c0 con 0x7fe0700af320 2023-10-06T03:06:26.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe06ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0700cc5a0 0x7fe07015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:26.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe06ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0700cc5a0 0x7fe07015bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44788/0 (socket says 172.21.15.125:44788) 2023-10-06T03:06:26.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe06ed9d700 1 -- 172.21.15.125:0/1974448304 learned_addr learned my addr 172.21.15.125:0/1974448304 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:26.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe06e59c700 1 --2- 172.21.15.125:0/1974448304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe070067b50 0x7fe070169da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:26.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe06dd9b700 1 --2- 172.21.15.125:0/1974448304 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe0700af320 0x7fe070157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:26.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe06ed9d700 1 -- 172.21.15.125:0/1974448304 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe0700af320 msgr2=0x7fe070157520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:27.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe06ed9d700 1 --2- 172.21.15.125:0/1974448304 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe0700af320 0x7fe070157520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:27.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe06ed9d700 1 -- 172.21.15.125:0/1974448304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe070067b50 msgr2=0x7fe070169da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:27.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe06ed9d700 1 --2- 172.21.15.125:0/1974448304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe070067b50 0x7fe070169da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:27.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe06ed9d700 1 -- 172.21.15.125:0/1974448304 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe068009ae0 con 0x7fe0700cc5a0 2023-10-06T03:06:27.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe06ed9d700 1 --2- 172.21.15.125:0/1974448304 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0700cc5a0 0x7fe07015bc50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe07006a4d0 tx=0x7fe068018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:27.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe05e7fc700 1 -- 172.21.15.125:0/1974448304 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0680032f0 con 0x7fe0700cc5a0 2023-10-06T03:06:27.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe05e7fc700 1 -- 172.21.15.125:0/1974448304 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe068008d20 con 0x7fe0700cc5a0 2023-10-06T03:06:27.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe05e7fc700 1 -- 172.21.15.125:0/1974448304 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe068025690 con 0x7fe0700cc5a0 2023-10-06T03:06:27.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe074c92700 1 -- 172.21.15.125:0/1974448304 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07015e9a0 con 0x7fe0700cc5a0 2023-10-06T03:06:27.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.994+0000 7fe074c92700 1 -- 172.21.15.125:0/1974448304 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07015ef60 con 0x7fe0700cc5a0 2023-10-06T03:06:27.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.995+0000 7fe074c92700 1 -- 172.21.15.125:0/1974448304 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0700c6fe0 con 0x7fe0700cc5a0 2023-10-06T03:06:27.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.996+0000 7fe05e7fc700 1 -- 172.21.15.125:0/1974448304 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe068003040 con 0x7fe0700cc5a0 2023-10-06T03:06:27.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.996+0000 7fe05e7fc700 1 --2- 172.21.15.125:0/1974448304 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe050066f30 0x7fe0500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:27.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.996+0000 7fe05e7fc700 1 -- 172.21.15.125:0/1974448304 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe068085f10 con 0x7fe0700cc5a0 2023-10-06T03:06:27.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.996+0000 7fe06e59c700 1 --2- 172.21.15.125:0/1974448304 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe050066f30 0x7fe0500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:27.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:26.997+0000 7fe06e59c700 1 --2- 172.21.15.125:0/1974448304 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe050066f30 0x7fe0500693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe06000ac00 tx=0x7fe060008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:27.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:27.000+0000 7fe05e7fc700 1 -- 172.21.15.125:0/1974448304 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe068052f90 con 0x7fe0700cc5a0 2023-10-06T03:06:27.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:27.178+0000 7fe074c92700 1 -- 172.21.15.125:0/1974448304 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe070066510 con 0x7fe050066f30 2023-10-06T03:06:27.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:27.187+0000 7fe05e7fc700 1 -- 172.21.15.125:0/1974448304 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310315 (secure 0 0 0) 0x7fe070066510 con 0x7fe050066f30 2023-10-06T03:06:27.191 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:27.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:27.190+0000 7fe074c92700 1 -- 172.21.15.125:0/1974448304 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe050066f30 msgr2=0x7fe0500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:27.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:27.190+0000 7fe074c92700 1 --2- 172.21.15.125:0/1974448304 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe050066f30 0x7fe0500693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe06000ac00 tx=0x7fe060008040 comp rx=0 tx=0).stop 2023-10-06T03:06:27.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:27.190+0000 7fe074c92700 1 -- 172.21.15.125:0/1974448304 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0700cc5a0 msgr2=0x7fe07015bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:27.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:27.190+0000 7fe074c92700 1 --2- 172.21.15.125:0/1974448304 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0700cc5a0 0x7fe07015bc50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe07006a4d0 tx=0x7fe068018000 comp rx=0 tx=0).stop 2023-10-06T03:06:27.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:27.190+0000 7fe074c92700 1 -- 172.21.15.125:0/1974448304 shutdown_connections 2023-10-06T03:06:27.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:27.190+0000 7fe074c92700 1 --2- 172.21.15.125:0/1974448304 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe050066f30 0x7fe0500693e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:27.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:27.190+0000 7fe074c92700 1 --2- 172.21.15.125:0/1974448304 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe0700cc5a0 0x7fe07015bc50 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:27.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:27.190+0000 7fe074c92700 1 --2- 172.21.15.125:0/1974448304 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe070067b50 0x7fe070169da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:27.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:27.190+0000 7fe074c92700 1 --2- 172.21.15.125:0/1974448304 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe0700af320 0x7fe070157520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:27.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:27.190+0000 7fe074c92700 1 -- 172.21.15.125:0/1974448304 >> 172.21.15.125:0/1974448304 conn(0x7fe070068f00 msgr2=0x7fe0700c8450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:27.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:27.190+0000 7fe074c92700 1 -- 172.21.15.125:0/1974448304 shutdown_connections 2023-10-06T03:06:27.195 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:27.190+0000 7fe074c92700 1 -- 172.21.15.125:0/1974448304 wait complete. 2023-10-06T03:06:27.195 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-06T03:06:27.203 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":115,"stamp":"2023-10-06T03:06:25.831879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592480,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":186,"num_write_kb":2421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":151,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384804,"kb_used_data":6500,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589916,"statfs":{"total":773094113280,"available":770652073984,"internally_reserved":0,"allocated":6656000,"data_stored":3700067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2112,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000936"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633100+0000","last_change":"2023-10-06T03:06:21.621607+0000","last_active":"2023-10-06T03:06:21.633100+0000","last_peered":"2023-10-06T03:06:21.633100+0000","last_clean":"2023-10-06T03:06:21.633100+0000","last_became_active":"2023-10-06T03:06:21.621336+0000","last_became_peered":"2023-10-06T03:06:21.621336+0000","last_unstale":"2023-10-06T03:06:21.633100+0000","last_undegraded":"2023-10-06T03:06:21.633100+0000","last_fullsized":"2023-10-06T03:06:21.633100+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:03.625453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639899+0000","last_change":"2023-10-06T03:06:21.638143+0000","last_active":"2023-10-06T03:06:21.639899+0000","last_peered":"2023-10-06T03:06:21.639899+0000","last_clean":"2023-10-06T03:06:21.639899+0000","last_became_active":"2023-10-06T03:06:21.637865+0000","last_became_peered":"2023-10-06T03:06:21.637865+0000","last_unstale":"2023-10-06T03:06:21.639899+0000","last_undegraded":"2023-10-06T03:06:21.639899+0000","last_fullsized":"2023-10-06T03:06:21.639899+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:12.454052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.619224+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:06.942834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639545+0000","last_change":"2023-10-06T03:06:21.632909+0000","last_active":"2023-10-06T03:06:21.639545+0000","last_peered":"2023-10-06T03:06:21.639545+0000","last_clean":"2023-10-06T03:06:21.639545+0000","last_became_active":"2023-10-06T03:06:21.632654+0000","last_became_peered":"2023-10-06T03:06:21.632654+0000","last_unstale":"2023-10-06T03:06:21.639545+0000","last_undegraded":"2023-10-06T03:06:21.639545+0000","last_fullsized":"2023-10-06T03:06:21.639545+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:34.401176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635047+0000","last_change":"2023-10-06T03:06:21.628138+0000","last_active":"2023-10-06T03:06:21.635047+0000","last_peered":"2023-10-06T03:06:21.635047+0000","last_clean":"2023-10-06T03:06:21.635047+0000","last_became_active":"2023-10-06T03:06:21.627839+0000","last_became_peered":"2023-10-06T03:06:21.627839+0000","last_unstale":"2023-10-06T03:06:21.635047+0000","last_undegraded":"2023-10-06T03:06:21.635047+0000","last_fullsized":"2023-10-06T03:06:21.635047+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:35.993689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.614240+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:48:47.816353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.643908+0000","last_change":"2023-10-06T03:06:21.636657+0000","last_active":"2023-10-06T03:06:21.643908+0000","last_peered":"2023-10-06T03:06:21.643908+0000","last_clean":"2023-10-06T03:06:21.643908+0000","last_became_active":"2023-10-06T03:06:21.636400+0000","last_became_peered":"2023-10-06T03:06:21.636400+0000","last_unstale":"2023-10-06T03:06:21.643908+0000","last_undegraded":"2023-10-06T03:06:21.643908+0000","last_fullsized":"2023-10-06T03:06:21.643908+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:45.735702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.637344+0000","last_change":"2023-10-06T03:06:21.631743+0000","last_active":"2023-10-06T03:06:21.637344+0000","last_peered":"2023-10-06T03:06:21.637344+0000","last_clean":"2023-10-06T03:06:21.637344+0000","last_became_active":"2023-10-06T03:06:21.631464+0000","last_became_peered":"2023-10-06T03:06:21.631464+0000","last_unstale":"2023-10-06T03:06:21.637344+0000","last_undegraded":"2023-10-06T03:06:21.637344+0000","last_fullsized":"2023-10-06T03:06:21.637344+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:39.677516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.617831+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:57:23.298492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.616543+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:10:56.862803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635263+0000","last_change":"2023-10-06T03:06:21.624427+0000","last_active":"2023-10-06T03:06:21.635263+0000","last_peered":"2023-10-06T03:06:21.635263+0000","last_clean":"2023-10-06T03:06:21.635263+0000","last_became_active":"2023-10-06T03:06:21.624098+0000","last_became_peered":"2023-10-06T03:06:21.624098+0000","last_unstale":"2023-10-06T03:06:21.635263+0000","last_undegraded":"2023-10-06T03:06:21.635263+0000","last_fullsized":"2023-10-06T03:06:21.635263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:39.677516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.634789+0000","last_change":"2023-10-06T03:06:21.629593+0000","last_active":"2023-10-06T03:06:21.634789+0000","last_peered":"2023-10-06T03:06:21.634789+0000","last_clean":"2023-10-06T03:06:21.634789+0000","last_became_active":"2023-10-06T03:06:21.629297+0000","last_became_peered":"2023-10-06T03:06:21.629297+0000","last_unstale":"2023-10-06T03:06:21.634789+0000","last_undegraded":"2023-10-06T03:06:21.634789+0000","last_fullsized":"2023-10-06T03:06:21.634789+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:15.019288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633817+0000","last_change":"2023-10-06T03:06:21.625690+0000","last_active":"2023-10-06T03:06:21.633817+0000","last_peered":"2023-10-06T03:06:21.633817+0000","last_clean":"2023-10-06T03:06:21.633817+0000","last_became_active":"2023-10-06T03:06:21.625430+0000","last_became_peered":"2023-10-06T03:06:21.625430+0000","last_unstale":"2023-10-06T03:06:21.633817+0000","last_undegraded":"2023-10-06T03:06:21.633817+0000","last_fullsized":"2023-10-06T03:06:21.633817+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:25.318899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.618243+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:32.442537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.615744+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:44.519720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636378+0000","last_change":"2023-10-06T03:06:21.633328+0000","last_active":"2023-10-06T03:06:21.636378+0000","last_peered":"2023-10-06T03:06:21.636378+0000","last_clean":"2023-10-06T03:06:21.636378+0000","last_became_active":"2023-10-06T03:06:21.633115+0000","last_became_peered":"2023-10-06T03:06:21.633115+0000","last_unstale":"2023-10-06T03:06:21.636378+0000","last_undegraded":"2023-10-06T03:06:21.636378+0000","last_fullsized":"2023-10-06T03:06:21.636378+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:46.396243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633176+0000","last_change":"2023-10-06T03:06:21.630252+0000","last_active":"2023-10-06T03:06:21.633176+0000","last_peered":"2023-10-06T03:06:21.633176+0000","last_clean":"2023-10-06T03:06:21.633176+0000","last_became_active":"2023-10-06T03:06:21.629902+0000","last_became_peered":"2023-10-06T03:06:21.629902+0000","last_unstale":"2023-10-06T03:06:21.633176+0000","last_undegraded":"2023-10-06T03:06:21.633176+0000","last_fullsized":"2023-10-06T03:06:21.633176+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:49.417536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639251+0000","last_change":"2023-10-06T03:06:21.635767+0000","last_active":"2023-10-06T03:06:21.639251+0000","last_peered":"2023-10-06T03:06:21.639251+0000","last_clean":"2023-10-06T03:06:21.639251+0000","last_became_active":"2023-10-06T03:06:21.635155+0000","last_became_peered":"2023-10-06T03:06:21.635155+0000","last_unstale":"2023-10-06T03:06:21.639251+0000","last_undegraded":"2023-10-06T03:06:21.639251+0000","last_fullsized":"2023-10-06T03:06:21.639251+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:07.774084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636920+0000","last_change":"2023-10-06T03:06:21.630222+0000","last_active":"2023-10-06T03:06:21.636920+0000","last_peered":"2023-10-06T03:06:21.636920+0000","last_clean":"2023-10-06T03:06:21.636920+0000","last_became_active":"2023-10-06T03:06:21.629971+0000","last_became_peered":"2023-10-06T03:06:21.629971+0000","last_unstale":"2023-10-06T03:06:21.636920+0000","last_undegraded":"2023-10-06T03:06:21.636920+0000","last_fullsized":"2023-10-06T03:06:21.636920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:49.386862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.631033+0000","last_change":"2023-10-06T03:06:21.625167+0000","last_active":"2023-10-06T03:06:21.631033+0000","last_peered":"2023-10-06T03:06:21.631033+0000","last_clean":"2023-10-06T03:06:21.631033+0000","last_became_active":"2023-10-06T03:06:21.624919+0000","last_became_peered":"2023-10-06T03:06:21.624919+0000","last_unstale":"2023-10-06T03:06:21.631033+0000","last_undegraded":"2023-10-06T03:06:21.631033+0000","last_fullsized":"2023-10-06T03:06:21.631033+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:34.401176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.621313+0000","last_change":"2023-10-06T03:06:21.620048+0000","last_active":"2023-10-06T03:06:21.621313+0000","last_peered":"2023-10-06T03:06:21.621313+0000","last_clean":"2023-10-06T03:06:21.621313+0000","last_became_active":"2023-10-06T03:06:21.619777+0000","last_became_peered":"2023-10-06T03:06:21.619777+0000","last_unstale":"2023-10-06T03:06:21.621313+0000","last_undegraded":"2023-10-06T03:06:21.621313+0000","last_fullsized":"2023-10-06T03:06:21.621313+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:19.930817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.631585+0000","last_change":"2023-10-06T03:06:21.627387+0000","last_active":"2023-10-06T03:06:21.631585+0000","last_peered":"2023-10-06T03:06:21.631585+0000","last_clean":"2023-10-06T03:06:21.631585+0000","last_became_active":"2023-10-06T03:06:21.627106+0000","last_became_peered":"2023-10-06T03:06:21.627106+0000","last_unstale":"2023-10-06T03:06:21.631585+0000","last_undegraded":"2023-10-06T03:06:21.631585+0000","last_fullsized":"2023-10-06T03:06:21.631585+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:03.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.630922+0000","last_change":"2023-10-06T03:06:21.626786+0000","last_active":"2023-10-06T03:06:21.630922+0000","last_peered":"2023-10-06T03:06:21.630922+0000","last_clean":"2023-10-06T03:06:21.630922+0000","last_became_active":"2023-10-06T03:06:21.626533+0000","last_became_peered":"2023-10-06T03:06:21.626533+0000","last_unstale":"2023-10-06T03:06:21.630922+0000","last_undegraded":"2023-10-06T03:06:21.630922+0000","last_fullsized":"2023-10-06T03:06:21.630922+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:39.677516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.614948+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:17.898762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639361+0000","last_change":"2023-10-06T03:06:21.632296+0000","last_active":"2023-10-06T03:06:21.639361+0000","last_peered":"2023-10-06T03:06:21.639361+0000","last_clean":"2023-10-06T03:06:21.639361+0000","last_became_active":"2023-10-06T03:06:21.631870+0000","last_became_peered":"2023-10-06T03:06:21.631870+0000","last_unstale":"2023-10-06T03:06:21.639361+0000","last_undegraded":"2023-10-06T03:06:21.639361+0000","last_fullsized":"2023-10-06T03:06:21.639361+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:45.483003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.637111+0000","last_change":"2023-10-06T03:06:21.632692+0000","last_active":"2023-10-06T03:06:21.637111+0000","last_peered":"2023-10-06T03:06:21.637111+0000","last_clean":"2023-10-06T03:06:21.637111+0000","last_became_active":"2023-10-06T03:06:21.632437+0000","last_became_peered":"2023-10-06T03:06:21.632437+0000","last_unstale":"2023-10-06T03:06:21.637111+0000","last_undegraded":"2023-10-06T03:06:21.637111+0000","last_fullsized":"2023-10-06T03:06:21.637111+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:07.774084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635412+0000","last_change":"2023-10-06T03:06:21.629002+0000","last_active":"2023-10-06T03:06:21.635412+0000","last_peered":"2023-10-06T03:06:21.635412+0000","last_clean":"2023-10-06T03:06:21.635412+0000","last_became_active":"2023-10-06T03:06:21.628770+0000","last_became_peered":"2023-10-06T03:06:21.628770+0000","last_unstale":"2023-10-06T03:06:21.635412+0000","last_undegraded":"2023-10-06T03:06:21.635412+0000","last_fullsized":"2023-10-06T03:06:21.635412+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.103354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633020+0000","last_change":"2023-10-06T03:06:21.627263+0000","last_active":"2023-10-06T03:06:21.633020+0000","last_peered":"2023-10-06T03:06:21.633020+0000","last_clean":"2023-10-06T03:06:21.633020+0000","last_became_active":"2023-10-06T03:06:21.626762+0000","last_became_peered":"2023-10-06T03:06:21.626762+0000","last_unstale":"2023-10-06T03:06:21.633020+0000","last_undegraded":"2023-10-06T03:06:21.633020+0000","last_fullsized":"2023-10-06T03:06:21.633020+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:39.231251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.618600+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:04.481740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.630832+0000","last_change":"2023-10-06T03:06:21.624826+0000","last_active":"2023-10-06T03:06:21.630832+0000","last_peered":"2023-10-06T03:06:21.630832+0000","last_clean":"2023-10-06T03:06:21.630832+0000","last_became_active":"2023-10-06T03:06:21.623419+0000","last_became_peered":"2023-10-06T03:06:21.623419+0000","last_unstale":"2023-10-06T03:06:21.630832+0000","last_undegraded":"2023-10-06T03:06:21.630832+0000","last_fullsized":"2023-10-06T03:06:21.630832+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:34.401176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635759+0000","last_change":"2023-10-06T03:06:21.628936+0000","last_active":"2023-10-06T03:06:21.635759+0000","last_peered":"2023-10-06T03:06:21.635759+0000","last_clean":"2023-10-06T03:06:21.635759+0000","last_became_active":"2023-10-06T03:06:21.628692+0000","last_became_peered":"2023-10-06T03:06:21.628692+0000","last_unstale":"2023-10-06T03:06:21.635759+0000","last_undegraded":"2023-10-06T03:06:21.635759+0000","last_fullsized":"2023-10-06T03:06:21.635759+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:08.911020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.616009+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:04.649172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639639+0000","last_change":"2023-10-06T03:06:21.634615+0000","last_active":"2023-10-06T03:06:21.639639+0000","last_peered":"2023-10-06T03:06:21.639639+0000","last_clean":"2023-10-06T03:06:21.639639+0000","last_became_active":"2023-10-06T03:06:21.634339+0000","last_became_peered":"2023-10-06T03:06:21.634339+0000","last_unstale":"2023-10-06T03:06:21.639639+0000","last_undegraded":"2023-10-06T03:06:21.639639+0000","last_fullsized":"2023-10-06T03:06:21.639639+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:49.417536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"56'4","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.632034+0000","last_change":"2023-10-06T03:06:20.631590+0000","last_active":"2023-10-06T03:06:21.632034+0000","last_peered":"2023-10-06T03:06:21.632034+0000","last_clean":"2023-10-06T03:06:21.632034+0000","last_became_active":"2023-10-06T03:06:20.631374+0000","last_became_peered":"2023-10-06T03:06:20.631374+0000","last_unstale":"2023-10-06T03:06:21.632034+0000","last_undegraded":"2023-10-06T03:06:21.632034+0000","last_fullsized":"2023-10-06T03:06:21.632034+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:31.775819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635285+0000","last_change":"2023-10-06T03:06:21.625608+0000","last_active":"2023-10-06T03:06:21.635285+0000","last_peered":"2023-10-06T03:06:21.635285+0000","last_clean":"2023-10-06T03:06:21.635285+0000","last_became_active":"2023-10-06T03:06:21.625355+0000","last_became_peered":"2023-10-06T03:06:21.625355+0000","last_unstale":"2023-10-06T03:06:21.635285+0000","last_undegraded":"2023-10-06T03:06:21.635285+0000","last_fullsized":"2023-10-06T03:06:21.635285+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:19.930817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.631772+0000","last_change":"2023-10-06T03:06:20.631772+0000","last_active":"2023-10-06T03:06:20.631772+0000","last_peered":"2023-10-06T03:06:20.631772+0000","last_clean":"2023-10-06T03:06:20.631772+0000","last_became_active":"2023-10-06T03:06:20.631522+0000","last_became_peered":"2023-10-06T03:06:20.631522+0000","last_unstale":"2023-10-06T03:06:20.631772+0000","last_undegraded":"2023-10-06T03:06:20.631772+0000","last_fullsized":"2023-10-06T03:06:20.631772+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:05.937982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.614680+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:11.598376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.628973+0000","last_change":"2023-10-06T03:06:20.628973+0000","last_active":"2023-10-06T03:06:20.628973+0000","last_peered":"2023-10-06T03:06:20.628973+0000","last_clean":"2023-10-06T03:06:20.628973+0000","last_became_active":"2023-10-06T03:06:20.628313+0000","last_became_peered":"2023-10-06T03:06:20.628313+0000","last_unstale":"2023-10-06T03:06:20.628973+0000","last_undegraded":"2023-10-06T03:06:20.628973+0000","last_fullsized":"2023-10-06T03:06:20.628973+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:46.862868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.618244+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:09.042554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.628287+0000","last_change":"2023-10-06T03:06:20.628287+0000","last_active":"2023-10-06T03:06:20.628287+0000","last_peered":"2023-10-06T03:06:20.628287+0000","last_clean":"2023-10-06T03:06:20.628287+0000","last_became_active":"2023-10-06T03:06:20.628023+0000","last_became_peered":"2023-10-06T03:06:20.628023+0000","last_unstale":"2023-10-06T03:06:20.628287+0000","last_undegraded":"2023-10-06T03:06:20.628287+0000","last_fullsized":"2023-10-06T03:06:20.628287+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:08.037702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636359+0000","last_change":"2023-10-06T03:06:21.632635+0000","last_active":"2023-10-06T03:06:21.636359+0000","last_peered":"2023-10-06T03:06:21.636359+0000","last_clean":"2023-10-06T03:06:21.636359+0000","last_became_active":"2023-10-06T03:06:21.632374+0000","last_became_peered":"2023-10-06T03:06:21.632374+0000","last_unstale":"2023-10-06T03:06:21.636359+0000","last_undegraded":"2023-10-06T03:06:21.636359+0000","last_fullsized":"2023-10-06T03:06:21.636359+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:23:27.639109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.625899+0000","last_change":"2023-10-06T03:06:20.624970+0000","last_active":"2023-10-06T03:06:21.625899+0000","last_peered":"2023-10-06T03:06:21.625899+0000","last_clean":"2023-10-06T03:06:21.625899+0000","last_became_active":"2023-10-06T03:06:20.624691+0000","last_became_peered":"2023-10-06T03:06:20.624691+0000","last_unstale":"2023-10-06T03:06:21.625899+0000","last_undegraded":"2023-10-06T03:06:21.625899+0000","last_fullsized":"2023-10-06T03:06:21.625899+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:22.401226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.631663+0000","last_change":"2023-10-06T03:06:21.627803+0000","last_active":"2023-10-06T03:06:21.631663+0000","last_peered":"2023-10-06T03:06:21.631663+0000","last_clean":"2023-10-06T03:06:21.631663+0000","last_became_active":"2023-10-06T03:06:21.627539+0000","last_became_peered":"2023-10-06T03:06:21.627539+0000","last_unstale":"2023-10-06T03:06:21.631663+0000","last_undegraded":"2023-10-06T03:06:21.631663+0000","last_fullsized":"2023-10-06T03:06:21.631663+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:30.851317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.625995+0000","last_change":"2023-10-06T03:06:20.620568+0000","last_active":"2023-10-06T03:06:21.625995+0000","last_peered":"2023-10-06T03:06:21.625995+0000","last_clean":"2023-10-06T03:06:21.625995+0000","last_became_active":"2023-10-06T03:06:20.620321+0000","last_became_peered":"2023-10-06T03:06:20.620321+0000","last_unstale":"2023-10-06T03:06:21.625995+0000","last_undegraded":"2023-10-06T03:06:21.625995+0000","last_fullsized":"2023-10-06T03:06:21.625995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:03.644319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639958+0000","last_change":"2023-10-06T03:06:21.638728+0000","last_active":"2023-10-06T03:06:21.639958+0000","last_peered":"2023-10-06T03:06:21.639958+0000","last_clean":"2023-10-06T03:06:21.639958+0000","last_became_active":"2023-10-06T03:06:21.638519+0000","last_became_peered":"2023-10-06T03:06:21.638519+0000","last_unstale":"2023-10-06T03:06:21.639958+0000","last_undegraded":"2023-10-06T03:06:21.639958+0000","last_fullsized":"2023-10-06T03:06:21.639958+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:39.231251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611366+0000","last_change":"2023-10-06T03:06:20.625335+0000","last_active":"2023-10-06T03:06:21.611366+0000","last_peered":"2023-10-06T03:06:21.611366+0000","last_clean":"2023-10-06T03:06:21.611366+0000","last_became_active":"2023-10-06T03:06:20.624996+0000","last_became_peered":"2023-10-06T03:06:20.624996+0000","last_unstale":"2023-10-06T03:06:21.611366+0000","last_undegraded":"2023-10-06T03:06:21.611366+0000","last_fullsized":"2023-10-06T03:06:21.611366+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:39.376713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639100+0000","last_change":"2023-10-06T03:06:21.632580+0000","last_active":"2023-10-06T03:06:21.639100+0000","last_peered":"2023-10-06T03:06:21.639100+0000","last_clean":"2023-10-06T03:06:21.639100+0000","last_became_active":"2023-10-06T03:06:21.632302+0000","last_became_peered":"2023-10-06T03:06:21.632302+0000","last_unstale":"2023-10-06T03:06:21.639100+0000","last_undegraded":"2023-10-06T03:06:21.639100+0000","last_fullsized":"2023-10-06T03:06:21.639100+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.103354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.618594+0000","last_change":"2023-10-06T03:06:20.630249+0000","last_active":"2023-10-06T03:06:21.618594+0000","last_peered":"2023-10-06T03:06:21.618594+0000","last_clean":"2023-10-06T03:06:21.618594+0000","last_became_active":"2023-10-06T03:06:20.629958+0000","last_became_peered":"2023-10-06T03:06:20.629958+0000","last_unstale":"2023-10-06T03:06:21.618594+0000","last_undegraded":"2023-10-06T03:06:21.618594+0000","last_fullsized":"2023-10-06T03:06:21.618594+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:44.730849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633002+0000","last_change":"2023-10-06T03:06:21.627049+0000","last_active":"2023-10-06T03:06:21.633002+0000","last_peered":"2023-10-06T03:06:21.633002+0000","last_clean":"2023-10-06T03:06:21.633002+0000","last_became_active":"2023-10-06T03:06:21.626407+0000","last_became_peered":"2023-10-06T03:06:21.626407+0000","last_unstale":"2023-10-06T03:06:21.633002+0000","last_undegraded":"2023-10-06T03:06:21.633002+0000","last_fullsized":"2023-10-06T03:06:21.633002+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:13.651697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.633131+0000","last_change":"2023-10-06T03:06:20.633131+0000","last_active":"2023-10-06T03:06:20.633131+0000","last_peered":"2023-10-06T03:06:20.633131+0000","last_clean":"2023-10-06T03:06:20.633131+0000","last_became_active":"2023-10-06T03:06:20.632929+0000","last_became_peered":"2023-10-06T03:06:20.632929+0000","last_unstale":"2023-10-06T03:06:20.633131+0000","last_undegraded":"2023-10-06T03:06:20.633131+0000","last_fullsized":"2023-10-06T03:06:20.633131+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:48.925338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.627674+0000","last_change":"2023-10-06T03:06:21.621046+0000","last_active":"2023-10-06T03:06:21.627674+0000","last_peered":"2023-10-06T03:06:21.627674+0000","last_clean":"2023-10-06T03:06:21.627674+0000","last_became_active":"2023-10-06T03:06:21.620800+0000","last_became_peered":"2023-10-06T03:06:21.620800+0000","last_unstale":"2023-10-06T03:06:21.627674+0000","last_undegraded":"2023-10-06T03:06:21.627674+0000","last_fullsized":"2023-10-06T03:06:21.627674+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:15.019288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.612889+0000","last_change":"2023-10-06T03:06:20.624338+0000","last_active":"2023-10-06T03:06:21.612889+0000","last_peered":"2023-10-06T03:06:21.612889+0000","last_clean":"2023-10-06T03:06:21.612889+0000","last_became_active":"2023-10-06T03:06:20.624066+0000","last_became_peered":"2023-10-06T03:06:20.624066+0000","last_unstale":"2023-10-06T03:06:21.612889+0000","last_undegraded":"2023-10-06T03:06:21.612889+0000","last_fullsized":"2023-10-06T03:06:21.612889+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:31.418752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.637057+0000","last_change":"2023-10-06T03:06:21.631917+0000","last_active":"2023-10-06T03:06:21.637057+0000","last_peered":"2023-10-06T03:06:21.637057+0000","last_clean":"2023-10-06T03:06:21.637057+0000","last_became_active":"2023-10-06T03:06:21.631618+0000","last_became_peered":"2023-10-06T03:06:21.631618+0000","last_unstale":"2023-10-06T03:06:21.637057+0000","last_undegraded":"2023-10-06T03:06:21.637057+0000","last_fullsized":"2023-10-06T03:06:21.637057+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:12.454052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.632587+0000","last_change":"2023-10-06T03:06:20.632587+0000","last_active":"2023-10-06T03:06:20.632587+0000","last_peered":"2023-10-06T03:06:20.632587+0000","last_clean":"2023-10-06T03:06:20.632587+0000","last_became_active":"2023-10-06T03:06:20.632127+0000","last_became_peered":"2023-10-06T03:06:20.632127+0000","last_unstale":"2023-10-06T03:06:20.632587+0000","last_undegraded":"2023-10-06T03:06:20.632587+0000","last_fullsized":"2023-10-06T03:06:20.632587+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:00.533803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.634705+0000","last_change":"2023-10-06T03:06:21.624727+0000","last_active":"2023-10-06T03:06:21.634705+0000","last_peered":"2023-10-06T03:06:21.634705+0000","last_clean":"2023-10-06T03:06:21.634705+0000","last_became_active":"2023-10-06T03:06:21.624412+0000","last_became_peered":"2023-10-06T03:06:21.624412+0000","last_unstale":"2023-10-06T03:06:21.634705+0000","last_undegraded":"2023-10-06T03:06:21.634705+0000","last_fullsized":"2023-10-06T03:06:21.634705+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:25.318899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"56'6","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.642652+0000","last_change":"2023-10-06T03:06:20.627919+0000","last_active":"2023-10-06T03:06:21.642652+0000","last_peered":"2023-10-06T03:06:21.642652+0000","last_clean":"2023-10-06T03:06:21.642652+0000","last_became_active":"2023-10-06T03:06:20.627646+0000","last_became_peered":"2023-10-06T03:06:20.627646+0000","last_unstale":"2023-10-06T03:06:21.642652+0000","last_undegraded":"2023-10-06T03:06:21.642652+0000","last_fullsized":"2023-10-06T03:06:21.642652+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:45.641976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639362+0000","last_change":"2023-10-06T03:06:21.634621+0000","last_active":"2023-10-06T03:06:21.639362+0000","last_peered":"2023-10-06T03:06:21.639362+0000","last_clean":"2023-10-06T03:06:21.639362+0000","last_became_active":"2023-10-06T03:06:21.633392+0000","last_became_peered":"2023-10-06T03:06:21.633392+0000","last_unstale":"2023-10-06T03:06:21.639362+0000","last_undegraded":"2023-10-06T03:06:21.639362+0000","last_fullsized":"2023-10-06T03:06:21.639362+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:15.019288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.631058+0000","last_change":"2023-10-06T03:06:20.631058+0000","last_active":"2023-10-06T03:06:20.631058+0000","last_peered":"2023-10-06T03:06:20.631058+0000","last_clean":"2023-10-06T03:06:20.631058+0000","last_became_active":"2023-10-06T03:06:20.630645+0000","last_became_peered":"2023-10-06T03:06:20.630645+0000","last_unstale":"2023-10-06T03:06:20.631058+0000","last_undegraded":"2023-10-06T03:06:20.631058+0000","last_fullsized":"2023-10-06T03:06:20.631058+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:42:08.211673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636656+0000","last_change":"2023-10-06T03:06:21.631809+0000","last_active":"2023-10-06T03:06:21.636656+0000","last_peered":"2023-10-06T03:06:21.636656+0000","last_clean":"2023-10-06T03:06:21.636656+0000","last_became_active":"2023-10-06T03:06:21.631542+0000","last_became_peered":"2023-10-06T03:06:21.631542+0000","last_unstale":"2023-10-06T03:06:21.636656+0000","last_undegraded":"2023-10-06T03:06:21.636656+0000","last_fullsized":"2023-10-06T03:06:21.636656+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:08.911020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.615758+0000","last_change":"2023-10-06T03:06:20.624236+0000","last_active":"2023-10-06T03:06:21.615758+0000","last_peered":"2023-10-06T03:06:21.615758+0000","last_clean":"2023-10-06T03:06:21.615758+0000","last_became_active":"2023-10-06T03:06:20.623955+0000","last_became_peered":"2023-10-06T03:06:20.623955+0000","last_unstale":"2023-10-06T03:06:21.615758+0000","last_undegraded":"2023-10-06T03:06:21.615758+0000","last_fullsized":"2023-10-06T03:06:21.615758+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:31.418752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.637098+0000","last_change":"2023-10-06T03:06:21.631042+0000","last_active":"2023-10-06T03:06:21.637098+0000","last_peered":"2023-10-06T03:06:21.637098+0000","last_clean":"2023-10-06T03:06:21.637098+0000","last_became_active":"2023-10-06T03:06:21.629590+0000","last_became_peered":"2023-10-06T03:06:21.629590+0000","last_unstale":"2023-10-06T03:06:21.637098+0000","last_undegraded":"2023-10-06T03:06:21.637098+0000","last_fullsized":"2023-10-06T03:06:21.637098+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:03.625453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.629263+0000","last_change":"2023-10-06T03:06:20.629263+0000","last_active":"2023-10-06T03:06:20.629263+0000","last_peered":"2023-10-06T03:06:20.629263+0000","last_clean":"2023-10-06T03:06:20.629263+0000","last_became_active":"2023-10-06T03:06:20.626413+0000","last_became_peered":"2023-10-06T03:06:20.626413+0000","last_unstale":"2023-10-06T03:06:20.629263+0000","last_undegraded":"2023-10-06T03:06:20.629263+0000","last_fullsized":"2023-10-06T03:06:20.629263+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:48.412683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.632011+0000","last_change":"2023-10-06T03:06:21.629980+0000","last_active":"2023-10-06T03:06:21.632011+0000","last_peered":"2023-10-06T03:06:21.632011+0000","last_clean":"2023-10-06T03:06:21.632011+0000","last_became_active":"2023-10-06T03:06:21.629731+0000","last_became_peered":"2023-10-06T03:06:21.629731+0000","last_unstale":"2023-10-06T03:06:21.632011+0000","last_undegraded":"2023-10-06T03:06:21.632011+0000","last_fullsized":"2023-10-06T03:06:21.632011+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:42:09.216525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"56'8","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.641321+0000","last_change":"2023-10-06T03:06:20.623501+0000","last_active":"2023-10-06T03:06:21.641321+0000","last_peered":"2023-10-06T03:06:21.641321+0000","last_clean":"2023-10-06T03:06:21.641321+0000","last_became_active":"2023-10-06T03:06:20.623234+0000","last_became_peered":"2023-10-06T03:06:20.623234+0000","last_unstale":"2023-10-06T03:06:21.641321+0000","last_undegraded":"2023-10-06T03:06:21.641321+0000","last_fullsized":"2023-10-06T03:06:21.641321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:11.535511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.615047+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:40.381565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"56'2","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.641335+0000","last_change":"2023-10-06T03:06:20.630321+0000","last_active":"2023-10-06T03:06:21.641335+0000","last_peered":"2023-10-06T03:06:21.641335+0000","last_clean":"2023-10-06T03:06:21.641335+0000","last_became_active":"2023-10-06T03:06:20.630063+0000","last_became_peered":"2023-10-06T03:06:20.630063+0000","last_unstale":"2023-10-06T03:06:21.641335+0000","last_undegraded":"2023-10-06T03:06:21.641335+0000","last_fullsized":"2023-10-06T03:06:21.641335+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:05.937982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.643971+0000","last_change":"2023-10-06T03:06:21.638984+0000","last_active":"2023-10-06T03:06:21.643971+0000","last_peered":"2023-10-06T03:06:21.643971+0000","last_clean":"2023-10-06T03:06:21.643971+0000","last_became_active":"2023-10-06T03:06:21.638719+0000","last_became_peered":"2023-10-06T03:06:21.638719+0000","last_unstale":"2023-10-06T03:06:21.643971+0000","last_undegraded":"2023-10-06T03:06:21.643971+0000","last_fullsized":"2023-10-06T03:06:21.643971+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:32.641605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"57'1","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T03:06:24.076306+0000","last_change":"2023-10-06T03:06:20.622624+0000","last_active":"2023-10-06T03:06:24.076306+0000","last_peered":"2023-10-06T03:06:24.076306+0000","last_clean":"2023-10-06T03:06:24.076306+0000","last_became_active":"2023-10-06T03:06:20.622334+0000","last_became_peered":"2023-10-06T03:06:20.622334+0000","last_unstale":"2023-10-06T03:06:24.076306+0000","last_undegraded":"2023-10-06T03:06:24.076306+0000","last_fullsized":"2023-10-06T03:06:24.076306+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:03.476888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639263+0000","last_change":"2023-10-06T03:06:21.636220+0000","last_active":"2023-10-06T03:06:21.639263+0000","last_peered":"2023-10-06T03:06:21.639263+0000","last_clean":"2023-10-06T03:06:21.639263+0000","last_became_active":"2023-10-06T03:06:21.635976+0000","last_became_peered":"2023-10-06T03:06:21.635976+0000","last_unstale":"2023-10-06T03:06:21.639263+0000","last_undegraded":"2023-10-06T03:06:21.639263+0000","last_fullsized":"2023-10-06T03:06:21.639263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.103354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.629164+0000","last_change":"2023-10-06T03:06:20.629164+0000","last_active":"2023-10-06T03:06:20.629164+0000","last_peered":"2023-10-06T03:06:20.629164+0000","last_clean":"2023-10-06T03:06:20.629164+0000","last_became_active":"2023-10-06T03:06:20.628699+0000","last_became_peered":"2023-10-06T03:06:20.628699+0000","last_unstale":"2023-10-06T03:06:20.629164+0000","last_undegraded":"2023-10-06T03:06:20.629164+0000","last_fullsized":"2023-10-06T03:06:20.629164+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:31.418752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639709+0000","last_change":"2023-10-06T03:06:21.633840+0000","last_active":"2023-10-06T03:06:21.639709+0000","last_peered":"2023-10-06T03:06:21.639709+0000","last_clean":"2023-10-06T03:06:21.639709+0000","last_became_active":"2023-10-06T03:06:21.633420+0000","last_became_peered":"2023-10-06T03:06:21.633420+0000","last_unstale":"2023-10-06T03:06:21.639709+0000","last_undegraded":"2023-10-06T03:06:21.639709+0000","last_fullsized":"2023-10-06T03:06:21.639709+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:13.651697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.614763+0000","last_change":"2023-10-06T03:06:20.624698+0000","last_active":"2023-10-06T03:06:21.614763+0000","last_peered":"2023-10-06T03:06:21.614763+0000","last_clean":"2023-10-06T03:06:21.614763+0000","last_became_active":"2023-10-06T03:06:20.624434+0000","last_became_peered":"2023-10-06T03:06:20.624434+0000","last_unstale":"2023-10-06T03:06:21.614763+0000","last_undegraded":"2023-10-06T03:06:21.614763+0000","last_fullsized":"2023-10-06T03:06:21.614763+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:58.374860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639768+0000","last_change":"2023-10-06T03:06:21.634923+0000","last_active":"2023-10-06T03:06:21.639768+0000","last_peered":"2023-10-06T03:06:21.639768+0000","last_clean":"2023-10-06T03:06:21.639768+0000","last_became_active":"2023-10-06T03:06:21.634108+0000","last_became_peered":"2023-10-06T03:06:21.634108+0000","last_unstale":"2023-10-06T03:06:21.639768+0000","last_undegraded":"2023-10-06T03:06:21.639768+0000","last_fullsized":"2023-10-06T03:06:21.639768+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:30.851317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.630511+0000","last_change":"2023-10-06T03:06:20.630511+0000","last_active":"2023-10-06T03:06:20.630511+0000","last_peered":"2023-10-06T03:06:20.630511+0000","last_clean":"2023-10-06T03:06:20.630511+0000","last_became_active":"2023-10-06T03:06:20.629748+0000","last_became_peered":"2023-10-06T03:06:20.629748+0000","last_unstale":"2023-10-06T03:06:20.630511+0000","last_undegraded":"2023-10-06T03:06:20.630511+0000","last_fullsized":"2023-10-06T03:06:20.630511+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:41.887149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635739+0000","last_change":"2023-10-06T03:06:21.628438+0000","last_active":"2023-10-06T03:06:21.635739+0000","last_peered":"2023-10-06T03:06:21.635739+0000","last_clean":"2023-10-06T03:06:21.635739+0000","last_became_active":"2023-10-06T03:06:21.628168+0000","last_became_peered":"2023-10-06T03:06:21.628168+0000","last_unstale":"2023-10-06T03:06:21.635739+0000","last_undegraded":"2023-10-06T03:06:21.635739+0000","last_fullsized":"2023-10-06T03:06:21.635739+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:03.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611503+0000","last_change":"2023-10-06T03:06:20.624481+0000","last_active":"2023-10-06T03:06:21.611503+0000","last_peered":"2023-10-06T03:06:21.611503+0000","last_clean":"2023-10-06T03:06:21.611503+0000","last_became_active":"2023-10-06T03:06:20.624019+0000","last_became_peered":"2023-10-06T03:06:20.624019+0000","last_unstale":"2023-10-06T03:06:21.611503+0000","last_undegraded":"2023-10-06T03:06:21.611503+0000","last_fullsized":"2023-10-06T03:06:21.611503+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:15.597423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.631670+0000","last_change":"2023-10-06T03:06:21.627275+0000","last_active":"2023-10-06T03:06:21.631670+0000","last_peered":"2023-10-06T03:06:21.631670+0000","last_clean":"2023-10-06T03:06:21.631670+0000","last_became_active":"2023-10-06T03:06:21.627010+0000","last_became_peered":"2023-10-06T03:06:21.627010+0000","last_unstale":"2023-10-06T03:06:21.631670+0000","last_undegraded":"2023-10-06T03:06:21.631670+0000","last_fullsized":"2023-10-06T03:06:21.631670+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:36.552543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611457+0000","last_change":"2023-10-06T03:06:20.619461+0000","last_active":"2023-10-06T03:06:21.611457+0000","last_peered":"2023-10-06T03:06:21.611457+0000","last_clean":"2023-10-06T03:06:21.611457+0000","last_became_active":"2023-10-06T03:06:20.619221+0000","last_became_peered":"2023-10-06T03:06:20.619221+0000","last_unstale":"2023-10-06T03:06:21.611457+0000","last_undegraded":"2023-10-06T03:06:21.611457+0000","last_fullsized":"2023-10-06T03:06:21.611457+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:10.593523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636177+0000","last_change":"2023-10-06T03:06:21.634948+0000","last_active":"2023-10-06T03:06:21.636177+0000","last_peered":"2023-10-06T03:06:21.636177+0000","last_clean":"2023-10-06T03:06:21.636177+0000","last_became_active":"2023-10-06T03:06:21.634723+0000","last_became_peered":"2023-10-06T03:06:21.634723+0000","last_unstale":"2023-10-06T03:06:21.636177+0000","last_undegraded":"2023-10-06T03:06:21.636177+0000","last_fullsized":"2023-10-06T03:06:21.636177+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:12.923051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.613890+0000","last_change":"2023-10-06T03:06:20.627212+0000","last_active":"2023-10-06T03:06:21.613890+0000","last_peered":"2023-10-06T03:06:21.613890+0000","last_clean":"2023-10-06T03:06:21.613890+0000","last_became_active":"2023-10-06T03:06:20.625418+0000","last_became_peered":"2023-10-06T03:06:20.625418+0000","last_unstale":"2023-10-06T03:06:21.613890+0000","last_undegraded":"2023-10-06T03:06:21.613890+0000","last_fullsized":"2023-10-06T03:06:21.613890+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:58.560109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.616523+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:06.396629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.632136+0000","last_change":"2023-10-06T03:06:20.624883+0000","last_active":"2023-10-06T03:06:21.632136+0000","last_peered":"2023-10-06T03:06:21.632136+0000","last_clean":"2023-10-06T03:06:21.632136+0000","last_became_active":"2023-10-06T03:06:20.624619+0000","last_became_peered":"2023-10-06T03:06:20.624619+0000","last_unstale":"2023-10-06T03:06:21.632136+0000","last_undegraded":"2023-10-06T03:06:21.632136+0000","last_fullsized":"2023-10-06T03:06:21.632136+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:11.535511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.614836+0000","last_change":"2023-10-06T03:04:23.986472+0000","last_active":"2023-10-06T03:06:21.614836+0000","last_peered":"2023-10-06T03:06:21.614836+0000","last_clean":"2023-10-06T03:06:21.614836+0000","last_became_active":"2023-10-06T03:04:23.986228+0000","last_became_peered":"2023-10-06T03:04:23.986228+0000","last_unstale":"2023-10-06T03:06:21.614836+0000","last_undegraded":"2023-10-06T03:06:21.614836+0000","last_fullsized":"2023-10-06T03:06:21.614836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:08.739849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639982+0000","last_change":"2023-10-06T03:06:21.638861+0000","last_active":"2023-10-06T03:06:21.639982+0000","last_peered":"2023-10-06T03:06:21.639982+0000","last_clean":"2023-10-06T03:06:21.639982+0000","last_became_active":"2023-10-06T03:06:21.638563+0000","last_became_peered":"2023-10-06T03:06:21.638563+0000","last_unstale":"2023-10-06T03:06:21.639982+0000","last_undegraded":"2023-10-06T03:06:21.639982+0000","last_fullsized":"2023-10-06T03:06:21.639982+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:47.426610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.630137+0000","last_change":"2023-10-06T03:06:20.630137+0000","last_active":"2023-10-06T03:06:20.630137+0000","last_peered":"2023-10-06T03:06:20.630137+0000","last_clean":"2023-10-06T03:06:20.630137+0000","last_became_active":"2023-10-06T03:06:20.629832+0000","last_became_peered":"2023-10-06T03:06:20.629832+0000","last_unstale":"2023-10-06T03:06:20.630137+0000","last_undegraded":"2023-10-06T03:06:20.630137+0000","last_fullsized":"2023-10-06T03:06:20.630137+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:11.535511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.616107+0000","last_change":"2023-10-06T03:04:23.814917+0000","last_active":"2023-10-06T03:06:21.616107+0000","last_peered":"2023-10-06T03:06:21.616107+0000","last_clean":"2023-10-06T03:06:21.616107+0000","last_became_active":"2023-10-06T03:04:23.814601+0000","last_became_peered":"2023-10-06T03:04:23.814601+0000","last_unstale":"2023-10-06T03:06:21.616107+0000","last_undegraded":"2023-10-06T03:06:21.616107+0000","last_fullsized":"2023-10-06T03:06:21.616107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635294+0000","last_change":"2023-10-06T03:06:21.628936+0000","last_active":"2023-10-06T03:06:21.635294+0000","last_peered":"2023-10-06T03:06:21.635294+0000","last_clean":"2023-10-06T03:06:21.635294+0000","last_became_active":"2023-10-06T03:06:21.628695+0000","last_became_peered":"2023-10-06T03:06:21.628695+0000","last_unstale":"2023-10-06T03:06:21.635294+0000","last_undegraded":"2023-10-06T03:06:21.635294+0000","last_fullsized":"2023-10-06T03:06:21.635294+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:27.973305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.615945+0000","last_change":"2023-10-06T03:06:20.624082+0000","last_active":"2023-10-06T03:06:21.615945+0000","last_peered":"2023-10-06T03:06:21.615945+0000","last_clean":"2023-10-06T03:06:21.615945+0000","last_became_active":"2023-10-06T03:06:20.623824+0000","last_became_peered":"2023-10-06T03:06:20.623824+0000","last_unstale":"2023-10-06T03:06:21.615945+0000","last_undegraded":"2023-10-06T03:06:21.615945+0000","last_fullsized":"2023-10-06T03:06:21.615945+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:08.037702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.627857+0000","last_change":"2023-10-06T03:04:24.314547+0000","last_active":"2023-10-06T03:06:21.627857+0000","last_peered":"2023-10-06T03:06:21.627857+0000","last_clean":"2023-10-06T03:06:21.627857+0000","last_became_active":"2023-10-06T03:04:24.314278+0000","last_became_peered":"2023-10-06T03:04:24.314278+0000","last_unstale":"2023-10-06T03:06:21.627857+0000","last_undegraded":"2023-10-06T03:06:21.627857+0000","last_fullsized":"2023-10-06T03:06:21.627857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:25.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639798+0000","last_change":"2023-10-06T03:06:21.636813+0000","last_active":"2023-10-06T03:06:21.639798+0000","last_peered":"2023-10-06T03:06:21.639798+0000","last_clean":"2023-10-06T03:06:21.639798+0000","last_became_active":"2023-10-06T03:06:21.634134+0000","last_became_peered":"2023-10-06T03:06:21.634134+0000","last_unstale":"2023-10-06T03:06:21.639798+0000","last_undegraded":"2023-10-06T03:06:21.639798+0000","last_fullsized":"2023-10-06T03:06:21.639798+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:36.552543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611097+0000","last_change":"2023-10-06T03:06:20.627128+0000","last_active":"2023-10-06T03:06:21.611097+0000","last_peered":"2023-10-06T03:06:21.611097+0000","last_clean":"2023-10-06T03:06:21.611097+0000","last_became_active":"2023-10-06T03:06:20.626867+0000","last_became_peered":"2023-10-06T03:06:20.626867+0000","last_unstale":"2023-10-06T03:06:21.611097+0000","last_undegraded":"2023-10-06T03:06:21.611097+0000","last_fullsized":"2023-10-06T03:06:21.611097+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:34.227774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.616072+0000","last_change":"2023-10-06T03:04:23.807972+0000","last_active":"2023-10-06T03:06:21.616072+0000","last_peered":"2023-10-06T03:06:21.616072+0000","last_clean":"2023-10-06T03:06:21.616072+0000","last_became_active":"2023-10-06T03:04:23.807723+0000","last_became_peered":"2023-10-06T03:04:23.807723+0000","last_unstale":"2023-10-06T03:06:21.616072+0000","last_undegraded":"2023-10-06T03:06:21.616072+0000","last_fullsized":"2023-10-06T03:06:21.616072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":193,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:06:19.607658+0000","last_change":"2023-10-06T03:04:17.779925+0000","last_active":"2023-10-06T03:06:19.607658+0000","last_peered":"2023-10-06T03:06:19.607658+0000","last_clean":"2023-10-06T03:06:19.607658+0000","last_became_active":"2023-10-06T03:04:17.778997+0000","last_became_peered":"2023-10-06T03:04:17.778997+0000","last_unstale":"2023-10-06T03:06:19.607658+0000","last_undegraded":"2023-10-06T03:06:19.607658+0000","last_fullsized":"2023-10-06T03:06:19.607658+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_clean_scrub_stamp":"2023-10-06T03:04:16.761610+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T03:06:20.600920+0000","last_change":"2023-10-06T03:06:20.615550+0000","last_active":"2023-10-06T03:06:20.600920+0000","last_peered":"2023-10-06T03:06:20.600920+0000","last_clean":"2023-10-06T03:06:20.600920+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T03:06:20.600920+0000","last_undegraded":"2023-10-06T03:06:20.600920+0000","last_fullsized":"2023-10-06T03:06:20.600920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:16.602275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.623551+0000","last_change":"2023-10-06T03:06:20.623551+0000","last_active":"2023-10-06T03:06:20.623551+0000","last_peered":"2023-10-06T03:06:20.623551+0000","last_clean":"2023-10-06T03:06:20.623551+0000","last_became_active":"2023-10-06T03:06:20.623215+0000","last_became_peered":"2023-10-06T03:06:20.623215+0000","last_unstale":"2023-10-06T03:06:20.623551+0000","last_undegraded":"2023-10-06T03:06:20.623551+0000","last_fullsized":"2023-10-06T03:06:20.623551+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:03.476888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:06:19.607750+0000","last_change":"2023-10-06T03:04:23.814887+0000","last_active":"2023-10-06T03:06:19.607750+0000","last_peered":"2023-10-06T03:06:19.607750+0000","last_clean":"2023-10-06T03:06:19.607750+0000","last_became_active":"2023-10-06T03:04:23.814581+0000","last_became_peered":"2023-10-06T03:04:23.814581+0000","last_unstale":"2023-10-06T03:06:19.607750+0000","last_undegraded":"2023-10-06T03:06:19.607750+0000","last_fullsized":"2023-10-06T03:06:19.607750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639813+0000","last_change":"2023-10-06T03:06:21.637853+0000","last_active":"2023-10-06T03:06:21.639813+0000","last_peered":"2023-10-06T03:06:21.639813+0000","last_clean":"2023-10-06T03:06:21.639813+0000","last_became_active":"2023-10-06T03:06:21.637605+0000","last_became_peered":"2023-10-06T03:06:21.637605+0000","last_unstale":"2023-10-06T03:06:21.639813+0000","last_undegraded":"2023-10-06T03:06:21.639813+0000","last_fullsized":"2023-10-06T03:06:21.639813+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:44.331596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.630071+0000","last_change":"2023-10-06T03:06:20.630071+0000","last_active":"2023-10-06T03:06:20.630071+0000","last_peered":"2023-10-06T03:06:20.630071+0000","last_clean":"2023-10-06T03:06:20.630071+0000","last_became_active":"2023-10-06T03:06:20.629809+0000","last_became_peered":"2023-10-06T03:06:20.629809+0000","last_unstale":"2023-10-06T03:06:20.630071+0000","last_undegraded":"2023-10-06T03:06:20.630071+0000","last_fullsized":"2023-10-06T03:06:20.630071+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:39.342768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":40,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-10-06T03:06:19.607821+0000","last_change":"2023-10-06T03:04:23.986771+0000","last_active":"2023-10-06T03:06:19.607821+0000","last_peered":"2023-10-06T03:06:19.607821+0000","last_clean":"2023-10-06T03:06:19.607821+0000","last_became_active":"2023-10-06T03:04:23.986552+0000","last_became_peered":"2023-10-06T03:04:23.986552+0000","last_unstale":"2023-10-06T03:06:19.607821+0000","last_undegraded":"2023-10-06T03:06:19.607821+0000","last_fullsized":"2023-10-06T03:06:19.607821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636241+0000","last_change":"2023-10-06T03:06:21.625510+0000","last_active":"2023-10-06T03:06:21.636241+0000","last_peered":"2023-10-06T03:06:21.636241+0000","last_clean":"2023-10-06T03:06:21.636241+0000","last_became_active":"2023-10-06T03:06:21.625257+0000","last_became_peered":"2023-10-06T03:06:21.625257+0000","last_unstale":"2023-10-06T03:06:21.636241+0000","last_undegraded":"2023-10-06T03:06:21.636241+0000","last_fullsized":"2023-10-06T03:06:21.636241+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:27.973305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":55,"state":"active+clean","last_fresh":"2023-10-06T03:06:20.632683+0000","last_change":"2023-10-06T03:06:20.632683+0000","last_active":"2023-10-06T03:06:20.632683+0000","last_peered":"2023-10-06T03:06:20.632683+0000","last_clean":"2023-10-06T03:06:20.632683+0000","last_became_active":"2023-10-06T03:06:20.632440+0000","last_became_peered":"2023-10-06T03:06:20.632440+0000","last_unstale":"2023-10-06T03:06:20.632683+0000","last_undegraded":"2023-10-06T03:06:20.632683+0000","last_fullsized":"2023-10-06T03:06:20.632683+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:14.207986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.614562+0000","last_change":"2023-10-06T03:04:23.813862+0000","last_active":"2023-10-06T03:06:21.614562+0000","last_peered":"2023-10-06T03:06:21.614562+0000","last_clean":"2023-10-06T03:06:21.614562+0000","last_became_active":"2023-10-06T03:04:23.813584+0000","last_became_peered":"2023-10-06T03:04:23.813584+0000","last_unstale":"2023-10-06T03:06:21.614562+0000","last_undegraded":"2023-10-06T03:06:21.614562+0000","last_fullsized":"2023-10-06T03:06:21.614562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639687+0000","last_change":"2023-10-06T03:06:21.633661+0000","last_active":"2023-10-06T03:06:21.639687+0000","last_peered":"2023-10-06T03:06:21.639687+0000","last_clean":"2023-10-06T03:06:21.639687+0000","last_became_active":"2023-10-06T03:06:21.633117+0000","last_became_peered":"2023-10-06T03:06:21.633117+0000","last_unstale":"2023-10-06T03:06:21.639687+0000","last_undegraded":"2023-10-06T03:06:21.639687+0000","last_fullsized":"2023-10-06T03:06:21.639687+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:21.616453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611948+0000","last_change":"2023-10-06T03:06:20.616127+0000","last_active":"2023-10-06T03:06:21.611948+0000","last_peered":"2023-10-06T03:06:21.611948+0000","last_clean":"2023-10-06T03:06:21.611948+0000","last_became_active":"2023-10-06T03:06:20.615836+0000","last_became_peered":"2023-10-06T03:06:20.615836+0000","last_unstale":"2023-10-06T03:06:21.611948+0000","last_undegraded":"2023-10-06T03:06:21.611948+0000","last_fullsized":"2023-10-06T03:06:21.611948+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:55.497431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.622611+0000","last_change":"2023-10-06T03:04:23.805874+0000","last_active":"2023-10-06T03:06:21.622611+0000","last_peered":"2023-10-06T03:06:21.622611+0000","last_clean":"2023-10-06T03:06:21.622611+0000","last_became_active":"2023-10-06T03:04:23.805551+0000","last_became_peered":"2023-10-06T03:04:23.805551+0000","last_unstale":"2023-10-06T03:06:21.622611+0000","last_undegraded":"2023-10-06T03:06:21.622611+0000","last_fullsized":"2023-10-06T03:06:21.622611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:21.250275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2112,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298512,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073328,"statfs":{"total":96636764160,"available":96331087872,"internally_reserved":0,"allocated":1253376,"data_stored":894130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.629,"15min":0.64300000000000002},"min":{"1min":0.318,"5min":0.314,"15min":0.314},"max":{"1min":0.69999999999999996,"5min":3.8860000000000001,"15min":3.8860000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.64900000000000002,"15min":0.66400000000000003},"min":{"1min":0.38700000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.69699999999999995,"5min":3.988,"15min":3.988},"last":0.51200000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.65200000000000002,"15min":0.67000000000000004},"min":{"1min":0.36199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.81899999999999995,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":0.498},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.64800000000000002,"15min":0.66400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73099999999999998,"5min":3.444,"15min":3.444},"last":0.625}]},{"osd":2,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.67000000000000004,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78800000000000003,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85599999999999998,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.68799999999999994,"15min":0.70599999999999996},"min":{"1min":0.45600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.73099999999999998,"5min":3.903,"15min":3.903},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.71499999999999997,"15min":0.73399999999999999},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.746,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":0.66800000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46800000000000003,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.55700000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.38800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65400000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.39400000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.64000000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.43099999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59899999999999998,"15min":0.60399999999999998},"min":{"1min":0.46600000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.71399999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79100000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297960,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073880,"statfs":{"total":96636764160,"available":96331653120,"internally_reserved":0,"allocated":688128,"data_stored":318193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.79700000000000004,"15min":0.84299999999999997},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77200000000000002,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.83699999999999997,"15min":0.89300000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.64600000000000002,"5min":6.8330000000000002,"15min":6.8330000000000002},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.71599999999999997,"15min":0.74399999999999999},"min":{"1min":0.34899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.72299999999999998,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.73899999999999999,"15min":0.76500000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":3.948,"15min":3.948},"last":0.626}]},{"osd":2,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.754,"15min":0.754},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.75800000000000001,"5min":3.996,"15min":3.996},"last":0.59999999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.71799999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.57399999999999995}]},{"osd":4,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.34399999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.36499999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55400000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.50600000000000001,"15min":0.499},"min":{"1min":0.40999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.443,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.46600000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297984,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073856,"statfs":{"total":96636764160,"available":96331628544,"internally_reserved":0,"allocated":712704,"data_stored":320431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.38700000000000001,"15min":0.39700000000000002},"min":{"1min":0.20999999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.50900000000000001,"5min":1.159,"15min":1.159},"last":0.31},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.375,"15min":0.379},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46999999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.26600000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.58999999999999997,"15min":0.63200000000000001},"min":{"1min":0.254,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.44500000000000001,"5min":6.056,"15min":6.056},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57499999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.44800000000000001,"15min":0.45500000000000002},"min":{"1min":0.27700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.502,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.443,"15min":0.45100000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.56000000000000005,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.32400000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.46800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.77800000000000002,"5min":1.244,"15min":1.244},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.495,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":1.216,"15min":1.216},"last":0.67200000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.628,"15min":0.624},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82899999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.627,"15min":0.627},"min":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.76800000000000002,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89200000000000002,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85699999999999998,"5min":1.014,"15min":1.014},"last":0.66600000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":1.099,"15min":1.099},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.79800000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298508,"kb_used_data":1220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073332,"statfs":{"total":96636764160,"available":96331091968,"internally_reserved":0,"allocated":1249280,"data_stored":893119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.437,"5min":0.437,"15min":0.437},"last":0.35799999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.39600000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.373}]},{"osd":4,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.503},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.57299999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:05:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.53800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297956,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073884,"statfs":{"total":96636764160,"available":96331657216,"internally_reserved":0,"allocated":684032,"data_stored":318159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.80100000000000005,"15min":0.88400000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.437,"5min":12.913,"15min":12.913},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.316,"5min":0.36799999999999999,"15min":0.377},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.49199999999999999,"5min":0.997,"15min":0.997},"last":0.30399999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.51200000000000001,"15min":0.53900000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53000000000000003,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54900000000000004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.33300000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.36199999999999999,"15min":0.36799999999999999},"min":{"1min":0.252,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46200000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.88,"15min":0.96399999999999997},"min":{"1min":0.29199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57299999999999995,"5min":12.941000000000001,"15min":12.941000000000001},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":1.042,"15min":1.1200000000000001},"min":{"1min":0.40600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.76900000000000002,"5min":12.846,"15min":12.846},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.62,"15min":0.622},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.75900000000000001,"5min":1.046,"15min":1.046},"last":0.52600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76900000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":1.0620000000000001,"15min":1.141},"min":{"1min":0.47999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72799999999999998,"5min":12.884,"15min":12.884},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77100000000000002,"5min":1.071,"15min":1.071},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.62,"15min":0.622},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.73199999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.72999999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.504},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77000000000000002,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297956,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073884,"statfs":{"total":96636764160,"available":96331657216,"internally_reserved":0,"allocated":684032,"data_stored":318159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.373,"15min":0.38400000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55000000000000004,"5min":1.361,"15min":1.361},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.311,"5min":0.34899999999999998,"15min":0.35499999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.51200000000000001,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.32800000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.376,"15min":0.38300000000000001},"min":{"1min":0.20699999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53400000000000003,"5min":1.133,"15min":1.133},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.27800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66100000000000003,"5min":1.45,"15min":1.45},"last":0.312}]},{"osd":2,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57399999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.433,"15min":0.443},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59499999999999997,"5min":1.476,"15min":1.476},"last":0.34499999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.38100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":1.649,"15min":1.649},"last":0.437},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80200000000000005,"5min":1.054,"15min":1.054},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77300000000000002,"5min":1.401,"15min":1.401},"last":0.501},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77800000000000002,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.47999999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78000000000000003,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.46200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83399999999999996,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.54900000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81999999999999995,"5min":1.679,"15min":1.679},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80300000000000005,"5min":1.083,"15min":1.083},"last":0.52400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":696320,"data_stored":319695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52000000000000002,"15min":0.51100000000000001},"min":{"1min":0.376,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.41099999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84999999999999998,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.39200000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82699999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80400000000000005,"5min":0.875,"15min":0.875},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.439},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.42699999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.69699999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.503},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90200000000000002,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.622}]},{"osd":5,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83899999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.33900000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297960,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073880,"statfs":{"total":96636764160,"available":96331653120,"internally_reserved":0,"allocated":688128,"data_stored":318181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68500000000000005,"5min":1.012,"15min":1.012},"last":0.621},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74399999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70599999999999996,"5min":1.03,"15min":1.03},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.71399999999999997,"5min":0.755,"15min":0.755},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55400000000000005,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.76800000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.495},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.71899999999999997,"5min":0.998,"15min":0.998},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.58299999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.69599999999999995,"5min":1.048,"15min":1.048},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72799999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.57599999999999996}]},{"osd":4,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.45900000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.40500000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.745,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61699999999999999,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.76200000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.34200000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69199999999999995,"5min":0.872,"15min":0.872},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:06:28.814 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:06:28.817 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:06:30.211 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:06:30.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.346+0000 7f0cf80a3700 1 Processor -- start 2023-10-06T03:06:30.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.346+0000 7f0cf80a3700 1 -- start start 2023-10-06T03:06:30.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.347+0000 7f0cf80a3700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0cf015a320 0x7f0cf013fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:30.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.347+0000 7f0cf80a3700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf00c74c0 con 0x7f0cf006bd10 2023-10-06T03:06:30.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.347+0000 7f0cf80a3700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf00c7710 con 0x7f0cf013f6a0 2023-10-06T03:06:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.347+0000 7f0cf80a3700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf00c79f0 con 0x7f0cf015a320 2023-10-06T03:06:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.347+0000 7f0cf6640700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f0cf006bd10 0x7f0cf00cac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51600/0 (socket says 172.21.15.125:51600) 2023-10-06T03:06:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.347+0000 7f0cf6640700 1 -- 172.21.15.125:0/2233121660 learned_addr learned my addr 172.21.15.125:0/2233121660 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.347+0000 7f0cf563e700 1 --2- 172.21.15.125:0/2233121660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0cf015a320 0x7f0cf013fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.347+0000 7f0cf4e3d700 1 -- 172.21.15.125:0/2233121660 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2979404779 0 0) 0x7f0cf00c74c0 con 0x7f0cf006bd10 2023-10-06T03:06:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.347+0000 7f0cf4e3d700 1 -- 172.21.15.125:0/2233121660 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cdc003570 con 0x7f0cf006bd10 2023-10-06T03:06:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf4e3d700 1 -- 172.21.15.125:0/2233121660 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411473246 0 0) 0x7f0cf00c7710 con 0x7f0cf013f6a0 2023-10-06T03:06:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf4e3d700 1 -- 172.21.15.125:0/2233121660 --> v1:172.21.15.130:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cf00c74c0 con 0x7f0cf013f6a0 2023-10-06T03:06:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf4e3d700 1 -- 172.21.15.125:0/2233121660 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1073058784 0 0) 0x7f0cdc003570 con 0x7f0cf006bd10 2023-10-06T03:06:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf4e3d700 1 -- 172.21.15.125:0/2233121660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0cf015a320 msgr2=0x7f0cf013fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf4e3d700 1 --2- 172.21.15.125:0/2233121660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0cf015a320 0x7f0cf013fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:30.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf4e3d700 1 -- 172.21.15.125:0/2233121660 >> v1:172.21.15.130:6789/0 conn(0x7f0cf013f6a0 legacy=0x7f0cf0159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:30.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf4e3d700 1 -- 172.21.15.125:0/2233121660 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf00c9b40 con 0x7f0cf006bd10 2023-10-06T03:06:30.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf4e3d700 1 -- 172.21.15.125:0/2233121660 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f0ce80017f0 con 0x7f0cf006bd10 2023-10-06T03:06:30.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf4e3d700 1 -- 172.21.15.125:0/2233121660 >> v1:172.21.15.125:6789/0 conn(0x7f0cf006bd10 legacy=0x7f0cf00cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:30.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf4e3d700 1 --2- 172.21.15.125:0/2233121660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0cf015a320 0x7f0cdc003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:30.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf4e3d700 1 --2- 172.21.15.125:0/2233121660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cdc004180 0x7f0cdc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:30.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf4e3d700 1 --2- 172.21.15.125:0/2233121660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cdc004d50 0x7f0cdc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:30.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf4e3d700 1 -- 172.21.15.125:0/2233121660 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf00c79f0 con 0x7f0cdc004180 2023-10-06T03:06:30.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf4e3d700 1 -- 172.21.15.125:0/2233121660 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc00bba0 con 0x7f0cdc004d50 2023-10-06T03:06:30.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf4e3d700 1 -- 172.21.15.125:0/2233121660 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc00bd60 con 0x7f0cf015a320 2023-10-06T03:06:30.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf563e700 1 --2- 172.21.15.125:0/2233121660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cdc004180 0x7f0cdc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:30.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf5e3f700 1 --2- 172.21.15.125:0/2233121660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0cf015a320 0x7f0cdc003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:30.353 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf6640700 1 --2- 172.21.15.125:0/2233121660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cdc004d50 0x7f0cdc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:30.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf563e700 1 -- 172.21.15.125:0/2233121660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0cf015a320 msgr2=0x7f0cdc003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:30.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf563e700 1 --2- 172.21.15.125:0/2233121660 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0cf015a320 0x7f0cdc003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:30.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf563e700 1 -- 172.21.15.125:0/2233121660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cdc004d50 msgr2=0x7f0cdc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:30.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf563e700 1 --2- 172.21.15.125:0/2233121660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cdc004d50 0x7f0cdc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:30.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf563e700 1 -- 172.21.15.125:0/2233121660 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc003570 con 0x7f0cdc004180 2023-10-06T03:06:30.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf563e700 1 --2- 172.21.15.125:0/2233121660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cdc004180 0x7f0cdc004810 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009c00 tx=0x7f0ce00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ebbe2ce077c550 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:30.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf4e3d700 1 -- 172.21.15.125:0/2233121660 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce000e710 con 0x7f0cdc004180 2023-10-06T03:06:30.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf4e3d700 1 -- 172.21.15.125:0/2233121660 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce000e870 con 0x7f0cdc004180 2023-10-06T03:06:30.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.348+0000 7f0cf4e3d700 1 -- 172.21.15.125:0/2233121660 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce000ec30 con 0x7f0cdc004180 2023-10-06T03:06:30.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.349+0000 7f0cf80a3700 1 -- 172.21.15.125:0/2233121660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cdc004180 msgr2=0x7f0cdc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:30.354 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.349+0000 7f0cf80a3700 1 --2- 172.21.15.125:0/2233121660 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cdc004180 0x7f0cdc004810 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0009c00 tx=0x7f0ce00091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:30.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.349+0000 7f0cf6640700 1 -- 172.21.15.125:0/2233121660 reap_dead start 2023-10-06T03:06:30.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.349+0000 7f0cf80a3700 1 -- 172.21.15.125:0/2233121660 shutdown_connections 2023-10-06T03:06:30.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.349+0000 7f0cf80a3700 1 -- 172.21.15.125:0/2233121660 >> 172.21.15.125:0/2233121660 conn(0x7f0cf006b190 msgr2=0x7f0cf006b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:30.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.349+0000 7f0cf80a3700 1 -- 172.21.15.125:0/2233121660 shutdown_connections 2023-10-06T03:06:30.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.349+0000 7f0cf80a3700 1 -- 172.21.15.125:0/2233121660 wait complete. 2023-10-06T03:06:30.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.350+0000 7f0cf80a3700 1 Processor -- start 2023-10-06T03:06:30.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.350+0000 7f0cf80a3700 1 -- start start 2023-10-06T03:06:30.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.351+0000 7f0cf80a3700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cdc004180 0x7f0cf00ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:30.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.351+0000 7f0cf80a3700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0cf0159a80 0x7f0cf00c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:30.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.351+0000 7f0cf80a3700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cf00c5440 0x7f0cf00c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.351+0000 7f0cf80a3700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf0157a00 con 0x7f0cf00c5440 2023-10-06T03:06:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.351+0000 7f0cf80a3700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf01570f0 con 0x7f0cdc004180 2023-10-06T03:06:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.351+0000 7f0cf80a3700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf0159fa0 con 0x7f0cf0159a80 2023-10-06T03:06:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.351+0000 7f0cf6640700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cf00c5440 0x7f0cf00c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.351+0000 7f0cf6640700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cf00c5440 0x7f0cf00c58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44800/0 (socket says 172.21.15.125:44800) 2023-10-06T03:06:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.351+0000 7f0cf6640700 1 -- 172.21.15.125:0/3922449620 learned_addr learned my addr 172.21.15.125:0/3922449620 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.351+0000 7f0cf5e3f700 1 --2- 172.21.15.125:0/3922449620 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cdc004180 0x7f0cf00ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.351+0000 7f0cf563e700 1 --2- 172.21.15.125:0/3922449620 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0cf0159a80 0x7f0cf00c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:30.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.351+0000 7f0cf6640700 1 -- 172.21.15.125:0/3922449620 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0cf0159a80 msgr2=0x7f0cf00c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:30.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.351+0000 7f0cf6640700 1 --2- 172.21.15.125:0/3922449620 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0cf0159a80 0x7f0cf00c4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:30.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.351+0000 7f0cf6640700 1 -- 172.21.15.125:0/3922449620 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cdc004180 msgr2=0x7f0cf00ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:30.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.351+0000 7f0cf6640700 1 --2- 172.21.15.125:0/3922449620 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cdc004180 0x7f0cf00ae2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:30.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.351+0000 7f0cf6640700 1 -- 172.21.15.125:0/3922449620 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf0157340 con 0x7f0cf00c5440 2023-10-06T03:06:30.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.351+0000 7f0cf563e700 1 --2- 172.21.15.125:0/3922449620 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0cf0159a80 0x7f0cf00c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:30.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.352+0000 7f0cf6640700 1 --2- 172.21.15.125:0/3922449620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cf00c5440 0x7f0cf00c58e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0cf00c3dc0 tx=0x7f0ce8001370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:30.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.352+0000 7f0ce5ffb700 1 -- 172.21.15.125:0/3922449620 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce800ebc0 con 0x7f0cf00c5440 2023-10-06T03:06:30.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.352+0000 7f0ce5ffb700 1 -- 172.21.15.125:0/3922449620 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce800ed20 con 0x7f0cf00c5440 2023-10-06T03:06:30.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.352+0000 7f0cf80a3700 1 -- 172.21.15.125:0/3922449620 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf0157620 con 0x7f0cf00c5440 2023-10-06T03:06:30.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.352+0000 7f0ce5ffb700 1 -- 172.21.15.125:0/3922449620 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8013670 con 0x7f0cf00c5440 2023-10-06T03:06:30.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.352+0000 7f0cf80a3700 1 -- 172.21.15.125:0/3922449620 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf013d7d0 con 0x7f0cf00c5440 2023-10-06T03:06:30.359 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.353+0000 7f0cf80a3700 1 -- 172.21.15.125:0/3922449620 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf015aa60 con 0x7f0cf00c5440 2023-10-06T03:06:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.353+0000 7f0ce5ffb700 1 -- 172.21.15.125:0/3922449620 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ce80139e0 con 0x7f0cf00c5440 2023-10-06T03:06:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.354+0000 7f0ce5ffb700 1 --2- 172.21.15.125:0/3922449620 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0cd4066f30 0x7f0cd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.354+0000 7f0ce5ffb700 1 -- 172.21.15.125:0/3922449620 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0ce8084d90 con 0x7f0cf00c5440 2023-10-06T03:06:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.354+0000 7f0cf5e3f700 1 --2- 172.21.15.125:0/3922449620 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0cd4066f30 0x7f0cd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.354+0000 7f0cf5e3f700 1 --2- 172.21.15.125:0/3922449620 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0cd4066f30 0x7f0cd40693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0010e0 tx=0x7f0cec007d30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:30.360 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.358+0000 7f0ce5ffb700 1 -- 172.21.15.125:0/3922449620 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ce8051e20 con 0x7f0cf00c5440 2023-10-06T03:06:30.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.537+0000 7f0cf80a3700 1 -- 172.21.15.125:0/3922449620 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0cf0066510 con 0x7f0cd4066f30 2023-10-06T03:06:30.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.545+0000 7f0ce5ffb700 1 -- 172.21.15.125:0/3922449620 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310991 (secure 0 0 0) 0x7f0cf0066510 con 0x7f0cd4066f30 2023-10-06T03:06:30.550 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:30.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.548+0000 7f0cf80a3700 1 -- 172.21.15.125:0/3922449620 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0cd4066f30 msgr2=0x7f0cd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:30.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.548+0000 7f0cf80a3700 1 --2- 172.21.15.125:0/3922449620 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0cd4066f30 0x7f0cd40693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0010e0 tx=0x7f0cec007d30 comp rx=0 tx=0).stop 2023-10-06T03:06:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.548+0000 7f0cf80a3700 1 -- 172.21.15.125:0/3922449620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cf00c5440 msgr2=0x7f0cf00c58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.548+0000 7f0cf80a3700 1 --2- 172.21.15.125:0/3922449620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cf00c5440 0x7f0cf00c58e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f0cf00c3dc0 tx=0x7f0ce8001370 comp rx=0 tx=0).stop 2023-10-06T03:06:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.548+0000 7f0cf80a3700 1 -- 172.21.15.125:0/3922449620 shutdown_connections 2023-10-06T03:06:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.548+0000 7f0cf80a3700 1 --2- 172.21.15.125:0/3922449620 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0cd4066f30 0x7f0cd40693e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.548+0000 7f0cf80a3700 1 --2- 172.21.15.125:0/3922449620 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f0cf00c5440 0x7f0cf00c58e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.548+0000 7f0cf80a3700 1 --2- 172.21.15.125:0/3922449620 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0cdc004180 0x7f0cf00ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.548+0000 7f0cf80a3700 1 --2- 172.21.15.125:0/3922449620 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f0cf0159a80 0x7f0cf00c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.548+0000 7f0cf80a3700 1 -- 172.21.15.125:0/3922449620 >> 172.21.15.125:0/3922449620 conn(0x7f0cf006b190 msgr2=0x7f0cf00ccfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.548+0000 7f0cf80a3700 1 -- 172.21.15.125:0/3922449620 shutdown_connections 2023-10-06T03:06:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.548+0000 7f0cf80a3700 1 -- 172.21.15.125:0/3922449620 wait complete. 2023-10-06T03:06:30.553 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-06T03:06:30.561 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2023-10-06T03:06:29.832804+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":207,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384868,"kb_used_data":6564,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589852,"statfs":{"total":773094113280,"available":770652008448,"internally_reserved":0,"allocated":6721536,"data_stored":3729609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.223333"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633100+0000","last_change":"2023-10-06T03:06:21.621607+0000","last_active":"2023-10-06T03:06:21.633100+0000","last_peered":"2023-10-06T03:06:21.633100+0000","last_clean":"2023-10-06T03:06:21.633100+0000","last_became_active":"2023-10-06T03:06:21.621336+0000","last_became_peered":"2023-10-06T03:06:21.621336+0000","last_unstale":"2023-10-06T03:06:21.633100+0000","last_undegraded":"2023-10-06T03:06:21.633100+0000","last_fullsized":"2023-10-06T03:06:21.633100+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:03.625453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639899+0000","last_change":"2023-10-06T03:06:21.638143+0000","last_active":"2023-10-06T03:06:21.639899+0000","last_peered":"2023-10-06T03:06:21.639899+0000","last_clean":"2023-10-06T03:06:21.639899+0000","last_became_active":"2023-10-06T03:06:21.637865+0000","last_became_peered":"2023-10-06T03:06:21.637865+0000","last_unstale":"2023-10-06T03:06:21.639899+0000","last_undegraded":"2023-10-06T03:06:21.639899+0000","last_fullsized":"2023-10-06T03:06:21.639899+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:12.454052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.645205+0000","last_change":"2023-10-06T03:06:21.640909+0000","last_active":"2023-10-06T03:06:21.645205+0000","last_peered":"2023-10-06T03:06:21.645205+0000","last_clean":"2023-10-06T03:06:21.645205+0000","last_became_active":"2023-10-06T03:06:21.640725+0000","last_became_peered":"2023-10-06T03:06:21.640725+0000","last_unstale":"2023-10-06T03:06:21.645205+0000","last_undegraded":"2023-10-06T03:06:21.645205+0000","last_fullsized":"2023-10-06T03:06:21.645205+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:04:39.366032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639545+0000","last_change":"2023-10-06T03:06:21.632909+0000","last_active":"2023-10-06T03:06:21.639545+0000","last_peered":"2023-10-06T03:06:21.639545+0000","last_clean":"2023-10-06T03:06:21.639545+0000","last_became_active":"2023-10-06T03:06:21.632654+0000","last_became_peered":"2023-10-06T03:06:21.632654+0000","last_unstale":"2023-10-06T03:06:21.639545+0000","last_undegraded":"2023-10-06T03:06:21.639545+0000","last_fullsized":"2023-10-06T03:06:21.639545+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:34.401176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635047+0000","last_change":"2023-10-06T03:06:21.628138+0000","last_active":"2023-10-06T03:06:21.635047+0000","last_peered":"2023-10-06T03:06:21.635047+0000","last_clean":"2023-10-06T03:06:21.635047+0000","last_became_active":"2023-10-06T03:06:21.627839+0000","last_became_peered":"2023-10-06T03:06:21.627839+0000","last_unstale":"2023-10-06T03:06:21.635047+0000","last_undegraded":"2023-10-06T03:06:21.635047+0000","last_fullsized":"2023-10-06T03:06:21.635047+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:35.993689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.643340+0000","last_change":"2023-10-06T03:06:21.642303+0000","last_active":"2023-10-06T03:06:21.643340+0000","last_peered":"2023-10-06T03:06:21.643340+0000","last_clean":"2023-10-06T03:06:21.643340+0000","last_became_active":"2023-10-06T03:06:21.642001+0000","last_became_peered":"2023-10-06T03:06:21.642001+0000","last_unstale":"2023-10-06T03:06:21.643340+0000","last_undegraded":"2023-10-06T03:06:21.643340+0000","last_fullsized":"2023-10-06T03:06:21.643340+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:45.483003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.643908+0000","last_change":"2023-10-06T03:06:21.636657+0000","last_active":"2023-10-06T03:06:21.643908+0000","last_peered":"2023-10-06T03:06:21.643908+0000","last_clean":"2023-10-06T03:06:21.643908+0000","last_became_active":"2023-10-06T03:06:21.636400+0000","last_became_peered":"2023-10-06T03:06:21.636400+0000","last_unstale":"2023-10-06T03:06:21.643908+0000","last_undegraded":"2023-10-06T03:06:21.643908+0000","last_fullsized":"2023-10-06T03:06:21.643908+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:45.735702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.637344+0000","last_change":"2023-10-06T03:06:21.631743+0000","last_active":"2023-10-06T03:06:21.637344+0000","last_peered":"2023-10-06T03:06:21.637344+0000","last_clean":"2023-10-06T03:06:21.637344+0000","last_became_active":"2023-10-06T03:06:21.631464+0000","last_became_peered":"2023-10-06T03:06:21.631464+0000","last_unstale":"2023-10-06T03:06:21.637344+0000","last_undegraded":"2023-10-06T03:06:21.637344+0000","last_fullsized":"2023-10-06T03:06:21.637344+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:39.677516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.642470+0000","last_change":"2023-10-06T03:06:21.636212+0000","last_active":"2023-10-06T03:06:21.642470+0000","last_peered":"2023-10-06T03:06:21.642470+0000","last_clean":"2023-10-06T03:06:21.642470+0000","last_became_active":"2023-10-06T03:06:21.635932+0000","last_became_peered":"2023-10-06T03:06:21.635932+0000","last_unstale":"2023-10-06T03:06:21.642470+0000","last_undegraded":"2023-10-06T03:06:21.642470+0000","last_fullsized":"2023-10-06T03:06:21.642470+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:04.649172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.642501+0000","last_change":"2023-10-06T03:06:21.636140+0000","last_active":"2023-10-06T03:06:21.642501+0000","last_peered":"2023-10-06T03:06:21.642501+0000","last_clean":"2023-10-06T03:06:21.642501+0000","last_became_active":"2023-10-06T03:06:21.635876+0000","last_became_peered":"2023-10-06T03:06:21.635876+0000","last_unstale":"2023-10-06T03:06:21.642501+0000","last_undegraded":"2023-10-06T03:06:21.642501+0000","last_fullsized":"2023-10-06T03:06:21.642501+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:32.423604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635263+0000","last_change":"2023-10-06T03:06:21.624427+0000","last_active":"2023-10-06T03:06:21.635263+0000","last_peered":"2023-10-06T03:06:21.635263+0000","last_clean":"2023-10-06T03:06:21.635263+0000","last_became_active":"2023-10-06T03:06:21.624098+0000","last_became_peered":"2023-10-06T03:06:21.624098+0000","last_unstale":"2023-10-06T03:06:21.635263+0000","last_undegraded":"2023-10-06T03:06:21.635263+0000","last_fullsized":"2023-10-06T03:06:21.635263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:39.677516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.634789+0000","last_change":"2023-10-06T03:06:21.629593+0000","last_active":"2023-10-06T03:06:21.634789+0000","last_peered":"2023-10-06T03:06:21.634789+0000","last_clean":"2023-10-06T03:06:21.634789+0000","last_became_active":"2023-10-06T03:06:21.629297+0000","last_became_peered":"2023-10-06T03:06:21.629297+0000","last_unstale":"2023-10-06T03:06:21.634789+0000","last_undegraded":"2023-10-06T03:06:21.634789+0000","last_fullsized":"2023-10-06T03:06:21.634789+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:15.019288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633817+0000","last_change":"2023-10-06T03:06:21.625690+0000","last_active":"2023-10-06T03:06:21.633817+0000","last_peered":"2023-10-06T03:06:21.633817+0000","last_clean":"2023-10-06T03:06:21.633817+0000","last_became_active":"2023-10-06T03:06:21.625430+0000","last_became_peered":"2023-10-06T03:06:21.625430+0000","last_unstale":"2023-10-06T03:06:21.633817+0000","last_undegraded":"2023-10-06T03:06:21.633817+0000","last_fullsized":"2023-10-06T03:06:21.633817+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:25.318899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.642543+0000","last_change":"2023-10-06T03:06:21.638064+0000","last_active":"2023-10-06T03:06:21.642543+0000","last_peered":"2023-10-06T03:06:21.642543+0000","last_clean":"2023-10-06T03:06:21.642543+0000","last_became_active":"2023-10-06T03:06:21.637791+0000","last_became_peered":"2023-10-06T03:06:21.637791+0000","last_unstale":"2023-10-06T03:06:21.642543+0000","last_undegraded":"2023-10-06T03:06:21.642543+0000","last_fullsized":"2023-10-06T03:06:21.642543+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:11.598376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.645197+0000","last_change":"2023-10-06T03:06:21.640412+0000","last_active":"2023-10-06T03:06:21.645197+0000","last_peered":"2023-10-06T03:06:21.645197+0000","last_clean":"2023-10-06T03:06:21.645197+0000","last_became_active":"2023-10-06T03:06:21.640155+0000","last_became_peered":"2023-10-06T03:06:21.640155+0000","last_unstale":"2023-10-06T03:06:21.645197+0000","last_undegraded":"2023-10-06T03:06:21.645197+0000","last_fullsized":"2023-10-06T03:06:21.645197+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:12.540363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636378+0000","last_change":"2023-10-06T03:06:21.633328+0000","last_active":"2023-10-06T03:06:21.636378+0000","last_peered":"2023-10-06T03:06:21.636378+0000","last_clean":"2023-10-06T03:06:21.636378+0000","last_became_active":"2023-10-06T03:06:21.633115+0000","last_became_peered":"2023-10-06T03:06:21.633115+0000","last_unstale":"2023-10-06T03:06:21.636378+0000","last_undegraded":"2023-10-06T03:06:21.636378+0000","last_fullsized":"2023-10-06T03:06:21.636378+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:46.396243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633176+0000","last_change":"2023-10-06T03:06:21.630252+0000","last_active":"2023-10-06T03:06:21.633176+0000","last_peered":"2023-10-06T03:06:21.633176+0000","last_clean":"2023-10-06T03:06:21.633176+0000","last_became_active":"2023-10-06T03:06:21.629902+0000","last_became_peered":"2023-10-06T03:06:21.629902+0000","last_unstale":"2023-10-06T03:06:21.633176+0000","last_undegraded":"2023-10-06T03:06:21.633176+0000","last_fullsized":"2023-10-06T03:06:21.633176+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:49.417536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639251+0000","last_change":"2023-10-06T03:06:21.635767+0000","last_active":"2023-10-06T03:06:21.639251+0000","last_peered":"2023-10-06T03:06:21.639251+0000","last_clean":"2023-10-06T03:06:21.639251+0000","last_became_active":"2023-10-06T03:06:21.635155+0000","last_became_peered":"2023-10-06T03:06:21.635155+0000","last_unstale":"2023-10-06T03:06:21.639251+0000","last_undegraded":"2023-10-06T03:06:21.639251+0000","last_fullsized":"2023-10-06T03:06:21.639251+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:07.774084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636920+0000","last_change":"2023-10-06T03:06:21.630222+0000","last_active":"2023-10-06T03:06:21.636920+0000","last_peered":"2023-10-06T03:06:21.636920+0000","last_clean":"2023-10-06T03:06:21.636920+0000","last_became_active":"2023-10-06T03:06:21.629971+0000","last_became_peered":"2023-10-06T03:06:21.629971+0000","last_unstale":"2023-10-06T03:06:21.636920+0000","last_undegraded":"2023-10-06T03:06:21.636920+0000","last_fullsized":"2023-10-06T03:06:21.636920+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:49.386862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.631033+0000","last_change":"2023-10-06T03:06:21.625167+0000","last_active":"2023-10-06T03:06:21.631033+0000","last_peered":"2023-10-06T03:06:21.631033+0000","last_clean":"2023-10-06T03:06:21.631033+0000","last_became_active":"2023-10-06T03:06:21.624919+0000","last_became_peered":"2023-10-06T03:06:21.624919+0000","last_unstale":"2023-10-06T03:06:21.631033+0000","last_undegraded":"2023-10-06T03:06:21.631033+0000","last_fullsized":"2023-10-06T03:06:21.631033+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:34.401176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.621313+0000","last_change":"2023-10-06T03:06:21.620048+0000","last_active":"2023-10-06T03:06:21.621313+0000","last_peered":"2023-10-06T03:06:21.621313+0000","last_clean":"2023-10-06T03:06:21.621313+0000","last_became_active":"2023-10-06T03:06:21.619777+0000","last_became_peered":"2023-10-06T03:06:21.619777+0000","last_unstale":"2023-10-06T03:06:21.621313+0000","last_undegraded":"2023-10-06T03:06:21.621313+0000","last_fullsized":"2023-10-06T03:06:21.621313+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:19.930817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.631585+0000","last_change":"2023-10-06T03:06:21.627387+0000","last_active":"2023-10-06T03:06:21.631585+0000","last_peered":"2023-10-06T03:06:21.631585+0000","last_clean":"2023-10-06T03:06:21.631585+0000","last_became_active":"2023-10-06T03:06:21.627106+0000","last_became_peered":"2023-10-06T03:06:21.627106+0000","last_unstale":"2023-10-06T03:06:21.631585+0000","last_undegraded":"2023-10-06T03:06:21.631585+0000","last_fullsized":"2023-10-06T03:06:21.631585+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:03.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.630922+0000","last_change":"2023-10-06T03:06:21.626786+0000","last_active":"2023-10-06T03:06:21.630922+0000","last_peered":"2023-10-06T03:06:21.630922+0000","last_clean":"2023-10-06T03:06:21.630922+0000","last_became_active":"2023-10-06T03:06:21.626533+0000","last_became_peered":"2023-10-06T03:06:21.626533+0000","last_unstale":"2023-10-06T03:06:21.630922+0000","last_undegraded":"2023-10-06T03:06:21.630922+0000","last_fullsized":"2023-10-06T03:06:21.630922+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:08:39.677516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.645168+0000","last_change":"2023-10-06T03:06:21.640416+0000","last_active":"2023-10-06T03:06:21.645168+0000","last_peered":"2023-10-06T03:06:21.645168+0000","last_clean":"2023-10-06T03:06:21.645168+0000","last_became_active":"2023-10-06T03:06:21.640167+0000","last_became_peered":"2023-10-06T03:06:21.640167+0000","last_unstale":"2023-10-06T03:06:21.645168+0000","last_undegraded":"2023-10-06T03:06:21.645168+0000","last_fullsized":"2023-10-06T03:06:21.645168+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:47.867720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639361+0000","last_change":"2023-10-06T03:06:21.632296+0000","last_active":"2023-10-06T03:06:21.639361+0000","last_peered":"2023-10-06T03:06:21.639361+0000","last_clean":"2023-10-06T03:06:21.639361+0000","last_became_active":"2023-10-06T03:06:21.631870+0000","last_became_peered":"2023-10-06T03:06:21.631870+0000","last_unstale":"2023-10-06T03:06:21.639361+0000","last_undegraded":"2023-10-06T03:06:21.639361+0000","last_fullsized":"2023-10-06T03:06:21.639361+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:45.483003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.637111+0000","last_change":"2023-10-06T03:06:21.632692+0000","last_active":"2023-10-06T03:06:21.637111+0000","last_peered":"2023-10-06T03:06:21.637111+0000","last_clean":"2023-10-06T03:06:21.637111+0000","last_became_active":"2023-10-06T03:06:21.632437+0000","last_became_peered":"2023-10-06T03:06:21.632437+0000","last_unstale":"2023-10-06T03:06:21.637111+0000","last_undegraded":"2023-10-06T03:06:21.637111+0000","last_fullsized":"2023-10-06T03:06:21.637111+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:07.774084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635412+0000","last_change":"2023-10-06T03:06:21.629002+0000","last_active":"2023-10-06T03:06:21.635412+0000","last_peered":"2023-10-06T03:06:21.635412+0000","last_clean":"2023-10-06T03:06:21.635412+0000","last_became_active":"2023-10-06T03:06:21.628770+0000","last_became_peered":"2023-10-06T03:06:21.628770+0000","last_unstale":"2023-10-06T03:06:21.635412+0000","last_undegraded":"2023-10-06T03:06:21.635412+0000","last_fullsized":"2023-10-06T03:06:21.635412+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.103354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633020+0000","last_change":"2023-10-06T03:06:21.627263+0000","last_active":"2023-10-06T03:06:21.633020+0000","last_peered":"2023-10-06T03:06:21.633020+0000","last_clean":"2023-10-06T03:06:21.633020+0000","last_became_active":"2023-10-06T03:06:21.626762+0000","last_became_peered":"2023-10-06T03:06:21.626762+0000","last_unstale":"2023-10-06T03:06:21.633020+0000","last_undegraded":"2023-10-06T03:06:21.633020+0000","last_fullsized":"2023-10-06T03:06:21.633020+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:39.231251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.642551+0000","last_change":"2023-10-06T03:06:21.636629+0000","last_active":"2023-10-06T03:06:21.642551+0000","last_peered":"2023-10-06T03:06:21.642551+0000","last_clean":"2023-10-06T03:06:21.642551+0000","last_became_active":"2023-10-06T03:06:21.636366+0000","last_became_peered":"2023-10-06T03:06:21.636366+0000","last_unstale":"2023-10-06T03:06:21.642551+0000","last_undegraded":"2023-10-06T03:06:21.642551+0000","last_fullsized":"2023-10-06T03:06:21.642551+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:48:47.816353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.630832+0000","last_change":"2023-10-06T03:06:21.624826+0000","last_active":"2023-10-06T03:06:21.630832+0000","last_peered":"2023-10-06T03:06:21.630832+0000","last_clean":"2023-10-06T03:06:21.630832+0000","last_became_active":"2023-10-06T03:06:21.623419+0000","last_became_peered":"2023-10-06T03:06:21.623419+0000","last_unstale":"2023-10-06T03:06:21.630832+0000","last_undegraded":"2023-10-06T03:06:21.630832+0000","last_fullsized":"2023-10-06T03:06:21.630832+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:34.401176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635759+0000","last_change":"2023-10-06T03:06:21.628936+0000","last_active":"2023-10-06T03:06:21.635759+0000","last_peered":"2023-10-06T03:06:21.635759+0000","last_clean":"2023-10-06T03:06:21.635759+0000","last_became_active":"2023-10-06T03:06:21.628692+0000","last_became_peered":"2023-10-06T03:06:21.628692+0000","last_unstale":"2023-10-06T03:06:21.635759+0000","last_undegraded":"2023-10-06T03:06:21.635759+0000","last_fullsized":"2023-10-06T03:06:21.635759+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:08.911020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.640577+0000","last_change":"2023-10-06T03:06:21.638294+0000","last_active":"2023-10-06T03:06:21.640577+0000","last_peered":"2023-10-06T03:06:21.640577+0000","last_clean":"2023-10-06T03:06:21.640577+0000","last_became_active":"2023-10-06T03:06:21.638084+0000","last_became_peered":"2023-10-06T03:06:21.638084+0000","last_unstale":"2023-10-06T03:06:21.640577+0000","last_undegraded":"2023-10-06T03:06:21.640577+0000","last_fullsized":"2023-10-06T03:06:21.640577+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:56.502283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639639+0000","last_change":"2023-10-06T03:06:21.634615+0000","last_active":"2023-10-06T03:06:21.639639+0000","last_peered":"2023-10-06T03:06:21.639639+0000","last_clean":"2023-10-06T03:06:21.639639+0000","last_became_active":"2023-10-06T03:06:21.634339+0000","last_became_peered":"2023-10-06T03:06:21.634339+0000","last_unstale":"2023-10-06T03:06:21.639639+0000","last_undegraded":"2023-10-06T03:06:21.639639+0000","last_fullsized":"2023-10-06T03:06:21.639639+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:49.417536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"56'4","reported_seq":14,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.632034+0000","last_change":"2023-10-06T03:06:20.631590+0000","last_active":"2023-10-06T03:06:21.632034+0000","last_peered":"2023-10-06T03:06:21.632034+0000","last_clean":"2023-10-06T03:06:21.632034+0000","last_became_active":"2023-10-06T03:06:20.631374+0000","last_became_peered":"2023-10-06T03:06:20.631374+0000","last_unstale":"2023-10-06T03:06:21.632034+0000","last_undegraded":"2023-10-06T03:06:21.632034+0000","last_fullsized":"2023-10-06T03:06:21.632034+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:01:31.775819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635285+0000","last_change":"2023-10-06T03:06:21.625608+0000","last_active":"2023-10-06T03:06:21.635285+0000","last_peered":"2023-10-06T03:06:21.635285+0000","last_clean":"2023-10-06T03:06:21.635285+0000","last_became_active":"2023-10-06T03:06:21.625355+0000","last_became_peered":"2023-10-06T03:06:21.625355+0000","last_unstale":"2023-10-06T03:06:21.635285+0000","last_undegraded":"2023-10-06T03:06:21.635285+0000","last_fullsized":"2023-10-06T03:06:21.635285+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:00:19.930817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.642454+0000","last_change":"2023-10-06T03:06:20.631772+0000","last_active":"2023-10-06T03:06:21.642454+0000","last_peered":"2023-10-06T03:06:21.642454+0000","last_clean":"2023-10-06T03:06:21.642454+0000","last_became_active":"2023-10-06T03:06:20.631522+0000","last_became_peered":"2023-10-06T03:06:20.631522+0000","last_unstale":"2023-10-06T03:06:21.642454+0000","last_undegraded":"2023-10-06T03:06:21.642454+0000","last_fullsized":"2023-10-06T03:06:21.642454+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:05.937982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636885+0000","last_change":"2023-10-06T03:06:21.634872+0000","last_active":"2023-10-06T03:06:21.636885+0000","last_peered":"2023-10-06T03:06:21.636885+0000","last_clean":"2023-10-06T03:06:21.636885+0000","last_became_active":"2023-10-06T03:06:21.634631+0000","last_became_peered":"2023-10-06T03:06:21.634631+0000","last_unstale":"2023-10-06T03:06:21.636885+0000","last_undegraded":"2023-10-06T03:06:21.636885+0000","last_fullsized":"2023-10-06T03:06:21.636885+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:23.406078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"56'2","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636334+0000","last_change":"2023-10-06T03:06:20.628973+0000","last_active":"2023-10-06T03:06:21.636334+0000","last_peered":"2023-10-06T03:06:21.636334+0000","last_clean":"2023-10-06T03:06:21.636334+0000","last_became_active":"2023-10-06T03:06:20.628313+0000","last_became_peered":"2023-10-06T03:06:20.628313+0000","last_unstale":"2023-10-06T03:06:21.636334+0000","last_undegraded":"2023-10-06T03:06:21.636334+0000","last_fullsized":"2023-10-06T03:06:21.636334+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:19:46.862868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.642490+0000","last_change":"2023-10-06T03:06:21.636634+0000","last_active":"2023-10-06T03:06:21.642490+0000","last_peered":"2023-10-06T03:06:21.642490+0000","last_clean":"2023-10-06T03:06:21.642490+0000","last_became_active":"2023-10-06T03:06:21.636409+0000","last_became_peered":"2023-10-06T03:06:21.636409+0000","last_unstale":"2023-10-06T03:06:21.642490+0000","last_undegraded":"2023-10-06T03:06:21.642490+0000","last_fullsized":"2023-10-06T03:06:21.642490+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:16.602275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"56'2","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.642435+0000","last_change":"2023-10-06T03:06:20.628287+0000","last_active":"2023-10-06T03:06:21.642435+0000","last_peered":"2023-10-06T03:06:21.642435+0000","last_clean":"2023-10-06T03:06:21.642435+0000","last_became_active":"2023-10-06T03:06:20.628023+0000","last_became_peered":"2023-10-06T03:06:20.628023+0000","last_unstale":"2023-10-06T03:06:21.642435+0000","last_undegraded":"2023-10-06T03:06:21.642435+0000","last_fullsized":"2023-10-06T03:06:21.642435+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:08.037702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636359+0000","last_change":"2023-10-06T03:06:21.632635+0000","last_active":"2023-10-06T03:06:21.636359+0000","last_peered":"2023-10-06T03:06:21.636359+0000","last_clean":"2023-10-06T03:06:21.636359+0000","last_became_active":"2023-10-06T03:06:21.632374+0000","last_became_peered":"2023-10-06T03:06:21.632374+0000","last_unstale":"2023-10-06T03:06:21.636359+0000","last_undegraded":"2023-10-06T03:06:21.636359+0000","last_fullsized":"2023-10-06T03:06:21.636359+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:23:27.639109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.625899+0000","last_change":"2023-10-06T03:06:20.624970+0000","last_active":"2023-10-06T03:06:21.625899+0000","last_peered":"2023-10-06T03:06:21.625899+0000","last_clean":"2023-10-06T03:06:21.625899+0000","last_became_active":"2023-10-06T03:06:20.624691+0000","last_became_peered":"2023-10-06T03:06:20.624691+0000","last_unstale":"2023-10-06T03:06:21.625899+0000","last_undegraded":"2023-10-06T03:06:21.625899+0000","last_fullsized":"2023-10-06T03:06:21.625899+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:35:22.401226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.631663+0000","last_change":"2023-10-06T03:06:21.627803+0000","last_active":"2023-10-06T03:06:21.631663+0000","last_peered":"2023-10-06T03:06:21.631663+0000","last_clean":"2023-10-06T03:06:21.631663+0000","last_became_active":"2023-10-06T03:06:21.627539+0000","last_became_peered":"2023-10-06T03:06:21.627539+0000","last_unstale":"2023-10-06T03:06:21.631663+0000","last_undegraded":"2023-10-06T03:06:21.631663+0000","last_fullsized":"2023-10-06T03:06:21.631663+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:30.851317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.625995+0000","last_change":"2023-10-06T03:06:20.620568+0000","last_active":"2023-10-06T03:06:21.625995+0000","last_peered":"2023-10-06T03:06:21.625995+0000","last_clean":"2023-10-06T03:06:21.625995+0000","last_became_active":"2023-10-06T03:06:20.620321+0000","last_became_peered":"2023-10-06T03:06:20.620321+0000","last_unstale":"2023-10-06T03:06:21.625995+0000","last_undegraded":"2023-10-06T03:06:21.625995+0000","last_fullsized":"2023-10-06T03:06:21.625995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:03.644319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639958+0000","last_change":"2023-10-06T03:06:21.638728+0000","last_active":"2023-10-06T03:06:21.639958+0000","last_peered":"2023-10-06T03:06:21.639958+0000","last_clean":"2023-10-06T03:06:21.639958+0000","last_became_active":"2023-10-06T03:06:21.638519+0000","last_became_peered":"2023-10-06T03:06:21.638519+0000","last_unstale":"2023-10-06T03:06:21.639958+0000","last_undegraded":"2023-10-06T03:06:21.639958+0000","last_fullsized":"2023-10-06T03:06:21.639958+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:38:39.231251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611366+0000","last_change":"2023-10-06T03:06:20.625335+0000","last_active":"2023-10-06T03:06:21.611366+0000","last_peered":"2023-10-06T03:06:21.611366+0000","last_clean":"2023-10-06T03:06:21.611366+0000","last_became_active":"2023-10-06T03:06:20.624996+0000","last_became_peered":"2023-10-06T03:06:20.624996+0000","last_unstale":"2023-10-06T03:06:21.611366+0000","last_undegraded":"2023-10-06T03:06:21.611366+0000","last_fullsized":"2023-10-06T03:06:21.611366+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:39.376713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639100+0000","last_change":"2023-10-06T03:06:21.632580+0000","last_active":"2023-10-06T03:06:21.639100+0000","last_peered":"2023-10-06T03:06:21.639100+0000","last_clean":"2023-10-06T03:06:21.639100+0000","last_became_active":"2023-10-06T03:06:21.632302+0000","last_became_peered":"2023-10-06T03:06:21.632302+0000","last_unstale":"2023-10-06T03:06:21.639100+0000","last_undegraded":"2023-10-06T03:06:21.639100+0000","last_fullsized":"2023-10-06T03:06:21.639100+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.103354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.618594+0000","last_change":"2023-10-06T03:06:20.630249+0000","last_active":"2023-10-06T03:06:21.618594+0000","last_peered":"2023-10-06T03:06:21.618594+0000","last_clean":"2023-10-06T03:06:21.618594+0000","last_became_active":"2023-10-06T03:06:20.629958+0000","last_became_peered":"2023-10-06T03:06:20.629958+0000","last_unstale":"2023-10-06T03:06:21.618594+0000","last_undegraded":"2023-10-06T03:06:21.618594+0000","last_fullsized":"2023-10-06T03:06:21.618594+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:44.730849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.633002+0000","last_change":"2023-10-06T03:06:21.627049+0000","last_active":"2023-10-06T03:06:21.633002+0000","last_peered":"2023-10-06T03:06:21.633002+0000","last_clean":"2023-10-06T03:06:21.633002+0000","last_became_active":"2023-10-06T03:06:21.626407+0000","last_became_peered":"2023-10-06T03:06:21.626407+0000","last_unstale":"2023-10-06T03:06:21.633002+0000","last_undegraded":"2023-10-06T03:06:21.633002+0000","last_fullsized":"2023-10-06T03:06:21.633002+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:13.651697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.621877+0000","last_change":"2023-10-06T03:06:20.633131+0000","last_active":"2023-10-06T03:06:21.621877+0000","last_peered":"2023-10-06T03:06:21.621877+0000","last_clean":"2023-10-06T03:06:21.621877+0000","last_became_active":"2023-10-06T03:06:20.632929+0000","last_became_peered":"2023-10-06T03:06:20.632929+0000","last_unstale":"2023-10-06T03:06:21.621877+0000","last_undegraded":"2023-10-06T03:06:21.621877+0000","last_fullsized":"2023-10-06T03:06:21.621877+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:32:48.925338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.627674+0000","last_change":"2023-10-06T03:06:21.621046+0000","last_active":"2023-10-06T03:06:21.627674+0000","last_peered":"2023-10-06T03:06:21.627674+0000","last_clean":"2023-10-06T03:06:21.627674+0000","last_became_active":"2023-10-06T03:06:21.620800+0000","last_became_peered":"2023-10-06T03:06:21.620800+0000","last_unstale":"2023-10-06T03:06:21.627674+0000","last_undegraded":"2023-10-06T03:06:21.627674+0000","last_fullsized":"2023-10-06T03:06:21.627674+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:15.019288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.612889+0000","last_change":"2023-10-06T03:06:20.624338+0000","last_active":"2023-10-06T03:06:21.612889+0000","last_peered":"2023-10-06T03:06:21.612889+0000","last_clean":"2023-10-06T03:06:21.612889+0000","last_became_active":"2023-10-06T03:06:20.624066+0000","last_became_peered":"2023-10-06T03:06:20.624066+0000","last_unstale":"2023-10-06T03:06:21.612889+0000","last_undegraded":"2023-10-06T03:06:21.612889+0000","last_fullsized":"2023-10-06T03:06:21.612889+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:31.418752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.637057+0000","last_change":"2023-10-06T03:06:21.631917+0000","last_active":"2023-10-06T03:06:21.637057+0000","last_peered":"2023-10-06T03:06:21.637057+0000","last_clean":"2023-10-06T03:06:21.637057+0000","last_became_active":"2023-10-06T03:06:21.631618+0000","last_became_peered":"2023-10-06T03:06:21.631618+0000","last_unstale":"2023-10-06T03:06:21.637057+0000","last_undegraded":"2023-10-06T03:06:21.637057+0000","last_fullsized":"2023-10-06T03:06:21.637057+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:12.454052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"56'3","reported_seq":13,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.642680+0000","last_change":"2023-10-06T03:06:20.632587+0000","last_active":"2023-10-06T03:06:21.642680+0000","last_peered":"2023-10-06T03:06:21.642680+0000","last_clean":"2023-10-06T03:06:21.642680+0000","last_became_active":"2023-10-06T03:06:20.632127+0000","last_became_peered":"2023-10-06T03:06:20.632127+0000","last_unstale":"2023-10-06T03:06:21.642680+0000","last_undegraded":"2023-10-06T03:06:21.642680+0000","last_fullsized":"2023-10-06T03:06:21.642680+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:31:00.533803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.634705+0000","last_change":"2023-10-06T03:06:21.624727+0000","last_active":"2023-10-06T03:06:21.634705+0000","last_peered":"2023-10-06T03:06:21.634705+0000","last_clean":"2023-10-06T03:06:21.634705+0000","last_became_active":"2023-10-06T03:06:21.624412+0000","last_became_peered":"2023-10-06T03:06:21.624412+0000","last_unstale":"2023-10-06T03:06:21.634705+0000","last_undegraded":"2023-10-06T03:06:21.634705+0000","last_fullsized":"2023-10-06T03:06:21.634705+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:52:25.318899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"56'6","reported_seq":16,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.642652+0000","last_change":"2023-10-06T03:06:20.627919+0000","last_active":"2023-10-06T03:06:21.642652+0000","last_peered":"2023-10-06T03:06:21.642652+0000","last_clean":"2023-10-06T03:06:21.642652+0000","last_became_active":"2023-10-06T03:06:20.627646+0000","last_became_peered":"2023-10-06T03:06:20.627646+0000","last_unstale":"2023-10-06T03:06:21.642652+0000","last_undegraded":"2023-10-06T03:06:21.642652+0000","last_fullsized":"2023-10-06T03:06:21.642652+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:02:45.641976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639362+0000","last_change":"2023-10-06T03:06:21.634621+0000","last_active":"2023-10-06T03:06:21.639362+0000","last_peered":"2023-10-06T03:06:21.639362+0000","last_clean":"2023-10-06T03:06:21.639362+0000","last_became_active":"2023-10-06T03:06:21.633392+0000","last_became_peered":"2023-10-06T03:06:21.633392+0000","last_unstale":"2023-10-06T03:06:21.639362+0000","last_undegraded":"2023-10-06T03:06:21.639362+0000","last_fullsized":"2023-10-06T03:06:21.639362+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:10:15.019288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"56'2","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.640224+0000","last_change":"2023-10-06T03:06:20.631058+0000","last_active":"2023-10-06T03:06:21.640224+0000","last_peered":"2023-10-06T03:06:21.640224+0000","last_clean":"2023-10-06T03:06:21.640224+0000","last_became_active":"2023-10-06T03:06:20.630645+0000","last_became_peered":"2023-10-06T03:06:20.630645+0000","last_unstale":"2023-10-06T03:06:21.640224+0000","last_undegraded":"2023-10-06T03:06:21.640224+0000","last_fullsized":"2023-10-06T03:06:21.640224+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:42:08.211673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636656+0000","last_change":"2023-10-06T03:06:21.631809+0000","last_active":"2023-10-06T03:06:21.636656+0000","last_peered":"2023-10-06T03:06:21.636656+0000","last_clean":"2023-10-06T03:06:21.636656+0000","last_became_active":"2023-10-06T03:06:21.631542+0000","last_became_peered":"2023-10-06T03:06:21.631542+0000","last_unstale":"2023-10-06T03:06:21.636656+0000","last_undegraded":"2023-10-06T03:06:21.636656+0000","last_fullsized":"2023-10-06T03:06:21.636656+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:08.911020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.615758+0000","last_change":"2023-10-06T03:06:20.624236+0000","last_active":"2023-10-06T03:06:21.615758+0000","last_peered":"2023-10-06T03:06:21.615758+0000","last_clean":"2023-10-06T03:06:21.615758+0000","last_became_active":"2023-10-06T03:06:20.623955+0000","last_became_peered":"2023-10-06T03:06:20.623955+0000","last_unstale":"2023-10-06T03:06:21.615758+0000","last_undegraded":"2023-10-06T03:06:21.615758+0000","last_fullsized":"2023-10-06T03:06:21.615758+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:31.418752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.637098+0000","last_change":"2023-10-06T03:06:21.631042+0000","last_active":"2023-10-06T03:06:21.637098+0000","last_peered":"2023-10-06T03:06:21.637098+0000","last_clean":"2023-10-06T03:06:21.637098+0000","last_became_active":"2023-10-06T03:06:21.629590+0000","last_became_peered":"2023-10-06T03:06:21.629590+0000","last_unstale":"2023-10-06T03:06:21.637098+0000","last_undegraded":"2023-10-06T03:06:21.637098+0000","last_fullsized":"2023-10-06T03:06:21.637098+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:36:03.625453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.623267+0000","last_change":"2023-10-06T03:06:20.629263+0000","last_active":"2023-10-06T03:06:21.623267+0000","last_peered":"2023-10-06T03:06:21.623267+0000","last_clean":"2023-10-06T03:06:21.623267+0000","last_became_active":"2023-10-06T03:06:20.626413+0000","last_became_peered":"2023-10-06T03:06:20.626413+0000","last_unstale":"2023-10-06T03:06:21.623267+0000","last_undegraded":"2023-10-06T03:06:21.623267+0000","last_fullsized":"2023-10-06T03:06:21.623267+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:48.412683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.632011+0000","last_change":"2023-10-06T03:06:21.629980+0000","last_active":"2023-10-06T03:06:21.632011+0000","last_peered":"2023-10-06T03:06:21.632011+0000","last_clean":"2023-10-06T03:06:21.632011+0000","last_became_active":"2023-10-06T03:06:21.629731+0000","last_became_peered":"2023-10-06T03:06:21.629731+0000","last_unstale":"2023-10-06T03:06:21.632011+0000","last_undegraded":"2023-10-06T03:06:21.632011+0000","last_fullsized":"2023-10-06T03:06:21.632011+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:42:09.216525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"56'8","reported_seq":18,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.641321+0000","last_change":"2023-10-06T03:06:20.623501+0000","last_active":"2023-10-06T03:06:21.641321+0000","last_peered":"2023-10-06T03:06:21.641321+0000","last_clean":"2023-10-06T03:06:21.641321+0000","last_became_active":"2023-10-06T03:06:20.623234+0000","last_became_peered":"2023-10-06T03:06:20.623234+0000","last_unstale":"2023-10-06T03:06:21.641321+0000","last_undegraded":"2023-10-06T03:06:21.641321+0000","last_fullsized":"2023-10-06T03:06:21.641321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:11.535511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.642497+0000","last_change":"2023-10-06T03:06:21.639621+0000","last_active":"2023-10-06T03:06:21.642497+0000","last_peered":"2023-10-06T03:06:21.642497+0000","last_clean":"2023-10-06T03:06:21.642497+0000","last_became_active":"2023-10-06T03:06:21.639394+0000","last_became_peered":"2023-10-06T03:06:21.639394+0000","last_unstale":"2023-10-06T03:06:21.642497+0000","last_undegraded":"2023-10-06T03:06:21.642497+0000","last_fullsized":"2023-10-06T03:06:21.642497+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:39.357700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"56'2","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.641335+0000","last_change":"2023-10-06T03:06:20.630321+0000","last_active":"2023-10-06T03:06:21.641335+0000","last_peered":"2023-10-06T03:06:21.641335+0000","last_clean":"2023-10-06T03:06:21.641335+0000","last_became_active":"2023-10-06T03:06:20.630063+0000","last_became_peered":"2023-10-06T03:06:20.630063+0000","last_unstale":"2023-10-06T03:06:21.641335+0000","last_undegraded":"2023-10-06T03:06:21.641335+0000","last_fullsized":"2023-10-06T03:06:21.641335+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:29:05.937982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.643971+0000","last_change":"2023-10-06T03:06:21.638984+0000","last_active":"2023-10-06T03:06:21.643971+0000","last_peered":"2023-10-06T03:06:21.643971+0000","last_clean":"2023-10-06T03:06:21.643971+0000","last_became_active":"2023-10-06T03:06:21.638719+0000","last_became_peered":"2023-10-06T03:06:21.638719+0000","last_unstale":"2023-10-06T03:06:21.643971+0000","last_undegraded":"2023-10-06T03:06:21.643971+0000","last_fullsized":"2023-10-06T03:06:21.643971+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:48:32.641605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"57'1","reported_seq":11,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T03:06:24.076306+0000","last_change":"2023-10-06T03:06:20.622624+0000","last_active":"2023-10-06T03:06:24.076306+0000","last_peered":"2023-10-06T03:06:24.076306+0000","last_clean":"2023-10-06T03:06:24.076306+0000","last_became_active":"2023-10-06T03:06:20.622334+0000","last_became_peered":"2023-10-06T03:06:20.622334+0000","last_unstale":"2023-10-06T03:06:24.076306+0000","last_undegraded":"2023-10-06T03:06:24.076306+0000","last_fullsized":"2023-10-06T03:06:24.076306+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:03.476888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639263+0000","last_change":"2023-10-06T03:06:21.636220+0000","last_active":"2023-10-06T03:06:21.639263+0000","last_peered":"2023-10-06T03:06:21.639263+0000","last_clean":"2023-10-06T03:06:21.639263+0000","last_became_active":"2023-10-06T03:06:21.635976+0000","last_became_peered":"2023-10-06T03:06:21.635976+0000","last_unstale":"2023-10-06T03:06:21.639263+0000","last_undegraded":"2023-10-06T03:06:21.639263+0000","last_fullsized":"2023-10-06T03:06:21.639263+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:13:37.103354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.628446+0000","last_change":"2023-10-06T03:06:20.629164+0000","last_active":"2023-10-06T03:06:21.628446+0000","last_peered":"2023-10-06T03:06:21.628446+0000","last_clean":"2023-10-06T03:06:21.628446+0000","last_became_active":"2023-10-06T03:06:20.628699+0000","last_became_peered":"2023-10-06T03:06:20.628699+0000","last_unstale":"2023-10-06T03:06:21.628446+0000","last_undegraded":"2023-10-06T03:06:21.628446+0000","last_fullsized":"2023-10-06T03:06:21.628446+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:31.418752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639709+0000","last_change":"2023-10-06T03:06:21.633840+0000","last_active":"2023-10-06T03:06:21.639709+0000","last_peered":"2023-10-06T03:06:21.639709+0000","last_clean":"2023-10-06T03:06:21.639709+0000","last_became_active":"2023-10-06T03:06:21.633420+0000","last_became_peered":"2023-10-06T03:06:21.633420+0000","last_unstale":"2023-10-06T03:06:21.639709+0000","last_undegraded":"2023-10-06T03:06:21.639709+0000","last_fullsized":"2023-10-06T03:06:21.639709+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:19:13.651697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.614763+0000","last_change":"2023-10-06T03:06:20.624698+0000","last_active":"2023-10-06T03:06:21.614763+0000","last_peered":"2023-10-06T03:06:21.614763+0000","last_clean":"2023-10-06T03:06:21.614763+0000","last_became_active":"2023-10-06T03:06:20.624434+0000","last_became_peered":"2023-10-06T03:06:20.624434+0000","last_unstale":"2023-10-06T03:06:21.614763+0000","last_undegraded":"2023-10-06T03:06:21.614763+0000","last_fullsized":"2023-10-06T03:06:21.614763+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:58.374860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639768+0000","last_change":"2023-10-06T03:06:21.634923+0000","last_active":"2023-10-06T03:06:21.639768+0000","last_peered":"2023-10-06T03:06:21.639768+0000","last_clean":"2023-10-06T03:06:21.639768+0000","last_became_active":"2023-10-06T03:06:21.634108+0000","last_became_peered":"2023-10-06T03:06:21.634108+0000","last_unstale":"2023-10-06T03:06:21.639768+0000","last_undegraded":"2023-10-06T03:06:21.639768+0000","last_fullsized":"2023-10-06T03:06:21.639768+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:30.851317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.622811+0000","last_change":"2023-10-06T03:06:20.630511+0000","last_active":"2023-10-06T03:06:21.622811+0000","last_peered":"2023-10-06T03:06:21.622811+0000","last_clean":"2023-10-06T03:06:21.622811+0000","last_became_active":"2023-10-06T03:06:20.629748+0000","last_became_peered":"2023-10-06T03:06:20.629748+0000","last_unstale":"2023-10-06T03:06:21.622811+0000","last_undegraded":"2023-10-06T03:06:21.622811+0000","last_fullsized":"2023-10-06T03:06:21.622811+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:15:41.887149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635739+0000","last_change":"2023-10-06T03:06:21.628438+0000","last_active":"2023-10-06T03:06:21.635739+0000","last_peered":"2023-10-06T03:06:21.635739+0000","last_clean":"2023-10-06T03:06:21.635739+0000","last_became_active":"2023-10-06T03:06:21.628168+0000","last_became_peered":"2023-10-06T03:06:21.628168+0000","last_unstale":"2023-10-06T03:06:21.635739+0000","last_undegraded":"2023-10-06T03:06:21.635739+0000","last_fullsized":"2023-10-06T03:06:21.635739+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:18:03.596296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611503+0000","last_change":"2023-10-06T03:06:20.624481+0000","last_active":"2023-10-06T03:06:21.611503+0000","last_peered":"2023-10-06T03:06:21.611503+0000","last_clean":"2023-10-06T03:06:21.611503+0000","last_became_active":"2023-10-06T03:06:20.624019+0000","last_became_peered":"2023-10-06T03:06:20.624019+0000","last_unstale":"2023-10-06T03:06:21.611503+0000","last_undegraded":"2023-10-06T03:06:21.611503+0000","last_fullsized":"2023-10-06T03:06:21.611503+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:38:15.597423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.631670+0000","last_change":"2023-10-06T03:06:21.627275+0000","last_active":"2023-10-06T03:06:21.631670+0000","last_peered":"2023-10-06T03:06:21.631670+0000","last_clean":"2023-10-06T03:06:21.631670+0000","last_became_active":"2023-10-06T03:06:21.627010+0000","last_became_peered":"2023-10-06T03:06:21.627010+0000","last_unstale":"2023-10-06T03:06:21.631670+0000","last_undegraded":"2023-10-06T03:06:21.631670+0000","last_fullsized":"2023-10-06T03:06:21.631670+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:36.552543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611457+0000","last_change":"2023-10-06T03:06:20.619461+0000","last_active":"2023-10-06T03:06:21.611457+0000","last_peered":"2023-10-06T03:06:21.611457+0000","last_clean":"2023-10-06T03:06:21.611457+0000","last_became_active":"2023-10-06T03:06:20.619221+0000","last_became_peered":"2023-10-06T03:06:20.619221+0000","last_unstale":"2023-10-06T03:06:21.611457+0000","last_undegraded":"2023-10-06T03:06:21.611457+0000","last_fullsized":"2023-10-06T03:06:21.611457+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:10.593523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636177+0000","last_change":"2023-10-06T03:06:21.634948+0000","last_active":"2023-10-06T03:06:21.636177+0000","last_peered":"2023-10-06T03:06:21.636177+0000","last_clean":"2023-10-06T03:06:21.636177+0000","last_became_active":"2023-10-06T03:06:21.634723+0000","last_became_peered":"2023-10-06T03:06:21.634723+0000","last_unstale":"2023-10-06T03:06:21.636177+0000","last_undegraded":"2023-10-06T03:06:21.636177+0000","last_fullsized":"2023-10-06T03:06:21.636177+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:55:12.923051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.613890+0000","last_change":"2023-10-06T03:06:20.627212+0000","last_active":"2023-10-06T03:06:21.613890+0000","last_peered":"2023-10-06T03:06:21.613890+0000","last_clean":"2023-10-06T03:06:21.613890+0000","last_became_active":"2023-10-06T03:06:20.625418+0000","last_became_peered":"2023-10-06T03:06:20.625418+0000","last_unstale":"2023-10-06T03:06:21.613890+0000","last_undegraded":"2023-10-06T03:06:21.613890+0000","last_fullsized":"2023-10-06T03:06:21.613890+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:35:58.560109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.642619+0000","last_change":"2023-10-06T03:06:21.638437+0000","last_active":"2023-10-06T03:06:21.642619+0000","last_peered":"2023-10-06T03:06:21.642619+0000","last_clean":"2023-10-06T03:06:21.642619+0000","last_became_active":"2023-10-06T03:06:21.638233+0000","last_became_peered":"2023-10-06T03:06:21.638233+0000","last_unstale":"2023-10-06T03:06:21.642619+0000","last_undegraded":"2023-10-06T03:06:21.642619+0000","last_fullsized":"2023-10-06T03:06:21.642619+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:05:40.381565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.632136+0000","last_change":"2023-10-06T03:06:20.624883+0000","last_active":"2023-10-06T03:06:21.632136+0000","last_peered":"2023-10-06T03:06:21.632136+0000","last_clean":"2023-10-06T03:06:21.632136+0000","last_became_active":"2023-10-06T03:06:20.624619+0000","last_became_peered":"2023-10-06T03:06:20.624619+0000","last_unstale":"2023-10-06T03:06:21.632136+0000","last_undegraded":"2023-10-06T03:06:21.632136+0000","last_fullsized":"2023-10-06T03:06:21.632136+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:11.535511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.614836+0000","last_change":"2023-10-06T03:04:23.986472+0000","last_active":"2023-10-06T03:06:21.614836+0000","last_peered":"2023-10-06T03:06:21.614836+0000","last_clean":"2023-10-06T03:06:21.614836+0000","last_became_active":"2023-10-06T03:04:23.986228+0000","last_became_peered":"2023-10-06T03:04:23.986228+0000","last_unstale":"2023-10-06T03:06:21.614836+0000","last_undegraded":"2023-10-06T03:06:21.614836+0000","last_fullsized":"2023-10-06T03:06:21.614836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:08.739849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639982+0000","last_change":"2023-10-06T03:06:21.638861+0000","last_active":"2023-10-06T03:06:21.639982+0000","last_peered":"2023-10-06T03:06:21.639982+0000","last_clean":"2023-10-06T03:06:21.639982+0000","last_became_active":"2023-10-06T03:06:21.638563+0000","last_became_peered":"2023-10-06T03:06:21.638563+0000","last_unstale":"2023-10-06T03:06:21.639982+0000","last_undegraded":"2023-10-06T03:06:21.639982+0000","last_fullsized":"2023-10-06T03:06:21.639982+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:32:47.426610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.622716+0000","last_change":"2023-10-06T03:06:20.630137+0000","last_active":"2023-10-06T03:06:21.622716+0000","last_peered":"2023-10-06T03:06:21.622716+0000","last_clean":"2023-10-06T03:06:21.622716+0000","last_became_active":"2023-10-06T03:06:20.629832+0000","last_became_peered":"2023-10-06T03:06:20.629832+0000","last_unstale":"2023-10-06T03:06:21.622716+0000","last_undegraded":"2023-10-06T03:06:21.622716+0000","last_fullsized":"2023-10-06T03:06:21.622716+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:38:11.535511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.616107+0000","last_change":"2023-10-06T03:04:23.814917+0000","last_active":"2023-10-06T03:06:21.616107+0000","last_peered":"2023-10-06T03:06:21.616107+0000","last_clean":"2023-10-06T03:06:21.616107+0000","last_became_active":"2023-10-06T03:04:23.814601+0000","last_became_peered":"2023-10-06T03:04:23.814601+0000","last_unstale":"2023-10-06T03:06:21.616107+0000","last_undegraded":"2023-10-06T03:06:21.616107+0000","last_fullsized":"2023-10-06T03:06:21.616107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.635294+0000","last_change":"2023-10-06T03:06:21.628936+0000","last_active":"2023-10-06T03:06:21.635294+0000","last_peered":"2023-10-06T03:06:21.635294+0000","last_clean":"2023-10-06T03:06:21.635294+0000","last_became_active":"2023-10-06T03:06:21.628695+0000","last_became_peered":"2023-10-06T03:06:21.628695+0000","last_unstale":"2023-10-06T03:06:21.635294+0000","last_undegraded":"2023-10-06T03:06:21.635294+0000","last_fullsized":"2023-10-06T03:06:21.635294+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:27.973305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.615945+0000","last_change":"2023-10-06T03:06:20.624082+0000","last_active":"2023-10-06T03:06:21.615945+0000","last_peered":"2023-10-06T03:06:21.615945+0000","last_clean":"2023-10-06T03:06:21.615945+0000","last_became_active":"2023-10-06T03:06:20.623824+0000","last_became_peered":"2023-10-06T03:06:20.623824+0000","last_unstale":"2023-10-06T03:06:21.615945+0000","last_undegraded":"2023-10-06T03:06:21.615945+0000","last_fullsized":"2023-10-06T03:06:21.615945+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:06:08.037702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.627857+0000","last_change":"2023-10-06T03:04:24.314547+0000","last_active":"2023-10-06T03:06:21.627857+0000","last_peered":"2023-10-06T03:06:21.627857+0000","last_clean":"2023-10-06T03:06:21.627857+0000","last_became_active":"2023-10-06T03:04:24.314278+0000","last_became_peered":"2023-10-06T03:04:24.314278+0000","last_unstale":"2023-10-06T03:06:21.627857+0000","last_undegraded":"2023-10-06T03:06:21.627857+0000","last_fullsized":"2023-10-06T03:06:21.627857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:25.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639798+0000","last_change":"2023-10-06T03:06:21.636813+0000","last_active":"2023-10-06T03:06:21.639798+0000","last_peered":"2023-10-06T03:06:21.639798+0000","last_clean":"2023-10-06T03:06:21.639798+0000","last_became_active":"2023-10-06T03:06:21.634134+0000","last_became_peered":"2023-10-06T03:06:21.634134+0000","last_unstale":"2023-10-06T03:06:21.639798+0000","last_undegraded":"2023-10-06T03:06:21.639798+0000","last_fullsized":"2023-10-06T03:06:21.639798+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:55:36.552543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611097+0000","last_change":"2023-10-06T03:06:20.627128+0000","last_active":"2023-10-06T03:06:21.611097+0000","last_peered":"2023-10-06T03:06:21.611097+0000","last_clean":"2023-10-06T03:06:21.611097+0000","last_became_active":"2023-10-06T03:06:20.626867+0000","last_became_peered":"2023-10-06T03:06:20.626867+0000","last_unstale":"2023-10-06T03:06:21.611097+0000","last_undegraded":"2023-10-06T03:06:21.611097+0000","last_fullsized":"2023-10-06T03:06:21.611097+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:34.227774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.616072+0000","last_change":"2023-10-06T03:04:23.807972+0000","last_active":"2023-10-06T03:06:21.616072+0000","last_peered":"2023-10-06T03:06:21.616072+0000","last_clean":"2023-10-06T03:06:21.616072+0000","last_became_active":"2023-10-06T03:04:23.807723+0000","last_became_peered":"2023-10-06T03:04:23.807723+0000","last_unstale":"2023-10-06T03:06:21.616072+0000","last_undegraded":"2023-10-06T03:06:21.616072+0000","last_fullsized":"2023-10-06T03:06:21.616072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":195,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.626680+0000","last_change":"2023-10-06T03:04:17.779925+0000","last_active":"2023-10-06T03:06:21.626680+0000","last_peered":"2023-10-06T03:06:21.626680+0000","last_clean":"2023-10-06T03:06:21.626680+0000","last_became_active":"2023-10-06T03:04:17.778997+0000","last_became_peered":"2023-10-06T03:04:17.778997+0000","last_unstale":"2023-10-06T03:06:21.626680+0000","last_undegraded":"2023-10-06T03:06:21.626680+0000","last_fullsized":"2023-10-06T03:06:21.626680+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_clean_scrub_stamp":"2023-10-06T03:04:16.761610+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.640556+0000","last_change":"2023-10-06T03:06:21.638263+0000","last_active":"2023-10-06T03:06:21.640556+0000","last_peered":"2023-10-06T03:06:21.640556+0000","last_clean":"2023-10-06T03:06:21.640556+0000","last_became_active":"2023-10-06T03:06:21.637909+0000","last_became_peered":"2023-10-06T03:06:21.637909+0000","last_unstale":"2023-10-06T03:06:21.640556+0000","last_undegraded":"2023-10-06T03:06:21.640556+0000","last_fullsized":"2023-10-06T03:06:21.640556+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:35.232626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"56'2","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.637815+0000","last_change":"2023-10-06T03:06:20.623551+0000","last_active":"2023-10-06T03:06:21.637815+0000","last_peered":"2023-10-06T03:06:21.637815+0000","last_clean":"2023-10-06T03:06:21.637815+0000","last_became_active":"2023-10-06T03:06:20.623215+0000","last_became_peered":"2023-10-06T03:06:20.623215+0000","last_unstale":"2023-10-06T03:06:21.637815+0000","last_undegraded":"2023-10-06T03:06:21.637815+0000","last_fullsized":"2023-10-06T03:06:21.637815+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:52:03.476888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.622473+0000","last_change":"2023-10-06T03:04:23.814887+0000","last_active":"2023-10-06T03:06:21.622473+0000","last_peered":"2023-10-06T03:06:21.622473+0000","last_clean":"2023-10-06T03:06:21.622473+0000","last_became_active":"2023-10-06T03:04:23.814581+0000","last_became_peered":"2023-10-06T03:04:23.814581+0000","last_unstale":"2023-10-06T03:06:21.622473+0000","last_undegraded":"2023-10-06T03:06:21.622473+0000","last_fullsized":"2023-10-06T03:06:21.622473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639813+0000","last_change":"2023-10-06T03:06:21.637853+0000","last_active":"2023-10-06T03:06:21.639813+0000","last_peered":"2023-10-06T03:06:21.639813+0000","last_clean":"2023-10-06T03:06:21.639813+0000","last_became_active":"2023-10-06T03:06:21.637605+0000","last_became_peered":"2023-10-06T03:06:21.637605+0000","last_unstale":"2023-10-06T03:06:21.639813+0000","last_undegraded":"2023-10-06T03:06:21.639813+0000","last_fullsized":"2023-10-06T03:06:21.639813+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:36:44.331596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"56'2","reported_seq":12,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.640106+0000","last_change":"2023-10-06T03:06:20.630071+0000","last_active":"2023-10-06T03:06:21.640106+0000","last_peered":"2023-10-06T03:06:21.640106+0000","last_clean":"2023-10-06T03:06:21.640106+0000","last_became_active":"2023-10-06T03:06:20.629809+0000","last_became_peered":"2023-10-06T03:06:20.629809+0000","last_unstale":"2023-10-06T03:06:21.640106+0000","last_undegraded":"2023-10-06T03:06:21.640106+0000","last_fullsized":"2023-10-06T03:06:21.640106+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:14:39.342768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.637056+0000","last_change":"2023-10-06T03:04:23.986771+0000","last_active":"2023-10-06T03:06:21.637056+0000","last_peered":"2023-10-06T03:06:21.637056+0000","last_clean":"2023-10-06T03:06:21.637056+0000","last_became_active":"2023-10-06T03:04:23.986552+0000","last_became_peered":"2023-10-06T03:04:23.986552+0000","last_unstale":"2023-10-06T03:06:21.637056+0000","last_undegraded":"2023-10-06T03:06:21.637056+0000","last_fullsized":"2023-10-06T03:06:21.637056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.636241+0000","last_change":"2023-10-06T03:06:21.625510+0000","last_active":"2023-10-06T03:06:21.636241+0000","last_peered":"2023-10-06T03:06:21.636241+0000","last_clean":"2023-10-06T03:06:21.636241+0000","last_became_active":"2023-10-06T03:06:21.625257+0000","last_became_peered":"2023-10-06T03:06:21.625257+0000","last_unstale":"2023-10-06T03:06:21.636241+0000","last_undegraded":"2023-10-06T03:06:21.636241+0000","last_fullsized":"2023-10-06T03:06:21.636241+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:27.973305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"56'1","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.642525+0000","last_change":"2023-10-06T03:06:20.632683+0000","last_active":"2023-10-06T03:06:21.642525+0000","last_peered":"2023-10-06T03:06:21.642525+0000","last_clean":"2023-10-06T03:06:21.642525+0000","last_became_active":"2023-10-06T03:06:20.632440+0000","last_became_peered":"2023-10-06T03:06:20.632440+0000","last_unstale":"2023-10-06T03:06:21.642525+0000","last_undegraded":"2023-10-06T03:06:21.642525+0000","last_fullsized":"2023-10-06T03:06:21.642525+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:14:14.207986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.614562+0000","last_change":"2023-10-06T03:04:23.813862+0000","last_active":"2023-10-06T03:06:21.614562+0000","last_peered":"2023-10-06T03:06:21.614562+0000","last_clean":"2023-10-06T03:06:21.614562+0000","last_became_active":"2023-10-06T03:04:23.813584+0000","last_became_peered":"2023-10-06T03:04:23.813584+0000","last_unstale":"2023-10-06T03:06:21.614562+0000","last_undegraded":"2023-10-06T03:06:21.614562+0000","last_fullsized":"2023-10-06T03:06:21.614562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.639687+0000","last_change":"2023-10-06T03:06:21.633661+0000","last_active":"2023-10-06T03:06:21.639687+0000","last_peered":"2023-10-06T03:06:21.639687+0000","last_clean":"2023-10-06T03:06:21.639687+0000","last_became_active":"2023-10-06T03:06:21.633117+0000","last_became_peered":"2023-10-06T03:06:21.633117+0000","last_unstale":"2023-10-06T03:06:21.639687+0000","last_undegraded":"2023-10-06T03:06:21.639687+0000","last_fullsized":"2023-10-06T03:06:21.639687+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:20.600920+0000","last_clean_scrub_stamp":"2023-10-06T03:06:20.600920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:07:21.616453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.611948+0000","last_change":"2023-10-06T03:06:20.616127+0000","last_active":"2023-10-06T03:06:21.611948+0000","last_peered":"2023-10-06T03:06:21.611948+0000","last_clean":"2023-10-06T03:06:21.611948+0000","last_became_active":"2023-10-06T03:06:20.615836+0000","last_became_peered":"2023-10-06T03:06:20.615836+0000","last_unstale":"2023-10-06T03:06:21.611948+0000","last_undegraded":"2023-10-06T03:06:21.611948+0000","last_fullsized":"2023-10-06T03:06:21.611948+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:06:19.596068+0000","last_clean_scrub_stamp":"2023-10-06T03:06:19.596068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:55.497431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.622611+0000","last_change":"2023-10-06T03:04:23.805874+0000","last_active":"2023-10-06T03:06:21.622611+0000","last_peered":"2023-10-06T03:06:21.622611+0000","last_clean":"2023-10-06T03:06:21.622611+0000","last_became_active":"2023-10-06T03:04:23.805551+0000","last_became_peered":"2023-10-06T03:04:23.805551+0000","last_unstale":"2023-10-06T03:06:21.622611+0000","last_undegraded":"2023-10-06T03:06:21.622611+0000","last_fullsized":"2023-10-06T03:06:21.622611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:21.250275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298552,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073288,"statfs":{"total":96636764160,"available":96331046912,"internally_reserved":0,"allocated":1294336,"data_stored":909275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.629,"15min":0.64300000000000002},"min":{"1min":0.318,"5min":0.314,"15min":0.314},"max":{"1min":0.69999999999999996,"5min":3.8860000000000001,"15min":3.8860000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.64900000000000002,"15min":0.66400000000000003},"min":{"1min":0.38700000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.69699999999999995,"5min":3.988,"15min":3.988},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.65200000000000002,"15min":0.67000000000000004},"min":{"1min":0.36199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.81899999999999995,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.64800000000000002,"15min":0.66400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73099999999999998,"5min":3.444,"15min":3.444},"last":0.5}]},{"osd":2,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.67000000000000004,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78800000000000003,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85599999999999998,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.48799999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.68799999999999994,"15min":0.70599999999999996},"min":{"1min":0.45600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.73099999999999998,"5min":3.903,"15min":3.903},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.71499999999999997,"15min":0.73399999999999999},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.746,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":0.55000000000000004}]},{"osd":4,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46800000000000003,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.55700000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.38800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65400000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.46899999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.64000000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.56699999999999995}]},{"osd":6,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59899999999999998,"15min":0.60399999999999998},"min":{"1min":0.46600000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.71399999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.625},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79100000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.60699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297960,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073880,"statfs":{"total":96636764160,"available":96331653120,"internally_reserved":0,"allocated":688128,"data_stored":318193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.79700000000000004,"15min":0.84299999999999997},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77200000000000002,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.83699999999999997,"15min":0.89300000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.64600000000000002,"5min":6.8330000000000002,"15min":6.8330000000000002},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.71599999999999997,"15min":0.74399999999999999},"min":{"1min":0.34899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.72299999999999998,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.73899999999999999,"15min":0.76500000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":3.948,"15min":3.948},"last":0.626}]},{"osd":2,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.754,"15min":0.754},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.75800000000000001,"5min":3.996,"15min":3.996},"last":0.59999999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.71799999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.57399999999999995}]},{"osd":4,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.34399999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.36499999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.55400000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.50600000000000001,"15min":0.499},"min":{"1min":0.40999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.443,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.46600000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297984,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073856,"statfs":{"total":96636764160,"available":96331628544,"internally_reserved":0,"allocated":712704,"data_stored":320431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.38700000000000001,"15min":0.39700000000000002},"min":{"1min":0.20999999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.50900000000000001,"5min":1.159,"15min":1.159},"last":0.31},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.375,"15min":0.379},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46999999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.26600000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.58999999999999997,"15min":0.63200000000000001},"min":{"1min":0.254,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.44500000000000001,"5min":6.056,"15min":6.056},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57499999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.44800000000000001,"15min":0.45500000000000002},"min":{"1min":0.27700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.502,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.443,"15min":0.45100000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.56000000000000005,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.32400000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.46800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.77800000000000002,"5min":1.244,"15min":1.244},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.495,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":1.216,"15min":1.216},"last":0.67200000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.628,"15min":0.624},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82899999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.627,"15min":0.627},"min":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.76800000000000002,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89200000000000002,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85699999999999998,"5min":1.014,"15min":1.014},"last":0.66600000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":1.099,"15min":1.099},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.79800000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.65400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298532,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073308,"statfs":{"total":96636764160,"available":96331067392,"internally_reserved":0,"allocated":1273856,"data_stored":907516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.30099999999999999,"15min":0.29299999999999998},"min":{"1min":0.23599999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.34000000000000002,"15min":0.33400000000000002},"min":{"1min":0.28499999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.29999999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"min":{"1min":0.23200000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"min":{"1min":0.26000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.33200000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.32400000000000001},"min":{"1min":0.26000000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.31},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.371,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.28299999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.44900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.46600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.53700000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.39400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.5}]},{"osd":6,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82299999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.432},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.46300000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.434,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.443},{"interface":"front","average":{"1min":0.625,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.45400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297956,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073884,"statfs":{"total":96636764160,"available":96331657216,"internally_reserved":0,"allocated":684032,"data_stored":318159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.80100000000000005,"15min":0.88400000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.437,"5min":12.913,"15min":12.913},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.316,"5min":0.36799999999999999,"15min":0.377},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.49199999999999999,"5min":0.997,"15min":0.997},"last":0.30399999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.51200000000000001,"15min":0.53900000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53000000000000003,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54900000000000004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.33300000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.36199999999999999,"15min":0.36799999999999999},"min":{"1min":0.252,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46200000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.88,"15min":0.96399999999999997},"min":{"1min":0.29199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57299999999999995,"5min":12.941000000000001,"15min":12.941000000000001},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":1.042,"15min":1.1200000000000001},"min":{"1min":0.40600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.76900000000000002,"5min":12.846,"15min":12.846},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.62,"15min":0.622},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.75900000000000001,"5min":1.046,"15min":1.046},"last":0.52600000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76900000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":1.0620000000000001,"15min":1.141},"min":{"1min":0.47999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72799999999999998,"5min":12.884,"15min":12.884},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77100000000000002,"5min":1.071,"15min":1.071},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.62,"15min":0.622},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.73199999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.72999999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.504},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77000000000000002,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297956,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073884,"statfs":{"total":96636764160,"available":96331657216,"internally_reserved":0,"allocated":684032,"data_stored":318159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.373,"15min":0.38400000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55000000000000004,"5min":1.361,"15min":1.361},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.311,"5min":0.34899999999999998,"15min":0.35499999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.51200000000000001,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.32800000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.376,"15min":0.38300000000000001},"min":{"1min":0.20699999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53400000000000003,"5min":1.133,"15min":1.133},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.27800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66100000000000003,"5min":1.45,"15min":1.45},"last":0.312}]},{"osd":2,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57399999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.433,"15min":0.443},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59499999999999997,"5min":1.476,"15min":1.476},"last":0.34499999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.38100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":1.649,"15min":1.649},"last":0.437},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80200000000000005,"5min":1.054,"15min":1.054},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77300000000000002,"5min":1.401,"15min":1.401},"last":0.501},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77800000000000002,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.47999999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78000000000000003,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.46200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83399999999999996,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.54900000000000004}]},{"osd":7,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81999999999999995,"5min":1.679,"15min":1.679},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80300000000000005,"5min":1.083,"15min":1.083},"last":0.52400000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297968,"kb_used_data":680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073872,"statfs":{"total":96636764160,"available":96331644928,"internally_reserved":0,"allocated":696320,"data_stored":319695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52000000000000002,"15min":0.51100000000000001},"min":{"1min":0.376,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.41099999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84999999999999998,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.39200000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82699999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80400000000000005,"5min":0.875,"15min":0.875},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.439},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.42699999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.69699999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.503},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90200000000000002,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.622}]},{"osd":5,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83899999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.33900000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.72199999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297960,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073880,"statfs":{"total":96636764160,"available":96331653120,"internally_reserved":0,"allocated":688128,"data_stored":318181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68500000000000005,"5min":1.012,"15min":1.012},"last":0.621},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74399999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70599999999999996,"5min":1.03,"15min":1.03},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.71399999999999997,"5min":0.755,"15min":0.755},"last":0.54700000000000004}]},{"osd":2,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55400000000000005,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.76800000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.495},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.71899999999999997,"5min":0.998,"15min":0.998},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.58299999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.69599999999999995,"5min":1.048,"15min":1.048},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72799999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.57599999999999996}]},{"osd":4,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.45900000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.40500000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.745,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61699999999999999,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.76200000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.34200000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69199999999999995,"5min":0.872,"15min":0.872},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:06:30.568 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T03:06:30.568 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T03:06:30.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.725+0000 7f42aa4a2700 1 Processor -- start 2023-10-06T03:06:30.727 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.725+0000 7f42aa4a2700 1 -- start start 2023-10-06T03:06:30.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.726+0000 7f42aa4a2700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f42a40af320 0x7f42a40caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:30.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.726+0000 7f42aa4a2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a40cafe0 con 0x7f42a4067d20 2023-10-06T03:06:30.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.726+0000 7f42aa4a2700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a40c3b40 con 0x7f42a40ca190 2023-10-06T03:06:30.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.726+0000 7f42aa4a2700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a40ca710 con 0x7f42a40af320 2023-10-06T03:06:30.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.726+0000 7f42a8a3f700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f42a4067d20 0x7f42a40c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51604/0 (socket says 172.21.15.125:51604) 2023-10-06T03:06:30.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.726+0000 7f42a8a3f700 1 -- 172.21.15.125:0/1396804040 learned_addr learned my addr 172.21.15.125:0/1396804040 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:30.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.726+0000 7f42a3fff700 1 --2- 172.21.15.125:0/1396804040 >> v2:172.21.15.130:3300/0 conn(0x7f42a40af320 0x7f42a40caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:30.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.726+0000 7f42a2ffd700 1 -- 172.21.15.125:0/1396804040 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848091127 0 0) 0x7f429c001490 con 0x7f42a4067d20 2023-10-06T03:06:30.731 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.726+0000 7f42a2ffd700 1 -- 172.21.15.125:0/1396804040 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f428c003570 con 0x7f42a4067d20 2023-10-06T03:06:30.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.726+0000 7f42a2ffd700 1 -- 172.21.15.125:0/1396804040 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1830241772 0 0) 0x7f428c003570 con 0x7f42a4067d20 2023-10-06T03:06:30.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a2ffd700 1 -- 172.21.15.125:0/1396804040 >> v2:172.21.15.130:3300/0 conn(0x7f42a40af320 msgr2=0x7f42a40caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:30.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a2ffd700 1 --2- 172.21.15.125:0/1396804040 >> v2:172.21.15.130:3300/0 conn(0x7f42a40af320 0x7f42a40caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:30.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a2ffd700 1 -- 172.21.15.125:0/1396804040 >> v1:172.21.15.130:6789/0 conn(0x7f42a40ca190 legacy=0x7f42a4067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:30.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a2ffd700 1 -- 172.21.15.125:0/1396804040 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a40cc750 con 0x7f42a4067d20 2023-10-06T03:06:30.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a2ffd700 1 -- 172.21.15.125:0/1396804040 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f429c001980 con 0x7f42a4067d20 2023-10-06T03:06:30.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a2ffd700 1 -- 172.21.15.125:0/1396804040 >> v1:172.21.15.125:6789/0 conn(0x7f42a4067d20 legacy=0x7f42a40c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:30.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a2ffd700 1 --2- 172.21.15.125:0/1396804040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f428c003a60 0x7f428c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:30.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a2ffd700 1 --2- 172.21.15.125:0/1396804040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f428c004810 0x7f428c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:30.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a2ffd700 1 --2- 172.21.15.125:0/1396804040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f428c0052e0 0x7f428c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:30.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a2ffd700 1 -- 172.21.15.125:0/1396804040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a40ca710 con 0x7f428c003a60 2023-10-06T03:06:30.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a2ffd700 1 -- 172.21.15.125:0/1396804040 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c00c2a0 con 0x7f428c004810 2023-10-06T03:06:30.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a2ffd700 1 -- 172.21.15.125:0/1396804040 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c00c460 con 0x7f428c0052e0 2023-10-06T03:06:30.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a3fff700 1 --2- 172.21.15.125:0/1396804040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f428c003a60 0x7f428c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:30.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a37fe700 1 --2- 172.21.15.125:0/1396804040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f428c004810 0x7f428c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:30.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a8a3f700 1 --2- 172.21.15.125:0/1396804040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f428c0052e0 0x7f428c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:30.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a3fff700 1 -- 172.21.15.125:0/1396804040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f428c0052e0 msgr2=0x7f428c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:30.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a3fff700 1 --2- 172.21.15.125:0/1396804040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f428c0052e0 0x7f428c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:30.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a3fff700 1 -- 172.21.15.125:0/1396804040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f428c004810 msgr2=0x7f428c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:30.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a3fff700 1 --2- 172.21.15.125:0/1396804040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f428c004810 0x7f428c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:30.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a3fff700 1 -- 172.21.15.125:0/1396804040 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c003570 con 0x7f428c003a60 2023-10-06T03:06:30.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a37fe700 1 --2- 172.21.15.125:0/1396804040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f428c004810 0x7f428c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:30.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a8a3f700 1 --2- 172.21.15.125:0/1396804040 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f428c0052e0 0x7f428c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:30.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a8a3f700 1 -- 172.21.15.125:0/1396804040 reap_dead start 2023-10-06T03:06:30.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a3fff700 1 --2- 172.21.15.125:0/1396804040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f428c003a60 0x7f428c003e70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4298009bf0 tx=0x7f4298009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d68c54add3f2af8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:30.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a2ffd700 1 -- 172.21.15.125:0/1396804040 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4298005a00 con 0x7f428c003a60 2023-10-06T03:06:30.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a2ffd700 1 -- 172.21.15.125:0/1396804040 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4298005b60 con 0x7f428c003a60 2023-10-06T03:06:30.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.727+0000 7f42a2ffd700 1 -- 172.21.15.125:0/1396804040 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429800e710 con 0x7f428c003a60 2023-10-06T03:06:30.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.728+0000 7f42aa4a2700 1 -- 172.21.15.125:0/1396804040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f428c003a60 msgr2=0x7f428c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:30.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.728+0000 7f42aa4a2700 1 --2- 172.21.15.125:0/1396804040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f428c003a60 0x7f428c003e70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4298009bf0 tx=0x7f4298009120 comp rx=0 tx=0).stop 2023-10-06T03:06:30.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.728+0000 7f42aa4a2700 1 -- 172.21.15.125:0/1396804040 shutdown_connections 2023-10-06T03:06:30.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.728+0000 7f42aa4a2700 1 --2- 172.21.15.125:0/1396804040 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f428c003a60 0x7f428c003e70 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:30.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.728+0000 7f42aa4a2700 1 -- 172.21.15.125:0/1396804040 >> 172.21.15.125:0/1396804040 conn(0x7f42a4096120 msgr2=0x7f42a4068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:30.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.728+0000 7f42aa4a2700 1 -- 172.21.15.125:0/1396804040 shutdown_connections 2023-10-06T03:06:30.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.728+0000 7f42aa4a2700 1 -- 172.21.15.125:0/1396804040 wait complete. 2023-10-06T03:06:30.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.729+0000 7f42aa4a2700 1 Processor -- start 2023-10-06T03:06:30.735 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.729+0000 7f42aa4a2700 1 -- start start 2023-10-06T03:06:30.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.730+0000 7f42aa4a2700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f428c003a60 0x7f42a40b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:30.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.730+0000 7f42aa4a2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42a40b2030 0x7f42a406bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:30.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.730+0000 7f42aa4a2700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42a4169510 0x7f42a4152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:30.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.730+0000 7f42aa4a2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a416d9f0 con 0x7f42a40b2030 2023-10-06T03:06:30.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.730+0000 7f42aa4a2700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a416cde0 con 0x7f428c003a60 2023-10-06T03:06:30.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.730+0000 7f42aa4a2700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a416d0c0 con 0x7f42a4169510 2023-10-06T03:06:30.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.730+0000 7f42a37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42a40b2030 0x7f42a406bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:30.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.730+0000 7f42a37fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42a40b2030 0x7f42a406bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44820/0 (socket says 172.21.15.125:44820) 2023-10-06T03:06:30.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.730+0000 7f42a37fe700 1 -- 172.21.15.125:0/330480869 learned_addr learned my addr 172.21.15.125:0/330480869 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:30.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.730+0000 7f42a3fff700 1 --2- 172.21.15.125:0/330480869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f428c003a60 0x7f42a40b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:30.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.730+0000 7f42a37fe700 1 -- 172.21.15.125:0/330480869 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42a4169510 msgr2=0x7f42a4152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:30.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.730+0000 7f42a8a3f700 1 --2- 172.21.15.125:0/330480869 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42a4169510 0x7f42a4152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:30.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.730+0000 7f42a37fe700 1 --2- 172.21.15.125:0/330480869 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42a4169510 0x7f42a4152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:30.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.730+0000 7f42a37fe700 1 -- 172.21.15.125:0/330480869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f428c003a60 msgr2=0x7f42a40b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:30.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.730+0000 7f42a37fe700 1 --2- 172.21.15.125:0/330480869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f428c003a60 0x7f42a40b0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:30.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.730+0000 7f42a37fe700 1 -- 172.21.15.125:0/330480869 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a416d3a0 con 0x7f42a40b2030 2023-10-06T03:06:30.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.730+0000 7f42a8a3f700 1 --2- 172.21.15.125:0/330480869 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42a4169510 0x7f42a4152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:30.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.730+0000 7f42a37fe700 1 --2- 172.21.15.125:0/330480869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42a40b2030 0x7f42a406bf70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f429400e840 tx=0x7f4294009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:30.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.731+0000 7f428bfff700 1 -- 172.21.15.125:0/330480869 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4294017070 con 0x7f42a40b2030 2023-10-06T03:06:30.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.731+0000 7f428bfff700 1 -- 172.21.15.125:0/330480869 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4294006820 con 0x7f42a40b2030 2023-10-06T03:06:30.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.731+0000 7f42aa4a2700 1 -- 172.21.15.125:0/330480869 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a416d680 con 0x7f42a40b2030 2023-10-06T03:06:30.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.731+0000 7f428bfff700 1 -- 172.21.15.125:0/330480869 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4294006ba0 con 0x7f42a40b2030 2023-10-06T03:06:30.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.731+0000 7f42aa4a2700 1 -- 172.21.15.125:0/330480869 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a406c4b0 con 0x7f42a40b2030 2023-10-06T03:06:30.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.732+0000 7f42aa4a2700 1 -- 172.21.15.125:0/330480869 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a406c6d0 con 0x7f42a40b2030 2023-10-06T03:06:30.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.732+0000 7f428bfff700 1 -- 172.21.15.125:0/330480869 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4294007020 con 0x7f42a40b2030 2023-10-06T03:06:30.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.732+0000 7f428bfff700 1 --2- 172.21.15.125:0/330480869 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4290066f30 0x7f42900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:30.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.732+0000 7f428bfff700 1 -- 172.21.15.125:0/330480869 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4294084400 con 0x7f42a40b2030 2023-10-06T03:06:30.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.733+0000 7f42a3fff700 1 --2- 172.21.15.125:0/330480869 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4290066f30 0x7f42900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:30.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.733+0000 7f42a3fff700 1 --2- 172.21.15.125:0/330480869 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4290066f30 0x7f42900693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4298009160 tx=0x7f4298019000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:30.740 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.737+0000 7f428bfff700 1 -- 172.21.15.125:0/330480869 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42940513d0 con 0x7f42a40b2030 2023-10-06T03:06:30.997 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.996+0000 7f42aa4a2700 1 -- 172.21.15.125:0/330480869 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f42a4156be0 con 0x7f42a40b2030 2023-10-06T03:06:31.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:30.999+0000 7f428bfff700 1 -- 172.21.15.125:0/330480869 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f42a4156be0 con 0x7f42a40b2030 2023-10-06T03:06:31.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.001+0000 7f42aa4a2700 1 -- 172.21.15.125:0/330480869 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4290066f30 msgr2=0x7f42900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.001+0000 7f42aa4a2700 1 --2- 172.21.15.125:0/330480869 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4290066f30 0x7f42900693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4298009160 tx=0x7f4298019000 comp rx=0 tx=0).stop 2023-10-06T03:06:31.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.001+0000 7f42aa4a2700 1 -- 172.21.15.125:0/330480869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42a40b2030 msgr2=0x7f42a406bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.001+0000 7f42aa4a2700 1 --2- 172.21.15.125:0/330480869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42a40b2030 0x7f42a406bf70 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f429400e840 tx=0x7f4294009040 comp rx=0 tx=0).stop 2023-10-06T03:06:31.003 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.001+0000 7f42aa4a2700 1 -- 172.21.15.125:0/330480869 shutdown_connections 2023-10-06T03:06:31.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.001+0000 7f42aa4a2700 1 --2- 172.21.15.125:0/330480869 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4290066f30 0x7f42900693e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.001+0000 7f42aa4a2700 1 --2- 172.21.15.125:0/330480869 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f42a4169510 0x7f42a4152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.001+0000 7f42aa4a2700 1 --2- 172.21.15.125:0/330480869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f428c003a60 0x7f42a40b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.001+0000 7f42aa4a2700 1 --2- 172.21.15.125:0/330480869 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f42a40b2030 0x7f42a406bf70 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.001+0000 7f42aa4a2700 1 -- 172.21.15.125:0/330480869 >> 172.21.15.125:0/330480869 conn(0x7f42a4096120 msgr2=0x7f42a4155240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:31.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.002+0000 7f42aa4a2700 1 -- 172.21.15.125:0/330480869 shutdown_connections 2023-10-06T03:06:31.004 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.002+0000 7f42aa4a2700 1 -- 172.21.15.125:0/330480869 wait complete. 2023-10-06T03:06:31.004 INFO:teuthology.orchestra.run.smithi125.stderr:updated caps for client.0 2023-10-06T03:06:31.015 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:06:31.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.131+0000 7fd406334700 1 Processor -- start 2023-10-06T03:06:31.132 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.131+0000 7fd406334700 1 -- start start 2023-10-06T03:06:31.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.131+0000 7fd406334700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd4001546d0 0x7fd400154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.131+0000 7fd406334700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40006b3f0 con 0x7fd400067860 2023-10-06T03:06:31.135 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.131+0000 7fd406334700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4000ac540 con 0x7fd400067c30 2023-10-06T03:06:31.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.131+0000 7fd406334700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4000ac820 con 0x7fd4001546d0 2023-10-06T03:06:31.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd3fffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd400067860 0x7fd40006ace0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51620/0 (socket says 172.21.15.125:51620) 2023-10-06T03:06:31.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd3fffff700 1 -- 172.21.15.125:0/3990776028 learned_addr learned my addr 172.21.15.125:0/3990776028 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:31.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd4048d1700 1 --2- 172.21.15.125:0/3990776028 >> v2:172.21.15.130:3300/0 conn(0x7fd4001546d0 0x7fd400154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd3feffd700 1 -- 172.21.15.125:0/3990776028 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107487217 0 0) 0x7fd40006b3f0 con 0x7fd400067860 2023-10-06T03:06:31.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd3feffd700 1 -- 172.21.15.125:0/3990776028 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3e8003570 con 0x7fd400067860 2023-10-06T03:06:31.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd3feffd700 1 -- 172.21.15.125:0/3990776028 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2119733149 0 0) 0x7fd3e8003570 con 0x7fd400067860 2023-10-06T03:06:31.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd3feffd700 1 -- 172.21.15.125:0/3990776028 >> v2:172.21.15.130:3300/0 conn(0x7fd4001546d0 msgr2=0x7fd400154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:31.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd3feffd700 1 --2- 172.21.15.125:0/3990776028 >> v2:172.21.15.130:3300/0 conn(0x7fd4001546d0 0x7fd400154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd3feffd700 1 -- 172.21.15.125:0/3990776028 >> v1:172.21.15.130:6789/0 conn(0x7fd400067c30 legacy=0x7fd4000aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.136 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd3feffd700 1 -- 172.21.15.125:0/3990776028 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40006a4e0 con 0x7fd400067860 2023-10-06T03:06:31.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd3feffd700 1 -- 172.21.15.125:0/3990776028 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7fd3f0001470 con 0x7fd400067860 2023-10-06T03:06:31.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd3feffd700 1 -- 172.21.15.125:0/3990776028 >> v1:172.21.15.125:6789/0 conn(0x7fd400067860 legacy=0x7fd40006ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd3feffd700 1 --2- 172.21.15.125:0/3990776028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd3e8003a60 0x7fd3e8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd3feffd700 1 --2- 172.21.15.125:0/3990776028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3e8004810 0x7fd3e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd3feffd700 1 --2- 172.21.15.125:0/3990776028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3e80051c0 0x7fd3e800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd3feffd700 1 -- 172.21.15.125:0/3990776028 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000ac820 con 0x7fd3e8004810 2023-10-06T03:06:31.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd3feffd700 1 -- 172.21.15.125:0/3990776028 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e800c160 con 0x7fd3e8003a60 2023-10-06T03:06:31.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd3feffd700 1 -- 172.21.15.125:0/3990776028 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e800c320 con 0x7fd3e80051c0 2023-10-06T03:06:31.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd3ff7fe700 1 --2- 172.21.15.125:0/3990776028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3e8004810 0x7fd3e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd3fffff700 1 --2- 172.21.15.125:0/3990776028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd3e8003a60 0x7fd3e8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.137 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.132+0000 7fd4048d1700 1 --2- 172.21.15.125:0/3990776028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3e80051c0 0x7fd3e800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.133+0000 7fd3ff7fe700 1 -- 172.21.15.125:0/3990776028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3e80051c0 msgr2=0x7fd3e800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:31.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.133+0000 7fd3ff7fe700 1 --2- 172.21.15.125:0/3990776028 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd3e80051c0 0x7fd3e800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.133+0000 7fd3ff7fe700 1 -- 172.21.15.125:0/3990776028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd3e8003a60 msgr2=0x7fd3e8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:31.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.133+0000 7fd3ff7fe700 1 --2- 172.21.15.125:0/3990776028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd3e8003a60 0x7fd3e8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.133+0000 7fd3ff7fe700 1 -- 172.21.15.125:0/3990776028 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e8003570 con 0x7fd3e8004810 2023-10-06T03:06:31.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.133+0000 7fd4048d1700 1 -- 172.21.15.125:0/3990776028 reap_dead start 2023-10-06T03:06:31.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.133+0000 7fd3ff7fe700 1 --2- 172.21.15.125:0/3990776028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3e8004810 0x7fd3e8004c80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40018b0 tx=0x7fd3f4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc01fa6d1bbbde51 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:31.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.133+0000 7fd3feffd700 1 -- 172.21.15.125:0/3990776028 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4012420 con 0x7fd3e8004810 2023-10-06T03:06:31.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.133+0000 7fd3feffd700 1 -- 172.21.15.125:0/3990776028 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f40125a0 con 0x7fd3e8004810 2023-10-06T03:06:31.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.133+0000 7fd3feffd700 1 -- 172.21.15.125:0/3990776028 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4012960 con 0x7fd3e8004810 2023-10-06T03:06:31.138 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.133+0000 7fd406334700 1 -- 172.21.15.125:0/3990776028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3e8004810 msgr2=0x7fd3e8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.133+0000 7fd406334700 1 --2- 172.21.15.125:0/3990776028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3e8004810 0x7fd3e8004c80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd3f40018b0 tx=0x7fd3f4007d30 comp rx=0 tx=0).stop 2023-10-06T03:06:31.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.133+0000 7fd406334700 1 -- 172.21.15.125:0/3990776028 shutdown_connections 2023-10-06T03:06:31.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.133+0000 7fd406334700 1 --2- 172.21.15.125:0/3990776028 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd3e8004810 0x7fd3e8004c80 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.133+0000 7fd406334700 1 -- 172.21.15.125:0/3990776028 >> 172.21.15.125:0/3990776028 conn(0x7fd4000cbd00 msgr2=0x7fd4000cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:31.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.133+0000 7fd406334700 1 -- 172.21.15.125:0/3990776028 shutdown_connections 2023-10-06T03:06:31.139 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.133+0000 7fd406334700 1 -- 172.21.15.125:0/3990776028 wait complete. 2023-10-06T03:06:31.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.134+0000 7fd406334700 1 Processor -- start 2023-10-06T03:06:31.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.135+0000 7fd406334700 1 -- start start 2023-10-06T03:06:31.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.135+0000 7fd406334700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd3e8004810 0x7fd4000aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.135+0000 7fd406334700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd4000aeff0 0x7fd4000b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.135+0000 7fd406334700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4000b0fa0 0x7fd4000b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.135+0000 7fd406334700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000af460 con 0x7fd4000b0fa0 2023-10-06T03:06:31.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.135+0000 7fd406334700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000b1960 con 0x7fd3e8004810 2023-10-06T03:06:31.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.135+0000 7fd406334700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000a8cf0 con 0x7fd4000aeff0 2023-10-06T03:06:31.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.136+0000 7fd4048d1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4000b0fa0 0x7fd4000b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.136+0000 7fd4048d1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4000b0fa0 0x7fd4000b1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44836/0 (socket says 172.21.15.125:44836) 2023-10-06T03:06:31.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.136+0000 7fd4048d1700 1 -- 172.21.15.125:0/334830692 learned_addr learned my addr 172.21.15.125:0/334830692 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:31.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.136+0000 7fd3ff7fe700 1 --2- 172.21.15.125:0/334830692 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd4000aeff0 0x7fd4000b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.136+0000 7fd3fffff700 1 --2- 172.21.15.125:0/334830692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd3e8004810 0x7fd4000aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.136+0000 7fd4048d1700 1 -- 172.21.15.125:0/334830692 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd4000aeff0 msgr2=0x7fd4000b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.136+0000 7fd4048d1700 1 --2- 172.21.15.125:0/334830692 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd4000aeff0 0x7fd4000b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.143 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.136+0000 7fd4048d1700 1 -- 172.21.15.125:0/334830692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd3e8004810 msgr2=0x7fd4000aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.136+0000 7fd4048d1700 1 --2- 172.21.15.125:0/334830692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd3e8004810 0x7fd4000aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.136+0000 7fd4048d1700 1 -- 172.21.15.125:0/334830692 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4000a8fd0 con 0x7fd4000b0fa0 2023-10-06T03:06:31.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.136+0000 7fd4048d1700 1 --2- 172.21.15.125:0/334830692 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4000b0fa0 0x7fd4000b1420 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd4000c6230 tx=0x7fd3f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:31.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.136+0000 7fd3e7fff700 1 -- 172.21.15.125:0/334830692 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f800e070 con 0x7fd4000b0fa0 2023-10-06T03:06:31.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.136+0000 7fd3e7fff700 1 -- 172.21.15.125:0/334830692 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f8011b80 con 0x7fd4000b0fa0 2023-10-06T03:06:31.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.136+0000 7fd406334700 1 -- 172.21.15.125:0/334830692 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4000a92b0 con 0x7fd4000b0fa0 2023-10-06T03:06:31.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.136+0000 7fd3e7fff700 1 -- 172.21.15.125:0/334830692 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8016470 con 0x7fd4000b0fa0 2023-10-06T03:06:31.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.136+0000 7fd406334700 1 -- 172.21.15.125:0/334830692 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4000a9ab0 con 0x7fd4000b0fa0 2023-10-06T03:06:31.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.137+0000 7fd406334700 1 -- 172.21.15.125:0/334830692 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd400066510 con 0x7fd4000b0fa0 2023-10-06T03:06:31.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.137+0000 7fd3e7fff700 1 -- 172.21.15.125:0/334830692 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd3f8016860 con 0x7fd4000b0fa0 2023-10-06T03:06:31.144 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.138+0000 7fd3e7fff700 1 --2- 172.21.15.125:0/334830692 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd3ec066f30 0x7fd3ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.138+0000 7fd3e7fff700 1 -- 172.21.15.125:0/334830692 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fd3f8085210 con 0x7fd4000b0fa0 2023-10-06T03:06:31.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.138+0000 7fd3fffff700 1 --2- 172.21.15.125:0/334830692 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd3ec066f30 0x7fd3ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.138+0000 7fd3fffff700 1 --2- 172.21.15.125:0/334830692 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd3ec066f30 0x7fd3ec0693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0007f70 tx=0x7fd3f0001e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:31.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.142+0000 7fd3e7fff700 1 -- 172.21.15.125:0/334830692 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3f80521e0 con 0x7fd4000b0fa0 2023-10-06T03:06:31.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.366+0000 7fd406334700 1 -- 172.21.15.125:0/334830692 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd40006a7c0 con 0x7fd4000b0fa0 2023-10-06T03:06:31.367 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.366+0000 7fd3e7fff700 1 -- 172.21.15.125:0/334830692 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4610 (secure 0 0 0) 0x7fd3f8055800 con 0x7fd4000b0fa0 2023-10-06T03:06:31.368 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:31.368 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/2151384589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2151384589},{"type":"v1","addr":"172.21.15.130:6834","nonce":2151384589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5299,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1214475159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1214475159},{"type":"v1","addr":"172.21.15.130:6835","nonce":1214475159}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/4005469649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":4005469649},{"type":"v1","addr":"172.21.15.125:6836","nonce":4005469649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:06:20.996155+0000","modified":"2023-10-06T03:06:24.636313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5556":{"gid":5556,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/1751632854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":1751632854},{"type":"v1","addr":"172.21.15.125:6837","nonce":1751632854}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:06:31.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.368+0000 7fd406334700 1 -- 172.21.15.125:0/334830692 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd3ec066f30 msgr2=0x7fd3ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.368+0000 7fd406334700 1 --2- 172.21.15.125:0/334830692 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd3ec066f30 0x7fd3ec0693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0007f70 tx=0x7fd3f0001e50 comp rx=0 tx=0).stop 2023-10-06T03:06:31.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.368+0000 7fd406334700 1 -- 172.21.15.125:0/334830692 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4000b0fa0 msgr2=0x7fd4000b1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.368+0000 7fd406334700 1 --2- 172.21.15.125:0/334830692 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4000b0fa0 0x7fd4000b1420 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd4000c6230 tx=0x7fd3f800b040 comp rx=0 tx=0).stop 2023-10-06T03:06:31.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.368+0000 7fd406334700 1 -- 172.21.15.125:0/334830692 shutdown_connections 2023-10-06T03:06:31.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.368+0000 7fd406334700 1 --2- 172.21.15.125:0/334830692 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd3ec066f30 0x7fd3ec0693e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.368+0000 7fd406334700 1 --2- 172.21.15.125:0/334830692 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd4000b0fa0 0x7fd4000b1420 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.370 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.368+0000 7fd406334700 1 --2- 172.21.15.125:0/334830692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd3e8004810 0x7fd4000aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.368+0000 7fd406334700 1 --2- 172.21.15.125:0/334830692 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd4000aeff0 0x7fd4000b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.368+0000 7fd406334700 1 -- 172.21.15.125:0/334830692 >> 172.21.15.125:0/334830692 conn(0x7fd4000cbd00 msgr2=0x7fd4000ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:31.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.368+0000 7fd406334700 1 -- 172.21.15.125:0/334830692 shutdown_connections 2023-10-06T03:06:31.371 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.368+0000 7fd406334700 1 -- 172.21.15.125:0/334830692 wait complete. 2023-10-06T03:06:31.371 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 27 2023-10-06T03:06:31.785 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T03:06:20.996155+0000', 'modified': '2023-10-06T03:06:24.636313+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5556}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5556': {'gid': 5556, 'name': 'a', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.125:6837/1751632854', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.125:6835', 'nonce': 1751632854}, {'type': 'v1', 'addr': '172.21.15.125:6837', 'nonce': 1751632854}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T03:06:31.785 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T03:06:31.785 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T03:06:31.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f31257700 1 Processor -- start 2023-10-06T03:06:31.907 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f31257700 1 -- start start 2023-10-06T03:06:31.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f31257700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f2c067d20 0x7f4f2c0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f31257700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2c0cafe0 con 0x7f4f2c0ca190 2023-10-06T03:06:31.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f31257700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2c0c3b40 con 0x7f4f2c0af320 2023-10-06T03:06:31.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f31257700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c0ca710 con 0x7f4f2c067d20 2023-10-06T03:06:31.911 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f2b59e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4f2c0ca190 0x7f4f2c0c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51628/0 (socket says 172.21.15.125:51628) 2023-10-06T03:06:31.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f2b59e700 1 -- 172.21.15.125:0/4027128159 learned_addr learned my addr 172.21.15.125:0/4027128159 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:31.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f2a59c700 1 --2- 172.21.15.125:0/4027128159 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f2c067d20 0x7f4f2c0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f29d9b700 1 -- 172.21.15.125:0/4027128159 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221007543 0 0) 0x7f4f24001490 con 0x7f4f2c0ca190 2023-10-06T03:06:31.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f29d9b700 1 -- 172.21.15.125:0/4027128159 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f14003570 con 0x7f4f2c0ca190 2023-10-06T03:06:31.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f29d9b700 1 -- 172.21.15.125:0/4027128159 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 876184008 0 0) 0x7f4f14003570 con 0x7f4f2c0ca190 2023-10-06T03:06:31.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f29d9b700 1 -- 172.21.15.125:0/4027128159 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f2c067d20 msgr2=0x7f4f2c0caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:31.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f29d9b700 1 --2- 172.21.15.125:0/4027128159 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f2c067d20 0x7f4f2c0caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f29d9b700 1 -- 172.21.15.125:0/4027128159 >> v1:172.21.15.130:6789/0 conn(0x7f4f2c0af320 legacy=0x7f4f2c067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f29d9b700 1 -- 172.21.15.125:0/4027128159 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c0cc750 con 0x7f4f2c0ca190 2023-10-06T03:06:31.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f29d9b700 1 -- 172.21.15.125:0/4027128159 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f4f24001980 con 0x7f4f2c0ca190 2023-10-06T03:06:31.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f29d9b700 1 -- 172.21.15.125:0/4027128159 >> v1:172.21.15.125:6789/0 conn(0x7f4f2c0ca190 legacy=0x7f4f2c0c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.912 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f29d9b700 1 --2- 172.21.15.125:0/4027128159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f14003a90 0x7f4f14003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f29d9b700 1 --2- 172.21.15.125:0/4027128159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f14004810 0x7f4f14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f29d9b700 1 --2- 172.21.15.125:0/4027128159 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f2c067d20 0x7f4f14005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f29d9b700 1 -- 172.21.15.125:0/4027128159 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c0ca710 con 0x7f4f14003a90 2023-10-06T03:06:31.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f29d9b700 1 -- 172.21.15.125:0/4027128159 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1400bc20 con 0x7f4f14004810 2023-10-06T03:06:31.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f29d9b700 1 -- 172.21.15.125:0/4027128159 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1400bde0 con 0x7f4f2c067d20 2023-10-06T03:06:31.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f2ad9d700 1 --2- 172.21.15.125:0/4027128159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f14003a90 0x7f4f14003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f2a59c700 1 --2- 172.21.15.125:0/4027128159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f14004810 0x7f4f14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.907+0000 7f4f2b59e700 1 --2- 172.21.15.125:0/4027128159 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f2c067d20 0x7f4f14005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.908+0000 7f4f2ad9d700 1 -- 172.21.15.125:0/4027128159 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f2c067d20 msgr2=0x7f4f14005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:31.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.908+0000 7f4f2ad9d700 1 --2- 172.21.15.125:0/4027128159 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f2c067d20 0x7f4f14005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.908+0000 7f4f2ad9d700 1 -- 172.21.15.125:0/4027128159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f14004810 msgr2=0x7f4f14004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:31.913 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.908+0000 7f4f2ad9d700 1 --2- 172.21.15.125:0/4027128159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f14004810 0x7f4f14004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.908+0000 7f4f2ad9d700 1 -- 172.21.15.125:0/4027128159 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f14003570 con 0x7f4f14003a90 2023-10-06T03:06:31.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.908+0000 7f4f2ad9d700 1 --2- 172.21.15.125:0/4027128159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f14003a90 0x7f4f14003ea0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c007fd0 tx=0x7f4f1c007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ed622d65dec27e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:31.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.908+0000 7f4f29d9b700 1 -- 172.21.15.125:0/4027128159 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c012420 con 0x7f4f14003a90 2023-10-06T03:06:31.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.908+0000 7f4f29d9b700 1 -- 172.21.15.125:0/4027128159 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1c012580 con 0x7f4f14003a90 2023-10-06T03:06:31.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.908+0000 7f4f29d9b700 1 -- 172.21.15.125:0/4027128159 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c012940 con 0x7f4f14003a90 2023-10-06T03:06:31.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.908+0000 7f4f31257700 1 -- 172.21.15.125:0/4027128159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f14003a90 msgr2=0x7f4f14003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.908+0000 7f4f31257700 1 --2- 172.21.15.125:0/4027128159 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f14003a90 0x7f4f14003ea0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c007fd0 tx=0x7f4f1c007d80 comp rx=0 tx=0).stop 2023-10-06T03:06:31.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.908+0000 7f4f2b59e700 1 -- 172.21.15.125:0/4027128159 reap_dead start 2023-10-06T03:06:31.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.908+0000 7f4f31257700 1 -- 172.21.15.125:0/4027128159 shutdown_connections 2023-10-06T03:06:31.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.908+0000 7f4f31257700 1 -- 172.21.15.125:0/4027128159 >> 172.21.15.125:0/4027128159 conn(0x7f4f2c096120 msgr2=0x7f4f2c068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:31.914 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.909+0000 7f4f31257700 1 -- 172.21.15.125:0/4027128159 shutdown_connections 2023-10-06T03:06:31.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.909+0000 7f4f31257700 1 -- 172.21.15.125:0/4027128159 wait complete. 2023-10-06T03:06:31.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.910+0000 7f4f31257700 1 Processor -- start 2023-10-06T03:06:31.915 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.910+0000 7f4f31257700 1 -- start start 2023-10-06T03:06:31.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.910+0000 7f4f31257700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f14003a90 0x7f4f2c0c6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.910+0000 7f4f31257700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f2c0b1b20 0x7f4f2c1692a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.910+0000 7f4f31257700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f2c0b1f90 0x7f4f2c1697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.910+0000 7f4f31257700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c0c5ed0 con 0x7f4f14003a90 2023-10-06T03:06:31.917 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.911+0000 7f4f31257700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c0c52c0 con 0x7f4f2c0b1f90 2023-10-06T03:06:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.911+0000 7f4f31257700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c0c55a0 con 0x7f4f2c0b1b20 2023-10-06T03:06:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.911+0000 7f4f2ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f14003a90 0x7f4f2c0c6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.911+0000 7f4f2ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f14003a90 0x7f4f2c0c6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44868/0 (socket says 172.21.15.125:44868) 2023-10-06T03:06:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.911+0000 7f4f2ad9d700 1 -- 172.21.15.125:0/3796334837 learned_addr learned my addr 172.21.15.125:0/3796334837 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.911+0000 7f4f2a59c700 1 --2- 172.21.15.125:0/3796334837 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f2c0b1b20 0x7f4f2c1692a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.911+0000 7f4f2b59e700 1 --2- 172.21.15.125:0/3796334837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f2c0b1f90 0x7f4f2c1697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.911+0000 7f4f2ad9d700 1 -- 172.21.15.125:0/3796334837 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f2c0b1b20 msgr2=0x7f4f2c1692a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.911+0000 7f4f2ad9d700 1 --2- 172.21.15.125:0/3796334837 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f2c0b1b20 0x7f4f2c1692a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.911+0000 7f4f2ad9d700 1 -- 172.21.15.125:0/3796334837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f2c0b1f90 msgr2=0x7f4f2c1697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.911+0000 7f4f2ad9d700 1 --2- 172.21.15.125:0/3796334837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f2c0b1f90 0x7f4f2c1697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.918 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.911+0000 7f4f2ad9d700 1 -- 172.21.15.125:0/3796334837 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c0c5880 con 0x7f4f14003a90 2023-10-06T03:06:31.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.911+0000 7f4f2ad9d700 1 --2- 172.21.15.125:0/3796334837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f14003a90 0x7f4f2c0c6360 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400bbf0 tx=0x7f4f1c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:31.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.911+0000 7f4f12ffd700 1 -- 172.21.15.125:0/3796334837 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c012cb0 con 0x7f4f14003a90 2023-10-06T03:06:31.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.911+0000 7f4f12ffd700 1 -- 172.21.15.125:0/3796334837 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1c012e10 con 0x7f4f14003a90 2023-10-06T03:06:31.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.911+0000 7f4f31257700 1 -- 172.21.15.125:0/3796334837 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c0c5b60 con 0x7f4f14003a90 2023-10-06T03:06:31.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.911+0000 7f4f12ffd700 1 -- 172.21.15.125:0/3796334837 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c012940 con 0x7f4f14003a90 2023-10-06T03:06:31.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.911+0000 7f4f31257700 1 -- 172.21.15.125:0/3796334837 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2c0c4f50 con 0x7f4f14003a90 2023-10-06T03:06:31.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.913+0000 7f4f12ffd700 1 -- 172.21.15.125:0/3796334837 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f1c01f620 con 0x7f4f14003a90 2023-10-06T03:06:31.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.913+0000 7f4f12ffd700 1 --2- 172.21.15.125:0/3796334837 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4f18066f30 0x7f4f180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.913+0000 7f4f2a59c700 1 --2- 172.21.15.125:0/3796334837 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4f18066f30 0x7f4f180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.913+0000 7f4f12ffd700 1 -- 172.21.15.125:0/3796334837 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4f1c0860d0 con 0x7f4f14003a90 2023-10-06T03:06:31.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.914+0000 7f4f2a59c700 1 --2- 172.21.15.125:0/3796334837 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4f18066f30 0x7f4f180693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0635f0 tx=0x7f4f200091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:31.919 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.915+0000 7f4f3a56bb80 1 Processor -- start 2023-10-06T03:06:31.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f3a56bb80 1 -- start start 2023-10-06T03:06:31.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f3a56bb80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343ff770 0x55f7343ffb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f3a56bb80 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f734449370 0x55f7344009f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f3a56bb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f7343fa260 0x55f7343fa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f3a56bb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f734318310 con 0x55f7343fa260 2023-10-06T03:06:31.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f3a56bb80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f734355130 con 0x55f7343ff770 2023-10-06T03:06:31.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f3a56bb80 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f734352af0 con 0x55f734449370 2023-10-06T03:06:31.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f2b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f7343fa260 0x55f7343fa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f2b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f7343fa260 0x55f7343fa6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44884/0 (socket says 172.21.15.125:44884) 2023-10-06T03:06:31.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f2b59e700 1 -- 172.21.15.125:0/2347120033 learned_addr learned my addr 172.21.15.125:0/2347120033 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:31.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f2ad9d700 1 --2- 172.21.15.125:0/2347120033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343ff770 0x55f7343ffb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f2a59c700 1 --2- 172.21.15.125:0/2347120033 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f734449370 0x55f7344009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f2b59e700 1 -- 172.21.15.125:0/2347120033 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f734449370 msgr2=0x55f7344009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:31.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f2b59e700 1 --2- 172.21.15.125:0/2347120033 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f734449370 0x55f7344009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f2b59e700 1 -- 172.21.15.125:0/2347120033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343ff770 msgr2=0x55f7343ffb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:31.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f2b59e700 1 --2- 172.21.15.125:0/2347120033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343ff770 0x55f7343ffb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f2b59e700 1 -- 172.21.15.125:0/2347120033 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f734154790 con 0x55f7343fa260 2023-10-06T03:06:31.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f2ad9d700 1 --2- 172.21.15.125:0/2347120033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343ff770 0x55f7343ffb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:31.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f2b59e700 1 --2- 172.21.15.125:0/2347120033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f7343fa260 0x55f7343fa6d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0cc1f0 tx=0x7f4f24006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9f12f780b0e593 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:31.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f0bfff700 1 -- 172.21.15.125:0/2347120033 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2400acf0 con 0x55f7343fa260 2023-10-06T03:06:31.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f0bfff700 1 -- 172.21.15.125:0/2347120033 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2400ae50 con 0x55f7343fa260 2023-10-06T03:06:31.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.917+0000 7f4f0bfff700 1 -- 172.21.15.125:0/2347120033 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f24007340 con 0x55f7343fa260 2023-10-06T03:06:31.927 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.918+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/2347120033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f7343fa260 msgr2=0x55f7343fa6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.918+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/2347120033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f7343fa260 0x55f7343fa6d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0cc1f0 tx=0x7f4f24006040 comp rx=0 tx=0).stop 2023-10-06T03:06:31.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.918+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/2347120033 shutdown_connections 2023-10-06T03:06:31.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.918+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/2347120033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f7343fa260 0x55f7343fa6d0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.918+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/2347120033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343ff770 0x55f7343ffb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.918+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/2347120033 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f734449370 0x55f7344009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.918+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/2347120033 >> 172.21.15.125:0/2347120033 conn(0x55f734448890 msgr2=0x55f734448c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:31.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.918+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/2347120033 shutdown_connections 2023-10-06T03:06:31.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.918+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/2347120033 wait complete. 2023-10-06T03:06:31.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.919+0000 7f4f3a56bb80 1 -- start start 2023-10-06T03:06:31.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.919+0000 7f4f3a56bb80 1 Processor -- start 2023-10-06T03:06:31.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f3a56bb80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343fa260 0x55f734425940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f3a56bb80 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f7343ff770 0x55f734427370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f3a56bb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f734449370 0x55f734454a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f3a56bb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f73434e8e0 con 0x55f734449370 2023-10-06T03:06:31.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f3a56bb80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7342fa980 con 0x55f7343fa260 2023-10-06T03:06:31.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f3a56bb80 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f7342fa620 con 0x55f7343ff770 2023-10-06T03:06:31.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f3a56bb80 10 client.0 _ll_register_callbacks cb 0x55f73415da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:06:31.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f2b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f734449370 0x55f734454a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f2b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f734449370 0x55f734454a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44890/0 (socket says 172.21.15.125:44890) 2023-10-06T03:06:31.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f2b59e700 1 -- 172.21.15.125:0/3169996755 learned_addr learned my addr 172.21.15.125:0/3169996755 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:31.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f2ad9d700 1 --2- 172.21.15.125:0/3169996755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343fa260 0x55f734425940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f2a59c700 1 --2- 172.21.15.125:0/3169996755 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f7343ff770 0x55f734427370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f2b59e700 1 -- 172.21.15.125:0/3169996755 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f7343ff770 msgr2=0x55f734427370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:31.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f2b59e700 1 --2- 172.21.15.125:0/3169996755 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f7343ff770 0x55f734427370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f2b59e700 1 -- 172.21.15.125:0/3169996755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343fa260 msgr2=0x55f734425940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:31.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f2b59e700 1 --2- 172.21.15.125:0/3169996755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343fa260 0x55f734425940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f2b59e700 1 -- 172.21.15.125:0/3169996755 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2c0cc750 con 0x55f734449370 2023-10-06T03:06:31.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f2a59c700 1 --2- 172.21.15.125:0/3169996755 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f7343ff770 0x55f734427370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:31.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f2b59e700 1 --2- 172.21.15.125:0/3169996755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f734449370 0x55f734454a20 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4f24002250 tx=0x7f4f24016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff795c74f36b433 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:31.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f097fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-06T03:06:31.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f097fa700 1 -- 172.21.15.125:0/3169996755 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f24007a40 con 0x55f734449370 2023-10-06T03:06:31.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/3169996755 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f7343f2e50 con 0x55f734449370 2023-10-06T03:06:31.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f097fa700 1 -- 172.21.15.125:0/3169996755 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4f24015440 con 0x55f734449370 2023-10-06T03:06:31.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f097fa700 1 -- 172.21.15.125:0/3169996755 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f24015810 con 0x55f734449370 2023-10-06T03:06:31.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f3a56bb80 10 client.5742 fetch_fsmap learned FSMap version 27 2023-10-06T03:06:31.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.920+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/3169996755 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x55f7342410a0 con 0x55f734449370 2023-10-06T03:06:31.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.921+0000 7f4f097fa700 1 -- 172.21.15.125:0/3169996755 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f7343f2e50 con 0x55f734449370 2023-10-06T03:06:31.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.921+0000 7f4f097fa700 1 -- 172.21.15.125:0/3169996755 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4f24012070 con 0x55f734449370 2023-10-06T03:06:31.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.921+0000 7f4f3a56bb80 10 client.5742 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T03:06:31.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.921+0000 7f4f3a56bb80 10 client.5742 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:06:31.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.921+0000 7f4f3a56bb80 20 client.5742 populate_metadata read hostname 'smithi125' 2023-10-06T03:06:31.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.921+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/3169996755 >> [v2:172.21.15.125:6835/1751632854,v1:172.21.15.125:6837/1751632854] conn(0x55f7343fa650 0x55f7343faa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.921+0000 7f4f3a56bb80 4 client.5742 mds_command: new command op to 5556 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T03:06:31.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.921+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/3169996755 --> [v2:172.21.15.125:6835/1751632854,v1:172.21.15.125:6837/1751632854] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f7343cfc20 con 0x55f7343fa650 2023-10-06T03:06:31.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.921+0000 7f4f2ad9d700 1 --2- 172.21.15.125:0/3169996755 >> [v2:172.21.15.125:6835/1751632854,v1:172.21.15.125:6837/1751632854] conn(0x55f7343fa650 0x55f7343faa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.921+0000 7f4f097fa700 10 client.5742 ms_handle_connect on v2:172.21.15.125:6835/1751632854 2023-10-06T03:06:31.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.921+0000 7f4f2ad9d700 1 --2- 172.21.15.125:0/3169996755 >> [v2:172.21.15.125:6835/1751632854,v1:172.21.15.125:6837/1751632854] conn(0x55f7343fa650 0x55f7343faa20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f0859151e01dd54 server_cookie=31f14a6c68d5bf64 in_seq=0 out_seq=0 2023-10-06T03:06:31.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.922+0000 7f4f097fa700 1 -- 172.21.15.125:0/3169996755 <== mds.0 v2:172.21.15.125:6835/1751632854 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f7343cfc20 con 0x55f7343fa650 2023-10-06T03:06:31.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.922+0000 7f4f097fa700 10 client.5742 handle_command_reply: tid=0 2023-10-06T03:06:31.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.922+0000 7f4f3a56bb80 1 client.5742 shutdown 2023-10-06T03:06:31.932 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.922+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/3169996755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f734449370 msgr2=0x55f734454a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.922+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/3169996755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f734449370 0x55f734454a20 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4f24002250 tx=0x7f4f24016000 comp rx=0 tx=0).stop 2023-10-06T03:06:31.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.922+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/3169996755 shutdown_connections 2023-10-06T03:06:31.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.922+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/3169996755 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f734449370 0x55f734454a20 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.922+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/3169996755 >> [v2:172.21.15.125:6835/1751632854,v1:172.21.15.125:6837/1751632854] conn(0x55f7343fa650 0x55f7343faa20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.922+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/3169996755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343fa260 0x55f734425940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.922+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/3169996755 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f7343ff770 0x55f734427370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.922+0000 7f4f097fa700 0 client.5742 ms_handle_reset on v2:172.21.15.125:6835/1751632854 2023-10-06T03:06:31.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.922+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/3169996755 >> 172.21.15.125:0/3169996755 conn(0x55f734448890 msgr2=0x55f734445f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:31.933 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.922+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/3169996755 shutdown_connections 2023-10-06T03:06:31.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.922+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/3169996755 wait complete. 2023-10-06T03:06:31.934 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.922+0000 7f4f3a56bb80 20 client.5742 trim_cache size 0 max 16384 2023-10-06T03:06:31.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.939+0000 7f4f3a56bb80 1 Processor -- start 2023-10-06T03:06:31.940 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.939+0000 7f4f3a56bb80 1 -- start start 2023-10-06T03:06:31.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.940+0000 7f4f3a56bb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f7343fa260 0x55f734423220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.940+0000 7f4f3a56bb80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343ff770 0x55f7343faa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.940+0000 7f4f3a56bb80 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f734449370 0x55f7343f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.940+0000 7f4f3a56bb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7341e61e0 con 0x55f7343fa260 2023-10-06T03:06:31.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.940+0000 7f4f3a56bb80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f734454d80 con 0x55f7343ff770 2023-10-06T03:06:31.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.940+0000 7f4f3a56bb80 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f73442de60 con 0x55f734449370 2023-10-06T03:06:31.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.940+0000 7f4f2ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f7343fa260 0x55f734423220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.943 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.940+0000 7f4f2ad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f7343fa260 0x55f734423220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44896/0 (socket says 172.21.15.125:44896) 2023-10-06T03:06:31.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.940+0000 7f4f2ad9d700 1 -- 172.21.15.125:0/2377965054 learned_addr learned my addr 172.21.15.125:0/2377965054 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:31.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.940+0000 7f4f2ad9d700 1 -- 172.21.15.125:0/2377965054 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f734449370 msgr2=0x55f7343f49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:31.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.940+0000 7f4f2a59c700 1 --2- 172.21.15.125:0/2377965054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343ff770 0x55f7343faa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.940+0000 7f4f2ad9d700 1 --2- 172.21.15.125:0/2377965054 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f734449370 0x55f7343f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.940+0000 7f4f2ad9d700 1 -- 172.21.15.125:0/2377965054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343ff770 msgr2=0x55f7343faa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:31.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.940+0000 7f4f2ad9d700 1 --2- 172.21.15.125:0/2377965054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343ff770 0x55f7343faa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.940+0000 7f4f2ad9d700 1 -- 172.21.15.125:0/2377965054 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f734457740 con 0x55f7343fa260 2023-10-06T03:06:31.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.940+0000 7f4f2ad9d700 1 --2- 172.21.15.125:0/2377965054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f7343fa260 0x55f734423220 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c053280 tx=0x7f4f1c021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46e4ebfba321bd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:31.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.940+0000 7f4f10ff9700 1 -- 172.21.15.125:0/2377965054 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c05c0b0 con 0x55f7343fa260 2023-10-06T03:06:31.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.940+0000 7f4f10ff9700 1 -- 172.21.15.125:0/2377965054 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1c057480 con 0x55f7343fa260 2023-10-06T03:06:31.944 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.940+0000 7f4f10ff9700 1 -- 172.21.15.125:0/2377965054 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c056d80 con 0x55f7343fa260 2023-10-06T03:06:31.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.941+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/2377965054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f7343fa260 msgr2=0x55f734423220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.941+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/2377965054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f7343fa260 0x55f734423220 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c053280 tx=0x7f4f1c021040 comp rx=0 tx=0).stop 2023-10-06T03:06:31.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.941+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/2377965054 shutdown_connections 2023-10-06T03:06:31.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.941+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/2377965054 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f734449370 0x55f7343f49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.941+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/2377965054 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f7343fa260 0x55f734423220 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.941+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/2377965054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343ff770 0x55f7343faa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.941+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/2377965054 >> 172.21.15.125:0/2377965054 conn(0x55f734448890 msgr2=0x55f734448c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:31.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.941+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/2377965054 shutdown_connections 2023-10-06T03:06:31.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.941+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/2377965054 wait complete. 2023-10-06T03:06:31.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.941+0000 7f4f3a56bb80 1 -- start start 2023-10-06T03:06:31.945 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.941+0000 7f4f3a56bb80 1 Processor -- start 2023-10-06T03:06:31.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.942+0000 7f4f3a56bb80 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343fa260 0x55f73441dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.942+0000 7f4f3a56bb80 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f7343ff770 0x55f73449e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.949 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.942+0000 7f4f3a56bb80 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f734449370 0x55f7343fff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.942+0000 7f4f3a56bb80 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f73441e700 con 0x55f734449370 2023-10-06T03:06:31.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.942+0000 7f4f3a56bb80 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f73449f350 con 0x55f7343fa260 2023-10-06T03:06:31.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.942+0000 7f4f3a56bb80 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f7344a13a0 con 0x55f7343ff770 2023-10-06T03:06:31.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.942+0000 7f4f3a56bb80 10 client.0 _ll_register_callbacks cb 0x55f73415da00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T03:06:31.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.942+0000 7f4f2b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f734449370 0x55f7343fff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.942+0000 7f4f2b59e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f734449370 0x55f7343fff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44900/0 (socket says 172.21.15.125:44900) 2023-10-06T03:06:31.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.942+0000 7f4f2b59e700 1 -- 172.21.15.125:0/1565377542 learned_addr learned my addr 172.21.15.125:0/1565377542 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:31.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f2ad9d700 1 --2- 172.21.15.125:0/1565377542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343fa260 0x55f73441dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f2a59c700 1 --2- 172.21.15.125:0/1565377542 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f7343ff770 0x55f73449e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f2b59e700 1 -- 172.21.15.125:0/1565377542 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f7343ff770 msgr2=0x55f73449e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:31.950 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f2b59e700 1 --2- 172.21.15.125:0/1565377542 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f7343ff770 0x55f73449e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f2b59e700 1 -- 172.21.15.125:0/1565377542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343fa260 msgr2=0x55f73441dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:31.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f2b59e700 1 --2- 172.21.15.125:0/1565377542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343fa260 0x55f73441dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f2b59e700 1 -- 172.21.15.125:0/1565377542 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2c0c4f50 con 0x55f734449370 2023-10-06T03:06:31.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f2b59e700 1 --2- 172.21.15.125:0/1565377542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f734449370 0x55f7343fff20 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4f24021930 tx=0x7f4f24023040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52857e202a5daef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:31.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f097fa700 10 client.0 ms_handle_connect on v2:172.21.15.125:3300/0 2023-10-06T03:06:31.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f097fa700 1 -- 172.21.15.125:0/1565377542 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f240076b0 con 0x55f734449370 2023-10-06T03:06:31.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f097fa700 1 -- 172.21.15.125:0/1565377542 <== mon.0 v2:172.21.15.125:3300/0 2 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f4f24015440 con 0x55f734449370 2023-10-06T03:06:31.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/1565377542 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f73442e840 con 0x55f734449370 2023-10-06T03:06:31.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f097fa700 1 -- 172.21.15.125:0/1565377542 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f24015d30 con 0x55f734449370 2023-10-06T03:06:31.951 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f3a56bb80 10 client.5748 fetch_fsmap learned FSMap version 27 2023-10-06T03:06:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/1565377542 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x55f73431d3c0 con 0x55f734449370 2023-10-06T03:06:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f097fa700 1 -- 172.21.15.125:0/1565377542 <== mon.0 v2:172.21.15.125:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f73442e840 con 0x55f734449370 2023-10-06T03:06:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f097fa700 1 -- 172.21.15.125:0/1565377542 <== mon.0 v2:172.21.15.125:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4f24015a10 con 0x55f734449370 2023-10-06T03:06:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f3a56bb80 10 client.5748 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T03:06:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f3a56bb80 10 client.5748 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T03:06:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f3a56bb80 20 client.5748 populate_metadata read hostname 'smithi125' 2023-10-06T03:06:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/1565377542 >> [v2:172.21.15.125:6835/1751632854,v1:172.21.15.125:6837/1751632854] conn(0x55f7344a1830 0x55f7344a1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f3a56bb80 4 client.5748 mds_command: new command op to 5556 tid=0[{"prefix": "status"}] 2023-10-06T03:06:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.943+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/1565377542 --> [v2:172.21.15.125:6835/1751632854,v1:172.21.15.125:6837/1751632854] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f4f2400ae50 con 0x55f7344a1830 2023-10-06T03:06:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.944+0000 7f4f2ad9d700 1 --2- 172.21.15.125:0/1565377542 >> [v2:172.21.15.125:6835/1751632854,v1:172.21.15.125:6837/1751632854] conn(0x55f7344a1830 0x55f7344a1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:31.952 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.944+0000 7f4f097fa700 10 client.5748 ms_handle_connect on v2:172.21.15.125:6835/1751632854 2023-10-06T03:06:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.944+0000 7f4f2ad9d700 1 --2- 172.21.15.125:0/1565377542 >> [v2:172.21.15.125:6835/1751632854,v1:172.21.15.125:6837/1751632854] conn(0x55f7344a1830 0x55f7344a1c00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26de84a89a353d60 server_cookie=1d8ccb0c169a7714 in_seq=0 out_seq=0 2023-10-06T03:06:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.944+0000 7f4f097fa700 1 -- 172.21.15.125:0/1565377542 <== mds.0 v2:172.21.15.125:6835/1751632854 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f4f2400ae50 con 0x55f7344a1830 2023-10-06T03:06:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.944+0000 7f4f097fa700 10 client.5748 handle_command_reply: tid=0 2023-10-06T03:06:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.944+0000 7f4f3a56bb80 1 client.5748 shutdown 2023-10-06T03:06:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.944+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/1565377542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f734449370 msgr2=0x55f7343fff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.944+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/1565377542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f734449370 0x55f7343fff20 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4f24021930 tx=0x7f4f24023040 comp rx=0 tx=0).stop 2023-10-06T03:06:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.944+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/1565377542 shutdown_connections 2023-10-06T03:06:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.944+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/1565377542 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x55f734449370 0x55f7343fff20 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.944+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/1565377542 >> [v2:172.21.15.125:6835/1751632854,v1:172.21.15.125:6837/1751632854] conn(0x55f7344a1830 0x55f7344a1c00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.953 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.944+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/1565377542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f7343fa260 0x55f73441dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.944+0000 7f4f3a56bb80 1 --2- 172.21.15.125:0/1565377542 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x55f7343ff770 0x55f73449e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.944+0000 7f4f097fa700 0 client.5748 ms_handle_reset on v2:172.21.15.125:6835/1751632854 2023-10-06T03:06:31.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.944+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/1565377542 >> 172.21.15.125:0/1565377542 conn(0x55f734448890 msgr2=0x55f7343f49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:31.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.944+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/1565377542 shutdown_connections 2023-10-06T03:06:31.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.944+0000 7f4f3a56bb80 1 -- 172.21.15.125:0/1565377542 wait complete. 2023-10-06T03:06:31.954 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.944+0000 7f4f3a56bb80 20 client.5748 trim_cache size 0 max 16384 2023-10-06T03:06:31.954 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:06:31.954 INFO:teuthology.orchestra.run.smithi125.stdout: "cluster_fsid": "c8556660-0880-4430-a03a-c140780d46e7", 2023-10-06T03:06:31.955 INFO:teuthology.orchestra.run.smithi125.stdout: "whoami": 0, 2023-10-06T03:06:31.955 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 5556, 2023-10-06T03:06:31.955 INFO:teuthology.orchestra.run.smithi125.stdout: "want_state": "up:active", 2023-10-06T03:06:31.955 INFO:teuthology.orchestra.run.smithi125.stdout: "state": "up:active", 2023-10-06T03:06:31.955 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs", 2023-10-06T03:06:31.955 INFO:teuthology.orchestra.run.smithi125.stdout: "rank_uptime": 10.336254009999999, 2023-10-06T03:06:31.955 INFO:teuthology.orchestra.run.smithi125.stdout: "mdsmap_epoch": 27, 2023-10-06T03:06:31.955 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch": 57, 2023-10-06T03:06:31.955 INFO:teuthology.orchestra.run.smithi125.stdout: "osdmap_epoch_barrier": 57, 2023-10-06T03:06:31.955 INFO:teuthology.orchestra.run.smithi125.stdout: "uptime": 16.439356844999999 2023-10-06T03:06:31.955 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:06:31.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.945+0000 7f4f31257700 1 -- 172.21.15.125:0/3796334837 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4f18066f30 msgr2=0x7f4f180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.956 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.945+0000 7f4f31257700 1 --2- 172.21.15.125:0/3796334837 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4f18066f30 0x7f4f180693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0635f0 tx=0x7f4f200091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.945+0000 7f4f31257700 1 -- 172.21.15.125:0/3796334837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f14003a90 msgr2=0x7f4f2c0c6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:31.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.945+0000 7f4f31257700 1 --2- 172.21.15.125:0/3796334837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f14003a90 0x7f4f2c0c6360 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400bbf0 tx=0x7f4f1c015000 comp rx=0 tx=0).stop 2023-10-06T03:06:31.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.945+0000 7f4f31257700 1 -- 172.21.15.125:0/3796334837 shutdown_connections 2023-10-06T03:06:31.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.945+0000 7f4f31257700 1 --2- 172.21.15.125:0/3796334837 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4f18066f30 0x7f4f180693e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.945+0000 7f4f31257700 1 --2- 172.21.15.125:0/3796334837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4f2c0b1f90 0x7f4f2c1697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.945+0000 7f4f31257700 1 --2- 172.21.15.125:0/3796334837 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4f14003a90 0x7f4f2c0c6360 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.945+0000 7f4f31257700 1 --2- 172.21.15.125:0/3796334837 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4f2c0b1b20 0x7f4f2c1692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:31.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.945+0000 7f4f31257700 1 -- 172.21.15.125:0/3796334837 >> 172.21.15.125:0/3796334837 conn(0x7f4f2c096120 msgr2=0x7f4f2c1585e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:31.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.945+0000 7f4f31257700 1 -- 172.21.15.125:0/3796334837 shutdown_connections 2023-10-06T03:06:31.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:31.945+0000 7f4f31257700 1 -- 172.21.15.125:0/3796334837 wait complete. 2023-10-06T03:06:31.958 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:06:32.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.075+0000 7f31ff507700 1 Processor -- start 2023-10-06T03:06:32.076 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.075+0000 7f31ff507700 1 -- start start 2023-10-06T03:06:32.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.075+0000 7f31ff507700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f31f80af320 0x7f31f80c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:32.078 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.075+0000 7f31ff507700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31f8067d20 0x7f31f80c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:32.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.075+0000 7f31ff507700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f80caa40 con 0x7f31f80cc5a0 2023-10-06T03:06:32.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.075+0000 7f31ff507700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f80c1ca0 con 0x7f31f80af320 2023-10-06T03:06:32.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.075+0000 7f31ff507700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f80cca60 con 0x7f31f8067d20 2023-10-06T03:06:32.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.076+0000 7f31fd2a3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f31f80af320 0x7f31f80c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:32.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.076+0000 7f31fd2a3700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f31f80af320 0x7f31f80c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44916/0 (socket says 172.21.15.125:44916) 2023-10-06T03:06:32.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.076+0000 7f31fcaa2700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f31f80cc5a0 0x7f31f8067610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:51640/0 (socket says 172.21.15.125:51640) 2023-10-06T03:06:32.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.076+0000 7f31fd2a3700 1 -- 172.21.15.125:0/3770036536 learned_addr learned my addr 172.21.15.125:0/3770036536 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:32.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.076+0000 7f31fdaa4700 1 --2- 172.21.15.125:0/3770036536 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31f8067d20 0x7f31f80c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:32.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.076+0000 7f31fd2a3700 1 -- 172.21.15.125:0/3770036536 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31f8067d20 msgr2=0x7f31f80c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:32.079 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.076+0000 7f31fd2a3700 1 --2- 172.21.15.125:0/3770036536 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31f8067d20 0x7f31f80c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:32.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.076+0000 7f31fd2a3700 1 -- 172.21.15.125:0/3770036536 >> v1:172.21.15.125:6789/0 conn(0x7f31f80cc5a0 legacy=0x7f31f8067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:32.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.076+0000 7f31fd2a3700 1 -- 172.21.15.125:0/3770036536 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f80cac90 con 0x7f31f80af320 2023-10-06T03:06:32.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.076+0000 7f31ebfff700 1 -- 172.21.15.125:0/3770036536 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000476024 0 0) 0x7f31f80caa40 con 0x7f31f80cc5a0 2023-10-06T03:06:32.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.076+0000 7f31fdaa4700 1 --2- 172.21.15.125:0/3770036536 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31f8067d20 0x7f31f80c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:32.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.076+0000 7f31fd2a3700 1 --2- 172.21.15.125:0/3770036536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31f80af320 0x7f31f80c8ed0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f31ec009990 tx=0x7f31ec009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56057bc1abeb6aea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:32.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.076+0000 7f31ebfff700 1 -- 172.21.15.125:0/3770036536 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec005c10 con 0x7f31f80af320 2023-10-06T03:06:32.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.076+0000 7f31ebfff700 1 -- 172.21.15.125:0/3770036536 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec005d70 con 0x7f31f80af320 2023-10-06T03:06:32.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.076+0000 7f31ebfff700 1 -- 172.21.15.125:0/3770036536 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec00b880 con 0x7f31f80af320 2023-10-06T03:06:32.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.077+0000 7f31ff507700 1 -- 172.21.15.125:0/3770036536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31f80af320 msgr2=0x7f31f80c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:32.080 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.077+0000 7f31ff507700 1 --2- 172.21.15.125:0/3770036536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31f80af320 0x7f31f80c8ed0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f31ec009990 tx=0x7f31ec009220 comp rx=0 tx=0).stop 2023-10-06T03:06:32.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.077+0000 7f31ff507700 1 -- 172.21.15.125:0/3770036536 shutdown_connections 2023-10-06T03:06:32.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.077+0000 7f31ff507700 1 --2- 172.21.15.125:0/3770036536 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31f8067d20 0x7f31f80c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:32.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.077+0000 7f31ff507700 1 --2- 172.21.15.125:0/3770036536 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31f80af320 0x7f31f80c8ed0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:32.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.077+0000 7f31ff507700 1 -- 172.21.15.125:0/3770036536 >> 172.21.15.125:0/3770036536 conn(0x7f31f8068f00 msgr2=0x7f31f80cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:32.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.077+0000 7f31ff507700 1 -- 172.21.15.125:0/3770036536 shutdown_connections 2023-10-06T03:06:32.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.077+0000 7f31ff507700 1 -- 172.21.15.125:0/3770036536 wait complete. 2023-10-06T03:06:32.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.078+0000 7f31ff507700 1 Processor -- start 2023-10-06T03:06:32.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.078+0000 7f31ff507700 1 -- start start 2023-10-06T03:06:32.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.079+0000 7f31ff507700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31f8067d20 0x7f31f80afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:32.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.079+0000 7f31ff507700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31f80af320 0x7f31f8150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:32.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.079+0000 7f31ff507700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31f80cc5a0 0x7f31f80b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:32.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.079+0000 7f31ff507700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f80c5d20 con 0x7f31f80cc5a0 2023-10-06T03:06:32.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.079+0000 7f31ff507700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f8151510 con 0x7f31f8067d20 2023-10-06T03:06:32.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.079+0000 7f31ff507700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f80b23d0 con 0x7f31f80af320 2023-10-06T03:06:32.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.080+0000 7f31fdaa4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31f80cc5a0 0x7f31f80b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:32.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.080+0000 7f31fdaa4700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31f80cc5a0 0x7f31f80b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44924/0 (socket says 172.21.15.125:44924) 2023-10-06T03:06:32.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.080+0000 7f31fdaa4700 1 -- 172.21.15.125:0/1637525531 learned_addr learned my addr 172.21.15.125:0/1637525531 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:32.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.080+0000 7f31fd2a3700 1 --2- 172.21.15.125:0/1637525531 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31f8067d20 0x7f31f80afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:32.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.080+0000 7f31fdaa4700 1 -- 172.21.15.125:0/1637525531 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31f80af320 msgr2=0x7f31f8150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:32.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.080+0000 7f31fdaa4700 1 --2- 172.21.15.125:0/1637525531 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31f80af320 0x7f31f8150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:32.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.080+0000 7f31fdaa4700 1 -- 172.21.15.125:0/1637525531 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31f8067d20 msgr2=0x7f31f80afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:32.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.080+0000 7f31fdaa4700 1 --2- 172.21.15.125:0/1637525531 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31f8067d20 0x7f31f80afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:32.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.080+0000 7f31fdaa4700 1 -- 172.21.15.125:0/1637525531 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec009480 con 0x7f31f80cc5a0 2023-10-06T03:06:32.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.080+0000 7f31fdaa4700 1 --2- 172.21.15.125:0/1637525531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31f80cc5a0 0x7f31f80b1a10 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f31f0007f60 tx=0x7f31f0009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:32.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.080+0000 7f31e97fa700 1 -- 172.21.15.125:0/1637525531 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f000dce0 con 0x7f31f80cc5a0 2023-10-06T03:06:32.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.080+0000 7f31e97fa700 1 -- 172.21.15.125:0/1637525531 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f000f040 con 0x7f31f80cc5a0 2023-10-06T03:06:32.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.080+0000 7f31ff507700 1 -- 172.21.15.125:0/1637525531 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f80b26b0 con 0x7f31f80cc5a0 2023-10-06T03:06:32.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.080+0000 7f31e97fa700 1 -- 172.21.15.125:0/1637525531 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0015690 con 0x7f31f80cc5a0 2023-10-06T03:06:32.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.080+0000 7f31ff507700 1 -- 172.21.15.125:0/1637525531 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f80c59b0 con 0x7f31f80cc5a0 2023-10-06T03:06:32.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.081+0000 7f31ff507700 1 -- 172.21.15.125:0/1637525531 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f80c5810 con 0x7f31f80cc5a0 2023-10-06T03:06:32.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.081+0000 7f31e97fa700 1 -- 172.21.15.125:0/1637525531 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31f001e3b0 con 0x7f31f80cc5a0 2023-10-06T03:06:32.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.082+0000 7f31e97fa700 1 --2- 172.21.15.125:0/1637525531 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f31dc066f30 0x7f31dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:32.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.082+0000 7f31fd2a3700 1 --2- 172.21.15.125:0/1637525531 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f31dc066f30 0x7f31dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:32.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.082+0000 7f31e97fa700 1 -- 172.21.15.125:0/1637525531 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f31f0084d50 con 0x7f31f80cc5a0 2023-10-06T03:06:32.086 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.082+0000 7f31fd2a3700 1 --2- 172.21.15.125:0/1637525531 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f31dc066f30 0x7f31dc0693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f31ec009990 tx=0x7f31ec016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:32.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.087+0000 7f31e97fa700 1 -- 172.21.15.125:0/1637525531 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31f80c5810 con 0x7f31f80cc5a0 2023-10-06T03:06:32.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.311+0000 7f31ff507700 1 -- 172.21.15.125:0/1637525531 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f31f80c5810 con 0x7f31f80cc5a0 2023-10-06T03:06:32.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.312+0000 7f31e97fa700 1 -- 172.21.15.125:0/1637525531 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7f31f80c5810 con 0x7f31f80cc5a0 2023-10-06T03:06:32.314 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:06:32.315 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.314+0000 7f31ff507700 1 -- 172.21.15.125:0/1637525531 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f31dc066f30 msgr2=0x7f31dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.314+0000 7f31ff507700 1 --2- 172.21.15.125:0/1637525531 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f31dc066f30 0x7f31dc0693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f31ec009990 tx=0x7f31ec016000 comp rx=0 tx=0).stop 2023-10-06T03:06:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.314+0000 7f31ff507700 1 -- 172.21.15.125:0/1637525531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31f80cc5a0 msgr2=0x7f31f80b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.314+0000 7f31ff507700 1 --2- 172.21.15.125:0/1637525531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31f80cc5a0 0x7f31f80b1a10 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f31f0007f60 tx=0x7f31f0009950 comp rx=0 tx=0).stop 2023-10-06T03:06:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.314+0000 7f31ff507700 1 -- 172.21.15.125:0/1637525531 shutdown_connections 2023-10-06T03:06:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.314+0000 7f31ff507700 1 --2- 172.21.15.125:0/1637525531 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f31dc066f30 0x7f31dc0693e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.314+0000 7f31ff507700 1 --2- 172.21.15.125:0/1637525531 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f31f80cc5a0 0x7f31f80b1a10 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.314+0000 7f31ff507700 1 --2- 172.21.15.125:0/1637525531 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f31f8067d20 0x7f31f80afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.314+0000 7f31ff507700 1 --2- 172.21.15.125:0/1637525531 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f31f80af320 0x7f31f8150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.314+0000 7f31ff507700 1 -- 172.21.15.125:0/1637525531 >> 172.21.15.125:0/1637525531 conn(0x7f31f8068f00 msgr2=0x7f31f8151d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.314+0000 7f31ff507700 1 -- 172.21.15.125:0/1637525531 shutdown_connections 2023-10-06T03:06:32.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:32.314+0000 7f31ff507700 1 -- 172.21.15.125:0/1637525531 wait complete. 2023-10-06T03:06:32.327 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:06:32.327 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:06:32.327 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-10-06T03:06:32.327 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:06:32.327 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:32.327 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:06:32.327 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:06:32.327 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:06:32.327 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:06:32.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:32.328 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-10-06T03:06:32.347 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:06:32.347 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:06:32.347 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:06:32.347 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:32.347 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-10-06T03:06:32.347 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:32.347 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:06:32.347 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:06:32.347 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2023-10-06T03:06:32.347 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:06:32.348 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:06:32.348 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2023-10-06T03:06:32.348 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:06:32.348 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:06:32.348 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:06:32.348 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:06:32.348 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:06:32.348 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42408sec preferred_lft 42408sec 2023-10-06T03:06:32.348 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2023-10-06T03:06:32.348 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:32.348 INFO:teuthology.orchestra.run.smithi125.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:06:32.348 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 46:01:08:d7:90:9a brd ff:ff:ff:ff:ff:ff 2023-10-06T03:06:32.349 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:06:32.349 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:32.349 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::f829:e8ff:fe3d:51e0/64 scope link 2023-10-06T03:06:32.349 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:32.349 INFO:teuthology.orchestra.run.smithi125.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:06:32.349 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 46:01:08:d7:90:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:06:32.349 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::4401:8ff:fed7:909a/64 scope link 2023-10-06T03:06:32.349 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:32.349 INFO:teuthology.orchestra.run.smithi125.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:06:32.349 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 9a:de:60:3d:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:06:32.349 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::98de:60ff:fe3d:d710/64 scope link 2023-10-06T03:06:32.350 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:32.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:32.350 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:06:32.413 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-10-06T03:06:32.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:32.414 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-10-06T03:06:32.474 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-10-06T03:06:32.474 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:06:32.474 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:06:32.474 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:06:32.474 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:06:32.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:32.475 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:06:32.475 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:06:32.475 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:06:32.475 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:06:32.475 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:06:32.475 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:06:32.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:32.580 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-06T03:06:32.598 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:06:32.598 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:06:32.599 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:06:32.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:32.599 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2023-10-06T03:06:32.665 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T03:06:32.666 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:06:32.666 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:32.724 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:06:32.724 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:06:32.724 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:32.782 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-06T03:06:32.850 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:06:32.850 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:06:32.916 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:06:32.917 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:06:32.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:06:32.918 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-06T03:06:32.976 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T03:06:32.976 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T03:06:33.018 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-06T03:06:33.044 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:06:33.044 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:06:33.100 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2023-10-06T03:06:33.100+0000 7fb18ce7c540 -1 init, newargv = 0x55a11fa8eaf0 newargc=15 2023-10-06T03:06:33.100 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[141158]: starting ceph client 2023-10-06T03:06:33.104 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[141158]: starting fuse 2023-10-06T03:06:33.112 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:06:33.113 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:06:33.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:06:33.114 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-06T03:06:33.172 INFO:teuthology.orchestra.run.smithi125.stdout:46 2023-10-06T03:06:33.172 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T03:06:33.172 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:06:33.172 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2023-10-06T03:06:33.172 DEBUG:teuthology.orchestra.run.smithi125:> import re 2023-10-06T03:06:33.172 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-10-06T03:06:33.173 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2023-10-06T03:06:33.173 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:06:33.173 DEBUG:teuthology.orchestra.run.smithi125:> def _find_admin_socket(client_name): 2023-10-06T03:06:33.173 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T03:06:33.173 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2023-10-06T03:06:33.173 DEBUG:teuthology.orchestra.run.smithi125:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T03:06:33.173 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:06:33.173 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2023-10-06T03:06:33.173 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2023-10-06T03:06:33.173 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2023-10-06T03:06:33.173 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2023-10-06T03:06:33.173 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:06:33.173 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2023-10-06T03:06:33.174 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T03:06:33.174 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T03:06:33.174 DEBUG:teuthology.orchestra.run.smithi125:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T03:06:33.174 DEBUG:teuthology.orchestra.run.smithi125:> contents = proc_f.read() 2023-10-06T03:06:33.174 DEBUG:teuthology.orchestra.run.smithi125:> if mountpoint in contents: 2023-10-06T03:06:33.174 DEBUG:teuthology.orchestra.run.smithi125:> return f 2023-10-06T03:06:33.174 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T03:06:33.174 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:06:33.174 DEBUG:teuthology.orchestra.run.smithi125:> print(_find_admin_socket("client.0")) 2023-10-06T03:06:33.174 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-10-06T03:06:33.296 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.141158.asok 2023-10-06T03:06:33.478 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.141158.asok 2023-10-06T03:06:33.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:06:33.478 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.141158.asok status 2023-10-06T03:06:33.632 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:06:33.633 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2023-10-06T03:06:33.633 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T03:06:33.633 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T03:06:33.633 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2023-10-06T03:06:33.633 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2023-10-06T03:06:33.633 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T03:06:33.633 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "141158", 2023-10-06T03:06:33.633 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2023-10-06T03:06:33.633 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:33.633 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2023-10-06T03:06:33.633 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2023-10-06T03:06:33.634 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 5766, 2023-10-06T03:06:33.634 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2023-10-06T03:06:33.634 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2023-10-06T03:06:33.634 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2023-10-06T03:06:33.634 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 5766 2023-10-06T03:06:33.634 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:33.634 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-06T03:06:33.634 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-06T03:06:33.634 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:06:33.634 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 173026013 2023-10-06T03:06:33.634 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:33.635 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:33.635 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-06T03:06:33.635 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-06T03:06:33.635 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:06:33.635 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 173026013 2023-10-06T03:06:33.635 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:33.635 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.5766 192.168.0.1:0/173026013", 2023-10-06T03:06:33.635 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "192.168.0.1:0/173026013", 2023-10-06T03:06:33.635 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2023-10-06T03:06:33.635 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 27, 2023-10-06T03:06:33.635 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 57, 2023-10-06T03:06:33.635 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2023-10-06T03:06:33.636 INFO:teuthology.orchestra.run.smithi125.stdout: "blocklisted": false, 2023-10-06T03:06:33.636 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2023-10-06T03:06:33.636 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:06:33.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:06:33.642 DEBUG:teuthology.orchestra.run.smithi125:> stat --file-system '--printf=%T 2023-10-06T03:06:33.642 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:33.661 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2023-10-06T03:06:33.661 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:33.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:06:33.661 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:33.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:06:33.729 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch test_file) 2023-10-06T03:06:33.794 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow r pool=cephfs_data' 2023-10-06T03:06:33.957 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.957+0000 7f6c175c5700 1 Processor -- start 2023-10-06T03:06:33.958 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.957+0000 7f6c175c5700 1 -- start start 2023-10-06T03:06:33.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.958+0000 7f6c175c5700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6c1006ea90 0x7f6c1006ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:33.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.958+0000 7f6c175c5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6c100c7f40 0x7f6c10067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:33.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.958+0000 7f6c175c5700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c10156af0 0x7f6c10156f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:33.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.958+0000 7f6c175c5700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c10067e60 con 0x7f6c100c7f40 2023-10-06T03:06:33.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.958+0000 7f6c175c5700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c10068140 con 0x7f6c1006ea90 2023-10-06T03:06:33.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.958+0000 7f6c175c5700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c10068420 con 0x7f6c10156af0 2023-10-06T03:06:33.960 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.958+0000 7f6c14b60700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6c100c7f40 0x7f6c10067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:33.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.958+0000 7f6c14b60700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6c100c7f40 0x7f6c10067610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44926/0 (socket says 172.21.15.125:44926) 2023-10-06T03:06:33.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.958+0000 7f6c14b60700 1 -- 172.21.15.125:0/1034360083 learned_addr learned my addr 172.21.15.125:0/1034360083 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:33.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.958+0000 7f6c15361700 1 --2- 172.21.15.125:0/1034360083 >> v2:172.21.15.130:3300/0 conn(0x7f6c1006ea90 0x7f6c1006ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:33.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.958+0000 7f6c15b62700 1 --2- 172.21.15.125:0/1034360083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c10156af0 0x7f6c10156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:33.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.958+0000 7f6c14b60700 1 -- 172.21.15.125:0/1034360083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c10156af0 msgr2=0x7f6c10156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:33.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.958+0000 7f6c14b60700 1 --2- 172.21.15.125:0/1034360083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c10156af0 0x7f6c10156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:33.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.958+0000 7f6c14b60700 1 -- 172.21.15.125:0/1034360083 >> v2:172.21.15.130:3300/0 conn(0x7f6c1006ea90 msgr2=0x7f6c1006ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:33.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.959+0000 7f6c14b60700 1 --2- 172.21.15.125:0/1034360083 >> v2:172.21.15.130:3300/0 conn(0x7f6c1006ea90 0x7f6c1006ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:33.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.959+0000 7f6c14b60700 1 -- 172.21.15.125:0/1034360083 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c10068700 con 0x7f6c100c7f40 2023-10-06T03:06:33.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.959+0000 7f6c15361700 1 --2- 172.21.15.125:0/1034360083 >> v2:172.21.15.130:3300/0 conn(0x7f6c1006ea90 0x7f6c1006ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:33.961 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.959+0000 7f6c14b60700 1 --2- 172.21.15.125:0/1034360083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c100c7f40 0x7f6c10067610 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6c100cc420 tx=0x7f6c0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc6b47e35ce4cce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:33.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.959+0000 7f6c07fff700 1 -- 172.21.15.125:0/1034360083 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c00b860 con 0x7f6c100c7f40 2023-10-06T03:06:33.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.959+0000 7f6c07fff700 1 -- 172.21.15.125:0/1034360083 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c00b9c0 con 0x7f6c100c7f40 2023-10-06T03:06:33.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.959+0000 7f6c07fff700 1 -- 172.21.15.125:0/1034360083 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c00bd60 con 0x7f6c100c7f40 2023-10-06T03:06:33.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.959+0000 7f6c175c5700 1 -- 172.21.15.125:0/1034360083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c100c7f40 msgr2=0x7f6c10067610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:33.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.959+0000 7f6c175c5700 1 --2- 172.21.15.125:0/1034360083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c100c7f40 0x7f6c10067610 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6c100cc420 tx=0x7f6c0c009250 comp rx=0 tx=0).stop 2023-10-06T03:06:33.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.959+0000 7f6c175c5700 1 -- 172.21.15.125:0/1034360083 shutdown_connections 2023-10-06T03:06:33.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.959+0000 7f6c175c5700 1 --2- 172.21.15.125:0/1034360083 >> v2:172.21.15.130:3300/0 conn(0x7f6c1006ea90 0x7f6c1006ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:33.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.959+0000 7f6c175c5700 1 --2- 172.21.15.125:0/1034360083 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c10156af0 0x7f6c10156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:33.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.959+0000 7f6c175c5700 1 --2- 172.21.15.125:0/1034360083 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c100c7f40 0x7f6c10067610 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:33.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.959+0000 7f6c175c5700 1 -- 172.21.15.125:0/1034360083 >> 172.21.15.125:0/1034360083 conn(0x7f6c1006b3b0 msgr2=0x7f6c100cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:33.962 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.959+0000 7f6c175c5700 1 -- 172.21.15.125:0/1034360083 shutdown_connections 2023-10-06T03:06:33.963 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.960+0000 7f6c175c5700 1 -- 172.21.15.125:0/1034360083 wait complete. 2023-10-06T03:06:33.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.961+0000 7f6c175c5700 1 Processor -- start 2023-10-06T03:06:33.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.961+0000 7f6c175c5700 1 -- start start 2023-10-06T03:06:33.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.961+0000 7f6c175c5700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c1006ea90 0x7f6c100b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:33.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.961+0000 7f6c175c5700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c100c7f40 0x7f6c100afd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:33.965 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.961+0000 7f6c175c5700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c10156af0 0x7f6c10143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:33.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.961+0000 7f6c175c5700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c100b1110 con 0x7f6c100c7f40 2023-10-06T03:06:33.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.961+0000 7f6c175c5700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c100b0280 con 0x7f6c1006ea90 2023-10-06T03:06:33.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.961+0000 7f6c175c5700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c100b0500 con 0x7f6c10156af0 2023-10-06T03:06:33.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.962+0000 7f6c14b60700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c100c7f40 0x7f6c100afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:33.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.962+0000 7f6c14b60700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c100c7f40 0x7f6c100afd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44928/0 (socket says 172.21.15.125:44928) 2023-10-06T03:06:33.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.962+0000 7f6c14b60700 1 -- 172.21.15.125:0/4204831238 learned_addr learned my addr 172.21.15.125:0/4204831238 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:33.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.962+0000 7f6c15361700 1 --2- 172.21.15.125:0/4204831238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c1006ea90 0x7f6c100b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:33.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.962+0000 7f6c15b62700 1 --2- 172.21.15.125:0/4204831238 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c10156af0 0x7f6c10143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:33.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.962+0000 7f6c14b60700 1 -- 172.21.15.125:0/4204831238 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c10156af0 msgr2=0x7f6c10143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:33.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.962+0000 7f6c14b60700 1 --2- 172.21.15.125:0/4204831238 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c10156af0 0x7f6c10143000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:33.966 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.962+0000 7f6c14b60700 1 -- 172.21.15.125:0/4204831238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c1006ea90 msgr2=0x7f6c100b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:33.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.962+0000 7f6c14b60700 1 --2- 172.21.15.125:0/4204831238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c1006ea90 0x7f6c100b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:33.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.962+0000 7f6c14b60700 1 -- 172.21.15.125:0/4204831238 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c0094f0 con 0x7f6c100c7f40 2023-10-06T03:06:33.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.962+0000 7f6c14b60700 1 --2- 172.21.15.125:0/4204831238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c100c7f40 0x7f6c100afd40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009290 tx=0x7f6c0c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:33.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.962+0000 7f6c057fa700 1 -- 172.21.15.125:0/4204831238 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c011e40 con 0x7f6c100c7f40 2023-10-06T03:06:33.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.962+0000 7f6c057fa700 1 -- 172.21.15.125:0/4204831238 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c01f070 con 0x7f6c100c7f40 2023-10-06T03:06:33.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.962+0000 7f6c175c5700 1 -- 172.21.15.125:0/4204831238 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c100b07e0 con 0x7f6c100c7f40 2023-10-06T03:06:33.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.962+0000 7f6c057fa700 1 -- 172.21.15.125:0/4204831238 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c0266d0 con 0x7f6c100c7f40 2023-10-06T03:06:33.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.962+0000 7f6c175c5700 1 -- 172.21.15.125:0/4204831238 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c100b0da0 con 0x7f6c100c7f40 2023-10-06T03:06:33.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.963+0000 7f6c175c5700 1 -- 172.21.15.125:0/4204831238 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c10066510 con 0x7f6c100c7f40 2023-10-06T03:06:33.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.963+0000 7f6c057fa700 1 -- 172.21.15.125:0/4204831238 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c0c026a40 con 0x7f6c100c7f40 2023-10-06T03:06:33.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.964+0000 7f6c057fa700 1 --2- 172.21.15.125:0/4204831238 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6bf4066f30 0x7f6bf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:33.967 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.964+0000 7f6c057fa700 1 -- 172.21.15.125:0/4204831238 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6c0c021070 con 0x7f6c100c7f40 2023-10-06T03:06:33.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.964+0000 7f6c15361700 1 --2- 172.21.15.125:0/4204831238 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6bf4066f30 0x7f6bf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:33.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.964+0000 7f6c15361700 1 --2- 172.21.15.125:0/4204831238 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6bf4066f30 0x7f6bf40693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6c00006f00 tx=0x7f6c00008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:33.968 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:33.968+0000 7f6c057fa700 1 -- 172.21.15.125:0/4204831238 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c0c0535a0 con 0x7f6c100c7f40 2023-10-06T03:06:34.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:34.224+0000 7f6c175c5700 1 -- 172.21.15.125:0/4204831238 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]} v 0) v1 -- 0x7f6c100689e0 con 0x7f6c100c7f40 2023-10-06T03:06:34.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:34.228+0000 7f6c057fa700 1 -- 172.21.15.125:0/4204831238 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow r pool=cephfs_data"]}]=0 updated caps for client.0 v20) v1 ==== 183+0+0 (secure 0 0 0) 0x7f6c0c056bc0 con 0x7f6c100c7f40 2023-10-06T03:06:34.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:34.230+0000 7f6c175c5700 1 -- 172.21.15.125:0/4204831238 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6bf4066f30 msgr2=0x7f6bf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:34.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:34.230+0000 7f6c175c5700 1 --2- 172.21.15.125:0/4204831238 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6bf4066f30 0x7f6bf40693e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6c00006f00 tx=0x7f6c00008040 comp rx=0 tx=0).stop 2023-10-06T03:06:34.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:34.230+0000 7f6c175c5700 1 -- 172.21.15.125:0/4204831238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c100c7f40 msgr2=0x7f6c100afd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:34.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:34.230+0000 7f6c175c5700 1 --2- 172.21.15.125:0/4204831238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c100c7f40 0x7f6c100afd40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009290 tx=0x7f6c0c017000 comp rx=0 tx=0).stop 2023-10-06T03:06:34.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:34.230+0000 7f6c175c5700 1 -- 172.21.15.125:0/4204831238 shutdown_connections 2023-10-06T03:06:34.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:34.230+0000 7f6c175c5700 1 --2- 172.21.15.125:0/4204831238 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6bf4066f30 0x7f6bf40693e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:34.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:34.230+0000 7f6c175c5700 1 --2- 172.21.15.125:0/4204831238 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c10156af0 0x7f6c10143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:34.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:34.230+0000 7f6c175c5700 1 --2- 172.21.15.125:0/4204831238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c1006ea90 0x7f6c100b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:34.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:34.230+0000 7f6c175c5700 1 --2- 172.21.15.125:0/4204831238 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c100c7f40 0x7f6c100afd40 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:34.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:34.230+0000 7f6c175c5700 1 -- 172.21.15.125:0/4204831238 >> 172.21.15.125:0/4204831238 conn(0x7f6c1006b3b0 msgr2=0x7f6c10155de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:34.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:34.230+0000 7f6c175c5700 1 -- 172.21.15.125:0/4204831238 shutdown_connections 2023-10-06T03:06:34.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:34.230+0000 7f6c175c5700 1 -- 172.21.15.125:0/4204831238 wait complete. 2023-10-06T03:06:34.232 INFO:teuthology.orchestra.run.smithi125.stderr:updated caps for client.0 2023-10-06T03:06:34.242 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2023-10-06T03:06:34.242 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:06:34.242 DEBUG:teuthology.orchestra.run.smithi125:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:34.286 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[141158]: fuse finished with error 0 and tester_r 0 2023-10-06T03:06:34.287 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T03:06:40.388 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:06:40.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:40.389 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:06:40.412 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:06:40.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.588+0000 7f3d86c2d700 1 Processor -- start 2023-10-06T03:06:40.588 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.588+0000 7f3d86c2d700 1 -- start start 2023-10-06T03:06:40.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.589+0000 7f3d86c2d700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f3d8006bd10 0x7f3d8013fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:40.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.589+0000 7f3d86c2d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d800c74c0 con 0x7f3d8015a320 2023-10-06T03:06:40.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.589+0000 7f3d86c2d700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d800c7710 con 0x7f3d8013f6a0 2023-10-06T03:06:40.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.589+0000 7f3d86c2d700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d800c79f0 con 0x7f3d8006bd10 2023-10-06T03:06:40.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.589+0000 7f3d7ffff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3d8015a320 0x7f3d800cac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39272/0 (socket says 172.21.15.125:39272) 2023-10-06T03:06:40.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.589+0000 7f3d7ffff700 1 -- 172.21.15.125:0/365518270 learned_addr learned my addr 172.21.15.125:0/365518270 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:40.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.589+0000 7f3d851ca700 1 --2- 172.21.15.125:0/365518270 >> v2:172.21.15.130:3300/0 conn(0x7f3d8006bd10 0x7f3d8013fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:40.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.589+0000 7f3d7f7fe700 1 -- 172.21.15.125:0/365518270 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300877228 0 0) 0x7f3d800c74c0 con 0x7f3d8015a320 2023-10-06T03:06:40.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.589+0000 7f3d7f7fe700 1 -- 172.21.15.125:0/365518270 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d70003570 con 0x7f3d8015a320 2023-10-06T03:06:40.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d7f7fe700 1 -- 172.21.15.125:0/365518270 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1917625266 0 0) 0x7f3d70003570 con 0x7f3d8015a320 2023-10-06T03:06:40.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d7f7fe700 1 -- 172.21.15.125:0/365518270 >> v2:172.21.15.130:3300/0 conn(0x7f3d8006bd10 msgr2=0x7f3d8013fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:40.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d7f7fe700 1 --2- 172.21.15.125:0/365518270 >> v2:172.21.15.130:3300/0 conn(0x7f3d8006bd10 0x7f3d8013fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:40.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d7f7fe700 1 -- 172.21.15.125:0/365518270 >> v1:172.21.15.130:6789/0 conn(0x7f3d8013f6a0 legacy=0x7f3d80159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:40.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d7f7fe700 1 -- 172.21.15.125:0/365518270 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d800c9b40 con 0x7f3d8015a320 2023-10-06T03:06:40.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d7f7fe700 1 -- 172.21.15.125:0/365518270 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f3d6c001470 con 0x7f3d8015a320 2023-10-06T03:06:40.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d7f7fe700 1 -- 172.21.15.125:0/365518270 >> v1:172.21.15.125:6789/0 conn(0x7f3d8015a320 legacy=0x7f3d800cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:40.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d7f7fe700 1 --2- 172.21.15.125:0/365518270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d70003a60 0x7f3d70003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:40.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d7f7fe700 1 --2- 172.21.15.125:0/365518270 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d70004810 0x7f3d70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:40.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d7f7fe700 1 --2- 172.21.15.125:0/365518270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d700051c0 0x7f3d7000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:40.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d7f7fe700 1 -- 172.21.15.125:0/365518270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800c79f0 con 0x7f3d70003a60 2023-10-06T03:06:40.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d7f7fe700 1 -- 172.21.15.125:0/365518270 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7000c160 con 0x7f3d700051c0 2023-10-06T03:06:40.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d7f7fe700 1 -- 172.21.15.125:0/365518270 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7000c320 con 0x7f3d70004810 2023-10-06T03:06:40.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d849c9700 1 --2- 172.21.15.125:0/365518270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d70003a60 0x7f3d70003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:40.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d7ffff700 1 --2- 172.21.15.125:0/365518270 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d70004810 0x7f3d70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:40.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d851ca700 1 --2- 172.21.15.125:0/365518270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d700051c0 0x7f3d7000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:40.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d849c9700 1 -- 172.21.15.125:0/365518270 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d70004810 msgr2=0x7f3d70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:40.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d849c9700 1 --2- 172.21.15.125:0/365518270 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d70004810 0x7f3d70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:40.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d849c9700 1 -- 172.21.15.125:0/365518270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d700051c0 msgr2=0x7f3d7000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:40.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d849c9700 1 --2- 172.21.15.125:0/365518270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d700051c0 0x7f3d7000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:40.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d849c9700 1 -- 172.21.15.125:0/365518270 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d70003570 con 0x7f3d70003a60 2023-10-06T03:06:40.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d7ffff700 1 --2- 172.21.15.125:0/365518270 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d70004810 0x7f3d70004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:40.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d851ca700 1 --2- 172.21.15.125:0/365518270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d700051c0 0x7f3d7000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:40.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d851ca700 1 -- 172.21.15.125:0/365518270 reap_dead start 2023-10-06T03:06:40.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d849c9700 1 --2- 172.21.15.125:0/365518270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d70003a60 0x7f3d70003e70 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3d740018b0 tx=0x7f3d74007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73e50289b0b527b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:40.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d7f7fe700 1 -- 172.21.15.125:0/365518270 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74012420 con 0x7f3d70003a60 2023-10-06T03:06:40.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d7f7fe700 1 -- 172.21.15.125:0/365518270 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d740125a0 con 0x7f3d70003a60 2023-10-06T03:06:40.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.590+0000 7f3d7f7fe700 1 -- 172.21.15.125:0/365518270 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74012960 con 0x7f3d70003a60 2023-10-06T03:06:40.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.591+0000 7f3d86c2d700 1 -- 172.21.15.125:0/365518270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d70003a60 msgr2=0x7f3d70003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:40.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.591+0000 7f3d86c2d700 1 --2- 172.21.15.125:0/365518270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d70003a60 0x7f3d70003e70 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3d740018b0 tx=0x7f3d74007d30 comp rx=0 tx=0).stop 2023-10-06T03:06:40.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.591+0000 7f3d86c2d700 1 -- 172.21.15.125:0/365518270 shutdown_connections 2023-10-06T03:06:40.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.591+0000 7f3d86c2d700 1 --2- 172.21.15.125:0/365518270 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d70003a60 0x7f3d70003e70 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:40.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.591+0000 7f3d86c2d700 1 -- 172.21.15.125:0/365518270 >> 172.21.15.125:0/365518270 conn(0x7f3d8006b190 msgr2=0x7f3d8006b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:40.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.591+0000 7f3d86c2d700 1 -- 172.21.15.125:0/365518270 shutdown_connections 2023-10-06T03:06:40.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.591+0000 7f3d86c2d700 1 -- 172.21.15.125:0/365518270 wait complete. 2023-10-06T03:06:40.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.592+0000 7f3d86c2d700 1 Processor -- start 2023-10-06T03:06:40.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.592+0000 7f3d86c2d700 1 -- start start 2023-10-06T03:06:40.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.593+0000 7f3d86c2d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d70003a60 0x7f3d80159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:40.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.593+0000 7f3d86c2d700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d80156700 0x7f3d801559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:40.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.593+0000 7f3d86c2d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d800b0430 0x7f3d800b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:40.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.593+0000 7f3d86c2d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800cbcf0 con 0x7f3d800b0430 2023-10-06T03:06:40.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.593+0000 7f3d86c2d700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800b0dc0 con 0x7f3d80156700 2023-10-06T03:06:40.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.593+0000 7f3d86c2d700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d80156ec0 con 0x7f3d70003a60 2023-10-06T03:06:40.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.593+0000 7f3d851ca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d800b0430 0x7f3d800b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:40.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.593+0000 7f3d851ca700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d800b0430 0x7f3d800b0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48268/0 (socket says 172.21.15.125:48268) 2023-10-06T03:06:40.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.593+0000 7f3d851ca700 1 -- 172.21.15.125:0/796873737 learned_addr learned my addr 172.21.15.125:0/796873737 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:40.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.594+0000 7f3d7ffff700 1 --2- 172.21.15.125:0/796873737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d80156700 0x7f3d801559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:40.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.594+0000 7f3d849c9700 1 --2- 172.21.15.125:0/796873737 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d70003a60 0x7f3d80159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:40.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.594+0000 7f3d851ca700 1 -- 172.21.15.125:0/796873737 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d70003a60 msgr2=0x7f3d80159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:40.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.594+0000 7f3d851ca700 1 --2- 172.21.15.125:0/796873737 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d70003a60 0x7f3d80159250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:40.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.594+0000 7f3d851ca700 1 -- 172.21.15.125:0/796873737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d80156700 msgr2=0x7f3d801559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:40.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.594+0000 7f3d851ca700 1 --2- 172.21.15.125:0/796873737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d80156700 0x7f3d801559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:40.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.594+0000 7f3d851ca700 1 -- 172.21.15.125:0/796873737 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d801571a0 con 0x7f3d800b0430 2023-10-06T03:06:40.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.594+0000 7f3d7ffff700 1 --2- 172.21.15.125:0/796873737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d80156700 0x7f3d801559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:40.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.594+0000 7f3d851ca700 1 --2- 172.21.15.125:0/796873737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d800b0430 0x7f3d800b0880 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3d80063f50 tx=0x7f3d7800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:40.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.594+0000 7f3d7cff9700 1 -- 172.21.15.125:0/796873737 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7801b070 con 0x7f3d800b0430 2023-10-06T03:06:40.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.594+0000 7f3d7cff9700 1 -- 172.21.15.125:0/796873737 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7800f040 con 0x7f3d800b0430 2023-10-06T03:06:40.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.594+0000 7f3d7cff9700 1 -- 172.21.15.125:0/796873737 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7800e050 con 0x7f3d800b0430 2023-10-06T03:06:40.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.594+0000 7f3d86c2d700 1 -- 172.21.15.125:0/796873737 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d80157480 con 0x7f3d800b0430 2023-10-06T03:06:40.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.594+0000 7f3d86c2d700 1 -- 172.21.15.125:0/796873737 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d80155ee0 con 0x7f3d800b0430 2023-10-06T03:06:40.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.595+0000 7f3d86c2d700 1 -- 172.21.15.125:0/796873737 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d800cbe80 con 0x7f3d800b0430 2023-10-06T03:06:40.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.595+0000 7f3d7cff9700 1 -- 172.21.15.125:0/796873737 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d78003020 con 0x7f3d800b0430 2023-10-06T03:06:40.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.596+0000 7f3d7cff9700 1 --2- 172.21.15.125:0/796873737 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3d64066f30 0x7f3d640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:40.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.596+0000 7f3d7cff9700 1 -- 172.21.15.125:0/796873737 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f3d78084c80 con 0x7f3d800b0430 2023-10-06T03:06:40.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.596+0000 7f3d849c9700 1 --2- 172.21.15.125:0/796873737 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3d64066f30 0x7f3d640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:40.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.596+0000 7f3d849c9700 1 --2- 172.21.15.125:0/796873737 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3d64066f30 0x7f3d640693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3d74001690 tx=0x7f3d74015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:40.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.600+0000 7f3d7cff9700 1 -- 172.21.15.125:0/796873737 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d800cbe80 con 0x7f3d800b0430 2023-10-06T03:06:40.826 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.826+0000 7f3d86c2d700 1 -- 172.21.15.125:0/796873737 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3d800cbe80 con 0x7f3d800b0430 2023-10-06T03:06:40.827 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.826+0000 7f3d7cff9700 1 -- 172.21.15.125:0/796873737 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3d800cbe80 con 0x7f3d800b0430 2023-10-06T03:06:40.827 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:06:40.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.828+0000 7f3d86c2d700 1 -- 172.21.15.125:0/796873737 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3d64066f30 msgr2=0x7f3d640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:40.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.828+0000 7f3d86c2d700 1 --2- 172.21.15.125:0/796873737 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3d64066f30 0x7f3d640693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3d74001690 tx=0x7f3d74015000 comp rx=0 tx=0).stop 2023-10-06T03:06:40.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.828+0000 7f3d86c2d700 1 -- 172.21.15.125:0/796873737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d800b0430 msgr2=0x7f3d800b0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:40.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.828+0000 7f3d86c2d700 1 --2- 172.21.15.125:0/796873737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d800b0430 0x7f3d800b0880 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3d80063f50 tx=0x7f3d7800b040 comp rx=0 tx=0).stop 2023-10-06T03:06:40.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.828+0000 7f3d86c2d700 1 -- 172.21.15.125:0/796873737 shutdown_connections 2023-10-06T03:06:40.829 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.828+0000 7f3d86c2d700 1 --2- 172.21.15.125:0/796873737 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3d64066f30 0x7f3d640693e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:40.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.828+0000 7f3d86c2d700 1 --2- 172.21.15.125:0/796873737 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3d800b0430 0x7f3d800b0880 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:40.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.828+0000 7f3d86c2d700 1 --2- 172.21.15.125:0/796873737 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3d70003a60 0x7f3d80159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:40.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.828+0000 7f3d86c2d700 1 --2- 172.21.15.125:0/796873737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d80156700 0x7f3d801559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:40.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.828+0000 7f3d86c2d700 1 -- 172.21.15.125:0/796873737 >> 172.21.15.125:0/796873737 conn(0x7f3d8006b190 msgr2=0x7f3d8013e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:40.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.828+0000 7f3d86c2d700 1 -- 172.21.15.125:0/796873737 shutdown_connections 2023-10-06T03:06:40.830 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:40.828+0000 7f3d86c2d700 1 -- 172.21.15.125:0/796873737 wait complete. 2023-10-06T03:06:40.841 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:06:40.841 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:06:40.841 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-10-06T03:06:40.841 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:06:40.841 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:40.841 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:06:40.841 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:06:40.841 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:06:40.841 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:06:40.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:40.842 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-10-06T03:06:40.860 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:06:40.860 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:06:40.860 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:06:40.860 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:40.860 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-10-06T03:06:40.860 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:40.861 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:06:40.861 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:06:40.861 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2023-10-06T03:06:40.861 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:06:40.861 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:06:40.861 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2023-10-06T03:06:40.861 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:06:40.861 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:06:40.861 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:06:40.861 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:06:40.861 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:06:40.861 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42400sec preferred_lft 42400sec 2023-10-06T03:06:40.862 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2023-10-06T03:06:40.862 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:40.862 INFO:teuthology.orchestra.run.smithi125.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:06:40.862 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 46:01:08:d7:90:9a brd ff:ff:ff:ff:ff:ff 2023-10-06T03:06:40.862 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:06:40.862 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:40.862 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::f829:e8ff:fe3d:51e0/64 scope link 2023-10-06T03:06:40.862 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:40.862 INFO:teuthology.orchestra.run.smithi125.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:06:40.862 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 46:01:08:d7:90:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:06:40.862 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::4401:8ff:fed7:909a/64 scope link 2023-10-06T03:06:40.863 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:40.863 INFO:teuthology.orchestra.run.smithi125.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:06:40.863 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 9a:de:60:3d:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:06:40.863 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::98de:60ff:fe3d:d710/64 scope link 2023-10-06T03:06:40.863 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:40.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:40.863 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:06:40.926 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-10-06T03:06:40.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:40.928 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-10-06T03:06:40.988 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-10-06T03:06:40.988 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:06:40.988 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:06:40.988 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:06:40.988 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:06:40.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:40.989 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:06:40.989 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:06:40.989 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:06:40.989 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:06:40.989 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:06:40.989 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:06:41.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:41.094 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-06T03:06:41.112 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:06:41.112 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:06:41.112 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:06:41.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:41.112 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2023-10-06T03:06:41.180 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T03:06:41.180 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:06:41.180 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:41.238 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:06:41.238 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:06:41.238 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:41.296 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-06T03:06:41.363 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:06:41.364 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:06:41.431 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:06:41.431 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:06:41.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:06:41.432 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-06T03:06:41.490 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T03:06:41.491 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T03:06:41.534 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-06T03:06:41.560 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:06:41.560 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:06:41.617 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2023-10-06T03:06:41.616+0000 7f3278f51540 -1 init, newargv = 0x5588e5fbd800 newargc=15 2023-10-06T03:06:41.617 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[141844]: starting ceph client 2023-10-06T03:06:41.621 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[141844]: starting fuse 2023-10-06T03:06:41.630 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:06:41.631 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:06:41.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:06:41.632 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-06T03:06:41.690 INFO:teuthology.orchestra.run.smithi125.stdout:46 2023-10-06T03:06:41.690 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T03:06:41.690 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:06:41.691 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2023-10-06T03:06:41.691 DEBUG:teuthology.orchestra.run.smithi125:> import re 2023-10-06T03:06:41.691 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-10-06T03:06:41.691 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2023-10-06T03:06:41.691 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:06:41.691 DEBUG:teuthology.orchestra.run.smithi125:> def _find_admin_socket(client_name): 2023-10-06T03:06:41.691 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T03:06:41.691 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2023-10-06T03:06:41.691 DEBUG:teuthology.orchestra.run.smithi125:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T03:06:41.691 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:06:41.691 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2023-10-06T03:06:41.691 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2023-10-06T03:06:41.691 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2023-10-06T03:06:41.692 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2023-10-06T03:06:41.692 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:06:41.692 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2023-10-06T03:06:41.692 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T03:06:41.692 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T03:06:41.692 DEBUG:teuthology.orchestra.run.smithi125:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T03:06:41.692 DEBUG:teuthology.orchestra.run.smithi125:> contents = proc_f.read() 2023-10-06T03:06:41.692 DEBUG:teuthology.orchestra.run.smithi125:> if mountpoint in contents: 2023-10-06T03:06:41.692 DEBUG:teuthology.orchestra.run.smithi125:> return f 2023-10-06T03:06:41.692 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T03:06:41.692 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:06:41.692 DEBUG:teuthology.orchestra.run.smithi125:> print(_find_admin_socket("client.0")) 2023-10-06T03:06:41.692 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-10-06T03:06:41.813 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.141844.asok 2023-10-06T03:06:41.995 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.141844.asok 2023-10-06T03:06:41.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:06:41.996 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.141844.asok status 2023-10-06T03:06:42.149 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:06:42.150 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2023-10-06T03:06:42.150 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T03:06:42.150 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T03:06:42.150 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2023-10-06T03:06:42.150 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2023-10-06T03:06:42.150 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T03:06:42.150 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "141844", 2023-10-06T03:06:42.150 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2023-10-06T03:06:42.150 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:42.150 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2023-10-06T03:06:42.151 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2023-10-06T03:06:42.151 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 5784, 2023-10-06T03:06:42.151 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2023-10-06T03:06:42.151 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2023-10-06T03:06:42.151 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2023-10-06T03:06:42.151 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 5784 2023-10-06T03:06:42.151 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:42.152 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-06T03:06:42.152 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-06T03:06:42.152 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:06:42.152 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 562086767 2023-10-06T03:06:42.152 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:42.152 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:42.152 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-06T03:06:42.153 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-06T03:06:42.153 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:06:42.153 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 562086767 2023-10-06T03:06:42.153 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:42.153 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.5784 192.168.0.1:0/562086767", 2023-10-06T03:06:42.153 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "192.168.0.1:0/562086767", 2023-10-06T03:06:42.153 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2023-10-06T03:06:42.153 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 27, 2023-10-06T03:06:42.154 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 57, 2023-10-06T03:06:42.154 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2023-10-06T03:06:42.154 INFO:teuthology.orchestra.run.smithi125.stdout: "blocklisted": false, 2023-10-06T03:06:42.154 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2023-10-06T03:06:42.154 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:06:42.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:06:42.159 DEBUG:teuthology.orchestra.run.smithi125:> stat --file-system '--printf=%T 2023-10-06T03:06:42.159 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:42.178 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2023-10-06T03:06:42.178 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:42.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:06:42.178 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:42.245 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:06:42.245 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-10-06T03:06:42.245 DEBUG:teuthology.orchestra.run.smithi125:> import errno 2023-10-06T03:06:42.245 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:06:42.245 DEBUG:teuthology.orchestra.run.smithi125:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2023-10-06T03:06:42.246 DEBUG:teuthology.orchestra.run.smithi125:> try: 2023-10-06T03:06:42.246 DEBUG:teuthology.orchestra.run.smithi125:> if False: 2023-10-06T03:06:42.246 DEBUG:teuthology.orchestra.run.smithi125:> ret = os.read(fd, 1024) 2023-10-06T03:06:42.246 DEBUG:teuthology.orchestra.run.smithi125:> else: 2023-10-06T03:06:42.246 DEBUG:teuthology.orchestra.run.smithi125:> os.write(fd, b'"'"'content'"'"') 2023-10-06T03:06:42.246 DEBUG:teuthology.orchestra.run.smithi125:> except OSError as e: 2023-10-06T03:06:42.246 DEBUG:teuthology.orchestra.run.smithi125:> if e.errno != errno.EPERM: 2023-10-06T03:06:42.246 DEBUG:teuthology.orchestra.run.smithi125:> raise 2023-10-06T03:06:42.246 DEBUG:teuthology.orchestra.run.smithi125:> else: 2023-10-06T03:06:42.246 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("client does not check permission of data pool") 2023-10-06T03:06:42.246 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-10-06T03:06:42.541 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow w pool=cephfs_data' 2023-10-06T03:06:42.706 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.705+0000 7fc61177d700 1 Processor -- start 2023-10-06T03:06:42.707 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.705+0000 7fc61177d700 1 -- start start 2023-10-06T03:06:42.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.706+0000 7fc61177d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc60c068ba0 0x7fc60c0b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:42.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.706+0000 7fc61177d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60c0ca670 con 0x7fc60c15cb00 2023-10-06T03:06:42.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.706+0000 7fc61177d700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60c067a80 con 0x7fc60c067610 2023-10-06T03:06:42.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.706+0000 7fc61177d700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c068320 con 0x7fc60c068ba0 2023-10-06T03:06:42.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.706+0000 7fc60affd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fc60c15cb00 0x7fc60c068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:39276/0 (socket says 172.21.15.125:39276) 2023-10-06T03:06:42.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.706+0000 7fc60affd700 1 -- 172.21.15.125:0/3810122393 learned_addr learned my addr 172.21.15.125:0/3810122393 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:42.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.706+0000 7fc609ffb700 1 -- 172.21.15.125:0/3810122393 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264194069 0 0) 0x7fc60c0ca670 con 0x7fc60c15cb00 2023-10-06T03:06:42.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.706+0000 7fc609ffb700 1 -- 172.21.15.125:0/3810122393 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5f4003570 con 0x7fc60c15cb00 2023-10-06T03:06:42.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.706+0000 7fc60b7fe700 1 --2- 172.21.15.125:0/3810122393 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc60c068ba0 0x7fc60c0b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:42.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc609ffb700 1 -- 172.21.15.125:0/3810122393 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3294315427 0 0) 0x7fc5f4003570 con 0x7fc60c15cb00 2023-10-06T03:06:42.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc609ffb700 1 -- 172.21.15.125:0/3810122393 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc60c068ba0 msgr2=0x7fc60c0b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:42.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc609ffb700 1 --2- 172.21.15.125:0/3810122393 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc60c068ba0 0x7fc60c0b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:42.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc609ffb700 1 -- 172.21.15.125:0/3810122393 >> v1:172.21.15.130:6789/0 conn(0x7fc60c067610 legacy=0x7fc60c0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc609ffb700 1 -- 172.21.15.125:0/3810122393 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c067d60 con 0x7fc60c15cb00 2023-10-06T03:06:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc609ffb700 1 -- 172.21.15.125:0/3810122393 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7fc6000015f0 con 0x7fc60c15cb00 2023-10-06T03:06:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc60b7fe700 1 --2- 172.21.15.125:0/3810122393 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc60c068ba0 0x7fc60c0b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc609ffb700 1 -- 172.21.15.125:0/3810122393 >> v1:172.21.15.125:6789/0 conn(0x7fc60c15cb00 legacy=0x7fc60c068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc609ffb700 1 --2- 172.21.15.125:0/3810122393 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc60c068ba0 0x7fc5f4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc609ffb700 1 --2- 172.21.15.125:0/3810122393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5f4004080 0x7fc5f4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc609ffb700 1 --2- 172.21.15.125:0/3810122393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5f4004d50 0x7fc5f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc609ffb700 1 -- 172.21.15.125:0/3810122393 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c068320 con 0x7fc5f4004080 2023-10-06T03:06:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc609ffb700 1 -- 172.21.15.125:0/3810122393 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f400bca0 con 0x7fc5f4004d50 2023-10-06T03:06:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc609ffb700 1 -- 172.21.15.125:0/3810122393 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f400be60 con 0x7fc60c068ba0 2023-10-06T03:06:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc60a7fc700 1 --2- 172.21.15.125:0/3810122393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5f4004080 0x7fc5f4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:42.712 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc60b7fe700 1 --2- 172.21.15.125:0/3810122393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5f4004d50 0x7fc5f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc60affd700 1 --2- 172.21.15.125:0/3810122393 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc60c068ba0 0x7fc5f4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc60a7fc700 1 -- 172.21.15.125:0/3810122393 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc60c068ba0 msgr2=0x7fc5f4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc60a7fc700 1 --2- 172.21.15.125:0/3810122393 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc60c068ba0 0x7fc5f4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc60a7fc700 1 -- 172.21.15.125:0/3810122393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5f4004d50 msgr2=0x7fc5f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc60a7fc700 1 --2- 172.21.15.125:0/3810122393 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc5f4004d50 0x7fc5f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc60a7fc700 1 -- 172.21.15.125:0/3810122393 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f4003570 con 0x7fc5f4004080 2023-10-06T03:06:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc60affd700 1 --2- 172.21.15.125:0/3810122393 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc60c068ba0 0x7fc5f4003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc60a7fc700 1 --2- 172.21.15.125:0/3810122393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5f4004080 0x7fc5f4004810 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0018b0 tx=0x7fc5fc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad03ac4ce452fb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc609ffb700 1 -- 172.21.15.125:0/3810122393 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc012420 con 0x7fc5f4004080 2023-10-06T03:06:42.713 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc609ffb700 1 -- 172.21.15.125:0/3810122393 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc012580 con 0x7fc5f4004080 2023-10-06T03:06:42.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.707+0000 7fc609ffb700 1 -- 172.21.15.125:0/3810122393 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc012920 con 0x7fc5f4004080 2023-10-06T03:06:42.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.708+0000 7fc61177d700 1 -- 172.21.15.125:0/3810122393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5f4004080 msgr2=0x7fc5f4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:42.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.708+0000 7fc61177d700 1 --2- 172.21.15.125:0/3810122393 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc5f4004080 0x7fc5f4004810 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0018b0 tx=0x7fc5fc007d30 comp rx=0 tx=0).stop 2023-10-06T03:06:42.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.708+0000 7fc60b7fe700 1 -- 172.21.15.125:0/3810122393 reap_dead start 2023-10-06T03:06:42.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.708+0000 7fc61177d700 1 -- 172.21.15.125:0/3810122393 shutdown_connections 2023-10-06T03:06:42.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.708+0000 7fc61177d700 1 -- 172.21.15.125:0/3810122393 >> 172.21.15.125:0/3810122393 conn(0x7fc60c0af730 msgr2=0x7fc60c0afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:42.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.708+0000 7fc61177d700 1 -- 172.21.15.125:0/3810122393 shutdown_connections 2023-10-06T03:06:42.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.708+0000 7fc61177d700 1 -- 172.21.15.125:0/3810122393 wait complete. 2023-10-06T03:06:42.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.709+0000 7fc61177d700 1 Processor -- start 2023-10-06T03:06:42.715 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.709+0000 7fc61177d700 1 -- start start 2023-10-06T03:06:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.710+0000 7fc61177d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5f4004080 0x7fc60c14f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.710+0000 7fc61177d700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc60c0cbb60 0x7fc60c0cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.710+0000 7fc61177d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc60c154dd0 0x7fc60c155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.710+0000 7fc61177d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c15ad80 con 0x7fc60c154dd0 2023-10-06T03:06:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.710+0000 7fc61177d700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c0cc510 con 0x7fc60c0cbb60 2023-10-06T03:06:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.710+0000 7fc61177d700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c1557b0 con 0x7fc5f4004080 2023-10-06T03:06:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.710+0000 7fc60b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc60c154dd0 0x7fc60c155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:42.717 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.710+0000 7fc60b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc60c154dd0 0x7fc60c155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:48290/0 (socket says 172.21.15.125:48290) 2023-10-06T03:06:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.710+0000 7fc60b7fe700 1 -- 172.21.15.125:0/639976213 learned_addr learned my addr 172.21.15.125:0/639976213 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.710+0000 7fc60affd700 1 --2- 172.21.15.125:0/639976213 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5f4004080 0x7fc60c14f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.710+0000 7fc60a7fc700 1 --2- 172.21.15.125:0/639976213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc60c0cbb60 0x7fc60c0cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.710+0000 7fc60b7fe700 1 -- 172.21.15.125:0/639976213 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5f4004080 msgr2=0x7fc60c14f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.710+0000 7fc60b7fe700 1 --2- 172.21.15.125:0/639976213 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5f4004080 0x7fc60c14f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.710+0000 7fc60b7fe700 1 -- 172.21.15.125:0/639976213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc60c0cbb60 msgr2=0x7fc60c0cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.710+0000 7fc60b7fe700 1 --2- 172.21.15.125:0/639976213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc60c0cbb60 0x7fc60c0cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.710+0000 7fc60b7fe700 1 -- 172.21.15.125:0/639976213 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c15a100 con 0x7fc60c154dd0 2023-10-06T03:06:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.711+0000 7fc60b7fe700 1 --2- 172.21.15.125:0/639976213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc60c154dd0 0x7fc60c155270 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc60c06daf0 tx=0x7fc6040097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.711+0000 7fc5f2ffd700 1 -- 172.21.15.125:0/639976213 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604010bc0 con 0x7fc60c154dd0 2023-10-06T03:06:42.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.711+0000 7fc5f2ffd700 1 -- 172.21.15.125:0/639976213 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc604010d60 con 0x7fc60c154dd0 2023-10-06T03:06:42.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.711+0000 7fc5f2ffd700 1 -- 172.21.15.125:0/639976213 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604017680 con 0x7fc60c154dd0 2023-10-06T03:06:42.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.711+0000 7fc61177d700 1 -- 172.21.15.125:0/639976213 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60c15a3e0 con 0x7fc60c154dd0 2023-10-06T03:06:42.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.711+0000 7fc61177d700 1 -- 172.21.15.125:0/639976213 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60c15a9a0 con 0x7fc60c154dd0 2023-10-06T03:06:42.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.712+0000 7fc61177d700 1 -- 172.21.15.125:0/639976213 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc60c15aec0 con 0x7fc60c154dd0 2023-10-06T03:06:42.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.712+0000 7fc5f2ffd700 1 -- 172.21.15.125:0/639976213 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc604017a70 con 0x7fc60c154dd0 2023-10-06T03:06:42.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.712+0000 7fc5f2ffd700 1 --2- 172.21.15.125:0/639976213 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc5f8066f30 0x7fc5f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:42.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.713+0000 7fc5f2ffd700 1 -- 172.21.15.125:0/639976213 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fc6040853a0 con 0x7fc60c154dd0 2023-10-06T03:06:42.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.713+0000 7fc60affd700 1 --2- 172.21.15.125:0/639976213 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc5f8066f30 0x7fc5f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:42.719 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.713+0000 7fc60affd700 1 --2- 172.21.15.125:0/639976213 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc5f8066f30 0x7fc5f80693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc600001720 tx=0x7fc600009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:42.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.717+0000 7fc5f2ffd700 1 -- 172.21.15.125:0/639976213 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc60c15aec0 con 0x7fc60c154dd0 2023-10-06T03:06:42.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.975+0000 7fc61177d700 1 -- 172.21.15.125:0/639976213 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]} v 0) v1 -- 0x7fc60c15aec0 con 0x7fc60c154dd0 2023-10-06T03:06:42.980 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.979+0000 7fc5f2ffd700 1 -- 172.21.15.125:0/639976213 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow w pool=cephfs_data"]}]=0 updated caps for client.0 v21) v1 ==== 183+0+0 (secure 0 0 0) 0x7fc60c15aec0 con 0x7fc60c154dd0 2023-10-06T03:06:42.982 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.981+0000 7fc61177d700 1 -- 172.21.15.125:0/639976213 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc5f8066f30 msgr2=0x7fc5f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:42.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.981+0000 7fc61177d700 1 --2- 172.21.15.125:0/639976213 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc5f8066f30 0x7fc5f80693e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc600001720 tx=0x7fc600009040 comp rx=0 tx=0).stop 2023-10-06T03:06:42.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.981+0000 7fc61177d700 1 -- 172.21.15.125:0/639976213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc60c154dd0 msgr2=0x7fc60c155270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:42.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.981+0000 7fc61177d700 1 --2- 172.21.15.125:0/639976213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc60c154dd0 0x7fc60c155270 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc60c06daf0 tx=0x7fc6040097f0 comp rx=0 tx=0).stop 2023-10-06T03:06:42.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.981+0000 7fc61177d700 1 -- 172.21.15.125:0/639976213 shutdown_connections 2023-10-06T03:06:42.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.981+0000 7fc61177d700 1 --2- 172.21.15.125:0/639976213 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fc5f8066f30 0x7fc5f80693e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:42.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.981+0000 7fc61177d700 1 --2- 172.21.15.125:0/639976213 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fc60c154dd0 0x7fc60c155270 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:42.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.981+0000 7fc61177d700 1 --2- 172.21.15.125:0/639976213 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fc5f4004080 0x7fc60c14f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:42.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.981+0000 7fc61177d700 1 --2- 172.21.15.125:0/639976213 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc60c0cbb60 0x7fc60c0cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:42.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.981+0000 7fc61177d700 1 -- 172.21.15.125:0/639976213 >> 172.21.15.125:0/639976213 conn(0x7fc60c0af730 msgr2=0x7fc60c158e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:42.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.981+0000 7fc61177d700 1 -- 172.21.15.125:0/639976213 shutdown_connections 2023-10-06T03:06:42.983 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:42.981+0000 7fc61177d700 1 -- 172.21.15.125:0/639976213 wait complete. 2023-10-06T03:06:42.984 INFO:teuthology.orchestra.run.smithi125.stderr:updated caps for client.0 2023-10-06T03:06:42.994 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2023-10-06T03:06:42.994 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:06:42.994 DEBUG:teuthology.orchestra.run.smithi125:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:43.030 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[141844]: fuse finished with error 0 and tester_r 0 2023-10-06T03:06:43.031 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T03:06:49.133 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:06:49.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:49.133 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:06:49.156 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T03:06:49.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.331+0000 7fe2c781a700 1 Processor -- start 2023-10-06T03:06:49.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.332+0000 7fe2c781a700 1 -- start start 2023-10-06T03:06:49.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2c781a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2c00cbb50 0x7fe2c00a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:49.336 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2c781a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe2c00cbf20 0x7fe2c00caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:49.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2c781a700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe2c00caf80 0x7fe2c00c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:49.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2c781a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c00cb420 con 0x7fe2c00cbf20 2023-10-06T03:06:49.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2c781a700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c00c2910 con 0x7fe2c00caf80 2023-10-06T03:06:49.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2c781a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00c1d40 con 0x7fe2c00cbb50 2023-10-06T03:06:49.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2c4db5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe2c00cbf20 0x7fe2c00caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:49.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2c4db5700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe2c00cbf20 0x7fe2c00caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44158/0 (socket says 172.21.15.125:44158) 2023-10-06T03:06:49.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2c4db5700 1 -- 172.21.15.125:0/1867060232 learned_addr learned my addr 172.21.15.125:0/1867060232 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:49.337 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2c55b6700 1 --2- 172.21.15.125:0/1867060232 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2c00cbb50 0x7fe2c00a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:49.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2c5db7700 1 --2- 172.21.15.125:0/1867060232 >> v2:172.21.15.130:3300/0 conn(0x7fe2c00caf80 0x7fe2c00c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:49.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2c4db5700 1 -- 172.21.15.125:0/1867060232 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2c00cbb50 msgr2=0x7fe2c00a99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:49.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2c4db5700 1 --2- 172.21.15.125:0/1867060232 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2c00cbb50 0x7fe2c00a99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:49.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2c4db5700 1 -- 172.21.15.125:0/1867060232 >> v2:172.21.15.130:3300/0 conn(0x7fe2c00caf80 msgr2=0x7fe2c00c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:49.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2c4db5700 1 --2- 172.21.15.125:0/1867060232 >> v2:172.21.15.130:3300/0 conn(0x7fe2c00caf80 0x7fe2c00c2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:49.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2c4db5700 1 -- 172.21.15.125:0/1867060232 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c00c1fe0 con 0x7fe2c00cbf20 2023-10-06T03:06:49.338 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2c4db5700 1 --2- 172.21.15.125:0/1867060232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c00cbf20 0x7fe2c00caa40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe2c006efc0 tx=0x7fe2b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc108a0f73a440e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:49.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2b3fff700 1 -- 172.21.15.125:0/1867060232 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b400b860 con 0x7fe2c00cbf20 2023-10-06T03:06:49.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2b3fff700 1 -- 172.21.15.125:0/1867060232 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b400b9c0 con 0x7fe2c00cbf20 2023-10-06T03:06:49.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.333+0000 7fe2b3fff700 1 -- 172.21.15.125:0/1867060232 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b400bd60 con 0x7fe2c00cbf20 2023-10-06T03:06:49.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.334+0000 7fe2c781a700 1 -- 172.21.15.125:0/1867060232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c00cbf20 msgr2=0x7fe2c00caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:49.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.334+0000 7fe2c781a700 1 --2- 172.21.15.125:0/1867060232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c00cbf20 0x7fe2c00caa40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe2c006efc0 tx=0x7fe2b4009250 comp rx=0 tx=0).stop 2023-10-06T03:06:49.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.334+0000 7fe2c781a700 1 -- 172.21.15.125:0/1867060232 shutdown_connections 2023-10-06T03:06:49.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.334+0000 7fe2c781a700 1 --2- 172.21.15.125:0/1867060232 >> v2:172.21.15.130:3300/0 conn(0x7fe2c00caf80 0x7fe2c00c2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:49.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.334+0000 7fe2c781a700 1 --2- 172.21.15.125:0/1867060232 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2c00cbb50 0x7fe2c00a99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:49.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.334+0000 7fe2c781a700 1 --2- 172.21.15.125:0/1867060232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c00cbf20 0x7fe2c00caa40 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:49.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.334+0000 7fe2c781a700 1 -- 172.21.15.125:0/1867060232 >> 172.21.15.125:0/1867060232 conn(0x7fe2c0068f00 msgr2=0x7fe2c00cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:49.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.334+0000 7fe2c781a700 1 -- 172.21.15.125:0/1867060232 shutdown_connections 2023-10-06T03:06:49.340 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.334+0000 7fe2c781a700 1 -- 172.21.15.125:0/1867060232 wait complete. 2023-10-06T03:06:49.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.336+0000 7fe2c781a700 1 Processor -- start 2023-10-06T03:06:49.343 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.336+0000 7fe2c781a700 1 -- start start 2023-10-06T03:06:49.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.337+0000 7fe2c781a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2c00caf80 0x7fe2c00c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:49.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.337+0000 7fe2c781a700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2c00cbb50 0x7fe2c00c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:49.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.337+0000 7fe2c781a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c00cbf20 0x7fe2c01484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:49.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.337+0000 7fe2c781a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00c4460 con 0x7fe2c00cbf20 2023-10-06T03:06:49.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.337+0000 7fe2c781a700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00c4700 con 0x7fe2c00cbb50 2023-10-06T03:06:49.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.337+0000 7fe2c781a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00c49e0 con 0x7fe2c00caf80 2023-10-06T03:06:49.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.337+0000 7fe2c5db7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c00cbf20 0x7fe2c01484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:49.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.337+0000 7fe2c5db7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c00cbf20 0x7fe2c01484f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44168/0 (socket says 172.21.15.125:44168) 2023-10-06T03:06:49.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.337+0000 7fe2c5db7700 1 -- 172.21.15.125:0/3439925788 learned_addr learned my addr 172.21.15.125:0/3439925788 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:49.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.337+0000 7fe2c55b6700 1 --2- 172.21.15.125:0/3439925788 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2c00caf80 0x7fe2c00c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:49.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.337+0000 7fe2c4db5700 1 --2- 172.21.15.125:0/3439925788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2c00cbb50 0x7fe2c00c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:49.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.337+0000 7fe2c5db7700 1 -- 172.21.15.125:0/3439925788 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2c00caf80 msgr2=0x7fe2c00c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:49.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.337+0000 7fe2c5db7700 1 --2- 172.21.15.125:0/3439925788 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2c00caf80 0x7fe2c00c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:49.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.337+0000 7fe2c5db7700 1 -- 172.21.15.125:0/3439925788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2c00cbb50 msgr2=0x7fe2c00c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:49.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.337+0000 7fe2c5db7700 1 --2- 172.21.15.125:0/3439925788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2c00cbb50 0x7fe2c00c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:49.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.337+0000 7fe2c5db7700 1 -- 172.21.15.125:0/3439925788 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b40094f0 con 0x7fe2c00cbf20 2023-10-06T03:06:49.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.338+0000 7fe2c5db7700 1 --2- 172.21.15.125:0/3439925788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c00cbf20 0x7fe2c01484f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009fa0 tx=0x7fe2b8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:49.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.338+0000 7fe2b17fa700 1 -- 172.21.15.125:0/3439925788 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800ebc0 con 0x7fe2c00cbf20 2023-10-06T03:06:49.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.338+0000 7fe2b17fa700 1 -- 172.21.15.125:0/3439925788 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b800ed20 con 0x7fe2c00cbf20 2023-10-06T03:06:49.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.338+0000 7fe2c781a700 1 -- 172.21.15.125:0/3439925788 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c00c4cc0 con 0x7fe2c00cbf20 2023-10-06T03:06:49.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.338+0000 7fe2b17fa700 1 -- 172.21.15.125:0/3439925788 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8014670 con 0x7fe2c00cbf20 2023-10-06T03:06:49.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.338+0000 7fe2c781a700 1 -- 172.21.15.125:0/3439925788 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c0148a30 con 0x7fe2c00cbf20 2023-10-06T03:06:49.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.339+0000 7fe2b17fa700 1 -- 172.21.15.125:0/3439925788 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2b80149e0 con 0x7fe2c00cbf20 2023-10-06T03:06:49.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.339+0000 7fe2c781a700 1 -- 172.21.15.125:0/3439925788 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c0066510 con 0x7fe2c00cbf20 2023-10-06T03:06:49.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.340+0000 7fe2b17fa700 1 --2- 172.21.15.125:0/3439925788 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe2a4066f30 0x7fe2a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:49.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.340+0000 7fe2b17fa700 1 -- 172.21.15.125:0/3439925788 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe2b8084e70 con 0x7fe2c00cbf20 2023-10-06T03:06:49.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.340+0000 7fe2c55b6700 1 --2- 172.21.15.125:0/3439925788 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe2a4066f30 0x7fe2a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:49.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.340+0000 7fe2c55b6700 1 --2- 172.21.15.125:0/3439925788 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe2a4066f30 0x7fe2a40693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00c7110 tx=0x7fe2bc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:49.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.344+0000 7fe2b17fa700 1 -- 172.21.15.125:0/3439925788 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2b8051e40 con 0x7fe2c00cbf20 2023-10-06T03:06:49.570 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.568+0000 7fe2c781a700 1 -- 172.21.15.125:0/3439925788 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe2c00c22c0 con 0x7fe2c00cbf20 2023-10-06T03:06:49.571 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.569+0000 7fe2b17fa700 1 -- 172.21.15.125:0/3439925788 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe2b8055460 con 0x7fe2c00cbf20 2023-10-06T03:06:49.571 INFO:teuthology.orchestra.run.smithi125.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T03:06:49.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.571+0000 7fe2c781a700 1 -- 172.21.15.125:0/3439925788 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe2a4066f30 msgr2=0x7fe2a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:49.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.571+0000 7fe2c781a700 1 --2- 172.21.15.125:0/3439925788 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe2a4066f30 0x7fe2a40693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00c7110 tx=0x7fe2bc008040 comp rx=0 tx=0).stop 2023-10-06T03:06:49.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.571+0000 7fe2c781a700 1 -- 172.21.15.125:0/3439925788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c00cbf20 msgr2=0x7fe2c01484f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:49.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.571+0000 7fe2c781a700 1 --2- 172.21.15.125:0/3439925788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c00cbf20 0x7fe2c01484f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009fa0 tx=0x7fe2b8009900 comp rx=0 tx=0).stop 2023-10-06T03:06:49.573 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.571+0000 7fe2c781a700 1 -- 172.21.15.125:0/3439925788 shutdown_connections 2023-10-06T03:06:49.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.571+0000 7fe2c781a700 1 --2- 172.21.15.125:0/3439925788 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe2a4066f30 0x7fe2a40693e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:49.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.571+0000 7fe2c781a700 1 --2- 172.21.15.125:0/3439925788 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe2c00cbf20 0x7fe2c01484f0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:49.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.571+0000 7fe2c781a700 1 --2- 172.21.15.125:0/3439925788 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe2c00caf80 0x7fe2c00c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:49.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.571+0000 7fe2c781a700 1 --2- 172.21.15.125:0/3439925788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2c00cbb50 0x7fe2c00c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:49.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.571+0000 7fe2c781a700 1 -- 172.21.15.125:0/3439925788 >> 172.21.15.125:0/3439925788 conn(0x7fe2c0068f00 msgr2=0x7fe2c00cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:49.574 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.571+0000 7fe2c781a700 1 -- 172.21.15.125:0/3439925788 shutdown_connections 2023-10-06T03:06:49.575 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:49.571+0000 7fe2c781a700 1 -- 172.21.15.125:0/3439925788 wait complete. 2023-10-06T03:06:49.584 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T03:06:49.584 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T03:06:49.585 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi125.front.sepia.ceph.com 2023-10-06T03:06:49.585 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T03:06:49.585 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:49.585 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T03:06:49.585 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T03:06:49.585 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T03:06:49.585 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:06:49.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:49.586 DEBUG:teuthology.orchestra.run.smithi125:> ip addr 2023-10-06T03:06:49.606 INFO:teuthology.orchestra.run.smithi125.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T03:06:49.606 INFO:teuthology.orchestra.run.smithi125.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T03:06:49.606 INFO:teuthology.orchestra.run.smithi125.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T03:06:49.606 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:49.607 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 ::1/128 scope host 2023-10-06T03:06:49.607 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:49.607 INFO:teuthology.orchestra.run.smithi125.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:06:49.607 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f8 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:06:49.607 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f0 2023-10-06T03:06:49.607 INFO:teuthology.orchestra.run.smithi125.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:06:49.608 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:d8:da:f9 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:06:49.608 INFO:teuthology.orchestra.run.smithi125.stdout: altname enp7s0f1 2023-10-06T03:06:49.608 INFO:teuthology.orchestra.run.smithi125.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T03:06:49.608 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:38 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:06:49.608 INFO:teuthology.orchestra.run.smithi125.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T03:06:49.608 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 0c:c4:7a:8f:d7:39 brd ff:ff:ff:ff:ff:ff 2023-10-06T03:06:49.609 INFO:teuthology.orchestra.run.smithi125.stdout: inet 172.21.15.125/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T03:06:49.609 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft 42391sec preferred_lft 42391sec 2023-10-06T03:06:49.609 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::ec4:7aff:fe8f:d739/64 scope link 2023-10-06T03:06:49.609 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:49.609 INFO:teuthology.orchestra.run.smithi125.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T03:06:49.609 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 46:01:08:d7:90:9a brd ff:ff:ff:ff:ff:ff 2023-10-06T03:06:49.610 INFO:teuthology.orchestra.run.smithi125.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T03:06:49.610 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:49.610 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::f829:e8ff:fe3d:51e0/64 scope link 2023-10-06T03:06:49.610 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:49.610 INFO:teuthology.orchestra.run.smithi125.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:06:49.610 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 46:01:08:d7:90:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:06:49.611 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::4401:8ff:fed7:909a/64 scope link 2023-10-06T03:06:49.611 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:49.611 INFO:teuthology.orchestra.run.smithi125.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T03:06:49.611 INFO:teuthology.orchestra.run.smithi125.stdout: link/ether 9a:de:60:3d:d7:10 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:06:49.611 INFO:teuthology.orchestra.run.smithi125.stdout: inet6 fe80::98de:60ff:fe3d:d710/64 scope link 2023-10-06T03:06:49.611 INFO:teuthology.orchestra.run.smithi125.stdout: valid_lft forever preferred_lft forever 2023-10-06T03:06:49.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:49.612 DEBUG:teuthology.orchestra.run.smithi125:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T03:06:49.672 INFO:teuthology.orchestra.run.smithi125.stdout:1 2023-10-06T03:06:49.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:49.673 DEBUG:teuthology.orchestra.run.smithi125:> route 2023-10-06T03:06:49.733 INFO:teuthology.orchestra.run.smithi125.stdout:Kernel IP routing table 2023-10-06T03:06:49.733 INFO:teuthology.orchestra.run.smithi125.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T03:06:49.733 INFO:teuthology.orchestra.run.smithi125.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T03:06:49.733 INFO:teuthology.orchestra.run.smithi125.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T03:06:49.733 INFO:teuthology.orchestra.run.smithi125.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T03:06:49.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:49.734 DEBUG:teuthology.orchestra.run.smithi125:> (cd / && exec bash -c ' 2023-10-06T03:06:49.734 DEBUG:teuthology.orchestra.run.smithi125:> set -e 2023-10-06T03:06:49.734 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T03:06:49.734 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T03:06:49.734 DEBUG:teuthology.orchestra.run.smithi125:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T03:06:49.734 DEBUG:teuthology.orchestra.run.smithi125:> ') 2023-10-06T03:06:49.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:49.838 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-06T03:06:49.856 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:06:49.856 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:06:49.857 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:06:49.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:49.857 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link set brx.0 up 2023-10-06T03:06:49.924 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T03:06:49.924 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:06:49.924 DEBUG:teuthology.orchestra.run.smithi125:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:49.982 INFO:teuthology.orchestra.run.smithi125.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T03:06:49.983 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T03:06:49.983 DEBUG:teuthology.orchestra.run.smithi125:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:50.040 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-06T03:06:50.107 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:06:50.108 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:06:50.175 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:06:50.175 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:06:50.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:06:50.176 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-06T03:06:50.234 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T03:06:50.234 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T03:06:50.277 DEBUG:teuthology.orchestra.run.smithi125:> sudo modprobe fuse 2023-10-06T03:06:50.303 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T03:06:50.304 DEBUG:teuthology.orchestra.run.smithi125:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T03:06:50.360 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:2023-10-06T03:06:50.358+0000 7fe46f6aa540 -1 init, newargv = 0x560ffcaa6e20 newargc=15 2023-10-06T03:06:50.360 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[142522]: starting ceph client 2023-10-06T03:06:50.364 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[142522]: starting fuse 2023-10-06T03:06:50.373 INFO:teuthology.orchestra.run.smithi125.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T03:06:50.374 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T03:06:50.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:06:50.375 DEBUG:teuthology.orchestra.run.smithi125:> ls /sys/fs/fuse/connections 2023-10-06T03:06:50.433 INFO:teuthology.orchestra.run.smithi125.stdout:46 2023-10-06T03:06:50.433 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T03:06:50.434 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:06:50.434 DEBUG:teuthology.orchestra.run.smithi125:> import glob 2023-10-06T03:06:50.434 DEBUG:teuthology.orchestra.run.smithi125:> import re 2023-10-06T03:06:50.434 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-10-06T03:06:50.434 DEBUG:teuthology.orchestra.run.smithi125:> import subprocess 2023-10-06T03:06:50.434 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:06:50.434 DEBUG:teuthology.orchestra.run.smithi125:> def _find_admin_socket(client_name): 2023-10-06T03:06:50.434 DEBUG:teuthology.orchestra.run.smithi125:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T03:06:50.434 DEBUG:teuthology.orchestra.run.smithi125:> files = glob.glob(asok_path) 2023-10-06T03:06:50.434 DEBUG:teuthology.orchestra.run.smithi125:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T03:06:50.435 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:06:50.435 DEBUG:teuthology.orchestra.run.smithi125:> # Given a non-glob path, it better be there 2023-10-06T03:06:50.435 DEBUG:teuthology.orchestra.run.smithi125:> if "*" not in asok_path: 2023-10-06T03:06:50.435 DEBUG:teuthology.orchestra.run.smithi125:> assert(len(files) == 1) 2023-10-06T03:06:50.435 DEBUG:teuthology.orchestra.run.smithi125:> return files[0] 2023-10-06T03:06:50.435 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:06:50.435 DEBUG:teuthology.orchestra.run.smithi125:> for f in files: 2023-10-06T03:06:50.435 DEBUG:teuthology.orchestra.run.smithi125:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T03:06:50.435 DEBUG:teuthology.orchestra.run.smithi125:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T03:06:50.435 DEBUG:teuthology.orchestra.run.smithi125:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T03:06:50.435 DEBUG:teuthology.orchestra.run.smithi125:> contents = proc_f.read() 2023-10-06T03:06:50.435 DEBUG:teuthology.orchestra.run.smithi125:> if mountpoint in contents: 2023-10-06T03:06:50.435 DEBUG:teuthology.orchestra.run.smithi125:> return f 2023-10-06T03:06:50.436 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T03:06:50.436 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:06:50.436 DEBUG:teuthology.orchestra.run.smithi125:> print(_find_admin_socket("client.0")) 2023-10-06T03:06:50.436 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-10-06T03:06:50.557 INFO:teuthology.orchestra.run.smithi125.stdout:/var/run/ceph/ceph-client.0.142522.asok 2023-10-06T03:06:50.738 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.142522.asok 2023-10-06T03:06:50.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:06:50.739 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.142522.asok status 2023-10-06T03:06:50.893 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:06:50.893 INFO:teuthology.orchestra.run.smithi125.stdout: "metadata": { 2023-10-06T03:06:50.893 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_sha1": "736ac5ba72cb47af7d6f6666b1e100f7e20a20e2", 2023-10-06T03:06:50.893 INFO:teuthology.orchestra.run.smithi125.stdout: "ceph_version": "ceph version 17.2.6-1296-g736ac5ba (736ac5ba72cb47af7d6f6666b1e100f7e20a20e2) quincy (stable)", 2023-10-06T03:06:50.893 INFO:teuthology.orchestra.run.smithi125.stdout: "entity_id": "0", 2023-10-06T03:06:50.894 INFO:teuthology.orchestra.run.smithi125.stdout: "hostname": "smithi125", 2023-10-06T03:06:50.894 INFO:teuthology.orchestra.run.smithi125.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T03:06:50.894 INFO:teuthology.orchestra.run.smithi125.stdout: "pid": "142522", 2023-10-06T03:06:50.894 INFO:teuthology.orchestra.run.smithi125.stdout: "root": "/" 2023-10-06T03:06:50.894 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:50.894 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_count": 0, 2023-10-06T03:06:50.894 INFO:teuthology.orchestra.run.smithi125.stdout: "dentry_pinned_count": 0, 2023-10-06T03:06:50.894 INFO:teuthology.orchestra.run.smithi125.stdout: "id": 5805, 2023-10-06T03:06:50.894 INFO:teuthology.orchestra.run.smithi125.stdout: "inst": { 2023-10-06T03:06:50.894 INFO:teuthology.orchestra.run.smithi125.stdout: "name": { 2023-10-06T03:06:50.894 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "client", 2023-10-06T03:06:50.894 INFO:teuthology.orchestra.run.smithi125.stdout: "num": 5805 2023-10-06T03:06:50.895 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:50.895 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-06T03:06:50.895 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-06T03:06:50.895 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:06:50.895 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 3298252404 2023-10-06T03:06:50.895 INFO:teuthology.orchestra.run.smithi125.stdout: } 2023-10-06T03:06:50.895 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:50.895 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": { 2023-10-06T03:06:50.895 INFO:teuthology.orchestra.run.smithi125.stdout: "type": "v1", 2023-10-06T03:06:50.895 INFO:teuthology.orchestra.run.smithi125.stdout: "addr": "192.168.0.1:0", 2023-10-06T03:06:50.895 INFO:teuthology.orchestra.run.smithi125.stdout: "nonce": 3298252404 2023-10-06T03:06:50.895 INFO:teuthology.orchestra.run.smithi125.stdout: }, 2023-10-06T03:06:50.896 INFO:teuthology.orchestra.run.smithi125.stdout: "inst_str": "client.5805 192.168.0.1:0/3298252404", 2023-10-06T03:06:50.896 INFO:teuthology.orchestra.run.smithi125.stdout: "addr_str": "192.168.0.1:0/3298252404", 2023-10-06T03:06:50.896 INFO:teuthology.orchestra.run.smithi125.stdout: "inode_count": 1, 2023-10-06T03:06:50.896 INFO:teuthology.orchestra.run.smithi125.stdout: "mds_epoch": 27, 2023-10-06T03:06:50.896 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch": 57, 2023-10-06T03:06:50.896 INFO:teuthology.orchestra.run.smithi125.stdout: "osd_epoch_barrier": 0, 2023-10-06T03:06:50.896 INFO:teuthology.orchestra.run.smithi125.stdout: "blocklisted": false, 2023-10-06T03:06:50.896 INFO:teuthology.orchestra.run.smithi125.stdout: "fs_name": "cephfs" 2023-10-06T03:06:50.896 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:06:50.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:06:50.903 DEBUG:teuthology.orchestra.run.smithi125:> stat --file-system '--printf=%T 2023-10-06T03:06:50.903 DEBUG:teuthology.orchestra.run.smithi125:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:50.921 INFO:teuthology.orchestra.run.smithi125.stdout:fuseblk 2023-10-06T03:06:50.921 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:50.922 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T03:06:50.922 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:50.988 DEBUG:teuthology.orchestra.run.smithi125:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T03:06:50.988 DEBUG:teuthology.orchestra.run.smithi125:> import os 2023-10-06T03:06:50.989 DEBUG:teuthology.orchestra.run.smithi125:> import errno 2023-10-06T03:06:50.989 DEBUG:teuthology.orchestra.run.smithi125:> 2023-10-06T03:06:50.989 DEBUG:teuthology.orchestra.run.smithi125:> fd = os.open("/home/ubuntu/cephtest/mnt.0/test_file", os.O_RDWR) 2023-10-06T03:06:50.989 DEBUG:teuthology.orchestra.run.smithi125:> try: 2023-10-06T03:06:50.989 DEBUG:teuthology.orchestra.run.smithi125:> if True: 2023-10-06T03:06:50.989 DEBUG:teuthology.orchestra.run.smithi125:> ret = os.read(fd, 1024) 2023-10-06T03:06:50.989 DEBUG:teuthology.orchestra.run.smithi125:> else: 2023-10-06T03:06:50.989 DEBUG:teuthology.orchestra.run.smithi125:> os.write(fd, b'"'"'content'"'"') 2023-10-06T03:06:50.989 DEBUG:teuthology.orchestra.run.smithi125:> except OSError as e: 2023-10-06T03:06:50.989 DEBUG:teuthology.orchestra.run.smithi125:> if e.errno != errno.EPERM: 2023-10-06T03:06:50.989 DEBUG:teuthology.orchestra.run.smithi125:> raise 2023-10-06T03:06:50.989 DEBUG:teuthology.orchestra.run.smithi125:> else: 2023-10-06T03:06:50.990 DEBUG:teuthology.orchestra.run.smithi125:> raise RuntimeError("client does not check permission of data pool") 2023-10-06T03:06:50.990 DEBUG:teuthology.orchestra.run.smithi125:> ' 2023-10-06T03:06:51.284 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2023-10-06T03:06:51.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.449+0000 7f6b99d0e700 1 Processor -- start 2023-10-06T03:06:51.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.449+0000 7f6b99d0e700 1 -- start start 2023-10-06T03:06:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b99d0e700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6b94156de0 0x7f6b941571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b99d0e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b940cc060 0x7f6b9415b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b99d0e700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6b940cd790 0x7f6b940ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b99d0e700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b940cc4b0 con 0x7f6b94156de0 2023-10-06T03:06:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b99d0e700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b940cd300 con 0x7f6b940cd790 2023-10-06T03:06:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b99d0e700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9415bc50 con 0x7f6b940cc060 2023-10-06T03:06:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b937fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6b94156de0 0x7f6b941571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b937fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f6b94156de0 0x7f6b941571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44176/0 (socket says 172.21.15.125:44176) 2023-10-06T03:06:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b937fe700 1 -- 172.21.15.125:0/2857556354 learned_addr learned my addr 172.21.15.125:0/2857556354 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:51.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b8bfff700 1 --2- 172.21.15.125:0/2857556354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b940cc060 0x7f6b9415b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:51.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b93fff700 1 --2- 172.21.15.125:0/2857556354 >> v2:172.21.15.130:3300/0 conn(0x7f6b940cd790 0x7f6b940ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:51.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b937fe700 1 -- 172.21.15.125:0/2857556354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b940cc060 msgr2=0x7f6b9415b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:51.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b937fe700 1 --2- 172.21.15.125:0/2857556354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b940cc060 0x7f6b9415b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:51.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b937fe700 1 -- 172.21.15.125:0/2857556354 >> v2:172.21.15.130:3300/0 conn(0x7f6b940cd790 msgr2=0x7f6b940ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:51.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b937fe700 1 --2- 172.21.15.125:0/2857556354 >> v2:172.21.15.130:3300/0 conn(0x7f6b940cd790 0x7f6b940ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:51.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b937fe700 1 -- 172.21.15.125:0/2857556354 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b940cc6f0 con 0x7f6b94156de0 2023-10-06T03:06:51.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b93fff700 1 --2- 172.21.15.125:0/2857556354 >> v2:172.21.15.130:3300/0 conn(0x7f6b940cd790 0x7f6b940ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:51.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b937fe700 1 --2- 172.21.15.125:0/2857556354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b94156de0 0x7f6b941571b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6b940c4e90 tx=0x7f6b84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2cb554d1b70ca07 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:51.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b92ffd700 1 -- 172.21.15.125:0/2857556354 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8400b860 con 0x7f6b94156de0 2023-10-06T03:06:51.454 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b92ffd700 1 -- 172.21.15.125:0/2857556354 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8400b9c0 con 0x7f6b94156de0 2023-10-06T03:06:51.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.450+0000 7f6b92ffd700 1 -- 172.21.15.125:0/2857556354 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8400bd60 con 0x7f6b94156de0 2023-10-06T03:06:51.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.451+0000 7f6b99d0e700 1 -- 172.21.15.125:0/2857556354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b94156de0 msgr2=0x7f6b941571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:51.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.451+0000 7f6b99d0e700 1 --2- 172.21.15.125:0/2857556354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b94156de0 0x7f6b941571b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6b940c4e90 tx=0x7f6b84009250 comp rx=0 tx=0).stop 2023-10-06T03:06:51.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.451+0000 7f6b99d0e700 1 -- 172.21.15.125:0/2857556354 shutdown_connections 2023-10-06T03:06:51.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.451+0000 7f6b99d0e700 1 --2- 172.21.15.125:0/2857556354 >> v2:172.21.15.130:3300/0 conn(0x7f6b940cd790 0x7f6b940ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:51.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.451+0000 7f6b99d0e700 1 --2- 172.21.15.125:0/2857556354 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b94156de0 0x7f6b941571b0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:51.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.451+0000 7f6b99d0e700 1 --2- 172.21.15.125:0/2857556354 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b940cc060 0x7f6b9415b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:51.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.451+0000 7f6b99d0e700 1 -- 172.21.15.125:0/2857556354 >> 172.21.15.125:0/2857556354 conn(0x7f6b940cdf80 msgr2=0x7f6b940ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:51.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.451+0000 7f6b99d0e700 1 -- 172.21.15.125:0/2857556354 shutdown_connections 2023-10-06T03:06:51.455 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.451+0000 7f6b99d0e700 1 -- 172.21.15.125:0/2857556354 wait complete. 2023-10-06T03:06:51.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.452+0000 7f6b99d0e700 1 Processor -- start 2023-10-06T03:06:51.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.452+0000 7f6b99d0e700 1 -- start start 2023-10-06T03:06:51.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.453+0000 7f6b99d0e700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b940cc060 0x7f6b94069100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:51.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.453+0000 7f6b99d0e700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b940cd790 0x7f6b94151a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:51.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.453+0000 7f6b99d0e700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b94156de0 0x7f6b94151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:51.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.453+0000 7f6b99d0e700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b940c5440 con 0x7f6b94156de0 2023-10-06T03:06:51.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.453+0000 7f6b99d0e700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9406a170 con 0x7f6b940cd790 2023-10-06T03:06:51.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.453+0000 7f6b99d0e700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b94069bb0 con 0x7f6b940cc060 2023-10-06T03:06:51.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.453+0000 7f6b93fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b94156de0 0x7f6b94151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:51.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.453+0000 7f6b93fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b94156de0 0x7f6b94151f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44180/0 (socket says 172.21.15.125:44180) 2023-10-06T03:06:51.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.453+0000 7f6b93fff700 1 -- 172.21.15.125:0/1142919021 learned_addr learned my addr 172.21.15.125:0/1142919021 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:51.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.453+0000 7f6b8bfff700 1 --2- 172.21.15.125:0/1142919021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b940cd790 0x7f6b94151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:51.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.453+0000 7f6b937fe700 1 --2- 172.21.15.125:0/1142919021 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b940cc060 0x7f6b94069100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:51.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.453+0000 7f6b93fff700 1 -- 172.21.15.125:0/1142919021 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b940cc060 msgr2=0x7f6b94069100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:51.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.453+0000 7f6b93fff700 1 --2- 172.21.15.125:0/1142919021 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b940cc060 0x7f6b94069100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:51.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.453+0000 7f6b93fff700 1 -- 172.21.15.125:0/1142919021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b940cd790 msgr2=0x7f6b94151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:51.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.453+0000 7f6b93fff700 1 --2- 172.21.15.125:0/1142919021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b940cd790 0x7f6b94151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:51.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.453+0000 7f6b93fff700 1 -- 172.21.15.125:0/1142919021 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b840094f0 con 0x7f6b94156de0 2023-10-06T03:06:51.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.454+0000 7f6b93fff700 1 --2- 172.21.15.125:0/1142919021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b94156de0 0x7f6b94151f90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00d180 tx=0x7f6b8c009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:51.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.454+0000 7f6b8b7fe700 1 -- 172.21.15.125:0/1142919021 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c00dcc0 con 0x7f6b94156de0 2023-10-06T03:06:51.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.454+0000 7f6b8b7fe700 1 -- 172.21.15.125:0/1142919021 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8c00f040 con 0x7f6b94156de0 2023-10-06T03:06:51.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.454+0000 7f6b99d0e700 1 -- 172.21.15.125:0/1142919021 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b94069e90 con 0x7f6b94156de0 2023-10-06T03:06:51.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.454+0000 7f6b8b7fe700 1 -- 172.21.15.125:0/1142919021 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c015690 con 0x7f6b94156de0 2023-10-06T03:06:51.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.454+0000 7f6b99d0e700 1 -- 172.21.15.125:0/1142919021 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b9414f700 con 0x7f6b94156de0 2023-10-06T03:06:51.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.455+0000 7f6b99d0e700 1 -- 172.21.15.125:0/1142919021 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b940cece0 con 0x7f6b94156de0 2023-10-06T03:06:51.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.455+0000 7f6b8b7fe700 1 -- 172.21.15.125:0/1142919021 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b8c01e3b0 con 0x7f6b94156de0 2023-10-06T03:06:51.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.455+0000 7f6b8b7fe700 1 --2- 172.21.15.125:0/1142919021 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6b74066f30 0x7f6b740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:51.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.456+0000 7f6b8b7fe700 1 -- 172.21.15.125:0/1142919021 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f6b8c084c40 con 0x7f6b94156de0 2023-10-06T03:06:51.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.456+0000 7f6b937fe700 1 --2- 172.21.15.125:0/1142919021 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6b74066f30 0x7f6b740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:51.460 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.456+0000 7f6b937fe700 1 --2- 172.21.15.125:0/1142919021 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6b74066f30 0x7f6b740693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6b940c4e90 tx=0x7f6b84017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:51.461 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.460+0000 7f6b8b7fe700 1 -- 172.21.15.125:0/1142919021 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b8c051c10 con 0x7f6b94156de0 2023-10-06T03:06:51.714 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.713+0000 7f6b99d0e700 1 -- 172.21.15.125:0/1142919021 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f6b94066510 con 0x7f6b94156de0 2023-10-06T03:06:51.718 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.717+0000 7f6b8b7fe700 1 -- 172.21.15.125:0/1142919021 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v22) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6b8c01a0e0 con 0x7f6b94156de0 2023-10-06T03:06:51.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.718+0000 7f6b99d0e700 1 -- 172.21.15.125:0/1142919021 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6b74066f30 msgr2=0x7f6b740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:51.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.718+0000 7f6b99d0e700 1 --2- 172.21.15.125:0/1142919021 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6b74066f30 0x7f6b740693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6b940c4e90 tx=0x7f6b84017000 comp rx=0 tx=0).stop 2023-10-06T03:06:51.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.718+0000 7f6b99d0e700 1 -- 172.21.15.125:0/1142919021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b94156de0 msgr2=0x7f6b94151f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:51.720 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.718+0000 7f6b99d0e700 1 --2- 172.21.15.125:0/1142919021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b94156de0 0x7f6b94151f90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00d180 tx=0x7f6b8c009a50 comp rx=0 tx=0).stop 2023-10-06T03:06:51.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.719+0000 7f6b99d0e700 1 -- 172.21.15.125:0/1142919021 shutdown_connections 2023-10-06T03:06:51.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.719+0000 7f6b99d0e700 1 --2- 172.21.15.125:0/1142919021 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6b74066f30 0x7f6b740693e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:51.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.719+0000 7f6b99d0e700 1 --2- 172.21.15.125:0/1142919021 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6b94156de0 0x7f6b94151f90 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:51.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.719+0000 7f6b99d0e700 1 --2- 172.21.15.125:0/1142919021 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6b940cc060 0x7f6b94069100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:51.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.719+0000 7f6b99d0e700 1 --2- 172.21.15.125:0/1142919021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6b940cd790 0x7f6b94151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:51.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.719+0000 7f6b99d0e700 1 -- 172.21.15.125:0/1142919021 >> 172.21.15.125:0/1142919021 conn(0x7f6b940cdf80 msgr2=0x7f6b9415ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:51.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.719+0000 7f6b99d0e700 1 -- 172.21.15.125:0/1142919021 shutdown_connections 2023-10-06T03:06:51.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:51.719+0000 7f6b99d0e700 1 -- 172.21.15.125:0/1142919021 wait complete. 2023-10-06T03:06:51.722 INFO:teuthology.orchestra.run.smithi125.stderr:updated caps for client.0 2023-10-06T03:06:51.731 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T03:06:51.732 DEBUG:teuthology.orchestra.run.smithi125:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:06:51.768 DEBUG:teuthology.orchestra.run.smithi130:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T03:06:51.818 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T03:06:51.818 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi125.front.sepia.ceph.com... 2023-10-06T03:06:51.818 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T03:06:51.818 DEBUG:teuthology.orchestra.run.smithi125:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T03:06:51.852 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi125.stderr:ceph-fuse[142522]: fuse finished with error 0 and tester_r 0 2023-10-06T03:06:51.853 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:06:51.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:51.854 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T03:06:51.953 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-10-06T03:06:51.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:51.953 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T03:06:51.975 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:06:51.975 INFO:teuthology.orchestra.run.smithi130.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T03:06:51.976 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:06:51.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:51.976 DEBUG:teuthology.orchestra.run.smithi125:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T03:06:51.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:06:51.994 INFO:teuthology.orchestra.run.smithi125.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T03:06:51.994 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi130.front.sepia.ceph.com 2023-10-06T03:06:51.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:06:51.994 DEBUG:teuthology.orchestra.run.smithi130:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T03:06:52.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:06:52.037 INFO:teuthology.orchestra.run.smithi130.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T03:06:52.038 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:06:52.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.153+0000 7f511fb1f700 1 Processor -- start 2023-10-06T03:06:52.155 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.154+0000 7f511fb1f700 1 -- start start 2023-10-06T03:06:52.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.154+0000 7f511fb1f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51181590d0 0x7f511806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.154+0000 7f511fb1f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5118067c70 con 0x7f51181594a0 2023-10-06T03:06:52.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.154+0000 7f511fb1f700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51180c77e0 con 0x7f51180ac670 2023-10-06T03:06:52.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.154+0000 7f511fb1f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51180c7ac0 con 0x7f51181590d0 2023-10-06T03:06:52.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.154+0000 7f511e0bc700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f51181594a0 0x7f5118068100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38442/0 (socket says 172.21.15.125:38442) 2023-10-06T03:06:52.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.154+0000 7f511e0bc700 1 -- 172.21.15.125:0/3718020685 learned_addr learned my addr 172.21.15.125:0/3718020685 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:52.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511d8bb700 1 --2- 172.21.15.125:0/3718020685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51181590d0 0x7f511806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511c8b9700 1 -- 172.21.15.125:0/3718020685 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180425242 0 0) 0x7f5118067c70 con 0x7f51181594a0 2023-10-06T03:06:52.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511c8b9700 1 -- 172.21.15.125:0/3718020685 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5104003570 con 0x7f51181594a0 2023-10-06T03:06:52.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511c8b9700 1 -- 172.21.15.125:0/3718020685 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2254577148 0 0) 0x7f5104003570 con 0x7f51181594a0 2023-10-06T03:06:52.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511c8b9700 1 -- 172.21.15.125:0/3718020685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51181590d0 msgr2=0x7f511806a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:52.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511c8b9700 1 --2- 172.21.15.125:0/3718020685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51181590d0 0x7f511806a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511c8b9700 1 -- 172.21.15.125:0/3718020685 >> v1:172.21.15.130:6789/0 conn(0x7f51180ac670 legacy=0x7f51180c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:52.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511c8b9700 1 -- 172.21.15.125:0/3718020685 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51180c7da0 con 0x7f51181594a0 2023-10-06T03:06:52.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511c8b9700 1 -- 172.21.15.125:0/3718020685 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f51100017f0 con 0x7f51181594a0 2023-10-06T03:06:52.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511c8b9700 1 -- 172.21.15.125:0/3718020685 >> v1:172.21.15.125:6789/0 conn(0x7f51181594a0 legacy=0x7f5118068100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:52.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511c8b9700 1 --2- 172.21.15.125:0/3718020685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51181590d0 0x7f5104003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511c8b9700 1 --2- 172.21.15.125:0/3718020685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5104003fd0 0x7f5104004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511c8b9700 1 --2- 172.21.15.125:0/3718020685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5104004d50 0x7f51040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511c8b9700 1 -- 172.21.15.125:0/3718020685 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51180c7ac0 con 0x7f5104004d50 2023-10-06T03:06:52.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511c8b9700 1 -- 172.21.15.125:0/3718020685 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510400bb40 con 0x7f5104003fd0 2023-10-06T03:06:52.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511c8b9700 1 -- 172.21.15.125:0/3718020685 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510400bd00 con 0x7f51181590d0 2023-10-06T03:06:52.160 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511e0bc700 1 --2- 172.21.15.125:0/3718020685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5104004d50 0x7f51040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511d8bb700 1 --2- 172.21.15.125:0/3718020685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51181590d0 0x7f5104003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511d0ba700 1 --2- 172.21.15.125:0/3718020685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5104003fd0 0x7f5104004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511e0bc700 1 -- 172.21.15.125:0/3718020685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51181590d0 msgr2=0x7f5104003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:52.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511e0bc700 1 --2- 172.21.15.125:0/3718020685 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f51181590d0 0x7f5104003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511e0bc700 1 -- 172.21.15.125:0/3718020685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5104003fd0 msgr2=0x7f5104004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:52.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511e0bc700 1 --2- 172.21.15.125:0/3718020685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5104003fd0 0x7f5104004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511e0bc700 1 -- 172.21.15.125:0/3718020685 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5104003570 con 0x7f5104004d50 2023-10-06T03:06:52.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.155+0000 7f511d0ba700 1 --2- 172.21.15.125:0/3718020685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5104003fd0 0x7f5104004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:52.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.156+0000 7f511e0bc700 1 --2- 172.21.15.125:0/3718020685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5104004d50 0x7f51040051c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f51181598a0 tx=0x7f5118067be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb82ae0bf3006cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:52.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.156+0000 7f511c8b9700 1 -- 172.21.15.125:0/3718020685 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51100070d0 con 0x7f5104004d50 2023-10-06T03:06:52.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.156+0000 7f511c8b9700 1 -- 172.21.15.125:0/3718020685 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5110007230 con 0x7f5104004d50 2023-10-06T03:06:52.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.156+0000 7f511c8b9700 1 -- 172.21.15.125:0/3718020685 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51100075f0 con 0x7f5104004d50 2023-10-06T03:06:52.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.156+0000 7f511fb1f700 1 -- 172.21.15.125:0/3718020685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5104004d50 msgr2=0x7f51040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:52.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.156+0000 7f511fb1f700 1 --2- 172.21.15.125:0/3718020685 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5104004d50 0x7f51040051c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f51181598a0 tx=0x7f5118067be0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.156+0000 7f511e0bc700 1 -- 172.21.15.125:0/3718020685 reap_dead start 2023-10-06T03:06:52.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.156+0000 7f511fb1f700 1 -- 172.21.15.125:0/3718020685 shutdown_connections 2023-10-06T03:06:52.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.156+0000 7f511fb1f700 1 -- 172.21.15.125:0/3718020685 >> 172.21.15.125:0/3718020685 conn(0x7f51180cc5a0 msgr2=0x7f51180cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:52.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.156+0000 7f511fb1f700 1 -- 172.21.15.125:0/3718020685 shutdown_connections 2023-10-06T03:06:52.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.156+0000 7f511fb1f700 1 -- 172.21.15.125:0/3718020685 wait complete. 2023-10-06T03:06:52.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.158+0000 7f511fb1f700 1 Processor -- start 2023-10-06T03:06:52.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.158+0000 7f511fb1f700 1 -- start start 2023-10-06T03:06:52.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f511fb1f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5118150290 0x7f51180af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f511fb1f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5118157760 0x7f5118157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f511fb1f700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5118068490 0x7f5118068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f511fb1f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5118158110 con 0x7f5118157760 2023-10-06T03:06:52.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f511fb1f700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5118068e50 con 0x7f5118068490 2023-10-06T03:06:52.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f511fb1f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51180a88b0 con 0x7f5118150290 2023-10-06T03:06:52.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f511d0ba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5118157760 0x7f5118157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f511d0ba700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5118157760 0x7f5118157bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44200/0 (socket says 172.21.15.125:44200) 2023-10-06T03:06:52.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f511d0ba700 1 -- 172.21.15.125:0/557015107 learned_addr learned my addr 172.21.15.125:0/557015107 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:52.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f511e0bc700 1 --2- 172.21.15.125:0/557015107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5118068490 0x7f5118068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f511d8bb700 1 --2- 172.21.15.125:0/557015107 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5118150290 0x7f51180af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f511d0ba700 1 -- 172.21.15.125:0/557015107 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5118150290 msgr2=0x7f51180af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:52.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f511d0ba700 1 --2- 172.21.15.125:0/557015107 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5118150290 0x7f51180af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f511d0ba700 1 -- 172.21.15.125:0/557015107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5118068490 msgr2=0x7f5118068910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:52.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f511d0ba700 1 --2- 172.21.15.125:0/557015107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5118068490 0x7f5118068910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f511d0ba700 1 -- 172.21.15.125:0/557015107 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51180afd10 con 0x7f5118157760 2023-10-06T03:06:52.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f511d0ba700 1 --2- 172.21.15.125:0/557015107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5118157760 0x7f5118157bd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f511400e830 tx=0x7f5114009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:52.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f5109ffb700 1 -- 172.21.15.125:0/557015107 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511400a520 con 0x7f5118157760 2023-10-06T03:06:52.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f5109ffb700 1 -- 172.21.15.125:0/557015107 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5114010040 con 0x7f5118157760 2023-10-06T03:06:52.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f511fb1f700 1 -- 172.21.15.125:0/557015107 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51180a8b00 con 0x7f5118157760 2023-10-06T03:06:52.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.159+0000 7f5109ffb700 1 -- 172.21.15.125:0/557015107 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511400a890 con 0x7f5118157760 2023-10-06T03:06:52.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.160+0000 7f511fb1f700 1 -- 172.21.15.125:0/557015107 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51180a90c0 con 0x7f5118157760 2023-10-06T03:06:52.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.161+0000 7f511fb1f700 1 -- 172.21.15.125:0/557015107 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5118066510 con 0x7f5118157760 2023-10-06T03:06:52.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.161+0000 7f5109ffb700 1 -- 172.21.15.125:0/557015107 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f511400ac80 con 0x7f5118157760 2023-10-06T03:06:52.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.162+0000 7f5109ffb700 1 --2- 172.21.15.125:0/557015107 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f50fc066f30 0x7f50fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.162+0000 7f511d8bb700 1 --2- 172.21.15.125:0/557015107 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f50fc066f30 0x7f50fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.162+0000 7f5109ffb700 1 -- 172.21.15.125:0/557015107 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f5114084300 con 0x7f5118157760 2023-10-06T03:06:52.167 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.162+0000 7f511d8bb700 1 --2- 172.21.15.125:0/557015107 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f50fc066f30 0x7f50fc0693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f51180c33d0 tx=0x7f510c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:52.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.166+0000 7f5109ffb700 1 -- 172.21.15.125:0/557015107 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5114051380 con 0x7f5118157760 2023-10-06T03:06:52.391 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.390+0000 7f511fb1f700 1 -- 172.21.15.125:0/557015107 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51181565b0 con 0x7f5118157760 2023-10-06T03:06:52.392 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.390+0000 7f5109ffb700 1 -- 172.21.15.125:0/557015107 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4610 (secure 0 0 0) 0x7f51140549a0 con 0x7f5118157760 2023-10-06T03:06:52.392 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:52.392 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/2151384589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2151384589},{"type":"v1","addr":"172.21.15.130:6834","nonce":2151384589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5299,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1214475159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1214475159},{"type":"v1","addr":"172.21.15.130:6835","nonce":1214475159}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/4005469649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":4005469649},{"type":"v1","addr":"172.21.15.125:6836","nonce":4005469649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:06:20.996155+0000","modified":"2023-10-06T03:06:24.636313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5556":{"gid":5556,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/1751632854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":1751632854},{"type":"v1","addr":"172.21.15.125:6837","nonce":1751632854}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:06:52.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.392+0000 7f511fb1f700 1 -- 172.21.15.125:0/557015107 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f50fc066f30 msgr2=0x7f50fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:52.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.392+0000 7f511fb1f700 1 --2- 172.21.15.125:0/557015107 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f50fc066f30 0x7f50fc0693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f51180c33d0 tx=0x7f510c008040 comp rx=0 tx=0).stop 2023-10-06T03:06:52.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.392+0000 7f511fb1f700 1 -- 172.21.15.125:0/557015107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5118157760 msgr2=0x7f5118157bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:52.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.392+0000 7f511fb1f700 1 --2- 172.21.15.125:0/557015107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5118157760 0x7f5118157bd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f511400e830 tx=0x7f5114009040 comp rx=0 tx=0).stop 2023-10-06T03:06:52.394 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.392+0000 7f511fb1f700 1 -- 172.21.15.125:0/557015107 shutdown_connections 2023-10-06T03:06:52.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.392+0000 7f511fb1f700 1 --2- 172.21.15.125:0/557015107 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f50fc066f30 0x7f50fc0693e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.392+0000 7f511fb1f700 1 --2- 172.21.15.125:0/557015107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5118068490 0x7f5118068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.392+0000 7f511fb1f700 1 --2- 172.21.15.125:0/557015107 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f5118150290 0x7f51180af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.392+0000 7f511fb1f700 1 --2- 172.21.15.125:0/557015107 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5118157760 0x7f5118157bd0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.392+0000 7f511fb1f700 1 -- 172.21.15.125:0/557015107 >> 172.21.15.125:0/557015107 conn(0x7f51180cc5a0 msgr2=0x7f51180cb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:52.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.393+0000 7f511fb1f700 1 -- 172.21.15.125:0/557015107 shutdown_connections 2023-10-06T03:06:52.395 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.393+0000 7f511fb1f700 1 -- 172.21.15.125:0/557015107 wait complete. 2023-10-06T03:06:52.395 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 27 2023-10-06T03:06:52.406 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:06:52.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.522+0000 7f936285d700 1 Processor -- start 2023-10-06T03:06:52.524 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.522+0000 7f936285d700 1 -- start start 2023-10-06T03:06:52.527 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.523+0000 7f936285d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935c158f70 0x7f935c0b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.523+0000 7f936285d700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f935c0b1b50 0x7f935c0b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.523+0000 7f936285d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f935c0b44a0 con 0x7f935c159340 2023-10-06T03:06:52.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.523+0000 7f936285d700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935c0b2510 con 0x7f935c0b1b50 2023-10-06T03:06:52.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.523+0000 7f936285d700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935c0b4780 con 0x7f935c158f70 2023-10-06T03:06:52.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.523+0000 7f935b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f935c159340 0x7f935c0b39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38456/0 (socket says 172.21.15.125:38456) 2023-10-06T03:06:52.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.523+0000 7f935b7fe700 1 -- 172.21.15.125:0/246481373 learned_addr learned my addr 172.21.15.125:0/246481373 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:52.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.523+0000 7f935bfff700 1 --2- 172.21.15.125:0/246481373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935c158f70 0x7f935c0b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.523+0000 7f9360dfa700 1 --2- 172.21.15.125:0/246481373 >> v2:172.21.15.130:3300/0 conn(0x7f935c0b1b50 0x7f935c0b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.523+0000 7f935affd700 1 -- 172.21.15.125:0/246481373 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616821611 0 0) 0x7f935c0b44a0 con 0x7f935c159340 2023-10-06T03:06:52.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935affd700 1 -- 172.21.15.125:0/246481373 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9344003570 con 0x7f935c159340 2023-10-06T03:06:52.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935affd700 1 -- 172.21.15.125:0/246481373 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 351334169 0 0) 0x7f9344003570 con 0x7f935c159340 2023-10-06T03:06:52.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935affd700 1 -- 172.21.15.125:0/246481373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935c158f70 msgr2=0x7f935c0b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:52.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935affd700 1 --2- 172.21.15.125:0/246481373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935c158f70 0x7f935c0b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935affd700 1 -- 172.21.15.125:0/246481373 >> v2:172.21.15.130:3300/0 conn(0x7f935c0b1b50 msgr2=0x7f935c0b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:52.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935affd700 1 --2- 172.21.15.125:0/246481373 >> v2:172.21.15.130:3300/0 conn(0x7f935c0b1b50 0x7f935c0b1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935affd700 1 -- 172.21.15.125:0/246481373 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c0b4a60 con 0x7f935c159340 2023-10-06T03:06:52.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935affd700 1 -- 172.21.15.125:0/246481373 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f934c001470 con 0x7f935c159340 2023-10-06T03:06:52.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935affd700 1 -- 172.21.15.125:0/246481373 >> v1:172.21.15.125:6789/0 conn(0x7f935c159340 legacy=0x7f935c0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:52.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935affd700 1 --2- 172.21.15.125:0/246481373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935c158f70 0x7f9344003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935affd700 1 --2- 172.21.15.125:0/246481373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9344003fe0 0x7f9344004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935affd700 1 --2- 172.21.15.125:0/246481373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9344004d50 0x7f93440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935affd700 1 -- 172.21.15.125:0/246481373 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935c0b2510 con 0x7f9344003fe0 2023-10-06T03:06:52.529 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935affd700 1 -- 172.21.15.125:0/246481373 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935c0b4780 con 0x7f9344004d50 2023-10-06T03:06:52.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935affd700 1 -- 172.21.15.125:0/246481373 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f934400ba90 con 0x7f935c158f70 2023-10-06T03:06:52.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935b7fe700 1 --2- 172.21.15.125:0/246481373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9344003fe0 0x7f9344004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935bfff700 1 --2- 172.21.15.125:0/246481373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935c158f70 0x7f9344003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f9360dfa700 1 --2- 172.21.15.125:0/246481373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9344004d50 0x7f93440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935b7fe700 1 -- 172.21.15.125:0/246481373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935c158f70 msgr2=0x7f9344003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:52.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935b7fe700 1 --2- 172.21.15.125:0/246481373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935c158f70 0x7f9344003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935b7fe700 1 -- 172.21.15.125:0/246481373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9344004d50 msgr2=0x7f93440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:52.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935b7fe700 1 --2- 172.21.15.125:0/246481373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9344004d50 0x7f93440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935b7fe700 1 -- 172.21.15.125:0/246481373 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9344003570 con 0x7f9344003fe0 2023-10-06T03:06:52.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935bfff700 1 --2- 172.21.15.125:0/246481373 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935c158f70 0x7f9344003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:52.530 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f9360dfa700 1 --2- 172.21.15.125:0/246481373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9344004d50 0x7f93440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:52.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.524+0000 7f935b7fe700 1 --2- 172.21.15.125:0/246481373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9344003fe0 0x7f9344004810 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f934c00c3c0 tx=0x7f934c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279b2d01dae372db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:52.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.525+0000 7f935affd700 1 -- 172.21.15.125:0/246481373 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c00cc30 con 0x7f9344003fe0 2023-10-06T03:06:52.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.525+0000 7f935affd700 1 -- 172.21.15.125:0/246481373 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c00cdd0 con 0x7f9344003fe0 2023-10-06T03:06:52.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.525+0000 7f935affd700 1 -- 172.21.15.125:0/246481373 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c005b70 con 0x7f9344003fe0 2023-10-06T03:06:52.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.525+0000 7f936285d700 1 -- 172.21.15.125:0/246481373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9344003fe0 msgr2=0x7f9344004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:52.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.525+0000 7f936285d700 1 --2- 172.21.15.125:0/246481373 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9344003fe0 0x7f9344004810 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f934c00c3c0 tx=0x7f934c001e90 comp rx=0 tx=0).stop 2023-10-06T03:06:52.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.525+0000 7f9360dfa700 1 -- 172.21.15.125:0/246481373 reap_dead start 2023-10-06T03:06:52.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.525+0000 7f936285d700 1 -- 172.21.15.125:0/246481373 shutdown_connections 2023-10-06T03:06:52.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.525+0000 7f936285d700 1 -- 172.21.15.125:0/246481373 >> 172.21.15.125:0/246481373 conn(0x7f935c06ed40 msgr2=0x7f935c06f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:52.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.525+0000 7f936285d700 1 -- 172.21.15.125:0/246481373 shutdown_connections 2023-10-06T03:06:52.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.525+0000 7f936285d700 1 -- 172.21.15.125:0/246481373 wait complete. 2023-10-06T03:06:52.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.526+0000 7f936285d700 1 Processor -- start 2023-10-06T03:06:52.532 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.526+0000 7f936285d700 1 -- start start 2023-10-06T03:06:52.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.527+0000 7f936285d700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9344003fe0 0x7f935c155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.527+0000 7f936285d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935c156950 0x7f935c16c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.527+0000 7f936285d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f935c0b0b50 0x7f935c0b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.527+0000 7f936285d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935c0b1530 con 0x7f935c0b0b50 2023-10-06T03:06:52.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.527+0000 7f936285d700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935c1579f0 con 0x7f9344003fe0 2023-10-06T03:06:52.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.527+0000 7f936285d700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935c156de0 con 0x7f935c156950 2023-10-06T03:06:52.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.527+0000 7f9360dfa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f935c0b0b50 0x7f935c0b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.527+0000 7f9360dfa700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f935c0b0b50 0x7f935c0b0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44230/0 (socket says 172.21.15.125:44230) 2023-10-06T03:06:52.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.527+0000 7f9360dfa700 1 -- 172.21.15.125:0/1465152191 learned_addr learned my addr 172.21.15.125:0/1465152191 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:52.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.528+0000 7f9360dfa700 1 -- 172.21.15.125:0/1465152191 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935c156950 msgr2=0x7f935c16c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:52.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.528+0000 7f9360dfa700 1 --2- 172.21.15.125:0/1465152191 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935c156950 0x7f935c16c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.528+0000 7f9360dfa700 1 -- 172.21.15.125:0/1465152191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9344003fe0 msgr2=0x7f935c155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:52.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.528+0000 7f9360dfa700 1 --2- 172.21.15.125:0/1465152191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9344003fe0 0x7f935c155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.528+0000 7f9360dfa700 1 -- 172.21.15.125:0/1465152191 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c1570c0 con 0x7f935c0b0b50 2023-10-06T03:06:52.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.528+0000 7f9360dfa700 1 --2- 172.21.15.125:0/1465152191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f935c0b0b50 0x7f935c0b0ff0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f935c0890b0 tx=0x7f935400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:52.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.528+0000 7f9343fff700 1 -- 172.21.15.125:0/1465152191 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935401b070 con 0x7f935c0b0b50 2023-10-06T03:06:52.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.528+0000 7f9343fff700 1 -- 172.21.15.125:0/1465152191 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935400f040 con 0x7f935c0b0b50 2023-10-06T03:06:52.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.528+0000 7f9343fff700 1 -- 172.21.15.125:0/1465152191 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935400e050 con 0x7f935c0b0b50 2023-10-06T03:06:52.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.528+0000 7f936285d700 1 -- 172.21.15.125:0/1465152191 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935c1573a0 con 0x7f935c0b0b50 2023-10-06T03:06:52.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.528+0000 7f936285d700 1 -- 172.21.15.125:0/1465152191 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f935c16cb60 con 0x7f935c0b0b50 2023-10-06T03:06:52.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.529+0000 7f936285d700 1 -- 172.21.15.125:0/1465152191 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f935c066510 con 0x7f935c0b0b50 2023-10-06T03:06:52.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.530+0000 7f9343fff700 1 -- 172.21.15.125:0/1465152191 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9354003020 con 0x7f935c0b0b50 2023-10-06T03:06:52.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.530+0000 7f9343fff700 1 --2- 172.21.15.125:0/1465152191 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9348066f30 0x7f93480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.531+0000 7f9343fff700 1 -- 172.21.15.125:0/1465152191 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9354085c30 con 0x7f935c0b0b50 2023-10-06T03:06:52.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.531+0000 7f935bfff700 1 --2- 172.21.15.125:0/1465152191 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9348066f30 0x7f93480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.531+0000 7f935bfff700 1 --2- 172.21.15.125:0/1465152191 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9348066f30 0x7f93480693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9350009be0 tx=0x7f9350008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:52.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.534+0000 7f9343fff700 1 -- 172.21.15.125:0/1465152191 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9354052be0 con 0x7f935c0b0b50 2023-10-06T03:06:52.721 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.720+0000 7f936285d700 1 -- 172.21.15.125:0/1465152191 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f935c157b30 con 0x7f935c0b0b50 2023-10-06T03:06:52.722 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.720+0000 7f9343fff700 1 -- 172.21.15.125:0/1465152191 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+17217 (secure 0 0 0) 0x7f9354010ea0 con 0x7f935c0b0b50 2023-10-06T03:06:52.722 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:52.722 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":57,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:06:22.618226+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:06:18.650188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T03:06:19.963528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:06:52.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.722+0000 7f936285d700 1 -- 172.21.15.125:0/1465152191 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9348066f30 msgr2=0x7f93480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:52.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.722+0000 7f936285d700 1 --2- 172.21.15.125:0/1465152191 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9348066f30 0x7f93480693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9350009be0 tx=0x7f9350008040 comp rx=0 tx=0).stop 2023-10-06T03:06:52.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.722+0000 7f936285d700 1 -- 172.21.15.125:0/1465152191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f935c0b0b50 msgr2=0x7f935c0b0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:52.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.722+0000 7f936285d700 1 --2- 172.21.15.125:0/1465152191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f935c0b0b50 0x7f935c0b0ff0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f935c0890b0 tx=0x7f935400b040 comp rx=0 tx=0).stop 2023-10-06T03:06:52.724 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.722+0000 7f936285d700 1 -- 172.21.15.125:0/1465152191 shutdown_connections 2023-10-06T03:06:52.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.722+0000 7f936285d700 1 --2- 172.21.15.125:0/1465152191 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9348066f30 0x7f93480693e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.722+0000 7f936285d700 1 --2- 172.21.15.125:0/1465152191 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f935c0b0b50 0x7f935c0b0ff0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.722+0000 7f936285d700 1 --2- 172.21.15.125:0/1465152191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9344003fe0 0x7f935c155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.722+0000 7f936285d700 1 --2- 172.21.15.125:0/1465152191 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f935c156950 0x7f935c16c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.722+0000 7f936285d700 1 -- 172.21.15.125:0/1465152191 >> 172.21.15.125:0/1465152191 conn(0x7f935c06ed40 msgr2=0x7f935c0d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:52.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.723+0000 7f936285d700 1 -- 172.21.15.125:0/1465152191 shutdown_connections 2023-10-06T03:06:52.725 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.723+0000 7f936285d700 1 -- 172.21.15.125:0/1465152191 wait complete. 2023-10-06T03:06:52.736 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T03:04:15.845430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T03:04:22.729795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T03:06:18.650188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T03:06:19.963528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T03:06:52.736 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T03:06:52.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.856+0000 7fee322af700 1 Processor -- start 2023-10-06T03:06:52.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.856+0000 7fee322af700 1 -- start start 2023-10-06T03:06:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.857+0000 7fee322af700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee2c156de0 0x7fee2c1571b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.857+0000 7fee322af700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fee2c0cd790 0x7fee2c0ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.857+0000 7fee322af700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2c0cd300 con 0x7fee2c0cc060 2023-10-06T03:06:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.857+0000 7fee322af700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2c0cc4e0 con 0x7fee2c156de0 2023-10-06T03:06:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.857+0000 7fee322af700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2c0cc6f0 con 0x7fee2c0cd790 2023-10-06T03:06:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.857+0000 7fee2bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fee2c156de0 0x7fee2c1571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.857+0000 7fee2b7fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fee2c0cc060 0x7fee2c15b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38458/0 (socket says 172.21.15.125:38458) 2023-10-06T03:06:52.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.857+0000 7fee2b7fe700 1 -- 172.21.15.125:0/4241699446 learned_addr learned my addr 172.21.15.125:0/4241699446 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.857+0000 7fee3084c700 1 --2- 172.21.15.125:0/4241699446 >> v2:172.21.15.130:3300/0 conn(0x7fee2c0cd790 0x7fee2c0ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.857+0000 7fee2bfff700 1 -- 172.21.15.125:0/4241699446 >> v2:172.21.15.130:3300/0 conn(0x7fee2c0cd790 msgr2=0x7fee2c0ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.857+0000 7fee2bfff700 1 --2- 172.21.15.125:0/4241699446 >> v2:172.21.15.130:3300/0 conn(0x7fee2c0cd790 0x7fee2c0ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.857+0000 7fee2bfff700 1 -- 172.21.15.125:0/4241699446 >> v1:172.21.15.125:6789/0 conn(0x7fee2c0cc060 legacy=0x7fee2c15b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.857+0000 7fee2bfff700 1 -- 172.21.15.125:0/4241699446 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2c0cc9d0 con 0x7fee2c156de0 2023-10-06T03:06:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.857+0000 7fee2affd700 1 -- 172.21.15.125:0/4241699446 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694640484 0 0) 0x7fee2c0cd300 con 0x7fee2c0cc060 2023-10-06T03:06:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.857+0000 7fee3084c700 1 --2- 172.21.15.125:0/4241699446 >> v2:172.21.15.130:3300/0 conn(0x7fee2c0cd790 0x7fee2c0ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.858+0000 7fee2bfff700 1 --2- 172.21.15.125:0/4241699446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee2c156de0 0x7fee2c1571b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fee2c06fce0 tx=0x7fee200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40183b58ed95ceb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.858+0000 7fee2affd700 1 -- 172.21.15.125:0/4241699446 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2000b6b0 con 0x7fee2c156de0 2023-10-06T03:06:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.858+0000 7fee2affd700 1 -- 172.21.15.125:0/4241699446 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2000b810 con 0x7fee2c156de0 2023-10-06T03:06:52.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.858+0000 7fee2affd700 1 -- 172.21.15.125:0/4241699446 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2000bbb0 con 0x7fee2c156de0 2023-10-06T03:06:52.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.858+0000 7fee322af700 1 -- 172.21.15.125:0/4241699446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee2c156de0 msgr2=0x7fee2c1571b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:52.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.858+0000 7fee322af700 1 --2- 172.21.15.125:0/4241699446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee2c156de0 0x7fee2c1571b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fee2c06fce0 tx=0x7fee200091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.858+0000 7fee322af700 1 -- 172.21.15.125:0/4241699446 shutdown_connections 2023-10-06T03:06:52.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.858+0000 7fee322af700 1 --2- 172.21.15.125:0/4241699446 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee2c156de0 0x7fee2c1571b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.858+0000 7fee322af700 1 --2- 172.21.15.125:0/4241699446 >> v2:172.21.15.130:3300/0 conn(0x7fee2c0cd790 0x7fee2c0ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.858+0000 7fee322af700 1 -- 172.21.15.125:0/4241699446 >> 172.21.15.125:0/4241699446 conn(0x7fee2c0cdf80 msgr2=0x7fee2c0ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:52.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.858+0000 7fee322af700 1 -- 172.21.15.125:0/4241699446 shutdown_connections 2023-10-06T03:06:52.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.858+0000 7fee322af700 1 -- 172.21.15.125:0/4241699446 wait complete. 2023-10-06T03:06:52.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.859+0000 7fee322af700 1 Processor -- start 2023-10-06T03:06:52.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.860+0000 7fee322af700 1 -- start start 2023-10-06T03:06:52.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.860+0000 7fee322af700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee2c0cc060 0x7fee2c0691e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.860+0000 7fee322af700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee2c0cd790 0x7fee2c14ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.860+0000 7fee322af700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee2c156de0 0x7fee2c069940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.860+0000 7fee322af700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c069e80 con 0x7fee2c0cd790 2023-10-06T03:06:52.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.860+0000 7fee322af700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c0c7960 con 0x7fee2c0cc060 2023-10-06T03:06:52.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.860+0000 7fee322af700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c0c7380 con 0x7fee2c156de0 2023-10-06T03:06:52.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.860+0000 7fee2b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee2c0cd790 0x7fee2c14ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.860+0000 7fee2b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee2c0cd790 0x7fee2c14ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44248/0 (socket says 172.21.15.125:44248) 2023-10-06T03:06:52.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.860+0000 7fee2b7fe700 1 -- 172.21.15.125:0/1389593104 learned_addr learned my addr 172.21.15.125:0/1389593104 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:52.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.861+0000 7fee2bfff700 1 --2- 172.21.15.125:0/1389593104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee2c0cc060 0x7fee2c0691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.861+0000 7fee3084c700 1 --2- 172.21.15.125:0/1389593104 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee2c156de0 0x7fee2c069940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.861+0000 7fee2b7fe700 1 -- 172.21.15.125:0/1389593104 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee2c156de0 msgr2=0x7fee2c069940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:52.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.861+0000 7fee2b7fe700 1 --2- 172.21.15.125:0/1389593104 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee2c156de0 0x7fee2c069940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.861+0000 7fee2b7fe700 1 -- 172.21.15.125:0/1389593104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee2c0cc060 msgr2=0x7fee2c0691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:52.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.861+0000 7fee2b7fe700 1 --2- 172.21.15.125:0/1389593104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee2c0cc060 0x7fee2c0691e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:52.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.861+0000 7fee2b7fe700 1 -- 172.21.15.125:0/1389593104 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee20009420 con 0x7fee2c0cd790 2023-10-06T03:06:52.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.861+0000 7fee2b7fe700 1 --2- 172.21.15.125:0/1389593104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee2c0cd790 0x7fee2c14ccb0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00c810 tx=0x7fee1c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:52.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.861+0000 7fee13fff700 1 -- 172.21.15.125:0/1389593104 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c005b30 con 0x7fee2c0cd790 2023-10-06T03:06:52.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.861+0000 7fee13fff700 1 -- 172.21.15.125:0/1389593104 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c005c90 con 0x7fee2c0cd790 2023-10-06T03:06:52.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.861+0000 7fee322af700 1 -- 172.21.15.125:0/1389593104 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2c0c7df0 con 0x7fee2c0cd790 2023-10-06T03:06:52.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.861+0000 7fee13fff700 1 -- 172.21.15.125:0/1389593104 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c007300 con 0x7fee2c0cd790 2023-10-06T03:06:52.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.861+0000 7fee322af700 1 -- 172.21.15.125:0/1389593104 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2c0c75f0 con 0x7fee2c0cd790 2023-10-06T03:06:52.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.862+0000 7fee322af700 1 -- 172.21.15.125:0/1389593104 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2c0cee30 con 0x7fee2c0cd790 2023-10-06T03:06:52.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.863+0000 7fee13fff700 1 -- 172.21.15.125:0/1389593104 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee1c01b400 con 0x7fee2c0cd790 2023-10-06T03:06:52.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.863+0000 7fee13fff700 1 --2- 172.21.15.125:0/1389593104 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fee18066f30 0x7fee180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:52.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.863+0000 7fee13fff700 1 -- 172.21.15.125:0/1389593104 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fee1c084350 con 0x7fee2c0cd790 2023-10-06T03:06:52.867 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.863+0000 7fee2bfff700 1 --2- 172.21.15.125:0/1389593104 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fee18066f30 0x7fee180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:52.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.863+0000 7fee2bfff700 1 --2- 172.21.15.125:0/1389593104 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fee18066f30 0x7fee180693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fee2c1567f0 tx=0x7fee20017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:52.868 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:52.867+0000 7fee13fff700 1 -- 172.21.15.125:0/1389593104 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee1c0513a0 con 0x7fee2c0cd790 2023-10-06T03:06:53.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.047+0000 7fee322af700 1 -- 172.21.15.125:0/1389593104 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee2c06eba0 con 0x7fee2c0cd790 2023-10-06T03:06:53.049 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.047+0000 7fee13fff700 1 -- 172.21.15.125:0/1389593104 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7fee1c0549c0 con 0x7fee2c0cd790 2023-10-06T03:06:53.049 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 1 2023-10-06T03:06:53.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.049+0000 7fee322af700 1 -- 172.21.15.125:0/1389593104 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fee18066f30 msgr2=0x7fee180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:53.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.049+0000 7fee322af700 1 --2- 172.21.15.125:0/1389593104 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fee18066f30 0x7fee180693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fee2c1567f0 tx=0x7fee20017000 comp rx=0 tx=0).stop 2023-10-06T03:06:53.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.049+0000 7fee322af700 1 -- 172.21.15.125:0/1389593104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee2c0cd790 msgr2=0x7fee2c14ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:53.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.049+0000 7fee322af700 1 --2- 172.21.15.125:0/1389593104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee2c0cd790 0x7fee2c14ccb0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00c810 tx=0x7fee1c007df0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.049+0000 7fee322af700 1 -- 172.21.15.125:0/1389593104 shutdown_connections 2023-10-06T03:06:53.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.049+0000 7fee322af700 1 --2- 172.21.15.125:0/1389593104 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fee18066f30 0x7fee180693e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.051 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.049+0000 7fee322af700 1 --2- 172.21.15.125:0/1389593104 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fee2c156de0 0x7fee2c069940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.049+0000 7fee322af700 1 --2- 172.21.15.125:0/1389593104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fee2c0cc060 0x7fee2c0691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.049+0000 7fee322af700 1 --2- 172.21.15.125:0/1389593104 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fee2c0cd790 0x7fee2c14ccb0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.049+0000 7fee322af700 1 -- 172.21.15.125:0/1389593104 >> 172.21.15.125:0/1389593104 conn(0x7fee2c0cdf80 msgr2=0x7fee2c06d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:53.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.049+0000 7fee322af700 1 -- 172.21.15.125:0/1389593104 shutdown_connections 2023-10-06T03:06:53.052 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.049+0000 7fee322af700 1 -- 172.21.15.125:0/1389593104 wait complete. 2023-10-06T03:06:53.062 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T03:06:53.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.181+0000 7fe60bfff700 1 Processor -- start 2023-10-06T03:06:53.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.181+0000 7fe60bfff700 1 -- start start 2023-10-06T03:06:53.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.182+0000 7fe60bfff700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe60c1591a0 0x7fe60c06d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.182+0000 7fe60bfff700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe60c067610 0x7fe60c067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.185 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.182+0000 7fe60bfff700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe60c06c7f0 con 0x7fe60c0afa90 2023-10-06T03:06:53.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.182+0000 7fe60bfff700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe60c067fd0 con 0x7fe60c1591a0 2023-10-06T03:06:53.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.182+0000 7fe60bfff700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c06cad0 con 0x7fe60c067610 2023-10-06T03:06:53.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.182+0000 7fe60affd700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe60c1591a0 0x7fe60c06d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.182+0000 7fe60b7fe700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe60c067610 0x7fe60c067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.182+0000 7fe60a7fc700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe60c0afa90 0x7fe60c159570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:52370/0 (socket says 172.21.15.125:52370) 2023-10-06T03:06:53.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.182+0000 7fe60affd700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe60c1591a0 0x7fe60c06d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:50958/0 (socket says 172.21.15.125:50958) 2023-10-06T03:06:53.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.182+0000 7fe60b7fe700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe60c067610 0x7fe60c067a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:52076/0 (socket says 172.21.15.125:52076) 2023-10-06T03:06:53.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.183+0000 7fe60a7fc700 1 -- 172.21.15.125:0/2827379159 learned_addr learned my addr 172.21.15.125:0/2827379159 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:53.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.183+0000 7fe60affd700 1 -- 172.21.15.125:0/2827379159 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe60c067610 msgr2=0x7fe60c067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:53.186 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.183+0000 7fe60affd700 1 --2- 172.21.15.125:0/2827379159 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe60c067610 0x7fe60c067a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.183+0000 7fe60affd700 1 -- 172.21.15.125:0/2827379159 >> v1:172.21.15.130:6789/0 conn(0x7fe60c0afa90 legacy=0x7fe60c159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:53.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.183+0000 7fe60affd700 1 -- 172.21.15.125:0/2827379159 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c06cdb0 con 0x7fe60c1591a0 2023-10-06T03:06:53.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.183+0000 7fe60affd700 1 --2- 172.21.15.125:0/2827379159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe60c1591a0 0x7fe60c06d4f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe6000098e0 tx=0x7fe6000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8368f9ee343f5b22 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:53.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.183+0000 7fe609ffb700 1 -- 172.21.15.125:0/2827379159 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60000b640 con 0x7fe60c1591a0 2023-10-06T03:06:53.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.183+0000 7fe609ffb700 1 -- 172.21.15.125:0/2827379159 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60000b7a0 con 0x7fe60c1591a0 2023-10-06T03:06:53.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.183+0000 7fe609ffb700 1 -- 172.21.15.125:0/2827379159 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60000bb40 con 0x7fe60c1591a0 2023-10-06T03:06:53.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.184+0000 7fe60bfff700 1 -- 172.21.15.125:0/2827379159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe60c1591a0 msgr2=0x7fe60c06d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:53.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.184+0000 7fe60bfff700 1 --2- 172.21.15.125:0/2827379159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe60c1591a0 0x7fe60c06d4f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe6000098e0 tx=0x7fe6000091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.187 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.184+0000 7fe60bfff700 1 -- 172.21.15.125:0/2827379159 shutdown_connections 2023-10-06T03:06:53.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.184+0000 7fe60bfff700 1 --2- 172.21.15.125:0/2827379159 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe60c067610 0x7fe60c067a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.184+0000 7fe60bfff700 1 --2- 172.21.15.125:0/2827379159 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe60c1591a0 0x7fe60c06d4f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.184+0000 7fe60bfff700 1 -- 172.21.15.125:0/2827379159 >> 172.21.15.125:0/2827379159 conn(0x7fe60c0691f0 msgr2=0x7fe60c0cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:53.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.184+0000 7fe60bfff700 1 -- 172.21.15.125:0/2827379159 shutdown_connections 2023-10-06T03:06:53.188 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.184+0000 7fe60bfff700 1 -- 172.21.15.125:0/2827379159 wait complete. 2023-10-06T03:06:53.190 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.185+0000 7fe60bfff700 1 Processor -- start 2023-10-06T03:06:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.186+0000 7fe60bfff700 1 -- start start 2023-10-06T03:06:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.186+0000 7fe60bfff700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe60c067610 0x7fe60c16a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.186+0000 7fe60bfff700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe60c0afa90 0x7fe60c0cb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.186+0000 7fe60bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe60c1591a0 0x7fe60c15bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.186+0000 7fe60bfff700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c16d500 con 0x7fe60c1591a0 2023-10-06T03:06:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.186+0000 7fe60bfff700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c16dda0 con 0x7fe60c0afa90 2023-10-06T03:06:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.186+0000 7fe60bfff700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe60c0cba40 con 0x7fe60c067610 2023-10-06T03:06:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.187+0000 7fe60b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe60c1591a0 0x7fe60c15bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.191 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.187+0000 7fe60b7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe60c1591a0 0x7fe60c15bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44254/0 (socket says 172.21.15.125:44254) 2023-10-06T03:06:53.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.187+0000 7fe60b7fe700 1 -- 172.21.15.125:0/2966310133 learned_addr learned my addr 172.21.15.125:0/2966310133 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:53.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.187+0000 7fe60affd700 1 --2- 172.21.15.125:0/2966310133 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe60c067610 0x7fe60c16a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.187+0000 7fe60a7fc700 1 --2- 172.21.15.125:0/2966310133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe60c0afa90 0x7fe60c0cb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.187+0000 7fe60b7fe700 1 -- 172.21.15.125:0/2966310133 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe60c067610 msgr2=0x7fe60c16a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:53.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.187+0000 7fe60b7fe700 1 --2- 172.21.15.125:0/2966310133 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe60c067610 0x7fe60c16a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.187+0000 7fe60b7fe700 1 -- 172.21.15.125:0/2966310133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe60c0afa90 msgr2=0x7fe60c0cb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:53.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.187+0000 7fe60b7fe700 1 --2- 172.21.15.125:0/2966310133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe60c0afa90 0x7fe60c0cb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.187+0000 7fe60b7fe700 1 -- 172.21.15.125:0/2966310133 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe600009420 con 0x7fe60c1591a0 2023-10-06T03:06:53.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.187+0000 7fe60b7fe700 1 --2- 172.21.15.125:0/2966310133 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe60c1591a0 0x7fe60c15bdf0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe604009ec0 tx=0x7fe60400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:53.192 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.187+0000 7fe5f2ffd700 1 -- 172.21.15.125:0/2966310133 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60400cb70 con 0x7fe60c1591a0 2023-10-06T03:06:53.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.187+0000 7fe5f2ffd700 1 -- 172.21.15.125:0/2966310133 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60400f040 con 0x7fe60c1591a0 2023-10-06T03:06:53.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.187+0000 7fe60bfff700 1 -- 172.21.15.125:0/2966310133 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe60c155980 con 0x7fe60c1591a0 2023-10-06T03:06:53.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.187+0000 7fe5f2ffd700 1 -- 172.21.15.125:0/2966310133 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe604014480 con 0x7fe60c1591a0 2023-10-06T03:06:53.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.187+0000 7fe60bfff700 1 -- 172.21.15.125:0/2966310133 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60c16da30 con 0x7fe60c1591a0 2023-10-06T03:06:53.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.188+0000 7fe60bfff700 1 -- 172.21.15.125:0/2966310133 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60c06df20 con 0x7fe60c1591a0 2023-10-06T03:06:53.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.189+0000 7fe5f2ffd700 1 -- 172.21.15.125:0/2966310133 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe604014830 con 0x7fe60c1591a0 2023-10-06T03:06:53.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.189+0000 7fe5f2ffd700 1 --2- 172.21.15.125:0/2966310133 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe5f8066f30 0x7fe5f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.189+0000 7fe5f2ffd700 1 -- 172.21.15.125:0/2966310133 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7fe604085410 con 0x7fe60c1591a0 2023-10-06T03:06:53.193 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.189+0000 7fe60affd700 1 --2- 172.21.15.125:0/2966310133 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe5f8066f30 0x7fe5f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.189+0000 7fe60affd700 1 --2- 172.21.15.125:0/2966310133 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe5f8066f30 0x7fe5f80693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe6000093f0 tx=0x7fe600017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:53.194 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.193+0000 7fe5f2ffd700 1 -- 172.21.15.125:0/2966310133 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6040523e0 con 0x7fe60c1591a0 2023-10-06T03:06:53.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.374+0000 7fe60bfff700 1 -- 172.21.15.125:0/2966310133 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe60c06d090 con 0x7fe60c1591a0 2023-10-06T03:06:53.376 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.374+0000 7fe5f2ffd700 1 -- 172.21.15.125:0/2966310133 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v57) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe604055a00 con 0x7fe60c1591a0 2023-10-06T03:06:53.376 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 8 2023-10-06T03:06:53.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.376+0000 7fe60bfff700 1 -- 172.21.15.125:0/2966310133 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe5f8066f30 msgr2=0x7fe5f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:53.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.376+0000 7fe60bfff700 1 --2- 172.21.15.125:0/2966310133 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe5f8066f30 0x7fe5f80693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe6000093f0 tx=0x7fe600017000 comp rx=0 tx=0).stop 2023-10-06T03:06:53.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.376+0000 7fe60bfff700 1 -- 172.21.15.125:0/2966310133 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe60c1591a0 msgr2=0x7fe60c15bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:53.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.376+0000 7fe60bfff700 1 --2- 172.21.15.125:0/2966310133 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe60c1591a0 0x7fe60c15bdf0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe604009ec0 tx=0x7fe60400b040 comp rx=0 tx=0).stop 2023-10-06T03:06:53.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.376+0000 7fe60bfff700 1 -- 172.21.15.125:0/2966310133 shutdown_connections 2023-10-06T03:06:53.378 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.376+0000 7fe60bfff700 1 --2- 172.21.15.125:0/2966310133 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe5f8066f30 0x7fe5f80693e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.376+0000 7fe60bfff700 1 --2- 172.21.15.125:0/2966310133 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe60c1591a0 0x7fe60c15bdf0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.376+0000 7fe60bfff700 1 --2- 172.21.15.125:0/2966310133 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe60c067610 0x7fe60c16a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.376+0000 7fe60bfff700 1 --2- 172.21.15.125:0/2966310133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe60c0afa90 0x7fe60c0cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.376+0000 7fe60bfff700 1 -- 172.21.15.125:0/2966310133 >> 172.21.15.125:0/2966310133 conn(0x7fe60c0691f0 msgr2=0x7fe60c157430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:53.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.376+0000 7fe60bfff700 1 -- 172.21.15.125:0/2966310133 shutdown_connections 2023-10-06T03:06:53.379 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.376+0000 7fe60bfff700 1 -- 172.21.15.125:0/2966310133 wait complete. 2023-10-06T03:06:53.390 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T03:06:53.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.509+0000 7f210829b700 1 Processor -- start 2023-10-06T03:06:53.511 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.509+0000 7f210829b700 1 -- start start 2023-10-06T03:06:53.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.510+0000 7f210829b700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f21001574b0 0x7f2100067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.510+0000 7f210829b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2100067b50 con 0x7f21000b0240 2023-10-06T03:06:53.514 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.510+0000 7f210829b700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21000c7f70 con 0x7f21000c6eb0 2023-10-06T03:06:53.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.510+0000 7f210829b700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21000c8210 con 0x7f21001574b0 2023-10-06T03:06:53.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.510+0000 7f2105836700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f21000b0240 0x7f21000cb860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38464/0 (socket says 172.21.15.125:38464) 2023-10-06T03:06:53.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.510+0000 7f2105836700 1 -- 172.21.15.125:0/4191339056 learned_addr learned my addr 172.21.15.125:0/4191339056 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:53.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.510+0000 7f2105035700 1 -- 172.21.15.125:0/4191339056 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107119823 0 0) 0x7f2100067b50 con 0x7f21000b0240 2023-10-06T03:06:53.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.510+0000 7f2106037700 1 --2- 172.21.15.125:0/4191339056 >> v2:172.21.15.130:3300/0 conn(0x7f21001574b0 0x7f2100067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.510+0000 7f2105035700 1 -- 172.21.15.125:0/4191339056 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20ec003570 con 0x7f21000b0240 2023-10-06T03:06:53.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2105035700 1 -- 172.21.15.125:0/4191339056 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 391038275 0 0) 0x7f20ec003570 con 0x7f21000b0240 2023-10-06T03:06:53.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2105035700 1 -- 172.21.15.125:0/4191339056 >> v2:172.21.15.130:3300/0 conn(0x7f21001574b0 msgr2=0x7f2100067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:53.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2105035700 1 --2- 172.21.15.125:0/4191339056 >> v2:172.21.15.130:3300/0 conn(0x7f21001574b0 0x7f2100067610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2105035700 1 -- 172.21.15.125:0/4191339056 >> v1:172.21.15.130:6789/0 conn(0x7f21000c6eb0 legacy=0x7f21000c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:53.515 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2105035700 1 -- 172.21.15.125:0/4191339056 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21000c8b00 con 0x7f21000b0240 2023-10-06T03:06:53.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2105035700 1 -- 172.21.15.125:0/4191339056 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f20f0001470 con 0x7f21000b0240 2023-10-06T03:06:53.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2105035700 1 -- 172.21.15.125:0/4191339056 >> v1:172.21.15.125:6789/0 conn(0x7f21000b0240 legacy=0x7f21000cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:53.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2105035700 1 --2- 172.21.15.125:0/4191339056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec003a60 0x7f20ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2105035700 1 --2- 172.21.15.125:0/4191339056 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20ec004810 0x7f20ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2105035700 1 --2- 172.21.15.125:0/4191339056 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20ec0051c0 0x7f20ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2105035700 1 -- 172.21.15.125:0/4191339056 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21000c8210 con 0x7f20ec0051c0 2023-10-06T03:06:53.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2105035700 1 -- 172.21.15.125:0/4191339056 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec00c0d0 con 0x7f20ec003a60 2023-10-06T03:06:53.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2105035700 1 -- 172.21.15.125:0/4191339056 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec00c290 con 0x7f20ec004810 2023-10-06T03:06:53.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2106838700 1 --2- 172.21.15.125:0/4191339056 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20ec0051c0 0x7f20ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2106037700 1 --2- 172.21.15.125:0/4191339056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec003a60 0x7f20ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2105836700 1 --2- 172.21.15.125:0/4191339056 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20ec004810 0x7f20ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.516 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2106838700 1 -- 172.21.15.125:0/4191339056 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20ec004810 msgr2=0x7f20ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:53.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2106838700 1 --2- 172.21.15.125:0/4191339056 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f20ec004810 0x7f20ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2106838700 1 -- 172.21.15.125:0/4191339056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec003a60 msgr2=0x7f20ec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:53.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2106838700 1 --2- 172.21.15.125:0/4191339056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec003a60 0x7f20ec003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2106838700 1 -- 172.21.15.125:0/4191339056 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ec003570 con 0x7f20ec0051c0 2023-10-06T03:06:53.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2106838700 1 -- 172.21.15.125:0/4191339056 reap_dead start 2023-10-06T03:06:53.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2106838700 1 --2- 172.21.15.125:0/4191339056 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20ec0051c0 0x7f20ec00ba60 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f20f8001fc0 tx=0x7f20f8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b98e78998b0a4fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:53.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2105035700 1 -- 172.21.15.125:0/4191339056 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8001950 con 0x7f20ec0051c0 2023-10-06T03:06:53.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2105035700 1 -- 172.21.15.125:0/4191339056 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f800c8b0 con 0x7f20ec0051c0 2023-10-06T03:06:53.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.511+0000 7f2105035700 1 -- 172.21.15.125:0/4191339056 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f800cc90 con 0x7f20ec0051c0 2023-10-06T03:06:53.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.512+0000 7f210829b700 1 -- 172.21.15.125:0/4191339056 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20ec0051c0 msgr2=0x7f20ec00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:53.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.512+0000 7f210829b700 1 --2- 172.21.15.125:0/4191339056 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20ec0051c0 0x7f20ec00ba60 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f20f8001fc0 tx=0x7f20f8001640 comp rx=0 tx=0).stop 2023-10-06T03:06:53.517 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.512+0000 7f210829b700 1 -- 172.21.15.125:0/4191339056 shutdown_connections 2023-10-06T03:06:53.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.512+0000 7f210829b700 1 --2- 172.21.15.125:0/4191339056 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f20ec0051c0 0x7f20ec00ba60 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.512+0000 7f210829b700 1 -- 172.21.15.125:0/4191339056 >> 172.21.15.125:0/4191339056 conn(0x7f21000af730 msgr2=0x7f21000afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:53.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.512+0000 7f210829b700 1 -- 172.21.15.125:0/4191339056 shutdown_connections 2023-10-06T03:06:53.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.512+0000 7f210829b700 1 -- 172.21.15.125:0/4191339056 wait complete. 2023-10-06T03:06:53.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.513+0000 7f210829b700 1 Processor -- start 2023-10-06T03:06:53.518 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.513+0000 7f210829b700 1 -- start start 2023-10-06T03:06:53.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.514+0000 7f210829b700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec0051c0 0x7f21000c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.520 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.514+0000 7f210829b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f210015d780 0x7f21000c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.514+0000 7f210829b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21000c4890 0x7f21000c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.514+0000 7f210829b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210015ca70 con 0x7f21000c4890 2023-10-06T03:06:53.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.514+0000 7f210829b700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210015d2f0 con 0x7f20ec0051c0 2023-10-06T03:06:53.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.514+0000 7f210829b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21000c69c0 con 0x7f210015d780 2023-10-06T03:06:53.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.514+0000 7f2106838700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21000c4890 0x7f21000c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.514+0000 7f2106838700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21000c4890 0x7f21000c4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44272/0 (socket says 172.21.15.125:44272) 2023-10-06T03:06:53.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.514+0000 7f2106838700 1 -- 172.21.15.125:0/1129249704 learned_addr learned my addr 172.21.15.125:0/1129249704 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:53.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.514+0000 7f2106037700 1 --2- 172.21.15.125:0/1129249704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec0051c0 0x7f21000c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.514+0000 7f2105836700 1 --2- 172.21.15.125:0/1129249704 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f210015d780 0x7f21000c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.514+0000 7f2106838700 1 -- 172.21.15.125:0/1129249704 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f210015d780 msgr2=0x7f21000c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:53.521 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.514+0000 7f2106838700 1 --2- 172.21.15.125:0/1129249704 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f210015d780 0x7f21000c4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.514+0000 7f2106838700 1 -- 172.21.15.125:0/1129249704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec0051c0 msgr2=0x7f21000c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:53.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.514+0000 7f2106838700 1 --2- 172.21.15.125:0/1129249704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec0051c0 0x7f21000c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.514+0000 7f2106838700 1 -- 172.21.15.125:0/1129249704 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21000c3f40 con 0x7f21000c4890 2023-10-06T03:06:53.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.514+0000 7f2106037700 1 --2- 172.21.15.125:0/1129249704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec0051c0 0x7f21000c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:53.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.514+0000 7f2106838700 1 --2- 172.21.15.125:0/1129249704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21000c4890 0x7f21000c4d10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2100063a70 tx=0x7f20f8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:53.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.515+0000 7f20f67fc700 1 -- 172.21.15.125:0/1129249704 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8001950 con 0x7f21000c4890 2023-10-06T03:06:53.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.515+0000 7f20f67fc700 1 -- 172.21.15.125:0/1129249704 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f800c6d0 con 0x7f21000c4890 2023-10-06T03:06:53.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.515+0000 7f210829b700 1 -- 172.21.15.125:0/1129249704 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f210015cca0 con 0x7f21000c4890 2023-10-06T03:06:53.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.515+0000 7f20f67fc700 1 -- 172.21.15.125:0/1129249704 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f801e850 con 0x7f21000c4890 2023-10-06T03:06:53.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.515+0000 7f210829b700 1 -- 172.21.15.125:0/1129249704 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21000c3bf0 con 0x7f21000c4890 2023-10-06T03:06:53.522 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.516+0000 7f210829b700 1 -- 172.21.15.125:0/1129249704 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f210015d4a0 con 0x7f21000c4890 2023-10-06T03:06:53.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.516+0000 7f20f67fc700 1 -- 172.21.15.125:0/1129249704 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20f801ec00 con 0x7f21000c4890 2023-10-06T03:06:53.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.516+0000 7f20f67fc700 1 --2- 172.21.15.125:0/1129249704 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f20e4066f30 0x7f20e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.516+0000 7f20f67fc700 1 -- 172.21.15.125:0/1129249704 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f20f8085bb0 con 0x7f21000c4890 2023-10-06T03:06:53.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.516+0000 7f2106037700 1 --2- 172.21.15.125:0/1129249704 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f20e4066f30 0x7f20e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.517+0000 7f2106037700 1 --2- 172.21.15.125:0/1129249704 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f20e4066f30 0x7f20e40693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f21000c3b80 tx=0x7f20fc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:53.523 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.520+0000 7f20f67fc700 1 -- 172.21.15.125:0/1129249704 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f210015d4a0 con 0x7f21000c4890 2023-10-06T03:06:53.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.706+0000 7f210829b700 1 -- 172.21.15.125:0/1129249704 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f210015d460 con 0x7f21000c4890 2023-10-06T03:06:53.708 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.706+0000 7f20f67fc700 1 -- 172.21.15.125:0/1129249704 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v57) v1 ==== 104+0+11 (secure 0 0 0) 0x7f20f80170a0 con 0x7f21000c4890 2023-10-06T03:06:53.708 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 32 2023-10-06T03:06:53.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.708+0000 7f210829b700 1 -- 172.21.15.125:0/1129249704 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f20e4066f30 msgr2=0x7f20e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:53.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.708+0000 7f210829b700 1 --2- 172.21.15.125:0/1129249704 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f20e4066f30 0x7f20e40693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f21000c3b80 tx=0x7f20fc008040 comp rx=0 tx=0).stop 2023-10-06T03:06:53.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.708+0000 7f210829b700 1 -- 172.21.15.125:0/1129249704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21000c4890 msgr2=0x7f21000c4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:53.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.708+0000 7f210829b700 1 --2- 172.21.15.125:0/1129249704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21000c4890 0x7f21000c4d10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f2100063a70 tx=0x7f20f8015000 comp rx=0 tx=0).stop 2023-10-06T03:06:53.710 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.708+0000 7f210829b700 1 -- 172.21.15.125:0/1129249704 shutdown_connections 2023-10-06T03:06:53.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.708+0000 7f210829b700 1 --2- 172.21.15.125:0/1129249704 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f20e4066f30 0x7f20e40693e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.708+0000 7f210829b700 1 --2- 172.21.15.125:0/1129249704 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21000c4890 0x7f21000c4d10 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.708+0000 7f210829b700 1 --2- 172.21.15.125:0/1129249704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec0051c0 0x7f21000c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.708+0000 7f210829b700 1 --2- 172.21.15.125:0/1129249704 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f210015d780 0x7f21000c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.708+0000 7f210829b700 1 -- 172.21.15.125:0/1129249704 >> 172.21.15.125:0/1129249704 conn(0x7f21000af730 msgr2=0x7f2100063290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:53.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.708+0000 7f210829b700 1 -- 172.21.15.125:0/1129249704 shutdown_connections 2023-10-06T03:06:53.711 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.708+0000 7f210829b700 1 -- 172.21.15.125:0/1129249704 wait complete. 2023-10-06T03:06:53.721 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T03:06:53.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.841+0000 7f909d044700 1 Processor -- start 2023-10-06T03:06:53.852 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.841+0000 7f909d044700 1 -- start start 2023-10-06T03:06:53.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.842+0000 7f909d044700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90981558e0 0x7f90980cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.842+0000 7f909d044700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f90980ca440 0x7f90980ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.842+0000 7f909d044700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90980c1d50 con 0x7f9098155cb0 2023-10-06T03:06:53.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.842+0000 7f909d044700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90980ca1b0 con 0x7f90980ca440 2023-10-06T03:06:53.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.842+0000 7f909d044700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90980c1740 con 0x7f90981558e0 2023-10-06T03:06:53.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.842+0000 7f909659c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9098155cb0 0x7f90981595e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38476/0 (socket says 172.21.15.125:38476) 2023-10-06T03:06:53.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.842+0000 7f909659c700 1 -- 172.21.15.125:0/1491721098 learned_addr learned my addr 172.21.15.125:0/1491721098 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:53.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.842+0000 7f909759e700 1 --2- 172.21.15.125:0/1491721098 >> v2:172.21.15.130:3300/0 conn(0x7f90980ca440 0x7f90980ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.842+0000 7f9095d9b700 1 -- 172.21.15.125:0/1491721098 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 319472433 0 0) 0x7f90980c1d50 con 0x7f9098155cb0 2023-10-06T03:06:53.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.842+0000 7f9096d9d700 1 --2- 172.21.15.125:0/1491721098 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90981558e0 0x7f90980cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.842+0000 7f9095d9b700 1 -- 172.21.15.125:0/1491721098 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9080003570 con 0x7f9098155cb0 2023-10-06T03:06:53.853 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.842+0000 7f9095d9b700 1 -- 172.21.15.125:0/1491721098 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 885653521 0 0) 0x7f9080003570 con 0x7f9098155cb0 2023-10-06T03:06:53.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.842+0000 7f9095d9b700 1 -- 172.21.15.125:0/1491721098 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90981558e0 msgr2=0x7f90980cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:53.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.842+0000 7f9095d9b700 1 --2- 172.21.15.125:0/1491721098 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90981558e0 0x7f90980cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.842+0000 7f9095d9b700 1 -- 172.21.15.125:0/1491721098 >> v2:172.21.15.130:3300/0 conn(0x7f90980ca440 msgr2=0x7f90980ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:53.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.842+0000 7f9095d9b700 1 --2- 172.21.15.125:0/1491721098 >> v2:172.21.15.130:3300/0 conn(0x7f90980ca440 0x7f90980ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.842+0000 7f9095d9b700 1 -- 172.21.15.125:0/1491721098 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90980c9ed0 con 0x7f9098155cb0 2023-10-06T03:06:53.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.842+0000 7f9095d9b700 1 -- 172.21.15.125:0/1491721098 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f9088001470 con 0x7f9098155cb0 2023-10-06T03:06:53.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.842+0000 7f9095d9b700 1 -- 172.21.15.125:0/1491721098 >> v1:172.21.15.125:6789/0 conn(0x7f9098155cb0 legacy=0x7f90981595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:53.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f9095d9b700 1 --2- 172.21.15.125:0/1491721098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9080003a60 0x7f9080003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f9095d9b700 1 --2- 172.21.15.125:0/1491721098 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90981558e0 0x7f9080004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f9095d9b700 1 --2- 172.21.15.125:0/1491721098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9080004d50 0x7f90800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.854 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f9095d9b700 1 -- 172.21.15.125:0/1491721098 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90980ca1b0 con 0x7f9080003a60 2023-10-06T03:06:53.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f9095d9b700 1 -- 172.21.15.125:0/1491721098 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90980c1740 con 0x7f9080004d50 2023-10-06T03:06:53.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f9095d9b700 1 -- 172.21.15.125:0/1491721098 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f908000dc70 con 0x7f90981558e0 2023-10-06T03:06:53.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f9096d9d700 1 --2- 172.21.15.125:0/1491721098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9080003a60 0x7f9080003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f909659c700 1 --2- 172.21.15.125:0/1491721098 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90981558e0 0x7f9080004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f909759e700 1 --2- 172.21.15.125:0/1491721098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9080004d50 0x7f90800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f9096d9d700 1 -- 172.21.15.125:0/1491721098 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90981558e0 msgr2=0x7f9080004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:53.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f9096d9d700 1 --2- 172.21.15.125:0/1491721098 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90981558e0 0x7f9080004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f9096d9d700 1 -- 172.21.15.125:0/1491721098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9080004d50 msgr2=0x7f90800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:53.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f9096d9d700 1 --2- 172.21.15.125:0/1491721098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9080004d50 0x7f90800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f9096d9d700 1 -- 172.21.15.125:0/1491721098 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9080003570 con 0x7f9080003a60 2023-10-06T03:06:53.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f909659c700 1 --2- 172.21.15.125:0/1491721098 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f90981558e0 0x7f9080004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:53.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f909759e700 1 --2- 172.21.15.125:0/1491721098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9080004d50 0x7f90800051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:53.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f9096d9d700 1 --2- 172.21.15.125:0/1491721098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9080003a60 0x7f9080003e70 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f908c00aca0 tx=0x7f908c00a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fbbc69802e93cda server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:53.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f9095d9b700 1 -- 172.21.15.125:0/1491721098 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c005a00 con 0x7f9080003a60 2023-10-06T03:06:53.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f9095d9b700 1 -- 172.21.15.125:0/1491721098 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c005b60 con 0x7f9080003a60 2023-10-06T03:06:53.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.843+0000 7f9095d9b700 1 -- 172.21.15.125:0/1491721098 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c005cf0 con 0x7f9080003a60 2023-10-06T03:06:53.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.844+0000 7f909d044700 1 -- 172.21.15.125:0/1491721098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9080003a60 msgr2=0x7f9080003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:53.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.844+0000 7f909d044700 1 --2- 172.21.15.125:0/1491721098 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9080003a60 0x7f9080003e70 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f908c00aca0 tx=0x7f908c00a2e0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.844+0000 7f909759e700 1 -- 172.21.15.125:0/1491721098 reap_dead start 2023-10-06T03:06:53.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.844+0000 7f909d044700 1 -- 172.21.15.125:0/1491721098 shutdown_connections 2023-10-06T03:06:53.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.844+0000 7f909d044700 1 -- 172.21.15.125:0/1491721098 >> 172.21.15.125:0/1491721098 conn(0x7f90980af730 msgr2=0x7f90980afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:53.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.844+0000 7f909d044700 1 -- 172.21.15.125:0/1491721098 shutdown_connections 2023-10-06T03:06:53.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.844+0000 7f909d044700 1 -- 172.21.15.125:0/1491721098 wait complete. 2023-10-06T03:06:53.856 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.845+0000 7f909d044700 1 Processor -- start 2023-10-06T03:06:53.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.845+0000 7f909d044700 1 -- start start 2023-10-06T03:06:53.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f909d044700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9098168290 0x7f9098098a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f909d044700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9098096450 0x7f90981580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f909d044700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90981585e0 0x7f9098152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f909d044700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9098158a80 con 0x7f9098168290 2023-10-06T03:06:53.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f909d044700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9098097620 con 0x7f90981585e0 2023-10-06T03:06:53.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f909d044700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9098096a10 con 0x7f9098096450 2023-10-06T03:06:53.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f9096d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9098168290 0x7f9098098a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f9096d9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9098168290 0x7f9098098a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44288/0 (socket says 172.21.15.125:44288) 2023-10-06T03:06:53.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f9096d9d700 1 -- 172.21.15.125:0/3318590034 learned_addr learned my addr 172.21.15.125:0/3318590034 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:53.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f909659c700 1 --2- 172.21.15.125:0/3318590034 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9098096450 0x7f90981580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f909759e700 1 --2- 172.21.15.125:0/3318590034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90981585e0 0x7f9098152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f9096d9d700 1 -- 172.21.15.125:0/3318590034 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9098096450 msgr2=0x7f90981580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:53.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f9096d9d700 1 --2- 172.21.15.125:0/3318590034 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9098096450 0x7f90981580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f9096d9d700 1 -- 172.21.15.125:0/3318590034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90981585e0 msgr2=0x7f9098152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:53.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f9096d9d700 1 --2- 172.21.15.125:0/3318590034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90981585e0 0x7f9098152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:53.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f9096d9d700 1 -- 172.21.15.125:0/3318590034 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9098096cf0 con 0x7f9098168290 2023-10-06T03:06:53.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f909759e700 1 --2- 172.21.15.125:0/3318590034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90981585e0 0x7f9098152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:53.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f9096d9d700 1 --2- 172.21.15.125:0/3318590034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9098168290 0x7f9098098a00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f908c006000 tx=0x7f908c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:53.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f907effd700 1 -- 172.21.15.125:0/3318590034 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c021070 con 0x7f9098168290 2023-10-06T03:06:53.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f907effd700 1 -- 172.21.15.125:0/3318590034 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908c006240 con 0x7f9098168290 2023-10-06T03:06:53.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f907effd700 1 -- 172.21.15.125:0/3318590034 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f908c006600 con 0x7f9098168290 2023-10-06T03:06:53.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.846+0000 7f909d044700 1 -- 172.21.15.125:0/3318590034 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9098096fd0 con 0x7f9098168290 2023-10-06T03:06:53.858 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.847+0000 7f909d044700 1 -- 172.21.15.125:0/3318590034 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9098168660 con 0x7f9098168290 2023-10-06T03:06:53.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.847+0000 7f909d044700 1 -- 172.21.15.125:0/3318590034 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9098165310 con 0x7f9098168290 2023-10-06T03:06:53.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.848+0000 7f907effd700 1 -- 172.21.15.125:0/3318590034 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f908c017030 con 0x7f9098168290 2023-10-06T03:06:53.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.848+0000 7f907effd700 1 --2- 172.21.15.125:0/3318590034 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9084066f30 0x7f90840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:53.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.848+0000 7f907effd700 1 -- 172.21.15.125:0/3318590034 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f908c015070 con 0x7f9098168290 2023-10-06T03:06:53.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.848+0000 7f909659c700 1 --2- 172.21.15.125:0/3318590034 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9084066f30 0x7f90840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:53.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.849+0000 7f909659c700 1 --2- 172.21.15.125:0/3318590034 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9084066f30 0x7f90840693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9098154eb0 tx=0x7f9088007040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:53.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:53.852+0000 7f907effd700 1 -- 172.21.15.125:0/3318590034 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9098165310 con 0x7f9098168290 2023-10-06T03:06:54.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.033+0000 7f909d044700 1 -- 172.21.15.125:0/3318590034 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9098165310 con 0x7f9098168290 2023-10-06T03:06:54.035 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.033+0000 7f907effd700 1 -- 172.21.15.125:0/3318590034 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v57) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9098165310 con 0x7f9098168290 2023-10-06T03:06:54.036 INFO:teuthology.orchestra.run.smithi125.stdout:pg_num: 64 2023-10-06T03:06:54.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.036+0000 7f909d044700 1 -- 172.21.15.125:0/3318590034 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9084066f30 msgr2=0x7f90840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:54.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.036+0000 7f909d044700 1 --2- 172.21.15.125:0/3318590034 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9084066f30 0x7f90840693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9098154eb0 tx=0x7f9088007040 comp rx=0 tx=0).stop 2023-10-06T03:06:54.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.036+0000 7f909d044700 1 -- 172.21.15.125:0/3318590034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9098168290 msgr2=0x7f9098098a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:54.037 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.036+0000 7f909d044700 1 --2- 172.21.15.125:0/3318590034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9098168290 0x7f9098098a00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f908c006000 tx=0x7f908c018000 comp rx=0 tx=0).stop 2023-10-06T03:06:54.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.036+0000 7f909d044700 1 -- 172.21.15.125:0/3318590034 shutdown_connections 2023-10-06T03:06:54.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.036+0000 7f909d044700 1 --2- 172.21.15.125:0/3318590034 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9084066f30 0x7f90840693e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.036+0000 7f909d044700 1 --2- 172.21.15.125:0/3318590034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90981585e0 0x7f9098152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.036+0000 7f909d044700 1 --2- 172.21.15.125:0/3318590034 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9098168290 0x7f9098098a00 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.036+0000 7f909d044700 1 --2- 172.21.15.125:0/3318590034 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9098096450 0x7f90981580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.036+0000 7f909d044700 1 -- 172.21.15.125:0/3318590034 >> 172.21.15.125:0/3318590034 conn(0x7f90980af730 msgr2=0x7f909806ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:54.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.036+0000 7f909d044700 1 -- 172.21.15.125:0/3318590034 shutdown_connections 2023-10-06T03:06:54.038 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.036+0000 7f909d044700 1 -- 172.21.15.125:0/3318590034 wait complete. 2023-10-06T03:06:54.049 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:06:54.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.166+0000 7f00d8331700 1 Processor -- start 2023-10-06T03:06:54.168 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.166+0000 7f00d8331700 1 -- start start 2023-10-06T03:06:54.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.167+0000 7f00d8331700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f00d006a8c0 0x7f00d006ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:54.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.167+0000 7f00d8331700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d00acdb0 con 0x7f00d0157050 2023-10-06T03:06:54.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.167+0000 7f00d8331700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d0157420 con 0x7f00d00af370 2023-10-06T03:06:54.171 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.167+0000 7f00d8331700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d006b2a0 con 0x7f00d006a8c0 2023-10-06T03:06:54.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.167+0000 7f00d58cc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f00d006a8c0 0x7f00d006ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:54.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.167+0000 7f00d58cc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f00d006a8c0 0x7f00d006ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44298/0 (socket says 172.21.15.125:44298) 2023-10-06T03:06:54.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.167+0000 7f00d58cc700 1 -- 172.21.15.125:0/1383009671 learned_addr learned my addr 172.21.15.125:0/1383009671 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:54.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.167+0000 7f00d60cd700 1 --1- 172.21.15.125:0/1383009671 >> v1:172.21.15.125:6789/0 conn(0x7f00d0157050 0x7f00d00ab7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38486/0 (socket says 172.21.15.125:38486) 2023-10-06T03:06:54.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.168+0000 7f00d58cc700 1 -- 172.21.15.125:0/1383009671 >> v1:172.21.15.130:6789/0 conn(0x7f00d00af370 legacy=0x7f00d00af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:54.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.168+0000 7f00d58cc700 1 -- 172.21.15.125:0/1383009671 >> v1:172.21.15.125:6789/0 conn(0x7f00d0157050 legacy=0x7f00d00ab7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:54.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.168+0000 7f00d50cb700 1 -- 172.21.15.125:0/1383009671 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382427780 0 0) 0x7f00d00acdb0 con 0x7f00d0157050 2023-10-06T03:06:54.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.168+0000 7f00d58cc700 1 -- 172.21.15.125:0/1383009671 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d00abed0 con 0x7f00d006a8c0 2023-10-06T03:06:54.172 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.168+0000 7f00d58cc700 1 --2- 172.21.15.125:0/1383009671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00d006a8c0 0x7f00d006ad60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f00c40099b0 tx=0x7f00c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f89fdbc9ad275a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:54.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.168+0000 7f00d50cb700 1 -- 172.21.15.125:0/1383009671 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c400b820 con 0x7f00d006a8c0 2023-10-06T03:06:54.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.168+0000 7f00d50cb700 1 -- 172.21.15.125:0/1383009671 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c400b980 con 0x7f00d006a8c0 2023-10-06T03:06:54.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.168+0000 7f00d50cb700 1 -- 172.21.15.125:0/1383009671 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c400bd20 con 0x7f00d006a8c0 2023-10-06T03:06:54.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.169+0000 7f00d8331700 1 -- 172.21.15.125:0/1383009671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00d006a8c0 msgr2=0x7f00d006ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:54.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.169+0000 7f00d8331700 1 --2- 172.21.15.125:0/1383009671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00d006a8c0 0x7f00d006ad60 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f00c40099b0 tx=0x7f00c4009250 comp rx=0 tx=0).stop 2023-10-06T03:06:54.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.169+0000 7f00d8331700 1 -- 172.21.15.125:0/1383009671 shutdown_connections 2023-10-06T03:06:54.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.169+0000 7f00d8331700 1 --2- 172.21.15.125:0/1383009671 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00d006a8c0 0x7f00d006ad60 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.173 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.169+0000 7f00d8331700 1 -- 172.21.15.125:0/1383009671 >> 172.21.15.125:0/1383009671 conn(0x7f00d00cc5a0 msgr2=0x7f00d00cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:54.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.169+0000 7f00d8331700 1 -- 172.21.15.125:0/1383009671 shutdown_connections 2023-10-06T03:06:54.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.169+0000 7f00d8331700 1 -- 172.21.15.125:0/1383009671 wait complete. 2023-10-06T03:06:54.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.170+0000 7f00d8331700 1 Processor -- start 2023-10-06T03:06:54.174 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.170+0000 7f00d8331700 1 -- start start 2023-10-06T03:06:54.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.170+0000 7f00d8331700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00d006a8c0 0x7f00d00aaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:54.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00d8331700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00d00af370 0x7f00d00a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:54.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00d8331700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00d0157050 0x7f00d00c2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:54.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00d8331700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d00a9930 con 0x7f00d006a8c0 2023-10-06T03:06:54.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00d8331700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d01693d0 con 0x7f00d00af370 2023-10-06T03:06:54.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00d8331700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0169660 con 0x7f00d0157050 2023-10-06T03:06:54.178 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00d60cd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00d006a8c0 0x7f00d00aaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:54.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00d60cd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00d006a8c0 0x7f00d00aaf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44308/0 (socket says 172.21.15.125:44308) 2023-10-06T03:06:54.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00d60cd700 1 -- 172.21.15.125:0/3839670563 learned_addr learned my addr 172.21.15.125:0/3839670563 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:54.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00d58cc700 1 --2- 172.21.15.125:0/3839670563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00d00af370 0x7f00d00a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:54.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00d68ce700 1 --2- 172.21.15.125:0/3839670563 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00d0157050 0x7f00d00c2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:54.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00d60cd700 1 -- 172.21.15.125:0/3839670563 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00d0157050 msgr2=0x7f00d00c2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:54.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00d60cd700 1 --2- 172.21.15.125:0/3839670563 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00d0157050 0x7f00d00c2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.179 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00d60cd700 1 -- 172.21.15.125:0/3839670563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00d00af370 msgr2=0x7f00d00a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:54.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00d60cd700 1 --2- 172.21.15.125:0/3839670563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00d00af370 0x7f00d00a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00d60cd700 1 -- 172.21.15.125:0/3839670563 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c40094f0 con 0x7f00d006a8c0 2023-10-06T03:06:54.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00d60cd700 1 --2- 172.21.15.125:0/3839670563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00d006a8c0 0x7f00d00aaf60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00c5e0 tx=0x7f00cc001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:54.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00c27fc700 1 -- 172.21.15.125:0/3839670563 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc005a70 con 0x7f00d006a8c0 2023-10-06T03:06:54.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00c27fc700 1 -- 172.21.15.125:0/3839670563 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc005bd0 con 0x7f00d006a8c0 2023-10-06T03:06:54.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00c27fc700 1 -- 172.21.15.125:0/3839670563 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0070d0 con 0x7f00d006a8c0 2023-10-06T03:06:54.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00d8331700 1 -- 172.21.15.125:0/3839670563 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d00a8df0 con 0x7f00d006a8c0 2023-10-06T03:06:54.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.171+0000 7f00d8331700 1 -- 172.21.15.125:0/3839670563 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d00a9140 con 0x7f00d006a8c0 2023-10-06T03:06:54.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.172+0000 7f00d8331700 1 -- 172.21.15.125:0/3839670563 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d00ccb80 con 0x7f00d006a8c0 2023-10-06T03:06:54.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.173+0000 7f00c27fc700 1 -- 172.21.15.125:0/3839670563 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00cc007480 con 0x7f00d006a8c0 2023-10-06T03:06:54.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.173+0000 7f00c27fc700 1 --2- 172.21.15.125:0/3839670563 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f00b4066f30 0x7f00b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:54.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.173+0000 7f00c27fc700 1 -- 172.21.15.125:0/3839670563 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f00cc083c20 con 0x7f00d006a8c0 2023-10-06T03:06:54.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.173+0000 7f00d58cc700 1 --2- 172.21.15.125:0/3839670563 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f00b4066f30 0x7f00b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:54.181 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.173+0000 7f00d58cc700 1 --2- 172.21.15.125:0/3839670563 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f00b4066f30 0x7f00b40693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f00c40099b0 tx=0x7f00c4016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:54.182 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.177+0000 7f00c27fc700 1 -- 172.21.15.125:0/3839670563 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00cc050bf0 con 0x7f00d006a8c0 2023-10-06T03:06:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.400+0000 7f00d8331700 1 -- 172.21.15.125:0/3839670563 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00d0066510 con 0x7f00d006a8c0 2023-10-06T03:06:54.402 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.401+0000 7f00c27fc700 1 -- 172.21.15.125:0/3839670563 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4610 (secure 0 0 0) 0x7f00cc017070 con 0x7f00d006a8c0 2023-10-06T03:06:54.403 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:54.403 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/2151384589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2151384589},{"type":"v1","addr":"172.21.15.130:6834","nonce":2151384589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5299,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1214475159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1214475159},{"type":"v1","addr":"172.21.15.130:6835","nonce":1214475159}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/4005469649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":4005469649},{"type":"v1","addr":"172.21.15.125:6836","nonce":4005469649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:06:20.996155+0000","modified":"2023-10-06T03:06:24.636313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5556":{"gid":5556,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/1751632854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":1751632854},{"type":"v1","addr":"172.21.15.125:6837","nonce":1751632854}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:06:54.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.403+0000 7f00d8331700 1 -- 172.21.15.125:0/3839670563 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f00b4066f30 msgr2=0x7f00b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:54.405 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.403+0000 7f00d8331700 1 --2- 172.21.15.125:0/3839670563 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f00b4066f30 0x7f00b40693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f00c40099b0 tx=0x7f00c4016000 comp rx=0 tx=0).stop 2023-10-06T03:06:54.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.403+0000 7f00d8331700 1 -- 172.21.15.125:0/3839670563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00d006a8c0 msgr2=0x7f00d00aaf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:54.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.403+0000 7f00d8331700 1 --2- 172.21.15.125:0/3839670563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00d006a8c0 0x7f00d00aaf60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00c5e0 tx=0x7f00cc001040 comp rx=0 tx=0).stop 2023-10-06T03:06:54.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.403+0000 7f00d8331700 1 -- 172.21.15.125:0/3839670563 shutdown_connections 2023-10-06T03:06:54.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.403+0000 7f00d8331700 1 --2- 172.21.15.125:0/3839670563 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f00b4066f30 0x7f00b40693e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.406 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.403+0000 7f00d8331700 1 --2- 172.21.15.125:0/3839670563 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00d0157050 0x7f00d00c2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.403+0000 7f00d8331700 1 --2- 172.21.15.125:0/3839670563 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00d006a8c0 0x7f00d00aaf60 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.403+0000 7f00d8331700 1 --2- 172.21.15.125:0/3839670563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00d00af370 0x7f00d00a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.403+0000 7f00d8331700 1 -- 172.21.15.125:0/3839670563 >> 172.21.15.125:0/3839670563 conn(0x7f00d00cc5a0 msgr2=0x7f00d0154650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:54.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.403+0000 7f00d8331700 1 -- 172.21.15.125:0/3839670563 shutdown_connections 2023-10-06T03:06:54.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.403+0000 7f00d8331700 1 -- 172.21.15.125:0/3839670563 wait complete. 2023-10-06T03:06:54.408 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 27 2023-10-06T03:06:54.416 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:06:54.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.533+0000 7f0025bc9700 1 Processor -- start 2023-10-06T03:06:54.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.533+0000 7f0025bc9700 1 -- start start 2023-10-06T03:06:54.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.533+0000 7f0025bc9700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00200cbb50 0x7f00200a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:54.536 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.533+0000 7f0025bc9700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f00200cbf20 0x7f00200caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.533+0000 7f0025bc9700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00200c2910 con 0x7f00200caf80 2023-10-06T03:06:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.533+0000 7f0025bc9700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00200cb420 con 0x7f00200cbf20 2023-10-06T03:06:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.533+0000 7f0025bc9700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00200c1d40 con 0x7f00200cbb50 2023-10-06T03:06:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.534+0000 7f001f7fe700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00200cbb50 0x7f00200a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.534+0000 7f001effd700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f00200cbf20 0x7f00200caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.534+0000 7f001ffff700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f00200caf80 0x7f00200c2da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:52382/0 (socket says 172.21.15.125:52382) 2023-10-06T03:06:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.534+0000 7f001f7fe700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00200cbb50 0x7f00200a99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:52130/0 (socket says 172.21.15.125:52130) 2023-10-06T03:06:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.534+0000 7f001ffff700 1 -- 172.21.15.125:0/3036722672 learned_addr learned my addr 172.21.15.125:0/3036722672 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.534+0000 7f001effd700 1 -- 172.21.15.125:0/3036722672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00200cbb50 msgr2=0x7f00200a99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.534+0000 7f001effd700 1 --2- 172.21.15.125:0/3036722672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00200cbb50 0x7f00200a99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.534+0000 7f001effd700 1 -- 172.21.15.125:0/3036722672 >> v1:172.21.15.130:6789/0 conn(0x7f00200caf80 legacy=0x7f00200c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.534+0000 7f001effd700 1 -- 172.21.15.125:0/3036722672 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00200c1fe0 con 0x7f00200cbf20 2023-10-06T03:06:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.534+0000 7f001effd700 1 --2- 172.21.15.125:0/3036722672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00200cbf20 0x7f00200caa40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f001000bb90 tx=0x7f001000b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c96a4fb11f85fb41 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.534+0000 7f001e7fc700 1 -- 172.21.15.125:0/3036722672 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001000db40 con 0x7f00200cbf20 2023-10-06T03:06:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.535+0000 7f001e7fc700 1 -- 172.21.15.125:0/3036722672 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001000dca0 con 0x7f00200cbf20 2023-10-06T03:06:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.535+0000 7f001e7fc700 1 -- 172.21.15.125:0/3036722672 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00100196b0 con 0x7f00200cbf20 2023-10-06T03:06:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.535+0000 7f0025bc9700 1 -- 172.21.15.125:0/3036722672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00200cbf20 msgr2=0x7f00200caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.535+0000 7f0025bc9700 1 --2- 172.21.15.125:0/3036722672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00200cbf20 0x7f00200caa40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f001000bb90 tx=0x7f001000b430 comp rx=0 tx=0).stop 2023-10-06T03:06:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.535+0000 7f0025bc9700 1 -- 172.21.15.125:0/3036722672 shutdown_connections 2023-10-06T03:06:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.535+0000 7f0025bc9700 1 --2- 172.21.15.125:0/3036722672 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00200cbb50 0x7f00200a99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.535+0000 7f0025bc9700 1 --2- 172.21.15.125:0/3036722672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00200cbf20 0x7f00200caa40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.538 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.535+0000 7f0025bc9700 1 -- 172.21.15.125:0/3036722672 >> 172.21.15.125:0/3036722672 conn(0x7f0020068f00 msgr2=0x7f00200cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:54.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.535+0000 7f0025bc9700 1 -- 172.21.15.125:0/3036722672 shutdown_connections 2023-10-06T03:06:54.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.535+0000 7f0025bc9700 1 -- 172.21.15.125:0/3036722672 wait complete. 2023-10-06T03:06:54.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.536+0000 7f0025bc9700 1 Processor -- start 2023-10-06T03:06:54.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.536+0000 7f0025bc9700 1 -- start start 2023-10-06T03:06:54.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.537+0000 7f0025bc9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00200caf80 0x7f00200ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:54.541 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.537+0000 7f0025bc9700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00200cbb50 0x7f00200adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:54.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.537+0000 7f0025bc9700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00200cbf20 0x7f00200ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:54.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.537+0000 7f0025bc9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00201441c0 con 0x7f00200caf80 2023-10-06T03:06:54.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.537+0000 7f0025bc9700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00200af2e0 con 0x7f00200cbb50 2023-10-06T03:06:54.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.537+0000 7f0025bc9700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00200ae6d0 con 0x7f00200cbf20 2023-10-06T03:06:54.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.537+0000 7f001f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00200caf80 0x7f00200ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:54.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.537+0000 7f001f7fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00200caf80 0x7f00200ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44324/0 (socket says 172.21.15.125:44324) 2023-10-06T03:06:54.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.537+0000 7f001f7fe700 1 -- 172.21.15.125:0/1512440419 learned_addr learned my addr 172.21.15.125:0/1512440419 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:54.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.537+0000 7f001ffff700 1 --2- 172.21.15.125:0/1512440419 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00200cbf20 0x7f00200ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:54.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.538+0000 7f001effd700 1 --2- 172.21.15.125:0/1512440419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00200cbb50 0x7f00200adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:54.542 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.538+0000 7f001f7fe700 1 -- 172.21.15.125:0/1512440419 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00200cbf20 msgr2=0x7f00200ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:54.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.538+0000 7f001f7fe700 1 --2- 172.21.15.125:0/1512440419 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00200cbf20 0x7f00200ae0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.538+0000 7f001f7fe700 1 -- 172.21.15.125:0/1512440419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00200cbb50 msgr2=0x7f00200adb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:54.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.538+0000 7f001f7fe700 1 --2- 172.21.15.125:0/1512440419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00200cbb50 0x7f00200adb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.538+0000 7f001f7fe700 1 -- 172.21.15.125:0/1512440419 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001000b6d0 con 0x7f00200caf80 2023-10-06T03:06:54.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.538+0000 7f001f7fe700 1 --2- 172.21.15.125:0/1512440419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00200caf80 0x7f00200ca960 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f000800ec80 tx=0x7f0008009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:54.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.538+0000 7f00177fe700 1 -- 172.21.15.125:0/1512440419 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000800c9d0 con 0x7f00200caf80 2023-10-06T03:06:54.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.538+0000 7f00177fe700 1 -- 172.21.15.125:0/1512440419 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000800cb30 con 0x7f00200caf80 2023-10-06T03:06:54.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.538+0000 7f0025bc9700 1 -- 172.21.15.125:0/1512440419 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00200ae9b0 con 0x7f00200caf80 2023-10-06T03:06:54.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.538+0000 7f00177fe700 1 -- 172.21.15.125:0/1512440419 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0008013470 con 0x7f00200caf80 2023-10-06T03:06:54.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.538+0000 7f0025bc9700 1 -- 172.21.15.125:0/1512440419 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00200aef70 con 0x7f00200caf80 2023-10-06T03:06:54.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.539+0000 7f0025bc9700 1 -- 172.21.15.125:0/1512440419 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0020066510 con 0x7f00200caf80 2023-10-06T03:06:54.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.539+0000 7f00177fe700 1 -- 172.21.15.125:0/1512440419 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0008013860 con 0x7f00200caf80 2023-10-06T03:06:54.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.540+0000 7f00177fe700 1 --2- 172.21.15.125:0/1512440419 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0000066f30 0x7f00000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:54.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.540+0000 7f00177fe700 1 -- 172.21.15.125:0/1512440419 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f0008084f80 con 0x7f00200caf80 2023-10-06T03:06:54.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.540+0000 7f001effd700 1 --2- 172.21.15.125:0/1512440419 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0000066f30 0x7f00000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:54.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.540+0000 7f001effd700 1 --2- 172.21.15.125:0/1512440419 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0000066f30 0x7f00000693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f00200cc350 tx=0x7f001001b000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:54.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.544+0000 7f00177fe700 1 -- 172.21.15.125:0/1512440419 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0008051f50 con 0x7f00200caf80 2023-10-06T03:06:54.728 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.727+0000 7f0025bc9700 1 -- 172.21.15.125:0/1512440419 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00200af5c0 con 0x7f00200caf80 2023-10-06T03:06:54.729 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.728+0000 7f00177fe700 1 -- 172.21.15.125:0/1512440419 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+17217 (secure 0 0 0) 0x7f0008055570 con 0x7f00200caf80 2023-10-06T03:06:54.730 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:54.730 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":57,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:06:22.618226+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:06:18.650188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T03:06:19.963528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:06:54.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.730+0000 7f0025bc9700 1 -- 172.21.15.125:0/1512440419 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0000066f30 msgr2=0x7f00000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:54.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.730+0000 7f0025bc9700 1 --2- 172.21.15.125:0/1512440419 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0000066f30 0x7f00000693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f00200cc350 tx=0x7f001001b000 comp rx=0 tx=0).stop 2023-10-06T03:06:54.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.730+0000 7f0025bc9700 1 -- 172.21.15.125:0/1512440419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00200caf80 msgr2=0x7f00200ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:54.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.730+0000 7f0025bc9700 1 --2- 172.21.15.125:0/1512440419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00200caf80 0x7f00200ca960 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f000800ec80 tx=0x7f0008009120 comp rx=0 tx=0).stop 2023-10-06T03:06:54.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.730+0000 7f0025bc9700 1 -- 172.21.15.125:0/1512440419 shutdown_connections 2023-10-06T03:06:54.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.730+0000 7f0025bc9700 1 --2- 172.21.15.125:0/1512440419 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0000066f30 0x7f00000693e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.732 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.730+0000 7f0025bc9700 1 --2- 172.21.15.125:0/1512440419 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00200cbf20 0x7f00200ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.730+0000 7f0025bc9700 1 --2- 172.21.15.125:0/1512440419 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00200caf80 0x7f00200ca960 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.730+0000 7f0025bc9700 1 --2- 172.21.15.125:0/1512440419 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00200cbb50 0x7f00200adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.730+0000 7f0025bc9700 1 -- 172.21.15.125:0/1512440419 >> 172.21.15.125:0/1512440419 conn(0x7f0020068f00 msgr2=0x7f00200ab140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:54.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.730+0000 7f0025bc9700 1 -- 172.21.15.125:0/1512440419 shutdown_connections 2023-10-06T03:06:54.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.730+0000 7f0025bc9700 1 -- 172.21.15.125:0/1512440419 wait complete. 2023-10-06T03:06:54.744 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:06:54.744 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:06:54.861 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.860+0000 7f2911b62700 1 Processor -- start 2023-10-06T03:06:54.862 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.860+0000 7f2911b62700 1 -- start start 2023-10-06T03:06:54.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.861+0000 7f2911b62700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f290c0ac670 0x7f290c158c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:54.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.861+0000 7f2911b62700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f290c0c7250 0x7f290c159190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:54.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.861+0000 7f2911b62700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f290c067c70 con 0x7f290c06ab10 2023-10-06T03:06:54.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.861+0000 7f2911b62700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f290c069110 con 0x7f290c0ac670 2023-10-06T03:06:54.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.861+0000 7f2911b62700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290c1596d0 con 0x7f290c0c7250 2023-10-06T03:06:54.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.861+0000 7f290affd700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f290c0ac670 0x7f290c158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:54.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.861+0000 7f290affd700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f290c0ac670 0x7f290c158c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:51058/0 (socket says 172.21.15.125:51058) 2023-10-06T03:06:54.864 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.861+0000 7f290bfff700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f290c0c7250 0x7f290c159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:54.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.861+0000 7f290affd700 1 -- 172.21.15.125:0/2249126536 learned_addr learned my addr 172.21.15.125:0/2249126536 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:54.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.861+0000 7f290b7fe700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7f290c06ab10 0x7f290c0c6b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:52390/0 (socket says 172.21.15.125:52390) 2023-10-06T03:06:54.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.861+0000 7f290affd700 1 -- 172.21.15.125:0/2249126536 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f290c0c7250 msgr2=0x7f290c159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:54.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.861+0000 7f290affd700 1 --2- 172.21.15.125:0/2249126536 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f290c0c7250 0x7f290c159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.861+0000 7f290affd700 1 -- 172.21.15.125:0/2249126536 >> v1:172.21.15.130:6789/0 conn(0x7f290c06ab10 legacy=0x7f290c0c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:54.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.861+0000 7f290affd700 1 -- 172.21.15.125:0/2249126536 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290c0c7800 con 0x7f290c0ac670 2023-10-06T03:06:54.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.862+0000 7f290affd700 1 --2- 172.21.15.125:0/2249126536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f290c0ac670 0x7f290c158c50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0099b0 tx=0x7f28fc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be82c715fdb09ef7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:54.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.862+0000 7f290a7fc700 1 -- 172.21.15.125:0/2249126536 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc009ea0 con 0x7f290c0ac670 2023-10-06T03:06:54.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.862+0000 7f290a7fc700 1 -- 172.21.15.125:0/2249126536 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28fc00b860 con 0x7f290c0ac670 2023-10-06T03:06:54.865 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.862+0000 7f290a7fc700 1 -- 172.21.15.125:0/2249126536 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc00bc00 con 0x7f290c0ac670 2023-10-06T03:06:54.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.862+0000 7f2911b62700 1 -- 172.21.15.125:0/2249126536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f290c0ac670 msgr2=0x7f290c158c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:54.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.862+0000 7f2911b62700 1 --2- 172.21.15.125:0/2249126536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f290c0ac670 0x7f290c158c50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0099b0 tx=0x7f28fc009250 comp rx=0 tx=0).stop 2023-10-06T03:06:54.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.862+0000 7f2911b62700 1 -- 172.21.15.125:0/2249126536 shutdown_connections 2023-10-06T03:06:54.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.862+0000 7f2911b62700 1 --2- 172.21.15.125:0/2249126536 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f290c0c7250 0x7f290c159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.862+0000 7f2911b62700 1 --2- 172.21.15.125:0/2249126536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f290c0ac670 0x7f290c158c50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.862+0000 7f2911b62700 1 -- 172.21.15.125:0/2249126536 >> 172.21.15.125:0/2249126536 conn(0x7f290c0cc5a0 msgr2=0x7f290c0cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:54.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.862+0000 7f2911b62700 1 -- 172.21.15.125:0/2249126536 shutdown_connections 2023-10-06T03:06:54.866 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.862+0000 7f2911b62700 1 -- 172.21.15.125:0/2249126536 wait complete. 2023-10-06T03:06:54.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.864+0000 7f2911b62700 1 Processor -- start 2023-10-06T03:06:54.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.864+0000 7f2911b62700 1 -- start start 2023-10-06T03:06:54.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.864+0000 7f2911b62700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f290c06ab10 0x7f290c16d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:54.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.864+0000 7f2911b62700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f290c0ac670 0x7f290c0a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:54.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.864+0000 7f2911b62700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f290c0c7250 0x7f290c152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:54.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.864+0000 7f2911b62700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290c154b30 con 0x7f290c0c7250 2023-10-06T03:06:54.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.864+0000 7f2911b62700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290c0a8df0 con 0x7f290c0ac670 2023-10-06T03:06:54.869 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.864+0000 7f2911b62700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290c0a9090 con 0x7f290c06ab10 2023-10-06T03:06:54.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.864+0000 7f290bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f290c0c7250 0x7f290c152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:54.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.864+0000 7f290bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f290c0c7250 0x7f290c152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44336/0 (socket says 172.21.15.125:44336) 2023-10-06T03:06:54.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.864+0000 7f290bfff700 1 -- 172.21.15.125:0/2101352137 learned_addr learned my addr 172.21.15.125:0/2101352137 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:54.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.864+0000 7f290b7fe700 1 --2- 172.21.15.125:0/2101352137 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f290c06ab10 0x7f290c16d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:54.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.865+0000 7f290affd700 1 --2- 172.21.15.125:0/2101352137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f290c0ac670 0x7f290c0a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:54.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.865+0000 7f290bfff700 1 -- 172.21.15.125:0/2101352137 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f290c06ab10 msgr2=0x7f290c16d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:54.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.865+0000 7f290bfff700 1 --2- 172.21.15.125:0/2101352137 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f290c06ab10 0x7f290c16d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.865+0000 7f290bfff700 1 -- 172.21.15.125:0/2101352137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f290c0ac670 msgr2=0x7f290c0a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:54.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.865+0000 7f290bfff700 1 --2- 172.21.15.125:0/2101352137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f290c0ac670 0x7f290c0a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:54.870 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.865+0000 7f290bfff700 1 -- 172.21.15.125:0/2101352137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc0094f0 con 0x7f290c0c7250 2023-10-06T03:06:54.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.865+0000 7f290bfff700 1 --2- 172.21.15.125:0/2101352137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f290c0c7250 0x7f290c152a10 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f2904009df0 tx=0x7f290400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:54.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.865+0000 7f29037fe700 1 -- 172.21.15.125:0/2101352137 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290400caa0 con 0x7f290c0c7250 2023-10-06T03:06:54.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.865+0000 7f29037fe700 1 -- 172.21.15.125:0/2101352137 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290400f040 con 0x7f290c0c7250 2023-10-06T03:06:54.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.865+0000 7f2911b62700 1 -- 172.21.15.125:0/2101352137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f290c0a9370 con 0x7f290c0c7250 2023-10-06T03:06:54.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.865+0000 7f29037fe700 1 -- 172.21.15.125:0/2101352137 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290400ce70 con 0x7f290c0c7250 2023-10-06T03:06:54.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.865+0000 7f2911b62700 1 -- 172.21.15.125:0/2101352137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f290c152f50 con 0x7f290c0c7250 2023-10-06T03:06:54.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.866+0000 7f2911b62700 1 -- 172.21.15.125:0/2101352137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f290c0a9890 con 0x7f290c0c7250 2023-10-06T03:06:54.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.866+0000 7f29037fe700 1 -- 172.21.15.125:0/2101352137 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2904014690 con 0x7f290c0c7250 2023-10-06T03:06:54.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.867+0000 7f29037fe700 1 --2- 172.21.15.125:0/2101352137 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f28ec066f30 0x7f28ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:54.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.867+0000 7f29037fe700 1 -- 172.21.15.125:0/2101352137 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f2904085100 con 0x7f290c0c7250 2023-10-06T03:06:54.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.867+0000 7f290b7fe700 1 --2- 172.21.15.125:0/2101352137 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f28ec066f30 0x7f28ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:54.871 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.867+0000 7f290b7fe700 1 --2- 172.21.15.125:0/2101352137 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f28ec066f30 0x7f28ec0693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f290c06f400 tx=0x7f28f4007eb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:54.872 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:54.871+0000 7f29037fe700 1 -- 172.21.15.125:0/2101352137 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f290c0a9890 con 0x7f290c0c7250 2023-10-06T03:06:55.093 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.092+0000 7f2911b62700 1 -- 172.21.15.125:0/2101352137 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f290c154900 con 0x7f290c0c7250 2023-10-06T03:06:55.094 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.093+0000 7f29037fe700 1 -- 172.21.15.125:0/2101352137 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4610 (secure 0 0 0) 0x7f290c154900 con 0x7f290c0c7250 2023-10-06T03:06:55.094 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:55.094 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/2151384589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2151384589},{"type":"v1","addr":"172.21.15.130:6834","nonce":2151384589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5299,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1214475159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1214475159},{"type":"v1","addr":"172.21.15.130:6835","nonce":1214475159}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/4005469649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":4005469649},{"type":"v1","addr":"172.21.15.125:6836","nonce":4005469649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:06:20.996155+0000","modified":"2023-10-06T03:06:24.636313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5556":{"gid":5556,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/1751632854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":1751632854},{"type":"v1","addr":"172.21.15.125:6837","nonce":1751632854}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:06:55.096 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.095+0000 7f2911b62700 1 -- 172.21.15.125:0/2101352137 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f28ec066f30 msgr2=0x7f28ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:55.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.095+0000 7f2911b62700 1 --2- 172.21.15.125:0/2101352137 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f28ec066f30 0x7f28ec0693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f290c06f400 tx=0x7f28f4007eb0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.095+0000 7f2911b62700 1 -- 172.21.15.125:0/2101352137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f290c0c7250 msgr2=0x7f290c152a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:55.097 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.095+0000 7f2911b62700 1 --2- 172.21.15.125:0/2101352137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f290c0c7250 0x7f290c152a10 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f2904009df0 tx=0x7f290400b040 comp rx=0 tx=0).stop 2023-10-06T03:06:55.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.095+0000 7f2911b62700 1 -- 172.21.15.125:0/2101352137 shutdown_connections 2023-10-06T03:06:55.098 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.095+0000 7f2911b62700 1 --2- 172.21.15.125:0/2101352137 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f28ec066f30 0x7f28ec0693e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.095+0000 7f2911b62700 1 --2- 172.21.15.125:0/2101352137 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f290c0c7250 0x7f290c152a10 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.095+0000 7f2911b62700 1 --2- 172.21.15.125:0/2101352137 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f290c06ab10 0x7f290c16d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.095+0000 7f2911b62700 1 --2- 172.21.15.125:0/2101352137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f290c0ac670 0x7f290c0a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.095+0000 7f2911b62700 1 -- 172.21.15.125:0/2101352137 >> 172.21.15.125:0/2101352137 conn(0x7f290c0cc5a0 msgr2=0x7f290c158150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:55.099 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.095+0000 7f2911b62700 1 -- 172.21.15.125:0/2101352137 shutdown_connections 2023-10-06T03:06:55.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.095+0000 7f2911b62700 1 -- 172.21.15.125:0/2101352137 wait complete. 2023-10-06T03:06:55.101 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 27 2023-10-06T03:06:55.108 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:06:55.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.223+0000 7f80d3a40700 1 Processor -- start 2023-10-06T03:06:55.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.224+0000 7f80d3a40700 1 -- start start 2023-10-06T03:06:55.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.224+0000 7f80d3a40700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80cc0c7fd0 0x7f80cc156560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.224+0000 7f80d3a40700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f80cc0ad730 0x7f80cc0adb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.224+0000 7f80d3a40700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80cc156b40 con 0x7f80cc0c83a0 2023-10-06T03:06:55.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.224+0000 7f80d3a40700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80cc0aebb0 con 0x7f80cc0ad730 2023-10-06T03:06:55.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.224+0000 7f80d3a40700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc156e20 con 0x7f80cc0c7fd0 2023-10-06T03:06:55.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.225+0000 7f80d1fdd700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f80cc0ad730 0x7f80cc0adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.225+0000 7f80d17dc700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80cc0c7fd0 0x7f80cc156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.225+0000 7f80d1fdd700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f80cc0ad730 0x7f80cc0adb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:51076/0 (socket says 172.21.15.125:51076) 2023-10-06T03:06:55.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.225+0000 7f80d17dc700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80cc0c7fd0 0x7f80cc156560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:52156/0 (socket says 172.21.15.125:52156) 2023-10-06T03:06:55.227 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.225+0000 7f80d1fdd700 1 -- 172.21.15.125:0/3441828772 learned_addr learned my addr 172.21.15.125:0/3441828772 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:55.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.225+0000 7f80d0fdb700 1 --1- 172.21.15.125:0/3441828772 >> v1:172.21.15.130:6789/0 conn(0x7f80cc0c83a0 0x7f80cc068b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:52396/0 (socket says 172.21.15.125:52396) 2023-10-06T03:06:55.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.225+0000 7f80d1fdd700 1 -- 172.21.15.125:0/3441828772 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80cc0c7fd0 msgr2=0x7f80cc156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:55.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.225+0000 7f80d1fdd700 1 --2- 172.21.15.125:0/3441828772 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80cc0c7fd0 0x7f80cc156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.225+0000 7f80d1fdd700 1 -- 172.21.15.125:0/3441828772 >> v1:172.21.15.130:6789/0 conn(0x7f80cc0c83a0 legacy=0x7f80cc068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:55.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.225+0000 7f80d1fdd700 1 -- 172.21.15.125:0/3441828772 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc157100 con 0x7f80cc0ad730 2023-10-06T03:06:55.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.225+0000 7f80d1fdd700 1 --2- 172.21.15.125:0/3441828772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80cc0ad730 0x7f80cc0adb50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f80c400d1a0 tx=0x7f80c400ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b9a6d4c609311c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:55.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.225+0000 7f80bffff700 1 -- 172.21.15.125:0/3441828772 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c4010070 con 0x7f80cc0ad730 2023-10-06T03:06:55.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.225+0000 7f80bffff700 1 -- 172.21.15.125:0/3441828772 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c400de10 con 0x7f80cc0ad730 2023-10-06T03:06:55.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.225+0000 7f80bffff700 1 -- 172.21.15.125:0/3441828772 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c400b320 con 0x7f80cc0ad730 2023-10-06T03:06:55.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.226+0000 7f80d3a40700 1 -- 172.21.15.125:0/3441828772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80cc0ad730 msgr2=0x7f80cc0adb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:55.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.226+0000 7f80d3a40700 1 --2- 172.21.15.125:0/3441828772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80cc0ad730 0x7f80cc0adb50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f80c400d1a0 tx=0x7f80c400ba50 comp rx=0 tx=0).stop 2023-10-06T03:06:55.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.226+0000 7f80d3a40700 1 -- 172.21.15.125:0/3441828772 shutdown_connections 2023-10-06T03:06:55.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.226+0000 7f80d3a40700 1 --2- 172.21.15.125:0/3441828772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80cc0ad730 0x7f80cc0adb50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.226+0000 7f80d3a40700 1 --2- 172.21.15.125:0/3441828772 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80cc0c7fd0 0x7f80cc156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.226+0000 7f80d3a40700 1 -- 172.21.15.125:0/3441828772 >> 172.21.15.125:0/3441828772 conn(0x7f80cc0cc5a0 msgr2=0x7f80cc0cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:55.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.226+0000 7f80d3a40700 1 -- 172.21.15.125:0/3441828772 shutdown_connections 2023-10-06T03:06:55.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.226+0000 7f80d3a40700 1 -- 172.21.15.125:0/3441828772 wait complete. 2023-10-06T03:06:55.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.228+0000 7f80d3a40700 1 Processor -- start 2023-10-06T03:06:55.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.228+0000 7f80d3a40700 1 -- start start 2023-10-06T03:06:55.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.229+0000 7f80d3a40700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80cc0ad730 0x7f80cc0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.229+0000 7f80d3a40700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80cc0c7fd0 0x7f80cc158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.229+0000 7f80d3a40700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80cc0c83a0 0x7f80cc0af350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.229+0000 7f80d3a40700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc158470 con 0x7f80cc0c7fd0 2023-10-06T03:06:55.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.229+0000 7f80d3a40700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc157580 con 0x7f80cc0ad730 2023-10-06T03:06:55.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.229+0000 7f80d3a40700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc157860 con 0x7f80cc0c83a0 2023-10-06T03:06:55.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.229+0000 7f80d0fdb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80cc0c7fd0 0x7f80cc158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.229+0000 7f80d0fdb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80cc0c7fd0 0x7f80cc158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:44344/0 (socket says 172.21.15.125:44344) 2023-10-06T03:06:55.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.229+0000 7f80d0fdb700 1 -- 172.21.15.125:0/4166933443 learned_addr learned my addr 172.21.15.125:0/4166933443 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:55.233 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.229+0000 7f80d17dc700 1 --2- 172.21.15.125:0/4166933443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80cc0ad730 0x7f80cc0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.229+0000 7f80d1fdd700 1 --2- 172.21.15.125:0/4166933443 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80cc0c83a0 0x7f80cc0af350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.229+0000 7f80d0fdb700 1 -- 172.21.15.125:0/4166933443 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80cc0c83a0 msgr2=0x7f80cc0af350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:55.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.229+0000 7f80d0fdb700 1 --2- 172.21.15.125:0/4166933443 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80cc0c83a0 0x7f80cc0af350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.229+0000 7f80d0fdb700 1 -- 172.21.15.125:0/4166933443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80cc0ad730 msgr2=0x7f80cc0b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:55.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.229+0000 7f80d0fdb700 1 --2- 172.21.15.125:0/4166933443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80cc0ad730 0x7f80cc0b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.229+0000 7f80d0fdb700 1 -- 172.21.15.125:0/4166933443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c400bcf0 con 0x7f80cc0c7fd0 2023-10-06T03:06:55.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.229+0000 7f80d0fdb700 1 --2- 172.21.15.125:0/4166933443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80cc0c7fd0 0x7f80cc158900 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f80c800c790 tx=0x7f80c8007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:55.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.230+0000 7f80bd7fa700 1 -- 172.21.15.125:0/4166933443 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c8005a70 con 0x7f80cc0c7fd0 2023-10-06T03:06:55.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.230+0000 7f80bd7fa700 1 -- 172.21.15.125:0/4166933443 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c8005bf0 con 0x7f80cc0c7fd0 2023-10-06T03:06:55.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.230+0000 7f80bd7fa700 1 -- 172.21.15.125:0/4166933443 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c80070d0 con 0x7f80cc0c7fd0 2023-10-06T03:06:55.234 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.230+0000 7f80d3a40700 1 -- 172.21.15.125:0/4166933443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80cc157b40 con 0x7f80cc0c7fd0 2023-10-06T03:06:55.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.230+0000 7f80d3a40700 1 -- 172.21.15.125:0/4166933443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80cc158100 con 0x7f80cc0c7fd0 2023-10-06T03:06:55.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.231+0000 7f80d3a40700 1 -- 172.21.15.125:0/4166933443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80cc1582c0 con 0x7f80cc0c7fd0 2023-10-06T03:06:55.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.231+0000 7f80bd7fa700 1 -- 172.21.15.125:0/4166933443 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80c8007480 con 0x7f80cc0c7fd0 2023-10-06T03:06:55.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.231+0000 7f80bd7fa700 1 --2- 172.21.15.125:0/4166933443 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f80b0066f30 0x7f80b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.231+0000 7f80bd7fa700 1 -- 172.21.15.125:0/4166933443 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f80c8083be0 con 0x7f80cc0c7fd0 2023-10-06T03:06:55.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.231+0000 7f80d17dc700 1 --2- 172.21.15.125:0/4166933443 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f80b0066f30 0x7f80b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.235 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.232+0000 7f80d17dc700 1 --2- 172.21.15.125:0/4166933443 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f80b0066f30 0x7f80b00693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0bfa90 tx=0x7f80c00091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:55.237 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.235+0000 7f80bd7fa700 1 -- 172.21.15.125:0/4166933443 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80c8050bb0 con 0x7f80cc0c7fd0 2023-10-06T03:06:55.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.461+0000 7f80d3a40700 1 -- 172.21.15.125:0/4166933443 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80cc066510 con 0x7f80cc0c7fd0 2023-10-06T03:06:55.462 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.461+0000 7f80bd7fa700 1 -- 172.21.15.125:0/4166933443 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4610 (secure 0 0 0) 0x7f80c8017020 con 0x7f80cc0c7fd0 2023-10-06T03:06:55.463 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:55.463 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":27,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/2151384589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2151384589},{"type":"v1","addr":"172.21.15.130:6834","nonce":2151384589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5299,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1214475159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1214475159},{"type":"v1","addr":"172.21.15.130:6835","nonce":1214475159}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/4005469649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":4005469649},{"type":"v1","addr":"172.21.15.125:6836","nonce":4005469649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T03:06:20.996155+0000","modified":"2023-10-06T03:06:24.636313+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5556":{"gid":5556,"name":"a","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.125:6837/1751632854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":1751632854},{"type":"v1","addr":"172.21.15.125:6837","nonce":1751632854}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T03:06:55.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.463+0000 7f80d3a40700 1 -- 172.21.15.125:0/4166933443 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f80b0066f30 msgr2=0x7f80b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:55.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.463+0000 7f80d3a40700 1 --2- 172.21.15.125:0/4166933443 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f80b0066f30 0x7f80b00693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0bfa90 tx=0x7f80c00091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.463+0000 7f80d3a40700 1 -- 172.21.15.125:0/4166933443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80cc0c7fd0 msgr2=0x7f80cc158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:55.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.463+0000 7f80d3a40700 1 --2- 172.21.15.125:0/4166933443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80cc0c7fd0 0x7f80cc158900 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f80c800c790 tx=0x7f80c8007f40 comp rx=0 tx=0).stop 2023-10-06T03:06:55.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.463+0000 7f80d3a40700 1 -- 172.21.15.125:0/4166933443 shutdown_connections 2023-10-06T03:06:55.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.463+0000 7f80d3a40700 1 --2- 172.21.15.125:0/4166933443 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f80b0066f30 0x7f80b00693e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.463+0000 7f80d3a40700 1 --2- 172.21.15.125:0/4166933443 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f80cc0c83a0 0x7f80cc0af350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.463+0000 7f80d3a40700 1 --2- 172.21.15.125:0/4166933443 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80cc0ad730 0x7f80cc0b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.463+0000 7f80d3a40700 1 --2- 172.21.15.125:0/4166933443 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f80cc0c7fd0 0x7f80cc158900 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.463+0000 7f80d3a40700 1 -- 172.21.15.125:0/4166933443 >> 172.21.15.125:0/4166933443 conn(0x7f80cc0cc5a0 msgr2=0x7f80cc0ca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:55.465 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.463+0000 7f80d3a40700 1 -- 172.21.15.125:0/4166933443 shutdown_connections 2023-10-06T03:06:55.466 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.463+0000 7f80d3a40700 1 -- 172.21.15.125:0/4166933443 wait complete. 2023-10-06T03:06:55.466 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 27 2023-10-06T03:06:55.476 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:06:55.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.592+0000 7f9564d6a700 1 Processor -- start 2023-10-06T03:06:55.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.592+0000 7f9564d6a700 1 -- start start 2023-10-06T03:06:55.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.593+0000 7f9564d6a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95600cc8f0 0x7f9560069300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.593+0000 7f9564d6a700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f95600caa40 0x7f9560067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.593+0000 7f9564d6a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9560067fb0 con 0x7f9560067b50 2023-10-06T03:06:55.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.593+0000 7f9564d6a700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95600caeb0 con 0x7f95600caa40 2023-10-06T03:06:55.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.593+0000 7f9564d6a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95600cccc0 con 0x7f95600cc8f0 2023-10-06T03:06:55.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.593+0000 7f955ed9d700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f9560067b50 0x7f9560159d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40446/0 (socket says 172.21.15.125:40446) 2023-10-06T03:06:55.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.593+0000 7f955ed9d700 1 -- 172.21.15.125:0/3757943391 learned_addr learned my addr 172.21.15.125:0/3757943391 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:55.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955e59c700 1 --2- 172.21.15.125:0/3757943391 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95600cc8f0 0x7f9560069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955d59a700 1 -- 172.21.15.125:0/3757943391 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37132799 0 0) 0x7f9558001490 con 0x7f9560067b50 2023-10-06T03:06:55.600 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955d59a700 1 -- 172.21.15.125:0/3757943391 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9548003570 con 0x7f9560067b50 2023-10-06T03:06:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955dd9b700 1 --2- 172.21.15.125:0/3757943391 >> v2:172.21.15.130:3300/0 conn(0x7f95600caa40 0x7f9560067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955d59a700 1 -- 172.21.15.125:0/3757943391 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 241491398 0 0) 0x7f9548003570 con 0x7f9560067b50 2023-10-06T03:06:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955d59a700 1 -- 172.21.15.125:0/3757943391 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95600cc8f0 msgr2=0x7f9560069300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955d59a700 1 --2- 172.21.15.125:0/3757943391 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95600cc8f0 0x7f9560069300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955d59a700 1 -- 172.21.15.125:0/3757943391 >> v2:172.21.15.130:3300/0 conn(0x7f95600caa40 msgr2=0x7f9560067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955d59a700 1 --2- 172.21.15.125:0/3757943391 >> v2:172.21.15.130:3300/0 conn(0x7f95600caa40 0x7f9560067610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955d59a700 1 -- 172.21.15.125:0/3757943391 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95601585c0 con 0x7f9560067b50 2023-10-06T03:06:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955d59a700 1 -- 172.21.15.125:0/3757943391 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f9558001980 con 0x7f9560067b50 2023-10-06T03:06:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955d59a700 1 -- 172.21.15.125:0/3757943391 >> v1:172.21.15.125:6789/0 conn(0x7f9560067b50 legacy=0x7f9560159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955d59a700 1 --2- 172.21.15.125:0/3757943391 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95600cc8f0 0x7f9548003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955d59a700 1 --2- 172.21.15.125:0/3757943391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9548003fe0 0x7f9548004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.601 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955d59a700 1 --2- 172.21.15.125:0/3757943391 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9548004d50 0x7f95480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955d59a700 1 -- 172.21.15.125:0/3757943391 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95600caeb0 con 0x7f9548004d50 2023-10-06T03:06:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955d59a700 1 -- 172.21.15.125:0/3757943391 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95600cccc0 con 0x7f9548003fe0 2023-10-06T03:06:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955d59a700 1 -- 172.21.15.125:0/3757943391 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f954800ba90 con 0x7f95600cc8f0 2023-10-06T03:06:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955ed9d700 1 --2- 172.21.15.125:0/3757943391 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9548004d50 0x7f95480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955dd9b700 1 --2- 172.21.15.125:0/3757943391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9548003fe0 0x7f9548004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955e59c700 1 --2- 172.21.15.125:0/3757943391 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95600cc8f0 0x7f9548003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955ed9d700 1 -- 172.21.15.125:0/3757943391 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95600cc8f0 msgr2=0x7f9548003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955ed9d700 1 --2- 172.21.15.125:0/3757943391 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95600cc8f0 0x7f9548003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955ed9d700 1 -- 172.21.15.125:0/3757943391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9548003fe0 msgr2=0x7f9548004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955ed9d700 1 --2- 172.21.15.125:0/3757943391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9548003fe0 0x7f9548004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.594+0000 7f955ed9d700 1 -- 172.21.15.125:0/3757943391 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9548003570 con 0x7f9548004d50 2023-10-06T03:06:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.595+0000 7f955ed9d700 1 --2- 172.21.15.125:0/3757943391 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9548004d50 0x7f95480051c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f955800ab00 tx=0x7f955800a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8858e0d8e69e13 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.595+0000 7f955d59a700 1 -- 172.21.15.125:0/3757943391 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955800a490 con 0x7f9548004d50 2023-10-06T03:06:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.595+0000 7f955d59a700 1 -- 172.21.15.125:0/3757943391 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955800c570 con 0x7f9548004d50 2023-10-06T03:06:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.595+0000 7f955d59a700 1 -- 172.21.15.125:0/3757943391 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955800c910 con 0x7f9548004d50 2023-10-06T03:06:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.595+0000 7f9564d6a700 1 -- 172.21.15.125:0/3757943391 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9548004d50 msgr2=0x7f95480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.595+0000 7f9564d6a700 1 --2- 172.21.15.125:0/3757943391 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9548004d50 0x7f95480051c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f955800ab00 tx=0x7f955800a1a0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.595+0000 7f955ed9d700 1 -- 172.21.15.125:0/3757943391 reap_dead start 2023-10-06T03:06:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.595+0000 7f9564d6a700 1 -- 172.21.15.125:0/3757943391 shutdown_connections 2023-10-06T03:06:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.595+0000 7f9564d6a700 1 -- 172.21.15.125:0/3757943391 >> 172.21.15.125:0/3757943391 conn(0x7f9560068f00 msgr2=0x7f95600cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.595+0000 7f9564d6a700 1 -- 172.21.15.125:0/3757943391 shutdown_connections 2023-10-06T03:06:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.595+0000 7f9564d6a700 1 -- 172.21.15.125:0/3757943391 wait complete. 2023-10-06T03:06:55.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.596+0000 7f9564d6a700 1 Processor -- start 2023-10-06T03:06:55.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.596+0000 7f9564d6a700 1 -- start start 2023-10-06T03:06:55.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.597+0000 7f9564d6a700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9548004d50 0x7f9560153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.597+0000 7f9564d6a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95600aeba0 0x7f95600ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.597+0000 7f9564d6a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95601555c0 0x7f9560155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.597+0000 7f9564d6a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95600aca00 con 0x7f95601555c0 2023-10-06T03:06:55.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.597+0000 7f9564d6a700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9560155f70 con 0x7f9548004d50 2023-10-06T03:06:55.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.597+0000 7f9564d6a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95600af010 con 0x7f95600aeba0 2023-10-06T03:06:55.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.597+0000 7f955ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95601555c0 0x7f9560155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.597+0000 7f955ed9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95601555c0 0x7f9560155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34922/0 (socket says 172.21.15.125:34922) 2023-10-06T03:06:55.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.597+0000 7f955ed9d700 1 -- 172.21.15.125:0/887277753 learned_addr learned my addr 172.21.15.125:0/887277753 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:55.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.597+0000 7f955dd9b700 1 --2- 172.21.15.125:0/887277753 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95600aeba0 0x7f95600ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.597+0000 7f955e59c700 1 --2- 172.21.15.125:0/887277753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9548004d50 0x7f9560153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.598+0000 7f955ed9d700 1 -- 172.21.15.125:0/887277753 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95600aeba0 msgr2=0x7f95600ac4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:55.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.598+0000 7f955ed9d700 1 --2- 172.21.15.125:0/887277753 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95600aeba0 0x7f95600ac4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.598+0000 7f955ed9d700 1 -- 172.21.15.125:0/887277753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9548004d50 msgr2=0x7f9560153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:55.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.598+0000 7f955ed9d700 1 --2- 172.21.15.125:0/887277753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9548004d50 0x7f9560153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.598+0000 7f955ed9d700 1 -- 172.21.15.125:0/887277753 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95600acc30 con 0x7f95601555c0 2023-10-06T03:06:55.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.598+0000 7f955ed9d700 1 --2- 172.21.15.125:0/887277753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95601555c0 0x7f9560155a30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9558000f80 tx=0x7f9558016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:55.607 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.598+0000 7f954e7fc700 1 -- 172.21.15.125:0/887277753 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9558001a10 con 0x7f95601555c0 2023-10-06T03:06:55.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.598+0000 7f954e7fc700 1 -- 172.21.15.125:0/887277753 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955801e640 con 0x7f95601555c0 2023-10-06T03:06:55.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.598+0000 7f9564d6a700 1 -- 172.21.15.125:0/887277753 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95600acf10 con 0x7f95601555c0 2023-10-06T03:06:55.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.598+0000 7f954e7fc700 1 -- 172.21.15.125:0/887277753 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955801ea40 con 0x7f95601555c0 2023-10-06T03:06:55.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.598+0000 7f9564d6a700 1 -- 172.21.15.125:0/887277753 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95600ad4d0 con 0x7f95601555c0 2023-10-06T03:06:55.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.599+0000 7f9564d6a700 1 -- 172.21.15.125:0/887277753 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9560066510 con 0x7f95601555c0 2023-10-06T03:06:55.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.599+0000 7f954e7fc700 1 -- 172.21.15.125:0/887277753 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9558024070 con 0x7f95601555c0 2023-10-06T03:06:55.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.600+0000 7f954e7fc700 1 --2- 172.21.15.125:0/887277753 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9540066f30 0x7f95400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.600+0000 7f954e7fc700 1 -- 172.21.15.125:0/887277753 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f9558086c10 con 0x7f95601555c0 2023-10-06T03:06:55.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.600+0000 7f955e59c700 1 --2- 172.21.15.125:0/887277753 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9540066f30 0x7f95400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.600+0000 7f955e59c700 1 --2- 172.21.15.125:0/887277753 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9540066f30 0x7f95400693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9554006e70 tx=0x7f9554008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:55.608 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.604+0000 7f954e7fc700 1 -- 172.21.15.125:0/887277753 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9558053b40 con 0x7f95601555c0 2023-10-06T03:06:55.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.785+0000 7f9564d6a700 1 -- 172.21.15.125:0/887277753 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9560067fb0 con 0x7f95601555c0 2023-10-06T03:06:55.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.786+0000 7f954e7fc700 1 -- 172.21.15.125:0/887277753 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+17217 (secure 0 0 0) 0x7f9560067fb0 con 0x7f95601555c0 2023-10-06T03:06:55.787 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:06:55.787 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":57,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:06:22.618226+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T03:06:18.650188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T03:06:19.963528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:06:55.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.788+0000 7f9564d6a700 1 -- 172.21.15.125:0/887277753 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9540066f30 msgr2=0x7f95400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:55.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.788+0000 7f9564d6a700 1 --2- 172.21.15.125:0/887277753 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9540066f30 0x7f95400693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9554006e70 tx=0x7f9554008040 comp rx=0 tx=0).stop 2023-10-06T03:06:55.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.788+0000 7f9564d6a700 1 -- 172.21.15.125:0/887277753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95601555c0 msgr2=0x7f9560155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:55.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.788+0000 7f9564d6a700 1 --2- 172.21.15.125:0/887277753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95601555c0 0x7f9560155a30 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9558000f80 tx=0x7f9558016000 comp rx=0 tx=0).stop 2023-10-06T03:06:55.789 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.788+0000 7f9564d6a700 1 -- 172.21.15.125:0/887277753 shutdown_connections 2023-10-06T03:06:55.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.788+0000 7f9564d6a700 1 --2- 172.21.15.125:0/887277753 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9540066f30 0x7f95400693e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.788+0000 7f9564d6a700 1 --2- 172.21.15.125:0/887277753 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f95601555c0 0x7f9560155a30 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.788+0000 7f9564d6a700 1 --2- 172.21.15.125:0/887277753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9548004d50 0x7f9560153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.788+0000 7f9564d6a700 1 --2- 172.21.15.125:0/887277753 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f95600aeba0 0x7f95600ac4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.788+0000 7f9564d6a700 1 -- 172.21.15.125:0/887277753 >> 172.21.15.125:0/887277753 conn(0x7f9560068f00 msgr2=0x7f9560156750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:55.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.788+0000 7f9564d6a700 1 -- 172.21.15.125:0/887277753 shutdown_connections 2023-10-06T03:06:55.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.788+0000 7f9564d6a700 1 -- 172.21.15.125:0/887277753 wait complete. 2023-10-06T03:06:55.801 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T03:06:55.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.919+0000 7f589e7ea700 1 Processor -- start 2023-10-06T03:06:55.920 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.919+0000 7f589e7ea700 1 -- start start 2023-10-06T03:06:55.922 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.919+0000 7f589e7ea700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f58981571b0 0x7f58980cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.919+0000 7f589e7ea700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58980cd790 0x7f58980ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.920+0000 7f589e7ea700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58980cd300 con 0x7f5898156de0 2023-10-06T03:06:55.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.920+0000 7f589e7ea700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58980cc6f0 con 0x7f58981571b0 2023-10-06T03:06:55.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.920+0000 7f589e7ea700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58980cc9d0 con 0x7f58980cd790 2023-10-06T03:06:55.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.920+0000 7f58977fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f58981571b0 0x7f58980cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.920+0000 7f58977fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f58981571b0 0x7f58980cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34930/0 (socket says 172.21.15.125:34930) 2023-10-06T03:06:55.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.920+0000 7f58977fe700 1 -- 172.21.15.125:0/2681090784 learned_addr learned my addr 172.21.15.125:0/2681090784 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:55.923 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.920+0000 7f589cd87700 1 --2- 172.21.15.125:0/2681090784 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58980cd790 0x7f58980ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.920+0000 7f58977fe700 1 -- 172.21.15.125:0/2681090784 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58980cd790 msgr2=0x7f58980ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:55.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.920+0000 7f58977fe700 1 --2- 172.21.15.125:0/2681090784 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58980cd790 0x7f58980ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.920+0000 7f58977fe700 1 -- 172.21.15.125:0/2681090784 >> v1:172.21.15.130:6789/0 conn(0x7f5898156de0 legacy=0x7f589815b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:55.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.920+0000 7f58977fe700 1 -- 172.21.15.125:0/2681090784 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58980cccb0 con 0x7f58981571b0 2023-10-06T03:06:55.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.920+0000 7f589cd87700 1 --2- 172.21.15.125:0/2681090784 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58980cd790 0x7f58980ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:55.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.920+0000 7f58977fe700 1 --2- 172.21.15.125:0/2681090784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58981571b0 0x7f58980cc060 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f588c0099b0 tx=0x7f588c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d702e3a4a1566816 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:55.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.920+0000 7f5896ffd700 1 -- 172.21.15.125:0/2681090784 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c00b860 con 0x7f58981571b0 2023-10-06T03:06:55.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.920+0000 7f5896ffd700 1 -- 172.21.15.125:0/2681090784 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c00b9c0 con 0x7f58981571b0 2023-10-06T03:06:55.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.920+0000 7f5896ffd700 1 -- 172.21.15.125:0/2681090784 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c00bd60 con 0x7f58981571b0 2023-10-06T03:06:55.924 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.921+0000 7f589e7ea700 1 -- 172.21.15.125:0/2681090784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58981571b0 msgr2=0x7f58980cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:55.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.921+0000 7f589e7ea700 1 --2- 172.21.15.125:0/2681090784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58981571b0 0x7f58980cc060 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f588c0099b0 tx=0x7f588c009250 comp rx=0 tx=0).stop 2023-10-06T03:06:55.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.921+0000 7f589e7ea700 1 -- 172.21.15.125:0/2681090784 shutdown_connections 2023-10-06T03:06:55.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.921+0000 7f589e7ea700 1 --2- 172.21.15.125:0/2681090784 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58980cd790 0x7f58980ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.921+0000 7f589e7ea700 1 --2- 172.21.15.125:0/2681090784 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f58981571b0 0x7f58980cc060 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.921+0000 7f589e7ea700 1 -- 172.21.15.125:0/2681090784 >> 172.21.15.125:0/2681090784 conn(0x7f58980cdf80 msgr2=0x7f58980ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:55.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.921+0000 7f589e7ea700 1 -- 172.21.15.125:0/2681090784 shutdown_connections 2023-10-06T03:06:55.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.921+0000 7f589e7ea700 1 -- 172.21.15.125:0/2681090784 wait complete. 2023-10-06T03:06:55.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.922+0000 7f589e7ea700 1 Processor -- start 2023-10-06T03:06:55.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.922+0000 7f589e7ea700 1 -- start start 2023-10-06T03:06:55.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f589e7ea700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58980cd790 0x7f5898155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f589e7ea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5898156de0 0x7f58980aea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f589e7ea700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58981571b0 0x7f58980aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f589e7ea700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589814f2a0 con 0x7f5898156de0 2023-10-06T03:06:55.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f589e7ea700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58980c5950 con 0x7f58980cd790 2023-10-06T03:06:55.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f589e7ea700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58980c5f10 con 0x7f58981571b0 2023-10-06T03:06:55.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f58977fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5898156de0 0x7f58980aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f58977fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5898156de0 0x7f58980aea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34944/0 (socket says 172.21.15.125:34944) 2023-10-06T03:06:55.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f58977fe700 1 -- 172.21.15.125:0/359152892 learned_addr learned my addr 172.21.15.125:0/359152892 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:55.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f5897fff700 1 --2- 172.21.15.125:0/359152892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58980cd790 0x7f5898155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f589cd87700 1 --2- 172.21.15.125:0/359152892 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58981571b0 0x7f58980aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f58977fe700 1 -- 172.21.15.125:0/359152892 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58981571b0 msgr2=0x7f58980aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:55.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f58977fe700 1 --2- 172.21.15.125:0/359152892 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58981571b0 0x7f58980aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f58977fe700 1 -- 172.21.15.125:0/359152892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58980cd790 msgr2=0x7f5898155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:55.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f58977fe700 1 --2- 172.21.15.125:0/359152892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58980cd790 0x7f5898155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:55.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f58977fe700 1 -- 172.21.15.125:0/359152892 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c0094f0 con 0x7f5898156de0 2023-10-06T03:06:55.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f5897fff700 1 --2- 172.21.15.125:0/359152892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58980cd790 0x7f5898155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:55.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f58977fe700 1 --2- 172.21.15.125:0/359152892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5898156de0 0x7f58980aea60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f588c0090b0 tx=0x7f588c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:55.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f587ffff700 1 -- 172.21.15.125:0/359152892 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c026480 con 0x7f5898156de0 2023-10-06T03:06:55.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.923+0000 7f587ffff700 1 -- 172.21.15.125:0/359152892 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c01f070 con 0x7f5898156de0 2023-10-06T03:06:55.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.924+0000 7f587ffff700 1 -- 172.21.15.125:0/359152892 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c026830 con 0x7f5898156de0 2023-10-06T03:06:55.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.924+0000 7f589e7ea700 1 -- 172.21.15.125:0/359152892 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58980af640 con 0x7f5898156de0 2023-10-06T03:06:55.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.924+0000 7f589e7ea700 1 -- 172.21.15.125:0/359152892 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58980c5ba0 con 0x7f5898156de0 2023-10-06T03:06:55.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.925+0000 7f589e7ea700 1 -- 172.21.15.125:0/359152892 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58980c60a0 con 0x7f5898156de0 2023-10-06T03:06:55.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.925+0000 7f587ffff700 1 -- 172.21.15.125:0/359152892 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f588c026ba0 con 0x7f5898156de0 2023-10-06T03:06:55.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.925+0000 7f587ffff700 1 --2- 172.21.15.125:0/359152892 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5884066f60 0x7f5884069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:55.930 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.925+0000 7f587ffff700 1 -- 172.21.15.125:0/359152892 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6378+0+0 (secure 0 0 0) 0x7f588c021070 con 0x7f5898156de0 2023-10-06T03:06:55.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.925+0000 7f5897fff700 1 --2- 172.21.15.125:0/359152892 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5884066f60 0x7f5884069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:55.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.926+0000 7f5897fff700 1 --2- 172.21.15.125:0/359152892 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5884066f60 0x7f5884069410 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5888007fd0 tx=0x7f5888009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:55.931 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:55.930+0000 7f587ffff700 1 -- 172.21.15.125:0/359152892 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f588c0535a0 con 0x7f5898156de0 2023-10-06T03:06:56.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.152+0000 7f589e7ea700 1 -- 172.21.15.125:0/359152892 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f58980afbc0 con 0x7f5898156de0 2023-10-06T03:06:56.154 INFO:tasks.ceph.mon.a.smithi125.stderr:2023-10-06T03:06:56.153+0000 7f8a89245700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T03:06:56.158 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.157+0000 7f587ffff700 1 -- 172.21.15.125:0/359152892 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) v1 ==== 161+0+0 (secure 0 0 0) 0x7f588c056bc0 con 0x7f5898156de0 2023-10-06T03:06:56.159 INFO:tasks.ceph.mds.a.smithi125.stderr: -2466> 2023-10-06T03:06:25.910+0000 7f208dd7a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T03:06:56.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.159+0000 7f589e7ea700 1 -- 172.21.15.125:0/359152892 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5884066f60 msgr2=0x7f5884069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:56.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.159+0000 7f589e7ea700 1 --2- 172.21.15.125:0/359152892 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5884066f60 0x7f5884069410 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5888007fd0 tx=0x7f5888009040 comp rx=0 tx=0).stop 2023-10-06T03:06:56.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.159+0000 7f589e7ea700 1 -- 172.21.15.125:0/359152892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5898156de0 msgr2=0x7f58980aea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:56.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.159+0000 7f589e7ea700 1 --2- 172.21.15.125:0/359152892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5898156de0 0x7f58980aea60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f588c0090b0 tx=0x7f588c017000 comp rx=0 tx=0).stop 2023-10-06T03:06:56.161 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.159+0000 7f589e7ea700 1 -- 172.21.15.125:0/359152892 shutdown_connections 2023-10-06T03:06:56.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.159+0000 7f589e7ea700 1 --2- 172.21.15.125:0/359152892 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5884066f60 0x7f5884069410 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:56.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.159+0000 7f589e7ea700 1 --2- 172.21.15.125:0/359152892 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f58981571b0 0x7f58980aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:56.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.159+0000 7f589e7ea700 1 --2- 172.21.15.125:0/359152892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f58980cd790 0x7f5898155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:56.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.159+0000 7f589e7ea700 1 --2- 172.21.15.125:0/359152892 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f5898156de0 0x7f58980aea60 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:56.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.159+0000 7f589e7ea700 1 -- 172.21.15.125:0/359152892 >> 172.21.15.125:0/359152892 conn(0x7f58980cdf80 msgr2=0x7f58980c8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:56.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.159+0000 7f589e7ea700 1 -- 172.21.15.125:0/359152892 shutdown_connections 2023-10-06T03:06:56.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.159+0000 7f589e7ea700 1 -- 172.21.15.125:0/359152892 wait complete. 2023-10-06T03:06:56.162 INFO:teuthology.orchestra.run.smithi125.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T03:06:56.173 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T03:06:56.183 INFO:tasks.ceph.mds.a.smithi125.stdout:starting mds.a at 2023-10-06T03:06:56.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.292+0000 7fd0fa765700 1 Processor -- start 2023-10-06T03:06:56.293 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.292+0000 7fd0fa765700 1 -- start start 2023-10-06T03:06:56.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.293+0000 7fd0fa765700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0f41558e0 0x7fd0f40cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:56.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.293+0000 7fd0fa765700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd0f40ca440 0x7fd0f40ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:56.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.293+0000 7fd0fa765700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f40c1d50 con 0x7fd0f4155cb0 2023-10-06T03:06:56.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.293+0000 7fd0fa765700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f40ca1b0 con 0x7fd0f40ca440 2023-10-06T03:06:56.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.293+0000 7fd0fa765700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f40c1740 con 0x7fd0f41558e0 2023-10-06T03:06:56.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.293+0000 7fd0f37fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd0f4155cb0 0x7fd0f41595e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40448/0 (socket says 172.21.15.125:40448) 2023-10-06T03:06:56.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.293+0000 7fd0f37fe700 1 -- 172.21.15.125:0/2571162408 learned_addr learned my addr 172.21.15.125:0/2571162408 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:56.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.293+0000 7fd0f3fff700 1 --2- 172.21.15.125:0/2571162408 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0f41558e0 0x7fd0f40cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:56.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.293+0000 7fd0f8d02700 1 --2- 172.21.15.125:0/2571162408 >> v2:172.21.15.130:3300/0 conn(0x7fd0f40ca440 0x7fd0f40ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:56.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.293+0000 7fd0f2ffd700 1 -- 172.21.15.125:0/2571162408 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999026803 0 0) 0x7fd0f40c1d50 con 0x7fd0f4155cb0 2023-10-06T03:06:56.297 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.293+0000 7fd0f2ffd700 1 -- 172.21.15.125:0/2571162408 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0dc003570 con 0x7fd0f4155cb0 2023-10-06T03:06:56.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.294+0000 7fd0f2ffd700 1 -- 172.21.15.125:0/2571162408 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2658465137 0 0) 0x7fd0dc003570 con 0x7fd0f4155cb0 2023-10-06T03:06:56.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.294+0000 7fd0f3fff700 1 -- 172.21.15.125:0/2571162408 >> v2:172.21.15.130:3300/0 conn(0x7fd0f40ca440 msgr2=0x7fd0f40ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:56.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.294+0000 7fd0f3fff700 1 --2- 172.21.15.125:0/2571162408 >> v2:172.21.15.130:3300/0 conn(0x7fd0f40ca440 0x7fd0f40ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:56.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.294+0000 7fd0f3fff700 1 -- 172.21.15.125:0/2571162408 >> v1:172.21.15.125:6789/0 conn(0x7fd0f4155cb0 legacy=0x7fd0f41595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:56.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.294+0000 7fd0f3fff700 1 -- 172.21.15.125:0/2571162408 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f40c9ed0 con 0x7fd0f41558e0 2023-10-06T03:06:56.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.294+0000 7fd0f8d02700 1 --2- 172.21.15.125:0/2571162408 >> v2:172.21.15.130:3300/0 conn(0x7fd0f40ca440 0x7fd0f40ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:06:56.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.294+0000 7fd0f3fff700 1 --2- 172.21.15.125:0/2571162408 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0f41558e0 0x7fd0f40cc870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40098d0 tx=0x7fd0e4009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65d8c76bdeb75849 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:56.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.294+0000 7fd0f2ffd700 1 -- 172.21.15.125:0/2571162408 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8001470 con 0x7fd0f41558e0 2023-10-06T03:06:56.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.294+0000 7fd0f2ffd700 1 -- 172.21.15.125:0/2571162408 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e4011420 con 0x7fd0f41558e0 2023-10-06T03:06:56.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.294+0000 7fd0f2ffd700 1 -- 172.21.15.125:0/2571162408 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e40117a0 con 0x7fd0f41558e0 2023-10-06T03:06:56.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.295+0000 7fd0fa765700 1 -- 172.21.15.125:0/2571162408 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0f41558e0 msgr2=0x7fd0f40cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:56.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.295+0000 7fd0fa765700 1 --2- 172.21.15.125:0/2571162408 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0f41558e0 0x7fd0f40cc870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40098d0 tx=0x7fd0e4009120 comp rx=0 tx=0).stop 2023-10-06T03:06:56.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.295+0000 7fd0fa765700 1 -- 172.21.15.125:0/2571162408 shutdown_connections 2023-10-06T03:06:56.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.295+0000 7fd0fa765700 1 --2- 172.21.15.125:0/2571162408 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0f41558e0 0x7fd0f40cc870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:56.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.295+0000 7fd0fa765700 1 --2- 172.21.15.125:0/2571162408 >> v2:172.21.15.130:3300/0 conn(0x7fd0f40ca440 0x7fd0f40ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:56.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.295+0000 7fd0fa765700 1 -- 172.21.15.125:0/2571162408 >> 172.21.15.125:0/2571162408 conn(0x7fd0f40af730 msgr2=0x7fd0f40afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:56.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.295+0000 7fd0fa765700 1 -- 172.21.15.125:0/2571162408 shutdown_connections 2023-10-06T03:06:56.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.295+0000 7fd0fa765700 1 -- 172.21.15.125:0/2571162408 wait complete. 2023-10-06T03:06:56.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.296+0000 7fd0fa765700 1 Processor -- start 2023-10-06T03:06:56.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.296+0000 7fd0fa765700 1 -- start start 2023-10-06T03:06:56.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0fa765700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0f40ca440 0x7fd0f40981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:56.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0fa765700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0f41558e0 0x7fd0f414f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:56.302 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0fa765700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0f4096450 0x7fd0f40968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:56.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0fa765700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f4165040 con 0x7fd0f40ca440 2023-10-06T03:06:56.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0fa765700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f4098800 con 0x7fd0f41558e0 2023-10-06T03:06:56.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0fa765700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f4098ae0 con 0x7fd0f4096450 2023-10-06T03:06:56.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0f3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0f40ca440 0x7fd0f40981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:56.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0f3fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0f40ca440 0x7fd0f40981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34966/0 (socket says 172.21.15.125:34966) 2023-10-06T03:06:56.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0f3fff700 1 -- 172.21.15.125:0/2483659891 learned_addr learned my addr 172.21.15.125:0/2483659891 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:56.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0f37fe700 1 --2- 172.21.15.125:0/2483659891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0f41558e0 0x7fd0f414f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:56.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0f8d02700 1 --2- 172.21.15.125:0/2483659891 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0f4096450 0x7fd0f40968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:56.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0f3fff700 1 -- 172.21.15.125:0/2483659891 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0f4096450 msgr2=0x7fd0f40968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:56.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0f3fff700 1 --2- 172.21.15.125:0/2483659891 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0f4096450 0x7fd0f40968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:56.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0f3fff700 1 -- 172.21.15.125:0/2483659891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0f41558e0 msgr2=0x7fd0f414f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:56.303 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0f3fff700 1 --2- 172.21.15.125:0/2483659891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0f41558e0 0x7fd0f414f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:56.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0f3fff700 1 -- 172.21.15.125:0/2483659891 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec00a940 con 0x7fd0f40ca440 2023-10-06T03:06:56.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0f3fff700 1 --2- 172.21.15.125:0/2483659891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0f40ca440 0x7fd0f40981f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40c1880 tx=0x7fd0e4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:56.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0dbfff700 1 -- 172.21.15.125:0/2483659891 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4021070 con 0x7fd0f40ca440 2023-10-06T03:06:56.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0dbfff700 1 -- 172.21.15.125:0/2483659891 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e401ce40 con 0x7fd0f40ca440 2023-10-06T03:06:56.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0fa765700 1 -- 172.21.15.125:0/2483659891 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e40093c0 con 0x7fd0f40ca440 2023-10-06T03:06:56.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0dbfff700 1 -- 172.21.15.125:0/2483659891 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e401c280 con 0x7fd0f40ca440 2023-10-06T03:06:56.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.297+0000 7fd0fa765700 1 -- 172.21.15.125:0/2483659891 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f4152950 con 0x7fd0f40ca440 2023-10-06T03:06:56.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.298+0000 7fd0fa765700 1 -- 172.21.15.125:0/2483659891 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f40cd380 con 0x7fd0f40ca440 2023-10-06T03:06:56.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.299+0000 7fd0dbfff700 1 -- 172.21.15.125:0/2483659891 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd0e401a770 con 0x7fd0f40ca440 2023-10-06T03:06:56.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.299+0000 7fd0dbfff700 1 --2- 172.21.15.125:0/2483659891 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd0e0066f30 0x7fd0e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:56.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.299+0000 7fd0dbfff700 1 -- 172.21.15.125:0/2483659891 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fd0e4087590 con 0x7fd0f40ca440 2023-10-06T03:06:56.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.299+0000 7fd0f37fe700 1 --2- 172.21.15.125:0/2483659891 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd0e0066f30 0x7fd0e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:56.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.300+0000 7fd0f37fe700 1 --2- 172.21.15.125:0/2483659891 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd0e0066f30 0x7fd0e00693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4098730 tx=0x7fd0e8001680 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:56.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.304+0000 7fd0dbfff700 1 -- 172.21.15.125:0/2483659891 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0e4054510 con 0x7fd0f40ca440 2023-10-06T03:06:56.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:56.530+0000 7fd0fa765700 1 -- 172.21.15.125:0/2483659891 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd0f4152b40 con 0x7fd0f40ca440 2023-10-06T03:06:57.159 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.157+0000 7fd0dbfff700 1 -- 172.21.15.125:0/2483659891 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd0e401c3e0 con 0x7fd0f40ca440 2023-10-06T03:06:57.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.160+0000 7fd0fa765700 1 -- 172.21.15.125:0/2483659891 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd0e0066f30 msgr2=0x7fd0e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:57.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.160+0000 7fd0fa765700 1 --2- 172.21.15.125:0/2483659891 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd0e0066f30 0x7fd0e00693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4098730 tx=0x7fd0e8001680 comp rx=0 tx=0).stop 2023-10-06T03:06:57.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.160+0000 7fd0fa765700 1 -- 172.21.15.125:0/2483659891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0f40ca440 msgr2=0x7fd0f40981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:57.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.160+0000 7fd0fa765700 1 --2- 172.21.15.125:0/2483659891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0f40ca440 0x7fd0f40981f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40c1880 tx=0x7fd0e4016000 comp rx=0 tx=0).stop 2023-10-06T03:06:57.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.160+0000 7fd0fa765700 1 -- 172.21.15.125:0/2483659891 shutdown_connections 2023-10-06T03:06:57.162 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.160+0000 7fd0fa765700 1 --2- 172.21.15.125:0/2483659891 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd0e0066f30 0x7fd0e00693e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:57.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.160+0000 7fd0fa765700 1 --2- 172.21.15.125:0/2483659891 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd0f4096450 0x7fd0f40968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:57.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.160+0000 7fd0fa765700 1 --2- 172.21.15.125:0/2483659891 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd0f40ca440 0x7fd0f40981f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:57.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.160+0000 7fd0fa765700 1 --2- 172.21.15.125:0/2483659891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd0f41558e0 0x7fd0f414f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:57.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.161+0000 7fd0fa765700 1 -- 172.21.15.125:0/2483659891 >> 172.21.15.125:0/2483659891 conn(0x7fd0f40af730 msgr2=0x7fd0f406ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:57.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.161+0000 7fd0fa765700 1 -- 172.21.15.125:0/2483659891 shutdown_connections 2023-10-06T03:06:57.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.161+0000 7fd0fa765700 1 -- 172.21.15.125:0/2483659891 wait complete. 2023-10-06T03:06:57.176 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T03:06:57.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.343+0000 7fdfdc6a6700 1 Processor -- start 2023-10-06T03:06:57.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.343+0000 7fdfdc6a6700 1 -- start start 2023-10-06T03:06:57.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.344+0000 7fdfdc6a6700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfd406e120 0x7fdfd4157d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:57.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.344+0000 7fdfdc6a6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd40cbb90 con 0x7fdfd40ad080 2023-10-06T03:06:57.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.344+0000 7fdfdc6a6700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd4158420 con 0x7fdfd40ad450 2023-10-06T03:06:57.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.344+0000 7fdfdc6a6700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40cbde0 con 0x7fdfd406e120 2023-10-06T03:06:57.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfda442700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fdfd40ad080 0x7fdfd406da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40458/0 (socket says 172.21.15.125:40458) 2023-10-06T03:06:57.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfda442700 1 -- 172.21.15.125:0/1242769360 learned_addr learned my addr 172.21.15.125:0/1242769360 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:57.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfd9440700 1 -- 172.21.15.125:0/1242769360 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819663797 0 0) 0x7fdfd40cbb90 con 0x7fdfd40ad080 2023-10-06T03:06:57.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfd9440700 1 -- 172.21.15.125:0/1242769360 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfc0003570 con 0x7fdfd40ad080 2023-10-06T03:06:57.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfdac43700 1 --2- 172.21.15.125:0/1242769360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfd406e120 0x7fdfd4157d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:57.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfd9440700 1 -- 172.21.15.125:0/1242769360 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 629678079 0 0) 0x7fdfc0003570 con 0x7fdfd40ad080 2023-10-06T03:06:57.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfd9440700 1 -- 172.21.15.125:0/1242769360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfd406e120 msgr2=0x7fdfd4157d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:57.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfd9440700 1 --2- 172.21.15.125:0/1242769360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfd406e120 0x7fdfd4157d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:57.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfd9440700 1 -- 172.21.15.125:0/1242769360 >> v1:172.21.15.130:6789/0 conn(0x7fdfd40ad450 legacy=0x7fdfd4157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:57.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfd9440700 1 -- 172.21.15.125:0/1242769360 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd40cc0c0 con 0x7fdfd40ad080 2023-10-06T03:06:57.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfd9440700 1 -- 172.21.15.125:0/1242769360 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7fdfc4001470 con 0x7fdfd40ad080 2023-10-06T03:06:57.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfd9440700 1 -- 172.21.15.125:0/1242769360 >> v1:172.21.15.125:6789/0 conn(0x7fdfd40ad080 legacy=0x7fdfd406da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:57.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfd9440700 1 --2- 172.21.15.125:0/1242769360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfc0003a90 0x7fdfc0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:57.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfd9440700 1 --2- 172.21.15.125:0/1242769360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfd406e120 0x7fdfc0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:57.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfd9440700 1 --2- 172.21.15.125:0/1242769360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfc0004d50 0x7fdfc00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:57.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfd9440700 1 -- 172.21.15.125:0/1242769360 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40cbde0 con 0x7fdfc0004d50 2023-10-06T03:06:57.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfd9440700 1 -- 172.21.15.125:0/1242769360 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc000bb70 con 0x7fdfc0003a90 2023-10-06T03:06:57.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfd9440700 1 -- 172.21.15.125:0/1242769360 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc000bd30 con 0x7fdfd406e120 2023-10-06T03:06:57.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfdac43700 1 --2- 172.21.15.125:0/1242769360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfc0004d50 0x7fdfc00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:57.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfda442700 1 --2- 172.21.15.125:0/1242769360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfc0003a90 0x7fdfc0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:57.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.345+0000 7fdfd9c41700 1 --2- 172.21.15.125:0/1242769360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfd406e120 0x7fdfc0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:57.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.346+0000 7fdfdac43700 1 -- 172.21.15.125:0/1242769360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfd406e120 msgr2=0x7fdfc0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:57.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.346+0000 7fdfdac43700 1 --2- 172.21.15.125:0/1242769360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfd406e120 0x7fdfc0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:57.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.346+0000 7fdfdac43700 1 -- 172.21.15.125:0/1242769360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfc0003a90 msgr2=0x7fdfc0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:57.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.346+0000 7fdfdac43700 1 --2- 172.21.15.125:0/1242769360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfc0003a90 0x7fdfc0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:57.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.346+0000 7fdfdac43700 1 -- 172.21.15.125:0/1242769360 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc0003570 con 0x7fdfc0004d50 2023-10-06T03:06:57.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.346+0000 7fdfd9c41700 1 --2- 172.21.15.125:0/1242769360 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfd406e120 0x7fdfc0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:57.351 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.346+0000 7fdfdac43700 1 --2- 172.21.15.125:0/1242769360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfc0004d50 0x7fdfc00051c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00e210 tx=0x7fdfcc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b321bcde0c7ef3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:57.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.346+0000 7fdfd9440700 1 -- 172.21.15.125:0/1242769360 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc00eac0 con 0x7fdfc0004d50 2023-10-06T03:06:57.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.346+0000 7fdfd9440700 1 -- 172.21.15.125:0/1242769360 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfcc00f040 con 0x7fdfc0004d50 2023-10-06T03:06:57.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.346+0000 7fdfd9440700 1 -- 172.21.15.125:0/1242769360 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfcc00ee70 con 0x7fdfc0004d50 2023-10-06T03:06:57.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.346+0000 7fdfdc6a6700 1 -- 172.21.15.125:0/1242769360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfc0004d50 msgr2=0x7fdfc00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:57.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.346+0000 7fdfdc6a6700 1 --2- 172.21.15.125:0/1242769360 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfc0004d50 0x7fdfc00051c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc00e210 tx=0x7fdfcc00b040 comp rx=0 tx=0).stop 2023-10-06T03:06:57.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.346+0000 7fdfdac43700 1 -- 172.21.15.125:0/1242769360 reap_dead start 2023-10-06T03:06:57.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.346+0000 7fdfdc6a6700 1 -- 172.21.15.125:0/1242769360 shutdown_connections 2023-10-06T03:06:57.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.346+0000 7fdfdc6a6700 1 -- 172.21.15.125:0/1242769360 >> 172.21.15.125:0/1242769360 conn(0x7fdfd40cea90 msgr2=0x7fdfd406c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:57.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.347+0000 7fdfdc6a6700 1 -- 172.21.15.125:0/1242769360 shutdown_connections 2023-10-06T03:06:57.352 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.347+0000 7fdfdc6a6700 1 -- 172.21.15.125:0/1242769360 wait complete. 2023-10-06T03:06:57.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.348+0000 7fdfdc6a6700 1 Processor -- start 2023-10-06T03:06:57.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.348+0000 7fdfdc6a6700 1 -- start start 2023-10-06T03:06:57.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.348+0000 7fdfdc6a6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfc0004d50 0x7fdfd41536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:57.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.348+0000 7fdfdc6a6700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfd415b4d0 0x7fdfd415b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:57.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.348+0000 7fdfdc6a6700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfd40b29c0 0x7fdfd40b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:57.355 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.348+0000 7fdfdc6a6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd415be80 con 0x7fdfc0004d50 2023-10-06T03:06:57.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.348+0000 7fdfdc6a6700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd40c89f0 con 0x7fdfd40b29c0 2023-10-06T03:06:57.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.348+0000 7fdfdc6a6700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd4158790 con 0x7fdfd415b4d0 2023-10-06T03:06:57.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.348+0000 7fdfda442700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfc0004d50 0x7fdfd41536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:57.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.348+0000 7fdfda442700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfc0004d50 0x7fdfd41536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:34988/0 (socket says 172.21.15.125:34988) 2023-10-06T03:06:57.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.348+0000 7fdfda442700 1 -- 172.21.15.125:0/547630305 learned_addr learned my addr 172.21.15.125:0/547630305 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:57.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.349+0000 7fdfd9c41700 1 --2- 172.21.15.125:0/547630305 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfd415b4d0 0x7fdfd415b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:57.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.349+0000 7fdfdac43700 1 --2- 172.21.15.125:0/547630305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfd40b29c0 0x7fdfd40b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:57.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.349+0000 7fdfda442700 1 -- 172.21.15.125:0/547630305 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfd415b4d0 msgr2=0x7fdfd415b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:57.356 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.349+0000 7fdfda442700 1 --2- 172.21.15.125:0/547630305 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfd415b4d0 0x7fdfd415b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:57.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.349+0000 7fdfda442700 1 -- 172.21.15.125:0/547630305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfd40b29c0 msgr2=0x7fdfd40b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:57.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.349+0000 7fdfda442700 1 --2- 172.21.15.125:0/547630305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfd40b29c0 0x7fdfd40b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:57.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.349+0000 7fdfda442700 1 -- 172.21.15.125:0/547630305 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd4153c20 con 0x7fdfc0004d50 2023-10-06T03:06:57.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.349+0000 7fdfda442700 1 --2- 172.21.15.125:0/547630305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfc0004d50 0x7fdfd41536e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40073f0 tx=0x7fdfc4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:57.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.349+0000 7fdfca7fc700 1 -- 172.21.15.125:0/547630305 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc4018030 con 0x7fdfc0004d50 2023-10-06T03:06:57.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.349+0000 7fdfca7fc700 1 -- 172.21.15.125:0/547630305 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc4007860 con 0x7fdfc0004d50 2023-10-06T03:06:57.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.349+0000 7fdfca7fc700 1 -- 172.21.15.125:0/547630305 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc400fb20 con 0x7fdfc0004d50 2023-10-06T03:06:57.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.349+0000 7fdfdc6a6700 1 -- 172.21.15.125:0/547630305 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd40b3730 con 0x7fdfc0004d50 2023-10-06T03:06:57.357 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.349+0000 7fdfdc6a6700 1 -- 172.21.15.125:0/547630305 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd41589e0 con 0x7fdfc0004d50 2023-10-06T03:06:57.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.350+0000 7fdfdc6a6700 1 -- 172.21.15.125:0/547630305 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd406f1e0 con 0x7fdfc0004d50 2023-10-06T03:06:57.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.350+0000 7fdfca7fc700 1 -- 172.21.15.125:0/547630305 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfc401b070 con 0x7fdfc0004d50 2023-10-06T03:06:57.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.351+0000 7fdfca7fc700 1 --2- 172.21.15.125:0/547630305 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdfb8066f30 0x7fdfb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:57.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.351+0000 7fdfca7fc700 1 -- 172.21.15.125:0/547630305 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fdfc4019070 con 0x7fdfc0004d50 2023-10-06T03:06:57.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.351+0000 7fdfd9c41700 1 --2- 172.21.15.125:0/547630305 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdfb8066f30 0x7fdfb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:57.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.351+0000 7fdfd9c41700 1 --2- 172.21.15.125:0/547630305 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdfb8066f30 0x7fdfb80693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdfd415c1e0 tx=0x7fdfd0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:57.358 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.355+0000 7fdfca7fc700 1 -- 172.21.15.125:0/547630305 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfc40516f0 con 0x7fdfc0004d50 2023-10-06T03:06:57.537 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:57.536+0000 7fdfdc6a6700 1 -- 172.21.15.125:0/547630305 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdfd40cc3a0 con 0x7fdfc0004d50 2023-10-06T03:06:58.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.316+0000 7fdfca7fc700 1 -- 172.21.15.125:0/547630305 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v59) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdfc4054d10 con 0x7fdfc0004d50 2023-10-06T03:06:58.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.320+0000 7fdfdc6a6700 1 -- 172.21.15.125:0/547630305 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdfb8066f30 msgr2=0x7fdfb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:58.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.320+0000 7fdfdc6a6700 1 --2- 172.21.15.125:0/547630305 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdfb8066f30 0x7fdfb80693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdfd415c1e0 tx=0x7fdfd0009040 comp rx=0 tx=0).stop 2023-10-06T03:06:58.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.320+0000 7fdfdc6a6700 1 -- 172.21.15.125:0/547630305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfc0004d50 msgr2=0x7fdfd41536e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:58.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.320+0000 7fdfdc6a6700 1 --2- 172.21.15.125:0/547630305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfc0004d50 0x7fdfd41536e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40073f0 tx=0x7fdfc4001e50 comp rx=0 tx=0).stop 2023-10-06T03:06:58.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.320+0000 7fdfdc6a6700 1 -- 172.21.15.125:0/547630305 shutdown_connections 2023-10-06T03:06:58.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.320+0000 7fdfdc6a6700 1 --2- 172.21.15.125:0/547630305 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fdfb8066f30 0x7fdfb80693e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:58.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.320+0000 7fdfdc6a6700 1 --2- 172.21.15.125:0/547630305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdfd40b29c0 0x7fdfd40b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:58.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.320+0000 7fdfdc6a6700 1 --2- 172.21.15.125:0/547630305 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fdfc0004d50 0x7fdfd41536e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:58.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.320+0000 7fdfdc6a6700 1 --2- 172.21.15.125:0/547630305 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fdfd415b4d0 0x7fdfd415b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:58.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.320+0000 7fdfdc6a6700 1 -- 172.21.15.125:0/547630305 >> 172.21.15.125:0/547630305 conn(0x7fdfd40cea90 msgr2=0x7fdfd40c4290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:58.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.320+0000 7fdfdc6a6700 1 -- 172.21.15.125:0/547630305 shutdown_connections 2023-10-06T03:06:58.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.320+0000 7fdfdc6a6700 1 -- 172.21.15.125:0/547630305 wait complete. 2023-10-06T03:06:58.323 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_metadata' removed 2023-10-06T03:06:58.336 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T03:06:58.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.462+0000 7f7a24d6b700 1 Processor -- start 2023-10-06T03:06:58.464 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.462+0000 7f7a24d6b700 1 -- start start 2023-10-06T03:06:58.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.463+0000 7f7a24d6b700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7a200c7570 0x7f7a200c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:58.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.463+0000 7f7a24d6b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a2013d470 0x7f7a2013d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:58.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.463+0000 7f7a24d6b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a200ad120 con 0x7f7a200c82d0 2023-10-06T03:06:58.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.463+0000 7f7a24d6b700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a20069480 con 0x7f7a200c7570 2023-10-06T03:06:58.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.463+0000 7f7a24d6b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2013ddf0 con 0x7f7a2013d470 2023-10-06T03:06:58.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.463+0000 7f7a1e59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7a200c82d0 0x7f7a20068020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40464/0 (socket says 172.21.15.125:40464) 2023-10-06T03:06:58.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.463+0000 7f7a1e59c700 1 -- 172.21.15.125:0/3059552095 learned_addr learned my addr 172.21.15.125:0/3059552095 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:58.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.463+0000 7f7a1ed9d700 1 --2- 172.21.15.125:0/3059552095 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a2013d470 0x7f7a2013d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:58.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.463+0000 7f7a1dd9b700 1 --2- 172.21.15.125:0/3059552095 >> v2:172.21.15.130:3300/0 conn(0x7f7a200c7570 0x7f7a200c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:58.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.463+0000 7f7a1d59a700 1 -- 172.21.15.125:0/3059552095 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219906566 0 0) 0x7f7a200ad120 con 0x7f7a200c82d0 2023-10-06T03:06:58.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.463+0000 7f7a1d59a700 1 -- 172.21.15.125:0/3059552095 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a08003570 con 0x7f7a200c82d0 2023-10-06T03:06:58.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1d59a700 1 -- 172.21.15.125:0/3059552095 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3054279311 0 0) 0x7f7a08003570 con 0x7f7a200c82d0 2023-10-06T03:06:58.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1d59a700 1 -- 172.21.15.125:0/3059552095 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a2013d470 msgr2=0x7f7a2013d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:58.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1d59a700 1 --2- 172.21.15.125:0/3059552095 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a2013d470 0x7f7a2013d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:58.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1d59a700 1 -- 172.21.15.125:0/3059552095 >> v2:172.21.15.130:3300/0 conn(0x7f7a200c7570 msgr2=0x7f7a200c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:58.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1d59a700 1 --2- 172.21.15.125:0/3059552095 >> v2:172.21.15.130:3300/0 conn(0x7f7a200c7570 0x7f7a200c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:58.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1d59a700 1 -- 172.21.15.125:0/3059552095 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a20068900 con 0x7f7a200c82d0 2023-10-06T03:06:58.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1d59a700 1 -- 172.21.15.125:0/3059552095 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f7a14001470 con 0x7f7a200c82d0 2023-10-06T03:06:58.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1d59a700 1 -- 172.21.15.125:0/3059552095 >> v1:172.21.15.125:6789/0 conn(0x7f7a200c82d0 legacy=0x7f7a20068020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:58.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1d59a700 1 --2- 172.21.15.125:0/3059552095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a08003a60 0x7f7a08003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:58.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1d59a700 1 --2- 172.21.15.125:0/3059552095 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a2013d470 0x7f7a08004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:58.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1d59a700 1 --2- 172.21.15.125:0/3059552095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a08004d50 0x7f7a080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:58.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1d59a700 1 -- 172.21.15.125:0/3059552095 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a20069480 con 0x7f7a08003a60 2023-10-06T03:06:58.472 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1d59a700 1 -- 172.21.15.125:0/3059552095 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2013ddf0 con 0x7f7a08004d50 2023-10-06T03:06:58.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1d59a700 1 -- 172.21.15.125:0/3059552095 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0800ba60 con 0x7f7a2013d470 2023-10-06T03:06:58.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1e59c700 1 --2- 172.21.15.125:0/3059552095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a08003a60 0x7f7a08003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:58.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1dd9b700 1 --2- 172.21.15.125:0/3059552095 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a2013d470 0x7f7a08004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:58.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1ed9d700 1 --2- 172.21.15.125:0/3059552095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a08004d50 0x7f7a080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:58.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1e59c700 1 -- 172.21.15.125:0/3059552095 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a2013d470 msgr2=0x7f7a08004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:58.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1e59c700 1 --2- 172.21.15.125:0/3059552095 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a2013d470 0x7f7a08004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:58.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1e59c700 1 -- 172.21.15.125:0/3059552095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a08004d50 msgr2=0x7f7a080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:58.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1e59c700 1 --2- 172.21.15.125:0/3059552095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a08004d50 0x7f7a080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:58.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1e59c700 1 -- 172.21.15.125:0/3059552095 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a08003570 con 0x7f7a08003a60 2023-10-06T03:06:58.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1ed9d700 1 --2- 172.21.15.125:0/3059552095 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a08004d50 0x7f7a080051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:58.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1e59c700 1 --2- 172.21.15.125:0/3059552095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a08003a60 0x7f7a08003e70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7a1400c3c0 tx=0x7f7a14001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f2c54ac32272e2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:58.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1d59a700 1 -- 172.21.15.125:0/3059552095 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1400cc30 con 0x7f7a08003a60 2023-10-06T03:06:58.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1d59a700 1 -- 172.21.15.125:0/3059552095 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1400cdb0 con 0x7f7a08003a60 2023-10-06T03:06:58.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.464+0000 7f7a1d59a700 1 -- 172.21.15.125:0/3059552095 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14005b70 con 0x7f7a08003a60 2023-10-06T03:06:58.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.465+0000 7f7a24d6b700 1 -- 172.21.15.125:0/3059552095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a08003a60 msgr2=0x7f7a08003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:58.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.465+0000 7f7a24d6b700 1 --2- 172.21.15.125:0/3059552095 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a08003a60 0x7f7a08003e70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f7a1400c3c0 tx=0x7f7a14001e90 comp rx=0 tx=0).stop 2023-10-06T03:06:58.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.465+0000 7f7a1ed9d700 1 -- 172.21.15.125:0/3059552095 reap_dead start 2023-10-06T03:06:58.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.465+0000 7f7a24d6b700 1 -- 172.21.15.125:0/3059552095 shutdown_connections 2023-10-06T03:06:58.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.465+0000 7f7a24d6b700 1 -- 172.21.15.125:0/3059552095 >> 172.21.15.125:0/3059552095 conn(0x7f7a2006b190 msgr2=0x7f7a2006b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:58.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.465+0000 7f7a24d6b700 1 -- 172.21.15.125:0/3059552095 shutdown_connections 2023-10-06T03:06:58.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.465+0000 7f7a24d6b700 1 -- 172.21.15.125:0/3059552095 wait complete. 2023-10-06T03:06:58.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.466+0000 7f7a24d6b700 1 Processor -- start 2023-10-06T03:06:58.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.466+0000 7f7a24d6b700 1 -- start start 2023-10-06T03:06:58.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.467+0000 7f7a24d6b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a08003a60 0x7f7a200b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:58.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.467+0000 7f7a24d6b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a200b03d0 0x7f7a200b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:58.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.467+0000 7f7a24d6b700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a200c9590 0x7f7a200c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:58.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.467+0000 7f7a24d6b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a200c5e30 con 0x7f7a08003a60 2023-10-06T03:06:58.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.467+0000 7f7a24d6b700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a200c9f20 con 0x7f7a200c9590 2023-10-06T03:06:58.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.467+0000 7f7a24d6b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a200b2ce0 con 0x7f7a200b03d0 2023-10-06T03:06:58.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.467+0000 7f7a1e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a08003a60 0x7f7a200b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:58.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.467+0000 7f7a1e59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a08003a60 0x7f7a200b27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35014/0 (socket says 172.21.15.125:35014) 2023-10-06T03:06:58.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.467+0000 7f7a1e59c700 1 -- 172.21.15.125:0/2059245033 learned_addr learned my addr 172.21.15.125:0/2059245033 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:58.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.467+0000 7f7a1dd9b700 1 --2- 172.21.15.125:0/2059245033 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a200b03d0 0x7f7a200b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:58.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.467+0000 7f7a1ed9d700 1 --2- 172.21.15.125:0/2059245033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a200c9590 0x7f7a200c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:58.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.467+0000 7f7a1e59c700 1 -- 172.21.15.125:0/2059245033 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a200b03d0 msgr2=0x7f7a200b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:58.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.467+0000 7f7a1e59c700 1 --2- 172.21.15.125:0/2059245033 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a200b03d0 0x7f7a200b0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:58.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.467+0000 7f7a1e59c700 1 -- 172.21.15.125:0/2059245033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a200c9590 msgr2=0x7f7a200c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:58.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.467+0000 7f7a1e59c700 1 --2- 172.21.15.125:0/2059245033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a200c9590 0x7f7a200c99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:58.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.467+0000 7f7a1e59c700 1 -- 172.21.15.125:0/2059245033 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a200c5220 con 0x7f7a08003a60 2023-10-06T03:06:58.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.467+0000 7f7a1ed9d700 1 --2- 172.21.15.125:0/2059245033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a200c9590 0x7f7a200c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:06:58.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.467+0000 7f7a1e59c700 1 --2- 172.21.15.125:0/2059245033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a08003a60 0x7f7a200b27a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7a14001ed0 tx=0x7f7a14015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:58.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.468+0000 7f7a0e7fc700 1 -- 172.21.15.125:0/2059245033 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14001430 con 0x7f7a08003a60 2023-10-06T03:06:58.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.468+0000 7f7a0e7fc700 1 -- 172.21.15.125:0/2059245033 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a140072e0 con 0x7f7a08003a60 2023-10-06T03:06:58.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.468+0000 7f7a24d6b700 1 -- 172.21.15.125:0/2059245033 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a200c5500 con 0x7f7a08003a60 2023-10-06T03:06:58.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.468+0000 7f7a0e7fc700 1 -- 172.21.15.125:0/2059245033 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a140076a0 con 0x7f7a08003a60 2023-10-06T03:06:58.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.468+0000 7f7a24d6b700 1 -- 172.21.15.125:0/2059245033 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a200c5ac0 con 0x7f7a08003a60 2023-10-06T03:06:58.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.469+0000 7f7a24d6b700 1 -- 172.21.15.125:0/2059245033 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a200c6110 con 0x7f7a08003a60 2023-10-06T03:06:58.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.469+0000 7f7a0e7fc700 1 -- 172.21.15.125:0/2059245033 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a14019030 con 0x7f7a08003a60 2023-10-06T03:06:58.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.469+0000 7f7a0e7fc700 1 --2- 172.21.15.125:0/2059245033 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7a00066f30 0x7f7a000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:58.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.469+0000 7f7a0e7fc700 1 -- 172.21.15.125:0/2059245033 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6026+0+0 (secure 0 0 0) 0x7f7a14085e90 con 0x7f7a08003a60 2023-10-06T03:06:58.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.469+0000 7f7a1dd9b700 1 --2- 172.21.15.125:0/2059245033 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7a00066f30 0x7f7a000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:58.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.470+0000 7f7a1dd9b700 1 --2- 172.21.15.125:0/2059245033 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7a00066f30 0x7f7a000693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7a100093f0 tx=0x7f7a10008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:58.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.474+0000 7f7a0e7fc700 1 -- 172.21.15.125:0/2059245033 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a14052fc0 con 0x7f7a08003a60 2023-10-06T03:06:58.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:58.654+0000 7f7a24d6b700 1 -- 172.21.15.125:0/2059245033 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7a2004bb80 con 0x7f7a08003a60 2023-10-06T03:06:59.020 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:06:59.023 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:06:59.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.322+0000 7f7a0e7fc700 1 -- 172.21.15.125:0/2059245033 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v60) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7a140565e0 con 0x7f7a08003a60 2023-10-06T03:06:59.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.324+0000 7f7a24d6b700 1 -- 172.21.15.125:0/2059245033 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7a00066f30 msgr2=0x7f7a000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:59.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.324+0000 7f7a24d6b700 1 --2- 172.21.15.125:0/2059245033 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7a00066f30 0x7f7a000693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7a100093f0 tx=0x7f7a10008040 comp rx=0 tx=0).stop 2023-10-06T03:06:59.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.324+0000 7f7a24d6b700 1 -- 172.21.15.125:0/2059245033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a08003a60 msgr2=0x7f7a200b27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:59.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.324+0000 7f7a24d6b700 1 --2- 172.21.15.125:0/2059245033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a08003a60 0x7f7a200b27a0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7a14001ed0 tx=0x7f7a14015000 comp rx=0 tx=0).stop 2023-10-06T03:06:59.326 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.324+0000 7f7a24d6b700 1 -- 172.21.15.125:0/2059245033 shutdown_connections 2023-10-06T03:06:59.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.324+0000 7f7a24d6b700 1 --2- 172.21.15.125:0/2059245033 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7a00066f30 0x7f7a000693e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:59.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.324+0000 7f7a24d6b700 1 --2- 172.21.15.125:0/2059245033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7a200c9590 0x7f7a200c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:59.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.324+0000 7f7a24d6b700 1 --2- 172.21.15.125:0/2059245033 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7a08003a60 0x7f7a200b27a0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:59.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.324+0000 7f7a24d6b700 1 --2- 172.21.15.125:0/2059245033 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7a200b03d0 0x7f7a200b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:59.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.324+0000 7f7a24d6b700 1 -- 172.21.15.125:0/2059245033 >> 172.21.15.125:0/2059245033 conn(0x7f7a2006b190 msgr2=0x7f7a20156c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:59.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.325+0000 7f7a24d6b700 1 -- 172.21.15.125:0/2059245033 shutdown_connections 2023-10-06T03:06:59.327 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.325+0000 7f7a24d6b700 1 -- 172.21.15.125:0/2059245033 wait complete. 2023-10-06T03:06:59.327 INFO:teuthology.orchestra.run.smithi125.stderr:pool 'cephfs_data' removed 2023-10-06T03:06:59.340 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T03:06:59.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.461+0000 7f993ea30700 1 Processor -- start 2023-10-06T03:06:59.463 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.461+0000 7f993ea30700 1 -- start start 2023-10-06T03:06:59.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.462+0000 7f993ea30700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9938067d20 0x7f99380caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:59.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.462+0000 7f993ea30700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99380cafe0 con 0x7f99380af320 2023-10-06T03:06:59.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.462+0000 7f993ea30700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99380c3b40 con 0x7f99380ca190 2023-10-06T03:06:59.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.462+0000 7f993ea30700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99380ca710 con 0x7f9938067d20 2023-10-06T03:06:59.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.462+0000 7f9937fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f99380af320 0x7f9938067610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40480/0 (socket says 172.21.15.125:40480) 2023-10-06T03:06:59.469 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.462+0000 7f9937fff700 1 -- 172.21.15.125:0/3300038418 learned_addr learned my addr 172.21.15.125:0/3300038418 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:59.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9936ffd700 1 -- 172.21.15.125:0/3300038418 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3706293585 0 0) 0x7f9928001290 con 0x7f99380af320 2023-10-06T03:06:59.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9936ffd700 1 -- 172.21.15.125:0/3300038418 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9920003570 con 0x7f99380af320 2023-10-06T03:06:59.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f99377fe700 1 --2- 172.21.15.125:0/3300038418 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9938067d20 0x7f99380caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:59.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9936ffd700 1 -- 172.21.15.125:0/3300038418 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 182688553 0 0) 0x7f9920003570 con 0x7f99380af320 2023-10-06T03:06:59.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9936ffd700 1 -- 172.21.15.125:0/3300038418 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9938067d20 msgr2=0x7f99380caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:59.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9936ffd700 1 --2- 172.21.15.125:0/3300038418 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9938067d20 0x7f99380caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:59.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9936ffd700 1 -- 172.21.15.125:0/3300038418 >> v1:172.21.15.130:6789/0 conn(0x7f99380ca190 legacy=0x7f99380c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:59.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9936ffd700 1 -- 172.21.15.125:0/3300038418 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99380cc750 con 0x7f99380af320 2023-10-06T03:06:59.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9936ffd700 1 -- 172.21.15.125:0/3300038418 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f9928001780 con 0x7f99380af320 2023-10-06T03:06:59.470 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9936ffd700 1 -- 172.21.15.125:0/3300038418 >> v1:172.21.15.125:6789/0 conn(0x7f99380af320 legacy=0x7f9938067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:59.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9936ffd700 1 --2- 172.21.15.125:0/3300038418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9920003a90 0x7f9920003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:59.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9936ffd700 1 --2- 172.21.15.125:0/3300038418 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9938067d20 0x7f9920004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:59.471 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9936ffd700 1 --2- 172.21.15.125:0/3300038418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9920004da0 0x7f99200051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:59.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9936ffd700 1 -- 172.21.15.125:0/3300038418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99380ca710 con 0x7f9920003a90 2023-10-06T03:06:59.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9936ffd700 1 -- 172.21.15.125:0/3300038418 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992000bcc0 con 0x7f9920004da0 2023-10-06T03:06:59.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9936ffd700 1 -- 172.21.15.125:0/3300038418 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f992000be80 con 0x7f9938067d20 2023-10-06T03:06:59.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9937fff700 1 --2- 172.21.15.125:0/3300038418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9920003a90 0x7f9920003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:59.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f99377fe700 1 --2- 172.21.15.125:0/3300038418 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9938067d20 0x7f9920004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:59.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f993cfcd700 1 --2- 172.21.15.125:0/3300038418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9920004da0 0x7f99200051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:59.473 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9937fff700 1 -- 172.21.15.125:0/3300038418 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9938067d20 msgr2=0x7f9920004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:59.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9937fff700 1 --2- 172.21.15.125:0/3300038418 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9938067d20 0x7f9920004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:59.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9937fff700 1 -- 172.21.15.125:0/3300038418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9920004da0 msgr2=0x7f99200051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:59.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9937fff700 1 --2- 172.21.15.125:0/3300038418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9920004da0 0x7f99200051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:59.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9937fff700 1 -- 172.21.15.125:0/3300038418 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9920003570 con 0x7f9920003a90 2023-10-06T03:06:59.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.463+0000 7f9937fff700 1 --2- 172.21.15.125:0/3300038418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9920003a90 0x7f9920003ea0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f992800c5c0 tx=0x7f9928007a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c345e95d38b6e20 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:59.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.464+0000 7f9936ffd700 1 -- 172.21.15.125:0/3300038418 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992800cdc0 con 0x7f9920003a90 2023-10-06T03:06:59.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.464+0000 7f9936ffd700 1 -- 172.21.15.125:0/3300038418 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99280070d0 con 0x7f9920003a90 2023-10-06T03:06:59.474 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.464+0000 7f9936ffd700 1 -- 172.21.15.125:0/3300038418 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9928007490 con 0x7f9920003a90 2023-10-06T03:06:59.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.464+0000 7f993ea30700 1 -- 172.21.15.125:0/3300038418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9920003a90 msgr2=0x7f9920003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:59.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.464+0000 7f993ea30700 1 --2- 172.21.15.125:0/3300038418 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9920003a90 0x7f9920003ea0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f992800c5c0 tx=0x7f9928007a70 comp rx=0 tx=0).stop 2023-10-06T03:06:59.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.464+0000 7f993cfcd700 1 -- 172.21.15.125:0/3300038418 reap_dead start 2023-10-06T03:06:59.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.464+0000 7f993ea30700 1 -- 172.21.15.125:0/3300038418 shutdown_connections 2023-10-06T03:06:59.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.464+0000 7f993ea30700 1 -- 172.21.15.125:0/3300038418 >> 172.21.15.125:0/3300038418 conn(0x7f9938096120 msgr2=0x7f9938068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:59.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.464+0000 7f993ea30700 1 -- 172.21.15.125:0/3300038418 shutdown_connections 2023-10-06T03:06:59.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.464+0000 7f993ea30700 1 -- 172.21.15.125:0/3300038418 wait complete. 2023-10-06T03:06:59.475 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.465+0000 7f993ea30700 1 Processor -- start 2023-10-06T03:06:59.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.465+0000 7f993ea30700 1 -- start start 2023-10-06T03:06:59.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.466+0000 7f993ea30700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9920003a90 0x7f99380b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:59.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.466+0000 7f993ea30700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9938157750 0x7f993815ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:59.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.466+0000 7f993ea30700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f993815f3a0 0x7f993815f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:59.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.466+0000 7f993ea30700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993815fd50 con 0x7f9938157750 2023-10-06T03:06:59.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.466+0000 7f993ea30700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993815f0f0 con 0x7f993815f3a0 2023-10-06T03:06:59.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.466+0000 7f993ea30700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993815adf0 con 0x7f9920003a90 2023-10-06T03:06:59.476 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.466+0000 7f99377fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9938157750 0x7f993815ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:59.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.466+0000 7f99377fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9938157750 0x7f993815ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35030/0 (socket says 172.21.15.125:35030) 2023-10-06T03:06:59.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.466+0000 7f99377fe700 1 -- 172.21.15.125:0/3388014300 learned_addr learned my addr 172.21.15.125:0/3388014300 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:59.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.466+0000 7f993cfcd700 1 --2- 172.21.15.125:0/3388014300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f993815f3a0 0x7f993815f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:59.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.466+0000 7f9937fff700 1 --2- 172.21.15.125:0/3388014300 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9920003a90 0x7f99380b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:59.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.467+0000 7f99377fe700 1 -- 172.21.15.125:0/3388014300 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9920003a90 msgr2=0x7f99380b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:59.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.467+0000 7f99377fe700 1 --2- 172.21.15.125:0/3388014300 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9920003a90 0x7f99380b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:59.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.467+0000 7f99377fe700 1 -- 172.21.15.125:0/3388014300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f993815f3a0 msgr2=0x7f993815f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:59.477 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.467+0000 7f99377fe700 1 --2- 172.21.15.125:0/3388014300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f993815f3a0 0x7f993815f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:59.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.467+0000 7f99377fe700 1 -- 172.21.15.125:0/3388014300 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9938157bc0 con 0x7f9938157750 2023-10-06T03:06:59.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.467+0000 7f9937fff700 1 --2- 172.21.15.125:0/3388014300 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9920003a90 0x7f99380b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:06:59.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.467+0000 7f99377fe700 1 --2- 172.21.15.125:0/3388014300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9938157750 0x7f993815ebb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f992c010d00 tx=0x7f992c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:59.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.467+0000 7f991ffff700 1 -- 172.21.15.125:0/3388014300 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c00e9f0 con 0x7f9938157750 2023-10-06T03:06:59.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.467+0000 7f991ffff700 1 -- 172.21.15.125:0/3388014300 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c00eb50 con 0x7f9938157750 2023-10-06T03:06:59.478 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.467+0000 7f993ea30700 1 -- 172.21.15.125:0/3388014300 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99380b1570 con 0x7f9938157750 2023-10-06T03:06:59.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.467+0000 7f991ffff700 1 -- 172.21.15.125:0/3388014300 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c014430 con 0x7f9938157750 2023-10-06T03:06:59.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.467+0000 7f993ea30700 1 -- 172.21.15.125:0/3388014300 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99380b0fb0 con 0x7f9938157750 2023-10-06T03:06:59.479 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.468+0000 7f993ea30700 1 -- 172.21.15.125:0/3388014300 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9938066510 con 0x7f9938157750 2023-10-06T03:06:59.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.468+0000 7f991ffff700 1 -- 172.21.15.125:0/3388014300 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f992c014860 con 0x7f9938157750 2023-10-06T03:06:59.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.468+0000 7f991ffff700 1 --2- 172.21.15.125:0/3388014300 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9924066f30 0x7f99240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:59.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.469+0000 7f991ffff700 1 -- 172.21.15.125:0/3388014300 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f992c084c40 con 0x7f9938157750 2023-10-06T03:06:59.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.469+0000 7f9937fff700 1 --2- 172.21.15.125:0/3388014300 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9924066f30 0x7f99240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:59.480 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.469+0000 7f9937fff700 1 --2- 172.21.15.125:0/3388014300 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9924066f30 0x7f99240693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9928000ef0 tx=0x7f9928015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:59.481 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.473+0000 7f991ffff700 1 -- 172.21.15.125:0/3388014300 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f992c051f10 con 0x7f9938157750 2023-10-06T03:06:59.655 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.654+0000 7f993ea30700 1 -- 172.21.15.125:0/3388014300 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f993815abc0 con 0x7f9938157750 2023-10-06T03:06:59.660 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.659+0000 7f991ffff700 1 -- 172.21.15.125:0/3388014300 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f992c055530 con 0x7f9938157750 2023-10-06T03:06:59.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.661+0000 7f993ea30700 1 -- 172.21.15.125:0/3388014300 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9924066f30 msgr2=0x7f99240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:59.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.661+0000 7f993ea30700 1 --2- 172.21.15.125:0/3388014300 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9924066f30 0x7f99240693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9928000ef0 tx=0x7f9928015000 comp rx=0 tx=0).stop 2023-10-06T03:06:59.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.661+0000 7f993ea30700 1 -- 172.21.15.125:0/3388014300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9938157750 msgr2=0x7f993815ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:59.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.661+0000 7f993ea30700 1 --2- 172.21.15.125:0/3388014300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9938157750 0x7f993815ebb0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f992c010d00 tx=0x7f992c008040 comp rx=0 tx=0).stop 2023-10-06T03:06:59.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.661+0000 7f993ea30700 1 -- 172.21.15.125:0/3388014300 shutdown_connections 2023-10-06T03:06:59.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.661+0000 7f993ea30700 1 --2- 172.21.15.125:0/3388014300 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f9924066f30 0x7f99240693e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:59.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.661+0000 7f993ea30700 1 --2- 172.21.15.125:0/3388014300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f993815f3a0 0x7f993815f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:59.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.661+0000 7f993ea30700 1 --2- 172.21.15.125:0/3388014300 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f9920003a90 0x7f99380b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:59.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.661+0000 7f993ea30700 1 --2- 172.21.15.125:0/3388014300 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f9938157750 0x7f993815ebb0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:59.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.661+0000 7f993ea30700 1 -- 172.21.15.125:0/3388014300 >> 172.21.15.125:0/3388014300 conn(0x7f9938096120 msgr2=0x7f99380c1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:59.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.662+0000 7f993ea30700 1 -- 172.21.15.125:0/3388014300 shutdown_connections 2023-10-06T03:06:59.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.662+0000 7f993ea30700 1 -- 172.21.15.125:0/3388014300 wait complete. 2023-10-06T03:06:59.675 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm' 2023-10-06T03:06:59.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.791+0000 7efe9ec90700 1 Processor -- start 2023-10-06T03:06:59.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.791+0000 7efe9ec90700 1 -- start start 2023-10-06T03:06:59.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.792+0000 7efe9ec90700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efe980cbb50 0x7efe980a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:59.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.792+0000 7efe9ec90700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe980cbf20 0x7efe980caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:59.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.792+0000 7efe9ec90700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe980c2910 con 0x7efe980caf80 2023-10-06T03:06:59.794 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.792+0000 7efe9ec90700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe980cb420 con 0x7efe980cbb50 2023-10-06T03:06:59.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.792+0000 7efe9ec90700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe980c1d40 con 0x7efe980cbf20 2023-10-06T03:06:59.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.792+0000 7efe97fff700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe980cbf20 0x7efe980caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:59.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.792+0000 7efe9ca2c700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7efe980cbb50 0x7efe980a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:59.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.792+0000 7efe9d22d700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7efe980caf80 0x7efe980c2da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:55854/0 (socket says 172.21.15.125:55854) 2023-10-06T03:06:59.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.792+0000 7efe9d22d700 1 -- 172.21.15.125:0/3426796386 learned_addr learned my addr 172.21.15.125:0/3426796386 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:06:59.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.792+0000 7efe97fff700 1 -- 172.21.15.125:0/3426796386 >> v2:172.21.15.130:3300/0 conn(0x7efe980cbb50 msgr2=0x7efe980a99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:06:59.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.792+0000 7efe97fff700 1 --2- 172.21.15.125:0/3426796386 >> v2:172.21.15.130:3300/0 conn(0x7efe980cbb50 0x7efe980a99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:59.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.792+0000 7efe97fff700 1 -- 172.21.15.125:0/3426796386 >> v1:172.21.15.130:6789/0 conn(0x7efe980caf80 legacy=0x7efe980c2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:59.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.792+0000 7efe97fff700 1 -- 172.21.15.125:0/3426796386 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe980c1fe0 con 0x7efe980cbf20 2023-10-06T03:06:59.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.793+0000 7efe97fff700 1 --2- 172.21.15.125:0/3426796386 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe980cbf20 0x7efe980caa40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efe840098e0 tx=0x7efe840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a1c9c05b01e955c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:59.795 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.793+0000 7efe977fe700 1 -- 172.21.15.125:0/3426796386 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8400b640 con 0x7efe980cbf20 2023-10-06T03:06:59.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.793+0000 7efe977fe700 1 -- 172.21.15.125:0/3426796386 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8400b7a0 con 0x7efe980cbf20 2023-10-06T03:06:59.796 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.793+0000 7efe977fe700 1 -- 172.21.15.125:0/3426796386 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8400bb40 con 0x7efe980cbf20 2023-10-06T03:06:59.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.793+0000 7efe9ec90700 1 -- 172.21.15.125:0/3426796386 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe980cbf20 msgr2=0x7efe980caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:59.798 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.793+0000 7efe9ec90700 1 --2- 172.21.15.125:0/3426796386 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe980cbf20 0x7efe980caa40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efe840098e0 tx=0x7efe840091a0 comp rx=0 tx=0).stop 2023-10-06T03:06:59.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.793+0000 7efe9ec90700 1 -- 172.21.15.125:0/3426796386 shutdown_connections 2023-10-06T03:06:59.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.793+0000 7efe9ec90700 1 --2- 172.21.15.125:0/3426796386 >> v2:172.21.15.130:3300/0 conn(0x7efe980cbb50 0x7efe980a99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:59.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.793+0000 7efe9ec90700 1 --2- 172.21.15.125:0/3426796386 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe980cbf20 0x7efe980caa40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:59.799 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.793+0000 7efe9ec90700 1 -- 172.21.15.125:0/3426796386 >> 172.21.15.125:0/3426796386 conn(0x7efe98068f00 msgr2=0x7efe980cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:06:59.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.793+0000 7efe9ec90700 1 -- 172.21.15.125:0/3426796386 shutdown_connections 2023-10-06T03:06:59.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.794+0000 7efe9ec90700 1 -- 172.21.15.125:0/3426796386 wait complete. 2023-10-06T03:06:59.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.795+0000 7efe9ec90700 1 Processor -- start 2023-10-06T03:06:59.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.795+0000 7efe9ec90700 1 -- start start 2023-10-06T03:06:59.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.795+0000 7efe9ec90700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe980caf80 0x7efe981570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:59.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.795+0000 7efe9ec90700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe980cbb50 0x7efe9809a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:59.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.795+0000 7efe9ec90700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe980cbf20 0x7efe98098dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:59.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.795+0000 7efe9ec90700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe98099300 con 0x7efe980cbf20 2023-10-06T03:06:59.800 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.795+0000 7efe9ec90700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9809a140 con 0x7efe980caf80 2023-10-06T03:06:59.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.795+0000 7efe9ec90700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe98099530 con 0x7efe980cbb50 2023-10-06T03:06:59.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.796+0000 7efe9d22d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe980cbf20 0x7efe98098dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:59.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.796+0000 7efe9d22d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe980cbf20 0x7efe98098dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35038/0 (socket says 172.21.15.125:35038) 2023-10-06T03:06:59.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.796+0000 7efe9d22d700 1 -- 172.21.15.125:0/2160853060 learned_addr learned my addr 172.21.15.125:0/2160853060 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:06:59.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.796+0000 7efe97fff700 1 --2- 172.21.15.125:0/2160853060 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe980cbb50 0x7efe9809a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:59.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.796+0000 7efe9ca2c700 1 --2- 172.21.15.125:0/2160853060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe980caf80 0x7efe981570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:59.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.796+0000 7efe9d22d700 1 -- 172.21.15.125:0/2160853060 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe980cbb50 msgr2=0x7efe9809a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:59.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.796+0000 7efe9d22d700 1 --2- 172.21.15.125:0/2160853060 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe980cbb50 0x7efe9809a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:59.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.796+0000 7efe9d22d700 1 -- 172.21.15.125:0/2160853060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe980caf80 msgr2=0x7efe981570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:06:59.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.796+0000 7efe9d22d700 1 --2- 172.21.15.125:0/2160853060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe980caf80 0x7efe981570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:06:59.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.796+0000 7efe9d22d700 1 -- 172.21.15.125:0/2160853060 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe84009420 con 0x7efe980cbf20 2023-10-06T03:06:59.801 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.796+0000 7efe9d22d700 1 --2- 172.21.15.125:0/2160853060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe980cbf20 0x7efe98098dc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7efe9000ef40 tx=0x7efe90001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:59.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.796+0000 7efe94ff9700 1 -- 172.21.15.125:0/2160853060 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9000cdf0 con 0x7efe980cbf20 2023-10-06T03:06:59.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.796+0000 7efe94ff9700 1 -- 172.21.15.125:0/2160853060 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe90011470 con 0x7efe980cbf20 2023-10-06T03:06:59.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.796+0000 7efe94ff9700 1 -- 172.21.15.125:0/2160853060 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90011830 con 0x7efe980cbf20 2023-10-06T03:06:59.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.796+0000 7efe9ec90700 1 -- 172.21.15.125:0/2160853060 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe98099810 con 0x7efe980cbf20 2023-10-06T03:06:59.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.796+0000 7efe9ec90700 1 -- 172.21.15.125:0/2160853060 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe98099dd0 con 0x7efe980cbf20 2023-10-06T03:06:59.802 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.797+0000 7efe9ec90700 1 -- 172.21.15.125:0/2160853060 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe9809a2d0 con 0x7efe980cbf20 2023-10-06T03:06:59.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.798+0000 7efe94ff9700 1 -- 172.21.15.125:0/2160853060 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe90011c20 con 0x7efe980cbf20 2023-10-06T03:06:59.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.798+0000 7efe94ff9700 1 --2- 172.21.15.125:0/2160853060 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efe7c066f30 0x7efe7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:06:59.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.798+0000 7efe94ff9700 1 -- 172.21.15.125:0/2160853060 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7efe90087120 con 0x7efe980cbf20 2023-10-06T03:06:59.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.798+0000 7efe9ca2c700 1 --2- 172.21.15.125:0/2160853060 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efe7c066f30 0x7efe7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:06:59.803 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.799+0000 7efe9ca2c700 1 --2- 172.21.15.125:0/2160853060 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efe7c066f30 0x7efe7c0693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efe98097ec0 tx=0x7efe8c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:06:59.804 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:06:59.803+0000 7efe94ff9700 1 -- 172.21.15.125:0/2160853060 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe90054470 con 0x7efe980cbf20 2023-10-06T03:07:00.060 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:00.058+0000 7efe9ec90700 1 -- 172.21.15.125:0/2160853060 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]} v 0) v1 -- 0x7efe98066510 con 0x7efe980cbf20 2023-10-06T03:07:00.330 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:00.329+0000 7efe94ff9700 1 -- 172.21.15.125:0/2160853060 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_pool_perm.TestPoolPerm.test_pool_perm"]}]=0 v153) v1 ==== 134+0+0 (secure 0 0 0) 0x7efe90057a90 con 0x7efe980cbf20 2023-10-06T03:07:00.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:00.331+0000 7efe9ec90700 1 -- 172.21.15.125:0/2160853060 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efe7c066f30 msgr2=0x7efe7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:00.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:00.331+0000 7efe9ec90700 1 --2- 172.21.15.125:0/2160853060 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efe7c066f30 0x7efe7c0693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7efe98097ec0 tx=0x7efe8c008040 comp rx=0 tx=0).stop 2023-10-06T03:07:00.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:00.331+0000 7efe9ec90700 1 -- 172.21.15.125:0/2160853060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe980cbf20 msgr2=0x7efe98098dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:00.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:00.331+0000 7efe9ec90700 1 --2- 172.21.15.125:0/2160853060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe980cbf20 0x7efe98098dc0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7efe9000ef40 tx=0x7efe90001ae0 comp rx=0 tx=0).stop 2023-10-06T03:07:00.333 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:00.331+0000 7efe9ec90700 1 -- 172.21.15.125:0/2160853060 shutdown_connections 2023-10-06T03:07:00.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:00.331+0000 7efe9ec90700 1 --2- 172.21.15.125:0/2160853060 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efe7c066f30 0x7efe7c0693e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:00.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:00.331+0000 7efe9ec90700 1 --2- 172.21.15.125:0/2160853060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7efe980cbf20 0x7efe98098dc0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:00.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:00.331+0000 7efe9ec90700 1 --2- 172.21.15.125:0/2160853060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe980caf80 0x7efe981570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:00.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:00.331+0000 7efe9ec90700 1 --2- 172.21.15.125:0/2160853060 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7efe980cbb50 0x7efe9809a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:00.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:00.331+0000 7efe9ec90700 1 -- 172.21.15.125:0/2160853060 >> 172.21.15.125:0/2160853060 conn(0x7efe98068f00 msgr2=0x7efe980b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:00.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:00.332+0000 7efe9ec90700 1 -- 172.21.15.125:0/2160853060 shutdown_connections 2023-10-06T03:07:00.334 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:00.332+0000 7efe9ec90700 1 -- 172.21.15.125:0/2160853060 wait complete. 2023-10-06T03:07:00.345 INFO:tasks.cephfs_test_runner:test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) ... ok 2023-10-06T03:07:00.345 INFO:tasks.cephfs_test_runner: 2023-10-06T03:07:00.346 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T03:07:00.346 INFO:tasks.cephfs_test_runner:Ran 2 tests in 108.263s 2023-10-06T03:07:00.346 INFO:tasks.cephfs_test_runner: 2023-10-06T03:07:00.346 INFO:tasks.cephfs_test_runner:OK 2023-10-06T03:07:00.346 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T03:07:00.355 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-06T03:07:00.376 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-06T03:07:00.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:07:00.376 DEBUG:teuthology.orchestra.run.smithi130:> ip netns list 2023-10-06T03:07:00.398 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T03:07:00.398 INFO:teuthology.orchestra.run.smithi130.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T03:07:00.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:07:00.398 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T03:07:00.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:07:00.484 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T03:07:00.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:07:00.538 DEBUG:teuthology.orchestra.run.smithi130:> sudo ip link delete ceph-brx 2023-10-06T03:07:00.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:07:00.609 DEBUG:teuthology.orchestra.run.smithi125:> ip netns list 2023-10-06T03:07:00.629 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T03:07:00.629 INFO:teuthology.orchestra.run.smithi125.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T03:07:00.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:07:00.629 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T03:07:00.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:07:00.712 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T03:07:00.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T03:07:00.793 DEBUG:teuthology.orchestra.run.smithi125:> sudo ip link delete ceph-brx 2023-10-06T03:07:00.886 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T03:07:00.896 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T03:07:00.896 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:07:01.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.013+0000 7fe42cfea700 1 Processor -- start 2023-10-06T03:07:01.015 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.013+0000 7fe42cfea700 1 -- start start 2023-10-06T03:07:01.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.014+0000 7fe42cfea700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe4280af320 0x7fe4280c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.014+0000 7fe42cfea700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4280cc5a0 0x7fe428067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.018 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.014+0000 7fe42cfea700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe428067b50 0x7fe4280c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.014+0000 7fe42cfea700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe428067fd0 con 0x7fe4280af320 2023-10-06T03:07:01.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.014+0000 7fe42cfea700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4280caa40 con 0x7fe428067b50 2023-10-06T03:07:01.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.014+0000 7fe42cfea700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4280c1ca0 con 0x7fe4280cc5a0 2023-10-06T03:07:01.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.015+0000 7fe42659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe4280af320 0x7fe4280c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.015+0000 7fe42659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe4280af320 0x7fe4280c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35048/0 (socket says 172.21.15.125:35048) 2023-10-06T03:07:01.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.015+0000 7fe42659c700 1 -- 172.21.15.125:0/3345937514 learned_addr learned my addr 172.21.15.125:0/3345937514 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:01.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.015+0000 7fe426d9d700 1 --2- 172.21.15.125:0/3345937514 >> v2:172.21.15.130:3300/0 conn(0x7fe428067b50 0x7fe4280c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.015+0000 7fe42659c700 1 -- 172.21.15.125:0/3345937514 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4280cc5a0 msgr2=0x7fe428067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:01.019 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.015+0000 7fe425d9b700 1 --2- 172.21.15.125:0/3345937514 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4280cc5a0 0x7fe428067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.015+0000 7fe42659c700 1 --2- 172.21.15.125:0/3345937514 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4280cc5a0 0x7fe428067610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.015+0000 7fe42659c700 1 -- 172.21.15.125:0/3345937514 >> v2:172.21.15.130:3300/0 conn(0x7fe428067b50 msgr2=0x7fe4280c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:01.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.015+0000 7fe42659c700 1 --2- 172.21.15.125:0/3345937514 >> v2:172.21.15.130:3300/0 conn(0x7fe428067b50 0x7fe4280c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.015+0000 7fe42659c700 1 -- 172.21.15.125:0/3345937514 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4280cca60 con 0x7fe4280af320 2023-10-06T03:07:01.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.015+0000 7fe426d9d700 1 --2- 172.21.15.125:0/3345937514 >> v2:172.21.15.130:3300/0 conn(0x7fe428067b50 0x7fe4280c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:07:01.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.015+0000 7fe42659c700 1 --2- 172.21.15.125:0/3345937514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4280af320 0x7fe4280c8ed0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe428087210 tx=0x7fe41c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57350e675bb68078 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:01.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.015+0000 7fe42559a700 1 -- 172.21.15.125:0/3345937514 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c005c10 con 0x7fe4280af320 2023-10-06T03:07:01.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.015+0000 7fe42559a700 1 -- 172.21.15.125:0/3345937514 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c005d70 con 0x7fe4280af320 2023-10-06T03:07:01.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.015+0000 7fe42559a700 1 -- 172.21.15.125:0/3345937514 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c00b880 con 0x7fe4280af320 2023-10-06T03:07:01.020 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.016+0000 7fe42cfea700 1 -- 172.21.15.125:0/3345937514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4280af320 msgr2=0x7fe4280c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.016+0000 7fe42cfea700 1 --2- 172.21.15.125:0/3345937514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4280af320 0x7fe4280c8ed0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe428087210 tx=0x7fe41c009220 comp rx=0 tx=0).stop 2023-10-06T03:07:01.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.016+0000 7fe42cfea700 1 -- 172.21.15.125:0/3345937514 shutdown_connections 2023-10-06T03:07:01.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.016+0000 7fe42cfea700 1 --2- 172.21.15.125:0/3345937514 >> v2:172.21.15.130:3300/0 conn(0x7fe428067b50 0x7fe4280c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.016+0000 7fe42cfea700 1 --2- 172.21.15.125:0/3345937514 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe4280af320 0x7fe4280c8ed0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.016+0000 7fe42cfea700 1 --2- 172.21.15.125:0/3345937514 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4280cc5a0 0x7fe428067610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.016+0000 7fe42cfea700 1 -- 172.21.15.125:0/3345937514 >> 172.21.15.125:0/3345937514 conn(0x7fe428068f00 msgr2=0x7fe4280cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:01.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.016+0000 7fe42cfea700 1 -- 172.21.15.125:0/3345937514 shutdown_connections 2023-10-06T03:07:01.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.016+0000 7fe42cfea700 1 -- 172.21.15.125:0/3345937514 wait complete. 2023-10-06T03:07:01.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.017+0000 7fe42cfea700 1 Processor -- start 2023-10-06T03:07:01.021 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.017+0000 7fe42cfea700 1 -- start start 2023-10-06T03:07:01.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe42cfea700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe428067b50 0x7fe428169920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.024 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe42cfea700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4280af320 0x7fe4281569a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe42cfea700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4280cc5a0 0x7fe4280c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe42cfea700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42815cd80 con 0x7fe428067b50 2023-10-06T03:07:01.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe42cfea700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe428156ee0 con 0x7fe4280af320 2023-10-06T03:07:01.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe42cfea700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4280c4640 con 0x7fe4280cc5a0 2023-10-06T03:07:01.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe42659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe428067b50 0x7fe428169920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe42659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe428067b50 0x7fe428169920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35058/0 (socket says 172.21.15.125:35058) 2023-10-06T03:07:01.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe42659c700 1 -- 172.21.15.125:0/2144820681 learned_addr learned my addr 172.21.15.125:0/2144820681 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:01.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe425d9b700 1 --2- 172.21.15.125:0/2144820681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4280af320 0x7fe4281569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe426d9d700 1 --2- 172.21.15.125:0/2144820681 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4280cc5a0 0x7fe4280c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe42659c700 1 -- 172.21.15.125:0/2144820681 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4280cc5a0 msgr2=0x7fe4280c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.025 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe42659c700 1 --2- 172.21.15.125:0/2144820681 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4280cc5a0 0x7fe4280c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe42659c700 1 -- 172.21.15.125:0/2144820681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4280af320 msgr2=0x7fe4281569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe42659c700 1 --2- 172.21.15.125:0/2144820681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4280af320 0x7fe4281569a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe42659c700 1 -- 172.21.15.125:0/2144820681 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c009480 con 0x7fe428067b50 2023-10-06T03:07:01.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe426d9d700 1 --2- 172.21.15.125:0/2144820681 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4280cc5a0 0x7fe4280c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:07:01.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe42659c700 1 --2- 172.21.15.125:0/2144820681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe428067b50 0x7fe428169920 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00b3c0 tx=0x7fe41c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:01.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe4167fc700 1 -- 172.21.15.125:0/2144820681 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c011b30 con 0x7fe428067b50 2023-10-06T03:07:01.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe4167fc700 1 -- 172.21.15.125:0/2144820681 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c011c90 con 0x7fe428067b50 2023-10-06T03:07:01.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe42cfea700 1 -- 172.21.15.125:0/2144820681 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4280c4920 con 0x7fe428067b50 2023-10-06T03:07:01.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe4167fc700 1 -- 172.21.15.125:0/2144820681 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c01b660 con 0x7fe428067b50 2023-10-06T03:07:01.026 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.018+0000 7fe42cfea700 1 -- 172.21.15.125:0/2144820681 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4280c4ee0 con 0x7fe428067b50 2023-10-06T03:07:01.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.019+0000 7fe42cfea700 1 -- 172.21.15.125:0/2144820681 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe428066510 con 0x7fe428067b50 2023-10-06T03:07:01.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.020+0000 7fe4167fc700 1 -- 172.21.15.125:0/2144820681 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe41c01ba90 con 0x7fe428067b50 2023-10-06T03:07:01.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.020+0000 7fe4167fc700 1 --2- 172.21.15.125:0/2144820681 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe408066f30 0x7fe4080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.020+0000 7fe4167fc700 1 -- 172.21.15.125:0/2144820681 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fe41c085e00 con 0x7fe428067b50 2023-10-06T03:07:01.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.020+0000 7fe425d9b700 1 --2- 172.21.15.125:0/2144820681 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe408066f30 0x7fe4080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.020+0000 7fe425d9b700 1 --2- 172.21.15.125:0/2144820681 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe408066f30 0x7fe4080693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe418006fd0 tx=0x7fe418008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:01.027 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.024+0000 7fe4167fc700 1 -- 172.21.15.125:0/2144820681 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe41c0530d0 con 0x7fe428067b50 2023-10-06T03:07:01.207 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.206+0000 7fe42cfea700 1 -- 172.21.15.125:0/2144820681 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4280cac90 con 0x7fe428067b50 2023-10-06T03:07:01.208 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.206+0000 7fe4167fc700 1 -- 172.21.15.125:0/2144820681 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+14131 (secure 0 0 0) 0x7fe41c02a020 con 0x7fe428067b50 2023-10-06T03:07:01.208 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:07:01.208 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":60,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:06:59.315240+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:6837/1751632854":"2023-10-07T03:06:56.153997+0000","172.21.15.125:6835/1751632854":"2023-10-07T03:06:56.153997+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:07:01.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.208+0000 7fe42cfea700 1 -- 172.21.15.125:0/2144820681 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe408066f30 msgr2=0x7fe4080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.208+0000 7fe42cfea700 1 --2- 172.21.15.125:0/2144820681 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe408066f30 0x7fe4080693e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe418006fd0 tx=0x7fe418008040 comp rx=0 tx=0).stop 2023-10-06T03:07:01.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.208+0000 7fe42cfea700 1 -- 172.21.15.125:0/2144820681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe428067b50 msgr2=0x7fe428169920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.210 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.208+0000 7fe42cfea700 1 --2- 172.21.15.125:0/2144820681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe428067b50 0x7fe428169920 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00b3c0 tx=0x7fe41c016000 comp rx=0 tx=0).stop 2023-10-06T03:07:01.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.208+0000 7fe42cfea700 1 -- 172.21.15.125:0/2144820681 shutdown_connections 2023-10-06T03:07:01.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.208+0000 7fe42cfea700 1 --2- 172.21.15.125:0/2144820681 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe408066f30 0x7fe4080693e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.208+0000 7fe42cfea700 1 --2- 172.21.15.125:0/2144820681 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe4280cc5a0 0x7fe4280c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.208+0000 7fe42cfea700 1 --2- 172.21.15.125:0/2144820681 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe428067b50 0x7fe428169920 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.208+0000 7fe42cfea700 1 --2- 172.21.15.125:0/2144820681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe4280af320 0x7fe4281569a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.208+0000 7fe42cfea700 1 -- 172.21.15.125:0/2144820681 >> 172.21.15.125:0/2144820681 conn(0x7fe428068f00 msgr2=0x7fe4280c2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:01.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.208+0000 7fe42cfea700 1 -- 172.21.15.125:0/2144820681 shutdown_connections 2023-10-06T03:07:01.211 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.209+0000 7fe42cfea700 1 -- 172.21.15.125:0/2144820681 wait complete. 2023-10-06T03:07:01.222 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T03:07:01.222 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:07:01.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.337+0000 7fa35cc25700 1 Processor -- start 2023-10-06T03:07:01.339 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.337+0000 7fa35cc25700 1 -- start start 2023-10-06T03:07:01.344 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.339+0000 7fa35cc25700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa358155670 0x7fa3581592e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.339+0000 7fa35cc25700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fa35806f070 0x7fa3580ace80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.339+0000 7fa35cc25700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa358068290 con 0x7fa3580ad3c0 2023-10-06T03:07:01.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.339+0000 7fa35cc25700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa358159930 con 0x7fa358155670 2023-10-06T03:07:01.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.339+0000 7fa35cc25700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa358159c10 con 0x7fa35806f070 2023-10-06T03:07:01.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.339+0000 7fa35659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa358155670 0x7fa3581592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.339+0000 7fa35659c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fa358155670 0x7fa3581592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35062/0 (socket says 172.21.15.125:35062) 2023-10-06T03:07:01.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.339+0000 7fa35659c700 1 -- 172.21.15.125:0/3962513310 learned_addr learned my addr 172.21.15.125:0/3962513310 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:01.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.339+0000 7fa355d9b700 1 --2- 172.21.15.125:0/3962513310 >> v2:172.21.15.130:3300/0 conn(0x7fa35806f070 0x7fa3580ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.339+0000 7fa35659c700 1 -- 172.21.15.125:0/3962513310 >> v2:172.21.15.130:3300/0 conn(0x7fa35806f070 msgr2=0x7fa3580ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:01.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.339+0000 7fa35659c700 1 --2- 172.21.15.125:0/3962513310 >> v2:172.21.15.130:3300/0 conn(0x7fa35806f070 0x7fa3580ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.345 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.339+0000 7fa35659c700 1 -- 172.21.15.125:0/3962513310 >> v1:172.21.15.130:6789/0 conn(0x7fa3580ad3c0 legacy=0x7fa35806a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:01.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.339+0000 7fa35659c700 1 -- 172.21.15.125:0/3962513310 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa358159ef0 con 0x7fa358155670 2023-10-06T03:07:01.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.339+0000 7fa35659c700 1 --2- 172.21.15.125:0/3962513310 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa358155670 0x7fa3581592e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa35806fa30 tx=0x7fa34c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7093e8953ac735ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:01.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.339+0000 7fa35559a700 1 -- 172.21.15.125:0/3962513310 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c00b820 con 0x7fa358155670 2023-10-06T03:07:01.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.339+0000 7fa35559a700 1 -- 172.21.15.125:0/3962513310 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c00b980 con 0x7fa358155670 2023-10-06T03:07:01.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.339+0000 7fa35559a700 1 -- 172.21.15.125:0/3962513310 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c00bd20 con 0x7fa358155670 2023-10-06T03:07:01.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.340+0000 7fa35cc25700 1 -- 172.21.15.125:0/3962513310 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa358155670 msgr2=0x7fa3581592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.340+0000 7fa35cc25700 1 --2- 172.21.15.125:0/3962513310 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa358155670 0x7fa3581592e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fa35806fa30 tx=0x7fa34c009250 comp rx=0 tx=0).stop 2023-10-06T03:07:01.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.340+0000 7fa35cc25700 1 -- 172.21.15.125:0/3962513310 shutdown_connections 2023-10-06T03:07:01.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.340+0000 7fa35cc25700 1 --2- 172.21.15.125:0/3962513310 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa358155670 0x7fa3581592e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.340+0000 7fa35cc25700 1 --2- 172.21.15.125:0/3962513310 >> v2:172.21.15.130:3300/0 conn(0x7fa35806f070 0x7fa3580ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.340+0000 7fa35cc25700 1 -- 172.21.15.125:0/3962513310 >> 172.21.15.125:0/3962513310 conn(0x7fa3580cc5a0 msgr2=0x7fa3580cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:01.346 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.340+0000 7fa35cc25700 1 -- 172.21.15.125:0/3962513310 shutdown_connections 2023-10-06T03:07:01.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.340+0000 7fa35cc25700 1 -- 172.21.15.125:0/3962513310 wait complete. 2023-10-06T03:07:01.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.341+0000 7fa35cc25700 1 Processor -- start 2023-10-06T03:07:01.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.341+0000 7fa35cc25700 1 -- start start 2023-10-06T03:07:01.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.342+0000 7fa35cc25700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa35806f070 0x7fa3580b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.342+0000 7fa35cc25700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3580ad3c0 0x7fa358149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.342+0000 7fa35cc25700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa358155670 0x7fa358149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.342+0000 7fa35cc25700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3580b0320 con 0x7fa3580ad3c0 2023-10-06T03:07:01.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.342+0000 7fa35cc25700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3580b19c0 con 0x7fa35806f070 2023-10-06T03:07:01.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.342+0000 7fa35cc25700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3580afd10 con 0x7fa358155670 2023-10-06T03:07:01.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.342+0000 7fa355d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3580ad3c0 0x7fa358149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.342+0000 7fa355d9b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3580ad3c0 0x7fa358149200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35068/0 (socket says 172.21.15.125:35068) 2023-10-06T03:07:01.347 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.342+0000 7fa355d9b700 1 -- 172.21.15.125:0/2609133426 learned_addr learned my addr 172.21.15.125:0/2609133426 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:01.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.342+0000 7fa35659c700 1 --2- 172.21.15.125:0/2609133426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa35806f070 0x7fa3580b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.342+0000 7fa355d9b700 1 -- 172.21.15.125:0/2609133426 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa358155670 msgr2=0x7fa358149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.342+0000 7fa356d9d700 1 --2- 172.21.15.125:0/2609133426 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa358155670 0x7fa358149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.342+0000 7fa355d9b700 1 --2- 172.21.15.125:0/2609133426 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa358155670 0x7fa358149740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.342+0000 7fa355d9b700 1 -- 172.21.15.125:0/2609133426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa35806f070 msgr2=0x7fa3580b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.342+0000 7fa355d9b700 1 --2- 172.21.15.125:0/2609133426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa35806f070 0x7fa3580b07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.342+0000 7fa355d9b700 1 -- 172.21.15.125:0/2609133426 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa34c0094f0 con 0x7fa3580ad3c0 2023-10-06T03:07:01.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.342+0000 7fa355d9b700 1 --2- 172.21.15.125:0/2609133426 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3580ad3c0 0x7fa358149200 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa34800d890 tx=0x7fa348008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:01.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.342+0000 7fa3467fc700 1 -- 172.21.15.125:0/2609133426 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3480125f0 con 0x7fa3580ad3c0 2023-10-06T03:07:01.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.343+0000 7fa3467fc700 1 -- 172.21.15.125:0/2609133426 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa348012770 con 0x7fa3580ad3c0 2023-10-06T03:07:01.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.343+0000 7fa35cc25700 1 -- 172.21.15.125:0/2609133426 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3580b1c60 con 0x7fa3580ad3c0 2023-10-06T03:07:01.348 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.343+0000 7fa3467fc700 1 -- 172.21.15.125:0/2609133426 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348012b30 con 0x7fa3580ad3c0 2023-10-06T03:07:01.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.343+0000 7fa35cc25700 1 -- 172.21.15.125:0/2609133426 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3580affb0 con 0x7fa3580ad3c0 2023-10-06T03:07:01.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.343+0000 7fa35cc25700 1 -- 172.21.15.125:0/2609133426 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3580b2180 con 0x7fa3580ad3c0 2023-10-06T03:07:01.349 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.344+0000 7fa3467fc700 1 -- 172.21.15.125:0/2609133426 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa34801e460 con 0x7fa3580ad3c0 2023-10-06T03:07:01.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.344+0000 7fa3467fc700 1 --2- 172.21.15.125:0/2609133426 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa338066f30 0x7fa3380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.344+0000 7fa3467fc700 1 -- 172.21.15.125:0/2609133426 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fa348084bf0 con 0x7fa3580ad3c0 2023-10-06T03:07:01.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.344+0000 7fa35659c700 1 --2- 172.21.15.125:0/2609133426 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa338066f30 0x7fa3380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.345+0000 7fa35659c700 1 --2- 172.21.15.125:0/2609133426 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa338066f30 0x7fa3380693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa35806fa30 tx=0x7fa34c016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:01.350 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.348+0000 7fa3467fc700 1 -- 172.21.15.125:0/2609133426 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa348051ec0 con 0x7fa3580ad3c0 2023-10-06T03:07:01.528 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.527+0000 7fa35cc25700 1 -- 172.21.15.125:0/2609133426 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa358066510 con 0x7fa338066f30 2023-10-06T03:07:01.531 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.530+0000 7fa3467fc700 1 -- 172.21.15.125:0/2609133426 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72448 (secure 0 0 0) 0x7fa358066510 con 0x7fa338066f30 2023-10-06T03:07:01.532 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:07:01.533 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.532+0000 7fa35cc25700 1 -- 172.21.15.125:0/2609133426 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa338066f30 msgr2=0x7fa3380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.532+0000 7fa35cc25700 1 --2- 172.21.15.125:0/2609133426 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa338066f30 0x7fa3380693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa35806fa30 tx=0x7fa34c016000 comp rx=0 tx=0).stop 2023-10-06T03:07:01.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.532+0000 7fa35cc25700 1 -- 172.21.15.125:0/2609133426 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3580ad3c0 msgr2=0x7fa358149200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.532+0000 7fa35cc25700 1 --2- 172.21.15.125:0/2609133426 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3580ad3c0 0x7fa358149200 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa34800d890 tx=0x7fa348008040 comp rx=0 tx=0).stop 2023-10-06T03:07:01.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.532+0000 7fa35cc25700 1 -- 172.21.15.125:0/2609133426 shutdown_connections 2023-10-06T03:07:01.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.532+0000 7fa35cc25700 1 --2- 172.21.15.125:0/2609133426 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fa338066f30 0x7fa3380693e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.532+0000 7fa35cc25700 1 --2- 172.21.15.125:0/2609133426 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fa358155670 0x7fa358149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.534 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.532+0000 7fa35cc25700 1 --2- 172.21.15.125:0/2609133426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa35806f070 0x7fa3580b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.532+0000 7fa35cc25700 1 --2- 172.21.15.125:0/2609133426 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fa3580ad3c0 0x7fa358149200 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.532+0000 7fa35cc25700 1 -- 172.21.15.125:0/2609133426 >> 172.21.15.125:0/2609133426 conn(0x7fa3580cc5a0 msgr2=0x7fa3580ca180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:01.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.532+0000 7fa35cc25700 1 -- 172.21.15.125:0/2609133426 shutdown_connections 2023-10-06T03:07:01.535 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.532+0000 7fa35cc25700 1 -- 172.21.15.125:0/2609133426 wait complete. 2023-10-06T03:07:01.535 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-06T03:07:01.545 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2023-10-06T03:06:59.839486+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384892,"kb_used_data":6588,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589828,"statfs":{"total":773094113280,"available":770651983872,"internally_reserved":0,"allocated":6746112,"data_stored":3754157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12290,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-55,"num_write_kb":-30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001085"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.614836+0000","last_change":"2023-10-06T03:04:23.986472+0000","last_active":"2023-10-06T03:06:21.614836+0000","last_peered":"2023-10-06T03:06:21.614836+0000","last_clean":"2023-10-06T03:06:21.614836+0000","last_became_active":"2023-10-06T03:04:23.986228+0000","last_became_peered":"2023-10-06T03:04:23.986228+0000","last_unstale":"2023-10-06T03:06:21.614836+0000","last_undegraded":"2023-10-06T03:06:21.614836+0000","last_fullsized":"2023-10-06T03:06:21.614836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:08.739849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.616107+0000","last_change":"2023-10-06T03:04:23.814917+0000","last_active":"2023-10-06T03:06:21.616107+0000","last_peered":"2023-10-06T03:06:21.616107+0000","last_clean":"2023-10-06T03:06:21.616107+0000","last_became_active":"2023-10-06T03:04:23.814601+0000","last_became_peered":"2023-10-06T03:04:23.814601+0000","last_unstale":"2023-10-06T03:06:21.616107+0000","last_undegraded":"2023-10-06T03:06:21.616107+0000","last_fullsized":"2023-10-06T03:06:21.616107+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.627857+0000","last_change":"2023-10-06T03:04:24.314547+0000","last_active":"2023-10-06T03:06:21.627857+0000","last_peered":"2023-10-06T03:06:21.627857+0000","last_clean":"2023-10-06T03:06:21.627857+0000","last_became_active":"2023-10-06T03:04:24.314278+0000","last_became_peered":"2023-10-06T03:04:24.314278+0000","last_unstale":"2023-10-06T03:06:21.627857+0000","last_undegraded":"2023-10-06T03:06:21.627857+0000","last_fullsized":"2023-10-06T03:06:21.627857+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:25.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.616072+0000","last_change":"2023-10-06T03:04:23.807972+0000","last_active":"2023-10-06T03:06:21.616072+0000","last_peered":"2023-10-06T03:06:21.616072+0000","last_clean":"2023-10-06T03:06:21.616072+0000","last_became_active":"2023-10-06T03:04:23.807723+0000","last_became_peered":"2023-10-06T03:04:23.807723+0000","last_unstale":"2023-10-06T03:06:21.616072+0000","last_undegraded":"2023-10-06T03:06:21.616072+0000","last_fullsized":"2023-10-06T03:06:21.616072+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":195,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.626680+0000","last_change":"2023-10-06T03:04:17.779925+0000","last_active":"2023-10-06T03:06:21.626680+0000","last_peered":"2023-10-06T03:06:21.626680+0000","last_clean":"2023-10-06T03:06:21.626680+0000","last_became_active":"2023-10-06T03:04:17.778997+0000","last_became_peered":"2023-10-06T03:04:17.778997+0000","last_unstale":"2023-10-06T03:06:21.626680+0000","last_undegraded":"2023-10-06T03:06:21.626680+0000","last_fullsized":"2023-10-06T03:06:21.626680+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_clean_scrub_stamp":"2023-10-06T03:04:16.761610+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.622473+0000","last_change":"2023-10-06T03:04:23.814887+0000","last_active":"2023-10-06T03:06:21.622473+0000","last_peered":"2023-10-06T03:06:21.622473+0000","last_clean":"2023-10-06T03:06:21.622473+0000","last_became_active":"2023-10-06T03:04:23.814581+0000","last_became_peered":"2023-10-06T03:04:23.814581+0000","last_unstale":"2023-10-06T03:06:21.622473+0000","last_undegraded":"2023-10-06T03:06:21.622473+0000","last_fullsized":"2023-10-06T03:06:21.622473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.637056+0000","last_change":"2023-10-06T03:04:23.986771+0000","last_active":"2023-10-06T03:06:21.637056+0000","last_peered":"2023-10-06T03:06:21.637056+0000","last_clean":"2023-10-06T03:06:21.637056+0000","last_became_active":"2023-10-06T03:04:23.986552+0000","last_became_peered":"2023-10-06T03:04:23.986552+0000","last_unstale":"2023-10-06T03:06:21.637056+0000","last_undegraded":"2023-10-06T03:06:21.637056+0000","last_fullsized":"2023-10-06T03:06:21.637056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":45,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.614562+0000","last_change":"2023-10-06T03:04:23.813862+0000","last_active":"2023-10-06T03:06:21.614562+0000","last_peered":"2023-10-06T03:06:21.614562+0000","last_clean":"2023-10-06T03:06:21.614562+0000","last_became_active":"2023-10-06T03:04:23.813584+0000","last_became_peered":"2023-10-06T03:04:23.813584+0000","last_unstale":"2023-10-06T03:06:21.614562+0000","last_undegraded":"2023-10-06T03:06:21.614562+0000","last_fullsized":"2023-10-06T03:06:21.614562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T03:06:21.622611+0000","last_change":"2023-10-06T03:04:23.805874+0000","last_active":"2023-10-06T03:06:21.622611+0000","last_peered":"2023-10-06T03:06:21.622611+0000","last_clean":"2023-10-06T03:06:21.622611+0000","last_became_active":"2023-10-06T03:04:23.805551+0000","last_became_peered":"2023-10-06T03:04:23.805551+0000","last_unstale":"2023-10-06T03:06:21.622611+0000","last_undegraded":"2023-10-06T03:06:21.622611+0000","last_fullsized":"2023-10-06T03:06:21.622611+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:21.250275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298552,"kb_used_data":1264,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073288,"statfs":{"total":96636764160,"available":96331046912,"internally_reserved":0,"allocated":1294336,"data_stored":909275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.629,"15min":0.64300000000000002},"min":{"1min":0.318,"5min":0.314,"15min":0.314},"max":{"1min":0.69999999999999996,"5min":3.8860000000000001,"15min":3.8860000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.64900000000000002,"15min":0.66400000000000003},"min":{"1min":0.38700000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.69699999999999995,"5min":3.988,"15min":3.988},"last":0.54200000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.65200000000000002,"15min":0.67000000000000004},"min":{"1min":0.36199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.81899999999999995,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.64800000000000002,"15min":0.66400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73099999999999998,"5min":3.444,"15min":3.444},"last":0.442}]},{"osd":2,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.67000000000000004,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78800000000000003,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.501},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85599999999999998,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.63200000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.68799999999999994,"15min":0.70599999999999996},"min":{"1min":0.45600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.73099999999999998,"5min":3.903,"15min":3.903},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.71499999999999997,"15min":0.73399999999999999},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.746,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":0.52200000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46800000000000003,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.55700000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.38800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65400000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.55400000000000005}]},{"osd":5,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.64000000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.68000000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59899999999999998,"15min":0.60399999999999998},"min":{"1min":0.46600000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.71399999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79100000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.64200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574883,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297960,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073880,"statfs":{"total":96636764160,"available":96331653120,"internally_reserved":0,"allocated":688128,"data_stored":318193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.79700000000000004,"15min":0.84299999999999997},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77200000000000002,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.501,"5min":0.83699999999999997,"15min":0.89300000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.64600000000000002,"5min":6.8330000000000002,"15min":6.8330000000000002},"last":0.60099999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.71599999999999997,"15min":0.74399999999999999},"min":{"1min":0.34899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.72299999999999998,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.73899999999999999,"15min":0.76500000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":3.948,"15min":3.948},"last":0.55700000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.754,"15min":0.754},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.75800000000000001,"5min":3.996,"15min":3.996},"last":0.54400000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.435},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.71799999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.52400000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.34399999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.36499999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.49399999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.50600000000000001,"15min":0.499},"min":{"1min":0.40999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.58899999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.443,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.46600000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.57599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297996,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073844,"statfs":{"total":96636764160,"available":96331616256,"internally_reserved":0,"allocated":724992,"data_stored":332705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.38700000000000001,"15min":0.39700000000000002},"min":{"1min":0.20999999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.50900000000000001,"5min":1.159,"15min":1.159},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.375,"15min":0.379},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46999999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.58999999999999997,"15min":0.63200000000000001},"min":{"1min":0.254,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.44500000000000001,"5min":6.056,"15min":6.056},"last":0.378},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57499999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.435}]},{"osd":3,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.44800000000000001,"15min":0.45500000000000002},"min":{"1min":0.27700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.502,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.443,"15min":0.45100000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.56000000000000005,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.42499999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.46800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.77800000000000002,"5min":1.244,"15min":1.244},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.495,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":1.216,"15min":1.216},"last":0.71299999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.628,"15min":0.624},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82899999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.627,"15min":0.627},"min":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.76800000000000002,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.72199999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89200000000000002,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85699999999999998,"5min":1.014,"15min":1.014},"last":0.621}]},{"osd":7,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":1.099,"15min":1.099},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.79800000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.69099999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298532,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073308,"statfs":{"total":96636764160,"available":96331067392,"internally_reserved":0,"allocated":1273856,"data_stored":907516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.30099999999999999,"15min":0.29299999999999998},"min":{"1min":0.23599999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.34000000000000002,"15min":0.33400000000000002},"min":{"1min":0.28499999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.373}]},{"osd":2,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"min":{"1min":0.23200000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"min":{"1min":0.26000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.33600000000000002}]},{"osd":3,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.32400000000000001},"min":{"1min":0.26000000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":1.056},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.371,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.44900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.46600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":1.319}]},{"osd":5,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.39400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":1.3779999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.46999999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82299999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.46300000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.434,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.45400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":1.353}]}]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297956,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073884,"statfs":{"total":96636764160,"available":96331657216,"internally_reserved":0,"allocated":684032,"data_stored":318159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.80100000000000005,"15min":0.88400000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.437,"5min":12.913,"15min":12.913},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.316,"5min":0.36799999999999999,"15min":0.377},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.49199999999999999,"5min":0.997,"15min":0.997},"last":0.28299999999999997}]},{"osd":1,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.51200000000000001,"15min":0.53900000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53000000000000003,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54900000000000004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.32700000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.36199999999999999,"15min":0.36799999999999999},"min":{"1min":0.252,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46200000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.88,"15min":0.96399999999999997},"min":{"1min":0.29199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57299999999999995,"5min":12.941000000000001,"15min":12.941000000000001},"last":0.35799999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":1.042,"15min":1.1200000000000001},"min":{"1min":0.40600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.76900000000000002,"5min":12.846,"15min":12.846},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.62,"15min":0.622},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.75900000000000001,"5min":1.046,"15min":1.046},"last":0.64800000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76900000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.58799999999999997,"5min":1.0620000000000001,"15min":1.141},"min":{"1min":0.47999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72799999999999998,"5min":12.884,"15min":12.884},"last":0.58499999999999996}]},{"osd":6,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77100000000000002,"5min":1.071,"15min":1.071},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.62,"15min":0.622},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.73199999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.72999999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77000000000000002,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.65500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297956,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073884,"statfs":{"total":96636764160,"available":96331657216,"internally_reserved":0,"allocated":684032,"data_stored":318159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.373,"15min":0.38400000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55000000000000004,"5min":1.361,"15min":1.361},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.311,"5min":0.34899999999999998,"15min":0.35499999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.51200000000000001,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.29099999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.376,"15min":0.38300000000000001},"min":{"1min":0.20699999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53400000000000003,"5min":1.133,"15min":1.133},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.375,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.27800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66100000000000003,"5min":1.45,"15min":1.45},"last":0.34899999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57399999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.373,"5min":0.433,"15min":0.443},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59499999999999997,"5min":1.476,"15min":1.476},"last":0.314}]},{"osd":4,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.38100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":1.649,"15min":1.649},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80200000000000005,"5min":1.054,"15min":1.054},"last":0.59899999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77300000000000002,"5min":1.401,"15min":1.401},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77800000000000002,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78000000000000003,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.46200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83399999999999996,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81999999999999995,"5min":1.679,"15min":1.679},"last":0.626},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80300000000000005,"5min":1.083,"15min":1.083},"last":0.56499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574883,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297980,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073860,"statfs":{"total":96636764160,"available":96331632640,"internally_reserved":0,"allocated":708608,"data_stored":331969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52000000000000002,"15min":0.51100000000000001},"min":{"1min":0.376,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.41099999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84999999999999998,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.52600000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82699999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80400000000000005,"5min":0.875,"15min":0.875},"last":0.42799999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.42699999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.502}]},{"osd":3,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90200000000000002,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.66300000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83899999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.33900000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.64800000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.57799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297960,"kb_used_data":672,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073880,"statfs":{"total":96636764160,"available":96331653120,"internally_reserved":0,"allocated":688128,"data_stored":318181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68500000000000005,"5min":1.012,"15min":1.012},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74399999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.497}]},{"osd":1,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70599999999999996,"5min":1.03,"15min":1.03},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.71399999999999997,"5min":0.755,"15min":0.755},"last":0.64000000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55400000000000005,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.76800000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.71899999999999997,"5min":0.998,"15min":0.998},"last":0.66100000000000003}]},{"osd":3,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.58299999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.69599999999999995,"5min":1.048,"15min":1.048},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72799999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.625}]},{"osd":4,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.75}]},{"osd":6,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.40500000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.745,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61699999999999999,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.76200000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.34200000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69199999999999995,"5min":0.872,"15min":0.872},"last":0.84099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:07:01.547 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:07:01.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.664+0000 7f7d410a6700 1 Processor -- start 2023-10-06T03:07:01.666 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.664+0000 7f7d410a6700 1 -- start start 2023-10-06T03:07:01.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.665+0000 7f7d410a6700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f7d3c0cc4b0 0x7f7d3c0c85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.665+0000 7f7d410a6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3c0c4230 con 0x7f7d3c0ce8a0 2023-10-06T03:07:01.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.665+0000 7f7d410a6700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3c0cd290 con 0x7f7d3c0c3d30 2023-10-06T03:07:01.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.665+0000 7f7d410a6700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d3c0cd570 con 0x7f7d3c0cc4b0 2023-10-06T03:07:01.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.665+0000 7f7d3a59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7d3c0ce8a0 0x7f7d3c0cc880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40494/0 (socket says 172.21.15.125:40494) 2023-10-06T03:07:01.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.665+0000 7f7d3a59c700 1 -- 172.21.15.125:0/1138788370 learned_addr learned my addr 172.21.15.125:0/1138788370 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:07:01.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.665+0000 7f7d3ad9d700 1 --2- 172.21.15.125:0/1138788370 >> v2:172.21.15.130:3300/0 conn(0x7f7d3c0cc4b0 0x7f7d3c0c85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.665+0000 7f7d39d9b700 1 -- 172.21.15.125:0/1138788370 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988343530 0 0) 0x7f7d3c0c4230 con 0x7f7d3c0ce8a0 2023-10-06T03:07:01.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.665+0000 7f7d39d9b700 1 -- 172.21.15.125:0/1138788370 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d24003570 con 0x7f7d3c0ce8a0 2023-10-06T03:07:01.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.665+0000 7f7d39d9b700 1 -- 172.21.15.125:0/1138788370 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1553429811 0 0) 0x7f7d24003570 con 0x7f7d3c0ce8a0 2023-10-06T03:07:01.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.665+0000 7f7d39d9b700 1 -- 172.21.15.125:0/1138788370 >> v2:172.21.15.130:3300/0 conn(0x7f7d3c0cc4b0 msgr2=0x7f7d3c0c85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:01.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.665+0000 7f7d39d9b700 1 --2- 172.21.15.125:0/1138788370 >> v2:172.21.15.130:3300/0 conn(0x7f7d3c0cc4b0 0x7f7d3c0c85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d39d9b700 1 -- 172.21.15.125:0/1138788370 >> v1:172.21.15.130:6789/0 conn(0x7f7d3c0c3d30 legacy=0x7f7d3c069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d39d9b700 1 -- 172.21.15.125:0/1138788370 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3c0ccf90 con 0x7f7d3c0ce8a0 2023-10-06T03:07:01.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d39d9b700 1 -- 172.21.15.125:0/1138788370 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f7d2c001470 con 0x7f7d3c0ce8a0 2023-10-06T03:07:01.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d39d9b700 1 -- 172.21.15.125:0/1138788370 >> v1:172.21.15.125:6789/0 conn(0x7f7d3c0ce8a0 legacy=0x7f7d3c0cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d39d9b700 1 --2- 172.21.15.125:0/1138788370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d24003a60 0x7f7d24003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d39d9b700 1 --2- 172.21.15.125:0/1138788370 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d24004810 0x7f7d24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d39d9b700 1 --2- 172.21.15.125:0/1138788370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d240051c0 0x7f7d2400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d39d9b700 1 -- 172.21.15.125:0/1138788370 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c0cd570 con 0x7f7d240051c0 2023-10-06T03:07:01.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d39d9b700 1 -- 172.21.15.125:0/1138788370 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2400c0d0 con 0x7f7d24003a60 2023-10-06T03:07:01.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d39d9b700 1 -- 172.21.15.125:0/1138788370 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2400c290 con 0x7f7d24004810 2023-10-06T03:07:01.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d3b59e700 1 --2- 172.21.15.125:0/1138788370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d240051c0 0x7f7d2400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d3ad9d700 1 --2- 172.21.15.125:0/1138788370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d24003a60 0x7f7d24003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d3a59c700 1 --2- 172.21.15.125:0/1138788370 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d24004810 0x7f7d24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d3b59e700 1 -- 172.21.15.125:0/1138788370 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d24004810 msgr2=0x7f7d24004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:01.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d3b59e700 1 --2- 172.21.15.125:0/1138788370 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d24004810 0x7f7d24004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d3b59e700 1 -- 172.21.15.125:0/1138788370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d24003a60 msgr2=0x7f7d24003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:01.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d3b59e700 1 --2- 172.21.15.125:0/1138788370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d24003a60 0x7f7d24003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d3b59e700 1 -- 172.21.15.125:0/1138788370 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d24003570 con 0x7f7d240051c0 2023-10-06T03:07:01.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d3b59e700 1 -- 172.21.15.125:0/1138788370 reap_dead start 2023-10-06T03:07:01.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d3b59e700 1 --2- 172.21.15.125:0/1138788370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d240051c0 0x7f7d2400ba60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7d34001fc0 tx=0x7f7d34001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6e9720bb510316 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:01.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d39d9b700 1 -- 172.21.15.125:0/1138788370 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d34001950 con 0x7f7d240051c0 2023-10-06T03:07:01.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d39d9b700 1 -- 172.21.15.125:0/1138788370 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3400c8b0 con 0x7f7d240051c0 2023-10-06T03:07:01.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.666+0000 7f7d39d9b700 1 -- 172.21.15.125:0/1138788370 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3400cc90 con 0x7f7d240051c0 2023-10-06T03:07:01.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.667+0000 7f7d410a6700 1 -- 172.21.15.125:0/1138788370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d240051c0 msgr2=0x7f7d2400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.667+0000 7f7d410a6700 1 --2- 172.21.15.125:0/1138788370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d240051c0 0x7f7d2400ba60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7d34001fc0 tx=0x7f7d34001640 comp rx=0 tx=0).stop 2023-10-06T03:07:01.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.667+0000 7f7d410a6700 1 -- 172.21.15.125:0/1138788370 shutdown_connections 2023-10-06T03:07:01.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.667+0000 7f7d410a6700 1 --2- 172.21.15.125:0/1138788370 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d240051c0 0x7f7d2400ba60 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.667+0000 7f7d410a6700 1 -- 172.21.15.125:0/1138788370 >> 172.21.15.125:0/1138788370 conn(0x7f7d3c067df0 msgr2=0x7f7d3c0cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:01.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.667+0000 7f7d410a6700 1 -- 172.21.15.125:0/1138788370 shutdown_connections 2023-10-06T03:07:01.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.667+0000 7f7d410a6700 1 -- 172.21.15.125:0/1138788370 wait complete. 2023-10-06T03:07:01.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.668+0000 7f7d410a6700 1 Processor -- start 2023-10-06T03:07:01.674 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.668+0000 7f7d410a6700 1 -- start start 2023-10-06T03:07:01.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.669+0000 7f7d410a6700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d240051c0 0x7f7d3c1564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.669+0000 7f7d410a6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d3c156c60 0x7f7d3c169360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.669+0000 7f7d410a6700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d3c1698a0 0x7f7d3c169d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.669+0000 7f7d410a6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c0c5360 con 0x7f7d3c156c60 2023-10-06T03:07:01.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.669+0000 7f7d410a6700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c16a250 con 0x7f7d3c1698a0 2023-10-06T03:07:01.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.669+0000 7f7d410a6700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c0b28a0 con 0x7f7d240051c0 2023-10-06T03:07:01.676 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.669+0000 7f7d3a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d3c156c60 0x7f7d3c169360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.669+0000 7f7d3a59c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d3c156c60 0x7f7d3c169360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35092/0 (socket says 172.21.15.125:35092) 2023-10-06T03:07:01.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.669+0000 7f7d3a59c700 1 -- 172.21.15.125:0/3682067024 learned_addr learned my addr 172.21.15.125:0/3682067024 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:01.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.669+0000 7f7d3b59e700 1 --2- 172.21.15.125:0/3682067024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d3c1698a0 0x7f7d3c169d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.669+0000 7f7d3ad9d700 1 --2- 172.21.15.125:0/3682067024 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d240051c0 0x7f7d3c1564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.669+0000 7f7d3a59c700 1 -- 172.21.15.125:0/3682067024 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d240051c0 msgr2=0x7f7d3c1564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.669+0000 7f7d3a59c700 1 --2- 172.21.15.125:0/3682067024 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d240051c0 0x7f7d3c1564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.669+0000 7f7d3a59c700 1 -- 172.21.15.125:0/3682067024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d3c1698a0 msgr2=0x7f7d3c169d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.669+0000 7f7d3a59c700 1 --2- 172.21.15.125:0/3682067024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d3c1698a0 0x7f7d3c169d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.669+0000 7f7d3a59c700 1 -- 172.21.15.125:0/3682067024 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3c0b2b80 con 0x7f7d3c156c60 2023-10-06T03:07:01.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.670+0000 7f7d3a59c700 1 --2- 172.21.15.125:0/3682067024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d3c156c60 0x7f7d3c169360 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c0073c0 tx=0x7f7d2c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:01.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.670+0000 7f7d22ffd700 1 -- 172.21.15.125:0/3682067024 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c011590 con 0x7f7d3c156c60 2023-10-06T03:07:01.677 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.670+0000 7f7d22ffd700 1 -- 172.21.15.125:0/3682067024 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c011710 con 0x7f7d3c156c60 2023-10-06T03:07:01.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.670+0000 7f7d410a6700 1 -- 172.21.15.125:0/3682067024 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d3c0b2e60 con 0x7f7d3c156c60 2023-10-06T03:07:01.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.670+0000 7f7d22ffd700 1 -- 172.21.15.125:0/3682067024 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c011ad0 con 0x7f7d3c156c60 2023-10-06T03:07:01.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.670+0000 7f7d410a6700 1 -- 172.21.15.125:0/3682067024 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d3c0b3420 con 0x7f7d3c156c60 2023-10-06T03:07:01.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.671+0000 7f7d410a6700 1 -- 172.21.15.125:0/3682067024 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d3c0c6880 con 0x7f7d3c156c60 2023-10-06T03:07:01.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.671+0000 7f7d22ffd700 1 -- 172.21.15.125:0/3682067024 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d2c01d460 con 0x7f7d3c156c60 2023-10-06T03:07:01.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.671+0000 7f7d22ffd700 1 --2- 172.21.15.125:0/3682067024 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7d28066f30 0x7f7d280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.671+0000 7f7d22ffd700 1 -- 172.21.15.125:0/3682067024 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f7d2c084550 con 0x7f7d3c156c60 2023-10-06T03:07:01.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.672+0000 7f7d3ad9d700 1 --2- 172.21.15.125:0/3682067024 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7d28066f30 0x7f7d280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.678 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.672+0000 7f7d3ad9d700 1 --2- 172.21.15.125:0/3682067024 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7d28066f30 0x7f7d280693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7d30006f00 tx=0x7f7d300091a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:01.679 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.676+0000 7f7d22ffd700 1 -- 172.21.15.125:0/3682067024 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d2c051820 con 0x7f7d3c156c60 2023-10-06T03:07:01.855 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.853+0000 7f7d410a6700 1 -- 172.21.15.125:0/3682067024 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d3c066510 con 0x7f7d28066f30 2023-10-06T03:07:01.857 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.856+0000 7f7d22ffd700 1 -- 172.21.15.125:0/3682067024 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72558 (secure 0 0 0) 0x7f7d3c066510 con 0x7f7d28066f30 2023-10-06T03:07:01.858 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:07:01.859 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.858+0000 7f7d410a6700 1 -- 172.21.15.125:0/3682067024 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7d28066f30 msgr2=0x7f7d280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.858+0000 7f7d410a6700 1 --2- 172.21.15.125:0/3682067024 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7d28066f30 0x7f7d280693e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7d30006f00 tx=0x7f7d300091a0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.858+0000 7f7d410a6700 1 -- 172.21.15.125:0/3682067024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d3c156c60 msgr2=0x7f7d3c169360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.858+0000 7f7d410a6700 1 --2- 172.21.15.125:0/3682067024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d3c156c60 0x7f7d3c169360 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c0073c0 tx=0x7f7d2c001e50 comp rx=0 tx=0).stop 2023-10-06T03:07:01.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.858+0000 7f7d410a6700 1 -- 172.21.15.125:0/3682067024 shutdown_connections 2023-10-06T03:07:01.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.858+0000 7f7d410a6700 1 --2- 172.21.15.125:0/3682067024 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7d28066f30 0x7f7d280693e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.858+0000 7f7d410a6700 1 --2- 172.21.15.125:0/3682067024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7d3c1698a0 0x7f7d3c169d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.858+0000 7f7d410a6700 1 --2- 172.21.15.125:0/3682067024 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7d240051c0 0x7f7d3c1564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.858+0000 7f7d410a6700 1 --2- 172.21.15.125:0/3682067024 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7d3c156c60 0x7f7d3c169360 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.858+0000 7f7d410a6700 1 -- 172.21.15.125:0/3682067024 >> 172.21.15.125:0/3682067024 conn(0x7f7d3c067df0 msgr2=0x7f7d3c0cc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:01.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.858+0000 7f7d410a6700 1 -- 172.21.15.125:0/3682067024 shutdown_connections 2023-10-06T03:07:01.860 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.858+0000 7f7d410a6700 1 -- 172.21.15.125:0/3682067024 wait complete. 2023-10-06T03:07:01.861 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-06T03:07:01.871 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2023-10-06T03:07:01.839769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":117,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2385140,"kb_used_data":6836,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589580,"statfs":{"total":773094113280,"available":770651729920,"internally_reserved":0,"allocated":7000064,"data_stored":3875827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-16691,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-58,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001014"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.158497+0000","last_change":"2023-10-06T03:04:23.986472+0000","last_active":"2023-10-06T03:06:59.158497+0000","last_peered":"2023-10-06T03:06:59.158497+0000","last_clean":"2023-10-06T03:06:59.158497+0000","last_became_active":"2023-10-06T03:04:23.986228+0000","last_became_peered":"2023-10-06T03:04:23.986228+0000","last_unstale":"2023-10-06T03:06:59.158497+0000","last_undegraded":"2023-10-06T03:06:59.158497+0000","last_fullsized":"2023-10-06T03:06:59.158497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:08.739849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.158189+0000","last_change":"2023-10-06T03:04:23.814917+0000","last_active":"2023-10-06T03:06:59.158189+0000","last_peered":"2023-10-06T03:06:59.158189+0000","last_clean":"2023-10-06T03:06:59.158189+0000","last_became_active":"2023-10-06T03:04:23.814601+0000","last_became_peered":"2023-10-06T03:04:23.814601+0000","last_unstale":"2023-10-06T03:06:59.158189+0000","last_undegraded":"2023-10-06T03:06:59.158189+0000","last_fullsized":"2023-10-06T03:06:59.158189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:58.746846+0000","last_change":"2023-10-06T03:04:24.314547+0000","last_active":"2023-10-06T03:06:58.746846+0000","last_peered":"2023-10-06T03:06:58.746846+0000","last_clean":"2023-10-06T03:06:58.746846+0000","last_became_active":"2023-10-06T03:04:24.314278+0000","last_became_peered":"2023-10-06T03:04:24.314278+0000","last_unstale":"2023-10-06T03:06:58.746846+0000","last_undegraded":"2023-10-06T03:06:58.746846+0000","last_fullsized":"2023-10-06T03:06:58.746846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:25.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.158166+0000","last_change":"2023-10-06T03:04:23.807972+0000","last_active":"2023-10-06T03:06:59.158166+0000","last_peered":"2023-10-06T03:06:59.158166+0000","last_clean":"2023-10-06T03:06:59.158166+0000","last_became_active":"2023-10-06T03:04:23.807723+0000","last_became_peered":"2023-10-06T03:04:23.807723+0000","last_unstale":"2023-10-06T03:06:59.158166+0000","last_undegraded":"2023-10-06T03:06:59.158166+0000","last_fullsized":"2023-10-06T03:06:59.158166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":198,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.157774+0000","last_change":"2023-10-06T03:04:17.779925+0000","last_active":"2023-10-06T03:06:59.157774+0000","last_peered":"2023-10-06T03:06:59.157774+0000","last_clean":"2023-10-06T03:06:59.157774+0000","last_became_active":"2023-10-06T03:04:17.778997+0000","last_became_peered":"2023-10-06T03:04:17.778997+0000","last_unstale":"2023-10-06T03:06:59.157774+0000","last_undegraded":"2023-10-06T03:06:59.157774+0000","last_fullsized":"2023-10-06T03:06:59.157774+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_clean_scrub_stamp":"2023-10-06T03:04:16.761610+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.157661+0000","last_change":"2023-10-06T03:04:23.814887+0000","last_active":"2023-10-06T03:06:59.157661+0000","last_peered":"2023-10-06T03:06:59.157661+0000","last_clean":"2023-10-06T03:06:59.157661+0000","last_became_active":"2023-10-06T03:04:23.814581+0000","last_became_peered":"2023-10-06T03:04:23.814581+0000","last_unstale":"2023-10-06T03:06:59.157661+0000","last_undegraded":"2023-10-06T03:06:59.157661+0000","last_fullsized":"2023-10-06T03:06:59.157661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.160835+0000","last_change":"2023-10-06T03:04:23.986771+0000","last_active":"2023-10-06T03:06:59.160835+0000","last_peered":"2023-10-06T03:06:59.160835+0000","last_clean":"2023-10-06T03:06:59.160835+0000","last_became_active":"2023-10-06T03:04:23.986552+0000","last_became_peered":"2023-10-06T03:04:23.986552+0000","last_unstale":"2023-10-06T03:06:59.160835+0000","last_undegraded":"2023-10-06T03:06:59.160835+0000","last_fullsized":"2023-10-06T03:06:59.160835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.157357+0000","last_change":"2023-10-06T03:04:23.813862+0000","last_active":"2023-10-06T03:06:59.157357+0000","last_peered":"2023-10-06T03:06:59.157357+0000","last_clean":"2023-10-06T03:06:59.157357+0000","last_became_active":"2023-10-06T03:04:23.813584+0000","last_became_peered":"2023-10-06T03:04:23.813584+0000","last_unstale":"2023-10-06T03:06:59.157357+0000","last_undegraded":"2023-10-06T03:06:59.157357+0000","last_fullsized":"2023-10-06T03:06:59.157357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:58.317986+0000","last_change":"2023-10-06T03:04:23.805874+0000","last_active":"2023-10-06T03:06:58.317986+0000","last_peered":"2023-10-06T03:06:58.317986+0000","last_clean":"2023-10-06T03:06:58.317986+0000","last_became_active":"2023-10-06T03:04:23.805551+0000","last_became_peered":"2023-10-06T03:04:23.805551+0000","last_unstale":"2023-10-06T03:06:58.317986+0000","last_undegraded":"2023-10-06T03:06:58.317986+0000","last_fullsized":"2023-10-06T03:06:58.317986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:21.250275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1323008,"data_stored":928159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.629,"15min":0.64300000000000002},"min":{"1min":0.318,"5min":0.314,"15min":0.314},"max":{"1min":0.69999999999999996,"5min":3.8860000000000001,"15min":3.8860000000000001},"last":0.497},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.64900000000000002,"15min":0.66400000000000003},"min":{"1min":0.38700000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.69699999999999995,"5min":3.988,"15min":3.988},"last":0.51500000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.65200000000000002,"15min":0.67000000000000004},"min":{"1min":0.36199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.81899999999999995,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.64800000000000002,"15min":0.66400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73099999999999998,"5min":3.444,"15min":3.444},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.67000000000000004,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78800000000000003,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85599999999999998,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.32900000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.68799999999999994,"15min":0.70599999999999996},"min":{"1min":0.45600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.73099999999999998,"5min":3.903,"15min":3.903},"last":0.309},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.71499999999999997,"15min":0.73399999999999999},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.746,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46800000000000003,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.55700000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.38800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65400000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.45100000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.64000000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59899999999999998,"15min":0.60399999999999998},"min":{"1min":0.46600000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.71399999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79100000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.79700000000000004,"15min":0.84299999999999997},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77200000000000002,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.83699999999999997,"15min":0.89300000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.64600000000000002,"5min":6.8330000000000002,"15min":6.8330000000000002},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.71599999999999997,"15min":0.74399999999999999},"min":{"1min":0.34899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.72299999999999998,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.505},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.73899999999999999,"15min":0.76500000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":3.948,"15min":3.948},"last":0.68300000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.754,"15min":0.754},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.75800000000000001,"5min":3.996,"15min":3.996},"last":0.56599999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.71799999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.34399999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.63},{"interface":"front","average":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.36499999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.50600000000000001,"15min":0.499},"min":{"1min":0.40999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.443,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.749},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.46600000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.38700000000000001,"15min":0.39700000000000002},"min":{"1min":0.20999999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.50900000000000001,"5min":1.159,"15min":1.159},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.375,"15min":0.379},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46999999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.34699999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.58999999999999997,"15min":0.63200000000000001},"min":{"1min":0.254,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.44500000000000001,"5min":6.056,"15min":6.056},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57499999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.44800000000000001,"15min":0.45500000000000002},"min":{"1min":0.27700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.502,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.443,"15min":0.45100000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.56000000000000005,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.25900000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.46800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.77800000000000002,"5min":1.244,"15min":1.244},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.495,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":1.216,"15min":1.216},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.628,"15min":0.624},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82899999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.627,"15min":0.627},"min":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.76800000000000002,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89200000000000002,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85699999999999998,"5min":1.014,"15min":1.014},"last":0.69199999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":1.099,"15min":1.099},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.79800000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.59499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298576,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073264,"statfs":{"total":96636764160,"available":96331022336,"internally_reserved":0,"allocated":1318912,"data_stored":927148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.30099999999999999,"15min":0.29299999999999998},"min":{"1min":0.23599999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.34000000000000002,"15min":0.33400000000000002},"min":{"1min":0.28499999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.40300000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"min":{"1min":0.23200000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"min":{"1min":0.26000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.36199999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.32400000000000001},"min":{"1min":0.26000000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.371,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.379}]},{"osd":4,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.44900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.46600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.54900000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.39400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.49299999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82299999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.46300000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61499999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.434,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.45400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.60099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.80100000000000005,"15min":0.88400000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.437,"5min":12.913,"15min":12.913},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.316,"5min":0.36799999999999999,"15min":0.377},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.49199999999999999,"5min":0.997,"15min":0.997},"last":0.29799999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.51200000000000001,"15min":0.53900000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53000000000000003,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54900000000000004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.34599999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.36199999999999999,"15min":0.36799999999999999},"min":{"1min":0.252,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46200000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.88,"15min":0.96399999999999997},"min":{"1min":0.29199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57299999999999995,"5min":12.941000000000001,"15min":12.941000000000001},"last":0.317}]},{"osd":4,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":1.042,"15min":1.1200000000000001},"min":{"1min":0.40600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.76900000000000002,"5min":12.846,"15min":12.846},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.62,"15min":0.622},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.75900000000000001,"5min":1.046,"15min":1.046},"last":0.41399999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76900000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":1.0620000000000001,"15min":1.141},"min":{"1min":0.47999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72799999999999998,"5min":12.884,"15min":12.884},"last":0.442}]},{"osd":6,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77100000000000002,"5min":1.071,"15min":1.071},"last":0.499},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.62,"15min":0.622},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.73199999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.42399999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.72999999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.433},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77000000000000002,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.49099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297984,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073856,"statfs":{"total":96636764160,"available":96331628544,"internally_reserved":0,"allocated":712704,"data_stored":331565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.373,"15min":0.38400000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55000000000000004,"5min":1.361,"15min":1.361},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.34899999999999998,"15min":0.35499999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.51200000000000001,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.26200000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.376,"15min":0.38300000000000001},"min":{"1min":0.20699999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53400000000000003,"5min":1.133,"15min":1.133},"last":0.373},{"interface":"front","average":{"1min":0.375,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.27800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66100000000000003,"5min":1.45,"15min":1.45},"last":0.441}]},{"osd":2,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57399999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.433,"15min":0.443},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59499999999999997,"5min":1.476,"15min":1.476},"last":0.35099999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.38100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":1.649,"15min":1.649},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80200000000000005,"5min":1.054,"15min":1.054},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77300000000000002,"5min":1.401,"15min":1.401},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77800000000000002,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78000000000000003,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.504},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.46200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83399999999999996,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81999999999999995,"5min":1.679,"15min":1.679},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80300000000000005,"5min":1.083,"15min":1.083},"last":0.54300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52000000000000002,"15min":0.51100000000000001},"min":{"1min":0.376,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.41099999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84999999999999998,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.72899999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82699999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80400000000000005,"5min":0.875,"15min":0.875},"last":0.753}]},{"osd":2,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.42699999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90200000000000002,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.64000000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83899999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.33900000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68500000000000005,"5min":1.012,"15min":1.012},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74399999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.442}]},{"osd":1,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70599999999999996,"5min":1.03,"15min":1.03},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.71399999999999997,"5min":0.755,"15min":0.755},"last":0.42599999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55400000000000005,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.76800000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.71899999999999997,"5min":0.998,"15min":0.998},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.58299999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.69599999999999995,"5min":1.048,"15min":1.048},"last":0.373},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72799999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.40500000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.745,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61699999999999999,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.76200000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.34200000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69199999999999995,"5min":0.872,"15min":0.872},"last":0.67200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:07:01.873 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T03:07:01.874 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:07:01.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.989+0000 7fe5fe4f7700 1 Processor -- start 2023-10-06T03:07:01.991 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.989+0000 7fe5fe4f7700 1 -- start start 2023-10-06T03:07:01.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.990+0000 7fe5fe4f7700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe5f8157050 0x7fe5f80ab7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.993 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.990+0000 7fe5fe4f7700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5f80abd00 0x7fe5f806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.990+0000 7fe5fe4f7700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f80acdb0 con 0x7fe5f806ae00 2023-10-06T03:07:01.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.990+0000 7fe5fe4f7700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f806b280 con 0x7fe5f8157050 2023-10-06T03:07:01.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.990+0000 7fe5fe4f7700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80b0380 con 0x7fe5f80abd00 2023-10-06T03:07:01.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.990+0000 7fe5f7fff700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe5f8157050 0x7fe5f80ab7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.990+0000 7fe5f77fe700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5f80abd00 0x7fe5f806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.990+0000 7fe5f7fff700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fe5f8157050 0x7fe5f80ab7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.125:58498/0 (socket says 172.21.15.125:58498) 2023-10-06T03:07:01.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.990+0000 7fe5fca94700 1 --1- >> v1:172.21.15.130:6789/0 conn(0x7fe5f806ae00 0x7fe5f806e7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.130:6789/0 says I am v1:172.21.15.125:55890/0 (socket says 172.21.15.125:55890) 2023-10-06T03:07:01.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.990+0000 7fe5f77fe700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5f80abd00 0x7fe5f806a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3301/0 says I am v2:172.21.15.125:50800/0 (socket says 172.21.15.125:50800) 2023-10-06T03:07:01.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.990+0000 7fe5f7fff700 1 -- 172.21.15.125:0/841573697 learned_addr learned my addr 172.21.15.125:0/841573697 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:01.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.991+0000 7fe5f7fff700 1 -- 172.21.15.125:0/841573697 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5f80abd00 msgr2=0x7fe5f806a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:01.994 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.991+0000 7fe5f7fff700 1 --2- 172.21.15.125:0/841573697 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5f80abd00 0x7fe5f806a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.991+0000 7fe5f7fff700 1 -- 172.21.15.125:0/841573697 >> v1:172.21.15.130:6789/0 conn(0x7fe5f806ae00 legacy=0x7fe5f806e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.991+0000 7fe5f7fff700 1 -- 172.21.15.125:0/841573697 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f8157420 con 0x7fe5f8157050 2023-10-06T03:07:01.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.991+0000 7fe5f6ffd700 1 -- 172.21.15.125:0/841573697 <== mon.1 v1:172.21.15.130:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358983914 0 0) 0x7fe5f80acdb0 con 0x7fe5f806ae00 2023-10-06T03:07:01.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.991+0000 7fe5f7fff700 1 --2- 172.21.15.125:0/841573697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5f8157050 0x7fe5f80ab7c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80099b0 tx=0x7fe5e8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c7181ec0e4d5bc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:01.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.991+0000 7fe5f6ffd700 1 -- 172.21.15.125:0/841573697 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8009ea0 con 0x7fe5f8157050 2023-10-06T03:07:01.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.991+0000 7fe5f6ffd700 1 -- 172.21.15.125:0/841573697 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e800b860 con 0x7fe5f8157050 2023-10-06T03:07:01.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.991+0000 7fe5f6ffd700 1 -- 172.21.15.125:0/841573697 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e800bc00 con 0x7fe5f8157050 2023-10-06T03:07:01.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.991+0000 7fe5fe4f7700 1 -- 172.21.15.125:0/841573697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5f8157050 msgr2=0x7fe5f80ab7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.991+0000 7fe5fe4f7700 1 --2- 172.21.15.125:0/841573697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5f8157050 0x7fe5f80ab7c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80099b0 tx=0x7fe5e8009250 comp rx=0 tx=0).stop 2023-10-06T03:07:01.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.991+0000 7fe5fe4f7700 1 -- 172.21.15.125:0/841573697 shutdown_connections 2023-10-06T03:07:01.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.991+0000 7fe5fe4f7700 1 --2- 172.21.15.125:0/841573697 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5f8157050 0x7fe5f80ab7c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.995 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.992+0000 7fe5fe4f7700 1 --2- 172.21.15.125:0/841573697 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5f80abd00 0x7fe5f806a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.992+0000 7fe5fe4f7700 1 -- 172.21.15.125:0/841573697 >> 172.21.15.125:0/841573697 conn(0x7fe5f80cc5a0 msgr2=0x7fe5f80cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:01.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.992+0000 7fe5fe4f7700 1 -- 172.21.15.125:0/841573697 shutdown_connections 2023-10-06T03:07:01.996 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.992+0000 7fe5fe4f7700 1 -- 172.21.15.125:0/841573697 wait complete. 2023-10-06T03:07:01.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.993+0000 7fe5fe4f7700 1 Processor -- start 2023-10-06T03:07:01.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.993+0000 7fe5fe4f7700 1 -- start start 2023-10-06T03:07:01.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.993+0000 7fe5fe4f7700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5f806ae00 0x7fe5f814bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.993+0000 7fe5fe4f7700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f80abd00 0x7fe5f80c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.998 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.993+0000 7fe5fe4f7700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5f8157050 0x7fe5f80a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:01.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.993+0000 7fe5fe4f7700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80a49f0 con 0x7fe5f80abd00 2023-10-06T03:07:01.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.993+0000 7fe5fe4f7700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80a4cd0 con 0x7fe5f806ae00 2023-10-06T03:07:01.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.993+0000 7fe5fe4f7700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f80a4fb0 con 0x7fe5f8157050 2023-10-06T03:07:01.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.994+0000 7fe5f77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f80abd00 0x7fe5f80c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.994+0000 7fe5f77fe700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f80abd00 0x7fe5f80c5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35102/0 (socket says 172.21.15.125:35102) 2023-10-06T03:07:01.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.994+0000 7fe5f77fe700 1 -- 172.21.15.125:0/3542663151 learned_addr learned my addr 172.21.15.125:0/3542663151 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:01.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.994+0000 7fe5fca94700 1 --2- 172.21.15.125:0/3542663151 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5f8157050 0x7fe5f80a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.994+0000 7fe5f7fff700 1 --2- 172.21.15.125:0/3542663151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5f806ae00 0x7fe5f814bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:01.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.994+0000 7fe5f77fe700 1 -- 172.21.15.125:0/3542663151 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5f8157050 msgr2=0x7fe5f80a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.994+0000 7fe5f77fe700 1 --2- 172.21.15.125:0/3542663151 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5f8157050 0x7fe5f80a7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:01.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.994+0000 7fe5f77fe700 1 -- 172.21.15.125:0/3542663151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5f806ae00 msgr2=0x7fe5f814bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:01.999 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.994+0000 7fe5f77fe700 1 --2- 172.21.15.125:0/3542663151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5f806ae00 0x7fe5f814bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:02.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.994+0000 7fe5f77fe700 1 -- 172.21.15.125:0/3542663151 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e80094f0 con 0x7fe5f80abd00 2023-10-06T03:07:02.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.994+0000 7fe5f77fe700 1 --2- 172.21.15.125:0/3542663151 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f80abd00 0x7fe5f80c5740 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000ec80 tx=0x7fe5e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:02.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.994+0000 7fe5effff700 1 -- 172.21.15.125:0/3542663151 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e000c9d0 con 0x7fe5f80abd00 2023-10-06T03:07:02.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.994+0000 7fe5effff700 1 -- 172.21.15.125:0/3542663151 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e000cb30 con 0x7fe5f80abd00 2023-10-06T03:07:02.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.994+0000 7fe5fe4f7700 1 -- 172.21.15.125:0/3542663151 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f80a5290 con 0x7fe5f80abd00 2023-10-06T03:07:02.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.994+0000 7fe5effff700 1 -- 172.21.15.125:0/3542663151 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0013470 con 0x7fe5f80abd00 2023-10-06T03:07:02.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.994+0000 7fe5fe4f7700 1 -- 172.21.15.125:0/3542663151 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f80a4630 con 0x7fe5f80abd00 2023-10-06T03:07:02.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.995+0000 7fe5fe4f7700 1 -- 172.21.15.125:0/3542663151 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f8066510 con 0x7fe5f80abd00 2023-10-06T03:07:02.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.996+0000 7fe5effff700 1 -- 172.21.15.125:0/3542663151 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe5e0013820 con 0x7fe5f80abd00 2023-10-06T03:07:02.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.996+0000 7fe5effff700 1 --2- 172.21.15.125:0/3542663151 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe5d8066f30 0x7fe5d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:02.000 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.996+0000 7fe5effff700 1 -- 172.21.15.125:0/3542663151 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fe5e0084860 con 0x7fe5f80abd00 2023-10-06T03:07:02.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.996+0000 7fe5f7fff700 1 --2- 172.21.15.125:0/3542663151 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe5d8066f30 0x7fe5d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:02.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:01.996+0000 7fe5f7fff700 1 --2- 172.21.15.125:0/3542663151 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe5d8066f30 0x7fe5d80693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80099b0 tx=0x7fe5e8017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:02.001 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.000+0000 7fe5effff700 1 -- 172.21.15.125:0/3542663151 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5e0051b30 con 0x7fe5f80abd00 2023-10-06T03:07:02.177 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.176+0000 7fe5fe4f7700 1 -- 172.21.15.125:0/3542663151 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe5f80ac1a0 con 0x7fe5d8066f30 2023-10-06T03:07:02.180 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.178+0000 7fe5effff700 1 -- 172.21.15.125:0/3542663151 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72558 (secure 0 0 0) 0x7fe5f80ac1a0 con 0x7fe5d8066f30 2023-10-06T03:07:02.181 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:07:02.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.181+0000 7fe5fe4f7700 1 -- 172.21.15.125:0/3542663151 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe5d8066f30 msgr2=0x7fe5d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:02.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.181+0000 7fe5fe4f7700 1 --2- 172.21.15.125:0/3542663151 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe5d8066f30 0x7fe5d80693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80099b0 tx=0x7fe5e8017000 comp rx=0 tx=0).stop 2023-10-06T03:07:02.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.181+0000 7fe5fe4f7700 1 -- 172.21.15.125:0/3542663151 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f80abd00 msgr2=0x7fe5f80c5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:02.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.181+0000 7fe5fe4f7700 1 --2- 172.21.15.125:0/3542663151 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f80abd00 0x7fe5f80c5740 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe5e000ec80 tx=0x7fe5e00091a0 comp rx=0 tx=0).stop 2023-10-06T03:07:02.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.181+0000 7fe5fe4f7700 1 -- 172.21.15.125:0/3542663151 shutdown_connections 2023-10-06T03:07:02.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.181+0000 7fe5fe4f7700 1 --2- 172.21.15.125:0/3542663151 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe5d8066f30 0x7fe5d80693e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:02.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.181+0000 7fe5fe4f7700 1 --2- 172.21.15.125:0/3542663151 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe5f8157050 0x7fe5f80a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:02.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.181+0000 7fe5fe4f7700 1 --2- 172.21.15.125:0/3542663151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe5f806ae00 0x7fe5f814bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:02.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.181+0000 7fe5fe4f7700 1 --2- 172.21.15.125:0/3542663151 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe5f80abd00 0x7fe5f80c5740 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:02.183 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.181+0000 7fe5fe4f7700 1 -- 172.21.15.125:0/3542663151 >> 172.21.15.125:0/3542663151 conn(0x7fe5f80cc5a0 msgr2=0x7fe5f8068040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:02.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.181+0000 7fe5fe4f7700 1 -- 172.21.15.125:0/3542663151 shutdown_connections 2023-10-06T03:07:02.184 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.181+0000 7fe5fe4f7700 1 -- 172.21.15.125:0/3542663151 wait complete. 2023-10-06T03:07:02.184 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-06T03:07:02.194 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":136,"stamp":"2023-10-06T03:07:01.839769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":117,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2385140,"kb_used_data":6836,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589580,"statfs":{"total":773094113280,"available":770651729920,"internally_reserved":0,"allocated":7000064,"data_stored":3875827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-16691,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-58,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001014"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.158497+0000","last_change":"2023-10-06T03:04:23.986472+0000","last_active":"2023-10-06T03:06:59.158497+0000","last_peered":"2023-10-06T03:06:59.158497+0000","last_clean":"2023-10-06T03:06:59.158497+0000","last_became_active":"2023-10-06T03:04:23.986228+0000","last_became_peered":"2023-10-06T03:04:23.986228+0000","last_unstale":"2023-10-06T03:06:59.158497+0000","last_undegraded":"2023-10-06T03:06:59.158497+0000","last_fullsized":"2023-10-06T03:06:59.158497+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:08.739849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.158189+0000","last_change":"2023-10-06T03:04:23.814917+0000","last_active":"2023-10-06T03:06:59.158189+0000","last_peered":"2023-10-06T03:06:59.158189+0000","last_clean":"2023-10-06T03:06:59.158189+0000","last_became_active":"2023-10-06T03:04:23.814601+0000","last_became_peered":"2023-10-06T03:04:23.814601+0000","last_unstale":"2023-10-06T03:06:59.158189+0000","last_undegraded":"2023-10-06T03:06:59.158189+0000","last_fullsized":"2023-10-06T03:06:59.158189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:58.746846+0000","last_change":"2023-10-06T03:04:24.314547+0000","last_active":"2023-10-06T03:06:58.746846+0000","last_peered":"2023-10-06T03:06:58.746846+0000","last_clean":"2023-10-06T03:06:58.746846+0000","last_became_active":"2023-10-06T03:04:24.314278+0000","last_became_peered":"2023-10-06T03:04:24.314278+0000","last_unstale":"2023-10-06T03:06:58.746846+0000","last_undegraded":"2023-10-06T03:06:58.746846+0000","last_fullsized":"2023-10-06T03:06:58.746846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:25.354548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.158166+0000","last_change":"2023-10-06T03:04:23.807972+0000","last_active":"2023-10-06T03:06:59.158166+0000","last_peered":"2023-10-06T03:06:59.158166+0000","last_clean":"2023-10-06T03:06:59.158166+0000","last_became_active":"2023-10-06T03:04:23.807723+0000","last_became_peered":"2023-10-06T03:04:23.807723+0000","last_unstale":"2023-10-06T03:06:59.158166+0000","last_undegraded":"2023-10-06T03:06:59.158166+0000","last_fullsized":"2023-10-06T03:06:59.158166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":198,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.157774+0000","last_change":"2023-10-06T03:04:17.779925+0000","last_active":"2023-10-06T03:06:59.157774+0000","last_peered":"2023-10-06T03:06:59.157774+0000","last_clean":"2023-10-06T03:06:59.157774+0000","last_became_active":"2023-10-06T03:04:17.778997+0000","last_became_peered":"2023-10-06T03:04:17.778997+0000","last_unstale":"2023-10-06T03:06:59.157774+0000","last_undegraded":"2023-10-06T03:06:59.157774+0000","last_fullsized":"2023-10-06T03:06:59.157774+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_clean_scrub_stamp":"2023-10-06T03:04:16.761610+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.157661+0000","last_change":"2023-10-06T03:04:23.814887+0000","last_active":"2023-10-06T03:06:59.157661+0000","last_peered":"2023-10-06T03:06:59.157661+0000","last_clean":"2023-10-06T03:06:59.157661+0000","last_became_active":"2023-10-06T03:04:23.814581+0000","last_became_peered":"2023-10-06T03:04:23.814581+0000","last_unstale":"2023-10-06T03:06:59.157661+0000","last_undegraded":"2023-10-06T03:06:59.157661+0000","last_fullsized":"2023-10-06T03:06:59.157661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.160835+0000","last_change":"2023-10-06T03:04:23.986771+0000","last_active":"2023-10-06T03:06:59.160835+0000","last_peered":"2023-10-06T03:06:59.160835+0000","last_clean":"2023-10-06T03:06:59.160835+0000","last_became_active":"2023-10-06T03:04:23.986552+0000","last_became_peered":"2023-10-06T03:04:23.986552+0000","last_unstale":"2023-10-06T03:06:59.160835+0000","last_undegraded":"2023-10-06T03:06:59.160835+0000","last_fullsized":"2023-10-06T03:06:59.160835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.157357+0000","last_change":"2023-10-06T03:04:23.813862+0000","last_active":"2023-10-06T03:06:59.157357+0000","last_peered":"2023-10-06T03:06:59.157357+0000","last_clean":"2023-10-06T03:06:59.157357+0000","last_became_active":"2023-10-06T03:04:23.813584+0000","last_became_peered":"2023-10-06T03:04:23.813584+0000","last_unstale":"2023-10-06T03:06:59.157357+0000","last_undegraded":"2023-10-06T03:06:59.157357+0000","last_fullsized":"2023-10-06T03:06:59.157357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:58.317986+0000","last_change":"2023-10-06T03:04:23.805874+0000","last_active":"2023-10-06T03:06:58.317986+0000","last_peered":"2023-10-06T03:06:58.317986+0000","last_clean":"2023-10-06T03:06:58.317986+0000","last_became_active":"2023-10-06T03:04:23.805551+0000","last_became_peered":"2023-10-06T03:04:23.805551+0000","last_unstale":"2023-10-06T03:06:58.317986+0000","last_undegraded":"2023-10-06T03:06:58.317986+0000","last_fullsized":"2023-10-06T03:06:58.317986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:21.250275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1323008,"data_stored":928159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.629,"15min":0.64300000000000002},"min":{"1min":0.318,"5min":0.314,"15min":0.314},"max":{"1min":0.69999999999999996,"5min":3.8860000000000001,"15min":3.8860000000000001},"last":0.497},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.64900000000000002,"15min":0.66400000000000003},"min":{"1min":0.38700000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.69699999999999995,"5min":3.988,"15min":3.988},"last":0.51500000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.65200000000000002,"15min":0.67000000000000004},"min":{"1min":0.36199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.81899999999999995,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.64800000000000002,"15min":0.66400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73099999999999998,"5min":3.444,"15min":3.444},"last":0.46899999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.67000000000000004,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78800000000000003,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85599999999999998,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.32900000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.68799999999999994,"15min":0.70599999999999996},"min":{"1min":0.45600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.73099999999999998,"5min":3.903,"15min":3.903},"last":0.309},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.71499999999999997,"15min":0.73399999999999999},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.746,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46800000000000003,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.55700000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.38800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65400000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.45100000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.64000000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59899999999999998,"15min":0.60399999999999998},"min":{"1min":0.46600000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.71399999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79100000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.48399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.79700000000000004,"15min":0.84299999999999997},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77200000000000002,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.83699999999999997,"15min":0.89300000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.64600000000000002,"5min":6.8330000000000002,"15min":6.8330000000000002},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.71599999999999997,"15min":0.74399999999999999},"min":{"1min":0.34899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.72299999999999998,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.505},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.73899999999999999,"15min":0.76500000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":3.948,"15min":3.948},"last":0.68300000000000005}]},{"osd":2,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.754,"15min":0.754},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.75800000000000001,"5min":3.996,"15min":3.996},"last":0.56599999999999995}]},{"osd":3,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.71799999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.34399999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.63},{"interface":"front","average":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.36499999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.50600000000000001,"15min":0.499},"min":{"1min":0.40999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.443,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.749},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.46600000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.64600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.38700000000000001,"15min":0.39700000000000002},"min":{"1min":0.20999999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.50900000000000001,"5min":1.159,"15min":1.159},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.375,"15min":0.379},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46999999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.34699999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.58999999999999997,"15min":0.63200000000000001},"min":{"1min":0.254,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.44500000000000001,"5min":6.056,"15min":6.056},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57499999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.44800000000000001,"15min":0.45500000000000002},"min":{"1min":0.27700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.502,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.443,"15min":0.45100000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.56000000000000005,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.25900000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.46800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.77800000000000002,"5min":1.244,"15min":1.244},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.495,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":1.216,"15min":1.216},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.628,"15min":0.624},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82899999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.627,"15min":0.627},"min":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.76800000000000002,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89200000000000002,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85699999999999998,"5min":1.014,"15min":1.014},"last":0.69199999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":1.099,"15min":1.099},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.79800000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.59499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298576,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073264,"statfs":{"total":96636764160,"available":96331022336,"internally_reserved":0,"allocated":1318912,"data_stored":927148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.30099999999999999,"15min":0.29299999999999998},"min":{"1min":0.23599999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.34000000000000002,"15min":0.33400000000000002},"min":{"1min":0.28499999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.40300000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"min":{"1min":0.23200000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"min":{"1min":0.26000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.36199999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.32400000000000001},"min":{"1min":0.26000000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.371,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.379}]},{"osd":4,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.44900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.46600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.54900000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.39400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.49299999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82299999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.46300000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61499999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.434,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.45400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.60099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.80100000000000005,"15min":0.88400000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.437,"5min":12.913,"15min":12.913},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.316,"5min":0.36799999999999999,"15min":0.377},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.49199999999999999,"5min":0.997,"15min":0.997},"last":0.29799999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.51200000000000001,"15min":0.53900000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53000000000000003,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54900000000000004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.34599999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.36199999999999999,"15min":0.36799999999999999},"min":{"1min":0.252,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46200000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.88,"15min":0.96399999999999997},"min":{"1min":0.29199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57299999999999995,"5min":12.941000000000001,"15min":12.941000000000001},"last":0.317}]},{"osd":4,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":1.042,"15min":1.1200000000000001},"min":{"1min":0.40600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.76900000000000002,"5min":12.846,"15min":12.846},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.62,"15min":0.622},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.75900000000000001,"5min":1.046,"15min":1.046},"last":0.41399999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76900000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":1.0620000000000001,"15min":1.141},"min":{"1min":0.47999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72799999999999998,"5min":12.884,"15min":12.884},"last":0.442}]},{"osd":6,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77100000000000002,"5min":1.071,"15min":1.071},"last":0.499},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.62,"15min":0.622},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.73199999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.42399999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.72999999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.433},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77000000000000002,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.49099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297984,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073856,"statfs":{"total":96636764160,"available":96331628544,"internally_reserved":0,"allocated":712704,"data_stored":331565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.373,"15min":0.38400000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55000000000000004,"5min":1.361,"15min":1.361},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.311,"5min":0.34899999999999998,"15min":0.35499999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.51200000000000001,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.26200000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.376,"15min":0.38300000000000001},"min":{"1min":0.20699999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53400000000000003,"5min":1.133,"15min":1.133},"last":0.373},{"interface":"front","average":{"1min":0.375,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.27800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66100000000000003,"5min":1.45,"15min":1.45},"last":0.441}]},{"osd":2,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57399999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.433,"15min":0.443},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59499999999999997,"5min":1.476,"15min":1.476},"last":0.35099999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.38100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":1.649,"15min":1.649},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80200000000000005,"5min":1.054,"15min":1.054},"last":0.57599999999999996}]},{"osd":5,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77300000000000002,"5min":1.401,"15min":1.401},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77800000000000002,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78000000000000003,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.504},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.46200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83399999999999996,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81999999999999995,"5min":1.679,"15min":1.679},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80300000000000005,"5min":1.083,"15min":1.083},"last":0.54300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52000000000000002,"15min":0.51100000000000001},"min":{"1min":0.376,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.41099999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84999999999999998,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.72899999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82699999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80400000000000005,"5min":0.875,"15min":0.875},"last":0.753}]},{"osd":2,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.42699999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90200000000000002,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.64000000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83899999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.33900000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.61099999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.58299999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68500000000000005,"5min":1.012,"15min":1.012},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74399999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.442}]},{"osd":1,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70599999999999996,"5min":1.03,"15min":1.03},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.71399999999999997,"5min":0.755,"15min":0.755},"last":0.42599999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55400000000000005,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.76800000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.71899999999999997,"5min":0.998,"15min":0.998},"last":0.50600000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.58299999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.69599999999999995,"5min":1.048,"15min":1.048},"last":0.373},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72799999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.61599999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.40500000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.745,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61699999999999999,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.76200000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.34200000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69199999999999995,"5min":0.872,"15min":0.872},"last":0.67200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:07:02.196 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T03:07:02.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.311+0000 7f0009c7f700 1 Processor -- start 2023-10-06T03:07:02.313 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.311+0000 7f0009c7f700 1 -- start start 2023-10-06T03:07:02.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.312+0000 7f0009c7f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00040ac670 0x7f0004158c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:02.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.312+0000 7f0009c7f700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f00040c7250 0x7f0004159190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:02.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.312+0000 7f0009c7f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0004067c70 con 0x7f000406ab10 2023-10-06T03:07:02.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.312+0000 7f0009c7f700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0004069110 con 0x7f00040c7250 2023-10-06T03:07:02.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.312+0000 7f0009c7f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00041596d0 con 0x7f00040ac670 2023-10-06T03:07:02.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.312+0000 7f00037fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f000406ab10 0x7f00040c6b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40506/0 (socket says 172.21.15.125:40506) 2023-10-06T03:07:02.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.312+0000 7f00037fe700 1 -- 172.21.15.125:0/3322200058 learned_addr learned my addr 172.21.15.125:0/3322200058 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:07:02.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.313+0000 7f0003fff700 1 --2- 172.21.15.125:0/3322200058 >> v2:172.21.15.130:3300/0 conn(0x7f00040c7250 0x7f0004159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:02.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.313+0000 7f0002ffd700 1 --2- 172.21.15.125:0/3322200058 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00040ac670 0x7f0004158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:02.316 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.313+0000 7f00027fc700 1 -- 172.21.15.125:0/3322200058 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744876555 0 0) 0x7f0004067c70 con 0x7f000406ab10 2023-10-06T03:07:02.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.313+0000 7f00027fc700 1 -- 172.21.15.125:0/3322200058 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effec003570 con 0x7f000406ab10 2023-10-06T03:07:02.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.313+0000 7f00027fc700 1 -- 172.21.15.125:0/3322200058 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3473237366 0 0) 0x7effec003570 con 0x7f000406ab10 2023-10-06T03:07:02.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.313+0000 7f0003fff700 1 -- 172.21.15.125:0/3322200058 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00040ac670 msgr2=0x7f0004158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:02.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.313+0000 7f0003fff700 1 --2- 172.21.15.125:0/3322200058 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00040ac670 0x7f0004158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:02.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.313+0000 7f0003fff700 1 -- 172.21.15.125:0/3322200058 >> v1:172.21.15.125:6789/0 conn(0x7f000406ab10 legacy=0x7f00040c6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:02.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.313+0000 7f0003fff700 1 -- 172.21.15.125:0/3322200058 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00040c7800 con 0x7f00040c7250 2023-10-06T03:07:02.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.313+0000 7f0003fff700 1 --2- 172.21.15.125:0/3322200058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00040c7250 0x7f0004159190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efffc009e60 tx=0x7efffc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=368eb9f0ce68cded server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:02.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.313+0000 7f00027fc700 1 -- 172.21.15.125:0/3322200058 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc00e070 con 0x7f00040c7250 2023-10-06T03:07:02.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.313+0000 7f00027fc700 1 -- 172.21.15.125:0/3322200058 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc00b7a0 con 0x7f00040c7250 2023-10-06T03:07:02.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.313+0000 7f00027fc700 1 -- 172.21.15.125:0/3322200058 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4001470 con 0x7f00040c7250 2023-10-06T03:07:02.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.314+0000 7f0009c7f700 1 -- 172.21.15.125:0/3322200058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00040c7250 msgr2=0x7f0004159190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:02.317 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.314+0000 7f0009c7f700 1 --2- 172.21.15.125:0/3322200058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00040c7250 0x7f0004159190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efffc009e60 tx=0x7efffc009780 comp rx=0 tx=0).stop 2023-10-06T03:07:02.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.314+0000 7f0009c7f700 1 -- 172.21.15.125:0/3322200058 shutdown_connections 2023-10-06T03:07:02.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.314+0000 7f0009c7f700 1 --2- 172.21.15.125:0/3322200058 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00040c7250 0x7f0004159190 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:02.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.314+0000 7f0009c7f700 1 --2- 172.21.15.125:0/3322200058 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00040ac670 0x7f0004158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:02.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.314+0000 7f0009c7f700 1 -- 172.21.15.125:0/3322200058 >> 172.21.15.125:0/3322200058 conn(0x7f00040cc5a0 msgr2=0x7f00040cc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:02.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.314+0000 7f0009c7f700 1 -- 172.21.15.125:0/3322200058 shutdown_connections 2023-10-06T03:07:02.318 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.314+0000 7f0009c7f700 1 -- 172.21.15.125:0/3322200058 wait complete. 2023-10-06T03:07:02.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.315+0000 7f0009c7f700 1 Processor -- start 2023-10-06T03:07:02.320 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.315+0000 7f0009c7f700 1 -- start start 2023-10-06T03:07:02.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.316+0000 7f0009c7f700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f000406ab10 0x7f00040a88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:02.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.316+0000 7f0009c7f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00040ac670 0x7f00041553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:02.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.316+0000 7f0009c7f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00040c7250 0x7f00040ad520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:02.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.316+0000 7f0009c7f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0004155900 con 0x7f00040ac670 2023-10-06T03:07:02.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.316+0000 7f0009c7f700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00040af390 con 0x7f000406ab10 2023-10-06T03:07:02.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.316+0000 7f0009c7f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00040ab1b0 con 0x7f00040c7250 2023-10-06T03:07:02.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.316+0000 7f0002ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00040ac670 0x7f00041553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:02.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.316+0000 7f0002ffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00040ac670 0x7f00041553c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35118/0 (socket says 172.21.15.125:35118) 2023-10-06T03:07:02.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.316+0000 7f0002ffd700 1 -- 172.21.15.125:0/3939784101 learned_addr learned my addr 172.21.15.125:0/3939784101 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:02.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.316+0000 7f00037fe700 1 --2- 172.21.15.125:0/3939784101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f000406ab10 0x7f00040a88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:02.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.316+0000 7f0003fff700 1 --2- 172.21.15.125:0/3939784101 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00040c7250 0x7f00040ad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:02.321 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.316+0000 7f0002ffd700 1 -- 172.21.15.125:0/3939784101 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00040c7250 msgr2=0x7f00040ad520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:02.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.316+0000 7f0002ffd700 1 --2- 172.21.15.125:0/3939784101 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00040c7250 0x7f00040ad520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:02.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.316+0000 7f0002ffd700 1 -- 172.21.15.125:0/3939784101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f000406ab10 msgr2=0x7f00040a88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:02.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.316+0000 7f0002ffd700 1 --2- 172.21.15.125:0/3939784101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f000406ab10 0x7f00040a88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:02.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.316+0000 7f0002ffd700 1 -- 172.21.15.125:0/3939784101 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc009a20 con 0x7f00040ac670 2023-10-06T03:07:02.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.316+0000 7f00037fe700 1 --2- 172.21.15.125:0/3939784101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f000406ab10 0x7f00040a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:07:02.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.316+0000 7f0003fff700 1 --2- 172.21.15.125:0/3939784101 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00040c7250 0x7f00040ad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:07:02.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.316+0000 7f0002ffd700 1 --2- 172.21.15.125:0/3939784101 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00040ac670 0x7f00041553c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7efff800ecb0 tx=0x7efff80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:02.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.317+0000 7effeb7fe700 1 -- 172.21.15.125:0/3939784101 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff800c9d0 con 0x7f00040ac670 2023-10-06T03:07:02.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.317+0000 7effeb7fe700 1 -- 172.21.15.125:0/3939784101 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff800cb30 con 0x7f00040ac670 2023-10-06T03:07:02.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.317+0000 7f0009c7f700 1 -- 172.21.15.125:0/3939784101 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00040ab490 con 0x7f00040ac670 2023-10-06T03:07:02.322 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.317+0000 7effeb7fe700 1 -- 172.21.15.125:0/3939784101 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff800ced0 con 0x7f00040ac670 2023-10-06T03:07:02.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.317+0000 7f0009c7f700 1 -- 172.21.15.125:0/3939784101 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00040aba50 con 0x7f00040ac670 2023-10-06T03:07:02.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.318+0000 7f0009c7f700 1 -- 172.21.15.125:0/3939784101 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00040af520 con 0x7f00040ac670 2023-10-06T03:07:02.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.318+0000 7effeb7fe700 1 -- 172.21.15.125:0/3939784101 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efff8013680 con 0x7f00040ac670 2023-10-06T03:07:02.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.318+0000 7effeb7fe700 1 --2- 172.21.15.125:0/3939784101 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efff0066f30 0x7efff00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:02.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.318+0000 7effeb7fe700 1 -- 172.21.15.125:0/3939784101 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7efff8084890 con 0x7f00040ac670 2023-10-06T03:07:02.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.318+0000 7f00037fe700 1 --2- 172.21.15.125:0/3939784101 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efff0066f30 0x7efff00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:02.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.319+0000 7f00037fe700 1 --2- 172.21.15.125:0/3939784101 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efff0066f30 0x7efff00693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efff40011e0 tx=0x7efff4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:02.323 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.322+0000 7effeb7fe700 1 -- 172.21.15.125:0/3939784101 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efff8051b60 con 0x7f00040ac670 2023-10-06T03:07:02.506 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.505+0000 7f0009c7f700 1 -- 172.21.15.125:0/3939784101 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0004066510 con 0x7f00040ac670 2023-10-06T03:07:02.507 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.506+0000 7effeb7fe700 1 -- 172.21.15.125:0/3939784101 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+14131 (secure 0 0 0) 0x7efff8055180 con 0x7f00040ac670 2023-10-06T03:07:02.507 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:07:02.507 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":60,"fsid":"c8556660-0880-4430-a03a-c140780d46e7","created":"2023-10-06T03:04:04.413480+0000","modified":"2023-10-06T03:06:59.315240+0000","last_up_change":"2023-10-06T03:04:15.753885+0000","last_in_change":"2023-10-06T03:04:06.871476+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T03:04:15.845430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T03:04:22.729795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"7048f99f-fcc5-4f1c-87a5-7824304cda3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6805","nonce":119696},{"type":"v1","addr":"172.21.15.125:6809","nonce":119696}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6813","nonce":119696},{"type":"v1","addr":"172.21.15.125:6817","nonce":119696}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6828","nonce":119696},{"type":"v1","addr":"172.21.15.125:6831","nonce":119696}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6821","nonce":119696},{"type":"v1","addr":"172.21.15.125:6825","nonce":119696}]},"public_addr":"172.21.15.125:6809/119696","cluster_addr":"172.21.15.125:6817/119696","heartbeat_back_addr":"172.21.15.125:6831/119696","heartbeat_front_addr":"172.21.15.125:6825/119696","state":["exists","up"]},{"osd":1,"uuid":"a7aa419c-25ca-4cff-adb8-ceb167c3c018","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6800","nonce":119697},{"type":"v1","addr":"172.21.15.125:6801","nonce":119697}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6804","nonce":119697},{"type":"v1","addr":"172.21.15.125:6808","nonce":119697}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6820","nonce":119697},{"type":"v1","addr":"172.21.15.125:6824","nonce":119697}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6812","nonce":119697},{"type":"v1","addr":"172.21.15.125:6816","nonce":119697}]},"public_addr":"172.21.15.125:6801/119697","cluster_addr":"172.21.15.125:6808/119697","heartbeat_back_addr":"172.21.15.125:6824/119697","heartbeat_front_addr":"172.21.15.125:6816/119697","state":["exists","up"]},{"osd":2,"uuid":"267967b9-c8b2-4986-a03c-c0c6fdd9f904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6803","nonce":119699},{"type":"v1","addr":"172.21.15.125:6807","nonce":119699}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6811","nonce":119699},{"type":"v1","addr":"172.21.15.125:6815","nonce":119699}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6827","nonce":119699},{"type":"v1","addr":"172.21.15.125:6830","nonce":119699}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6819","nonce":119699},{"type":"v1","addr":"172.21.15.125:6823","nonce":119699}]},"public_addr":"172.21.15.125:6807/119699","cluster_addr":"172.21.15.125:6815/119699","heartbeat_back_addr":"172.21.15.125:6830/119699","heartbeat_front_addr":"172.21.15.125:6823/119699","state":["exists","up"]},{"osd":3,"uuid":"1b17df34-2d29-4fc3-86d6-ddd94fe6a4eb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6802","nonce":119698},{"type":"v1","addr":"172.21.15.125:6806","nonce":119698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6810","nonce":119698},{"type":"v1","addr":"172.21.15.125:6814","nonce":119698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6826","nonce":119698},{"type":"v1","addr":"172.21.15.125:6829","nonce":119698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6818","nonce":119698},{"type":"v1","addr":"172.21.15.125:6822","nonce":119698}]},"public_addr":"172.21.15.125:6806/119698","cluster_addr":"172.21.15.125:6814/119698","heartbeat_back_addr":"172.21.15.125:6829/119698","heartbeat_front_addr":"172.21.15.125:6822/119698","state":["exists","up"]},{"osd":4,"uuid":"1767280f-d693-4502-b223-abed8add890b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":119973},{"type":"v1","addr":"172.21.15.130:6817","nonce":119973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":119973},{"type":"v1","addr":"172.21.15.130:6819","nonce":119973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":119973},{"type":"v1","addr":"172.21.15.130:6823","nonce":119973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":119973},{"type":"v1","addr":"172.21.15.130:6821","nonce":119973}]},"public_addr":"172.21.15.130:6817/119973","cluster_addr":"172.21.15.130:6819/119973","heartbeat_back_addr":"172.21.15.130:6823/119973","heartbeat_front_addr":"172.21.15.130:6821/119973","state":["exists","up"]},{"osd":5,"uuid":"b92692cd-bad6-44b2-8db9-6f350aa59ec5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":119955},{"type":"v1","addr":"172.21.15.130:6809","nonce":119955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":119955},{"type":"v1","addr":"172.21.15.130:6811","nonce":119955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":119955},{"type":"v1","addr":"172.21.15.130:6815","nonce":119955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":119955},{"type":"v1","addr":"172.21.15.130:6813","nonce":119955}]},"public_addr":"172.21.15.130:6809/119955","cluster_addr":"172.21.15.130:6811/119955","heartbeat_back_addr":"172.21.15.130:6815/119955","heartbeat_front_addr":"172.21.15.130:6813/119955","state":["exists","up"]},{"osd":6,"uuid":"edf6cb3e-d501-4ca8-b58a-f38fb7407de4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":119980},{"type":"v1","addr":"172.21.15.130:6825","nonce":119980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":119980},{"type":"v1","addr":"172.21.15.130:6827","nonce":119980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":119980},{"type":"v1","addr":"172.21.15.130:6831","nonce":119980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":119980},{"type":"v1","addr":"172.21.15.130:6829","nonce":119980}]},"public_addr":"172.21.15.130:6825/119980","cluster_addr":"172.21.15.130:6827/119980","heartbeat_back_addr":"172.21.15.130:6831/119980","heartbeat_front_addr":"172.21.15.130:6829/119980","state":["exists","up"]},{"osd":7,"uuid":"50227222-b109-4145-808b-e55357c49222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":119956},{"type":"v1","addr":"172.21.15.130:6801","nonce":119956}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":119956},{"type":"v1","addr":"172.21.15.130:6803","nonce":119956}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":119956},{"type":"v1","addr":"172.21.15.130:6807","nonce":119956}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":119956},{"type":"v1","addr":"172.21.15.130:6805","nonce":119956}]},"public_addr":"172.21.15.130:6801/119956","cluster_addr":"172.21.15.130:6803/119956","heartbeat_back_addr":"172.21.15.130:6807/119956","heartbeat_front_addr":"172.21.15.130:6805/119956","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.076266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.087295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.032336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.018320+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.102475+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.014700+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:11.984108+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T03:04:12.068431+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.125:6837/1751632854":"2023-10-07T03:06:56.153997+0000","172.21.15.125:6835/1751632854":"2023-10-07T03:06:56.153997+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T03:07:02.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.508+0000 7f0009c7f700 1 -- 172.21.15.125:0/3939784101 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efff0066f30 msgr2=0x7efff00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:02.509 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.508+0000 7f0009c7f700 1 --2- 172.21.15.125:0/3939784101 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efff0066f30 0x7efff00693e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efff40011e0 tx=0x7efff4009040 comp rx=0 tx=0).stop 2023-10-06T03:07:02.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.508+0000 7f0009c7f700 1 -- 172.21.15.125:0/3939784101 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00040ac670 msgr2=0x7f00041553c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:02.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.508+0000 7f0009c7f700 1 --2- 172.21.15.125:0/3939784101 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00040ac670 0x7f00041553c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7efff800ecb0 tx=0x7efff80091a0 comp rx=0 tx=0).stop 2023-10-06T03:07:02.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.508+0000 7f0009c7f700 1 -- 172.21.15.125:0/3939784101 shutdown_connections 2023-10-06T03:07:02.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.508+0000 7f0009c7f700 1 --2- 172.21.15.125:0/3939784101 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7efff0066f30 0x7efff00693e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:02.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.508+0000 7f0009c7f700 1 --2- 172.21.15.125:0/3939784101 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f00040c7250 0x7f00040ad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:02.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.508+0000 7f0009c7f700 1 --2- 172.21.15.125:0/3939784101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f000406ab10 0x7f00040a88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:02.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.508+0000 7f0009c7f700 1 --2- 172.21.15.125:0/3939784101 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f00040ac670 0x7f00041553c0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:02.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.508+0000 7f0009c7f700 1 -- 172.21.15.125:0/3939784101 >> 172.21.15.125:0/3939784101 conn(0x7f00040cc5a0 msgr2=0x7f000406e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:02.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.508+0000 7f0009c7f700 1 -- 172.21.15.125:0/3939784101 shutdown_connections 2023-10-06T03:07:02.510 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:02.508+0000 7f0009c7f700 1 -- 172.21.15.125:0/3939784101 wait complete. 2023-10-06T03:07:03.522 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T03:07:03.522 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:07:03.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.659+0000 7f219ec39700 1 Processor -- start 2023-10-06T03:07:03.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.659+0000 7f219ec39700 1 -- start start 2023-10-06T03:07:03.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.660+0000 7f219ec39700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21980af1c0 0x7f21980ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:03.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.660+0000 7f219ec39700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f21980692c0 0x7f21980b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:03.663 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.660+0000 7f219ec39700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21980cf2f0 con 0x7f21980af590 2023-10-06T03:07:03.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.660+0000 7f219ec39700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21980b3010 con 0x7f21980692c0 2023-10-06T03:07:03.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.660+0000 7f219ec39700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21980cf540 con 0x7f21980af1c0 2023-10-06T03:07:03.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.660+0000 7f219d1d6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f21980692c0 0x7f21980b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:03.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.660+0000 7f2197fff700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f21980af590 0x7f2198068bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40522/0 (socket says 172.21.15.125:40522) 2023-10-06T03:07:03.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.660+0000 7f2197fff700 1 -- 172.21.15.125:0/567947691 learned_addr learned my addr 172.21.15.125:0/567947691 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:07:03.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.660+0000 7f219c9d5700 1 --2- 172.21.15.125:0/567947691 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21980af1c0 0x7f21980ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:03.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.660+0000 7f219d1d6700 1 -- 172.21.15.125:0/567947691 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21980af1c0 msgr2=0x7f21980ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:03.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.660+0000 7f219d1d6700 1 --2- 172.21.15.125:0/567947691 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21980af1c0 0x7f21980ccb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:03.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.660+0000 7f219d1d6700 1 -- 172.21.15.125:0/567947691 >> v1:172.21.15.125:6789/0 conn(0x7f21980af590 legacy=0x7f2198068bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:03.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.660+0000 7f219d1d6700 1 -- 172.21.15.125:0/567947691 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21980cf820 con 0x7f21980692c0 2023-10-06T03:07:03.664 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.660+0000 7f21977fe700 1 -- 172.21.15.125:0/567947691 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1574925797 0 0) 0x7f21980cf2f0 con 0x7f21980af590 2023-10-06T03:07:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.660+0000 7f219d1d6700 1 --2- 172.21.15.125:0/567947691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21980692c0 0x7f21980b34a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f2190009e60 tx=0x7f2190009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558f3de50815718e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.661+0000 7f21977fe700 1 -- 172.21.15.125:0/567947691 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219000e070 con 0x7f21980692c0 2023-10-06T03:07:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.661+0000 7f21977fe700 1 -- 172.21.15.125:0/567947691 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219000bc30 con 0x7f21980692c0 2023-10-06T03:07:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.661+0000 7f21977fe700 1 -- 172.21.15.125:0/567947691 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2190012430 con 0x7f21980692c0 2023-10-06T03:07:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.661+0000 7f219ec39700 1 -- 172.21.15.125:0/567947691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21980692c0 msgr2=0x7f21980b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.661+0000 7f219ec39700 1 --2- 172.21.15.125:0/567947691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21980692c0 0x7f21980b34a0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f2190009e60 tx=0x7f2190009780 comp rx=0 tx=0).stop 2023-10-06T03:07:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.661+0000 7f219ec39700 1 -- 172.21.15.125:0/567947691 shutdown_connections 2023-10-06T03:07:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.661+0000 7f219ec39700 1 --2- 172.21.15.125:0/567947691 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21980692c0 0x7f21980b34a0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.661+0000 7f219ec39700 1 --2- 172.21.15.125:0/567947691 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21980af1c0 0x7f21980ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.661+0000 7f219ec39700 1 -- 172.21.15.125:0/567947691 >> 172.21.15.125:0/567947691 conn(0x7f219806f800 msgr2=0x7f21980b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.661+0000 7f219ec39700 1 -- 172.21.15.125:0/567947691 shutdown_connections 2023-10-06T03:07:03.665 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.661+0000 7f219ec39700 1 -- 172.21.15.125:0/567947691 wait complete. 2023-10-06T03:07:03.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.662+0000 7f219ec39700 1 Processor -- start 2023-10-06T03:07:03.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.663+0000 7f219ec39700 1 -- start start 2023-10-06T03:07:03.669 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.663+0000 7f219ec39700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21980692c0 0x7f21980cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:03.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.663+0000 7f219ec39700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21980af1c0 0x7f21980c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:03.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.663+0000 7f219ec39700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21980af590 0x7f219815b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:03.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.663+0000 7f219ec39700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21980cc680 con 0x7f21980af1c0 2023-10-06T03:07:03.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.663+0000 7f219ec39700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2198169f50 con 0x7f21980692c0 2023-10-06T03:07:03.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.663+0000 7f219ec39700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219816a230 con 0x7f21980af590 2023-10-06T03:07:03.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.663+0000 7f2197fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21980af1c0 0x7f21980c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:03.670 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.663+0000 7f2197fff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21980af1c0 0x7f21980c9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35150/0 (socket says 172.21.15.125:35150) 2023-10-06T03:07:03.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.663+0000 7f2197fff700 1 -- 172.21.15.125:0/1629388014 learned_addr learned my addr 172.21.15.125:0/1629388014 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:03.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.664+0000 7f219d1d6700 1 --2- 172.21.15.125:0/1629388014 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21980af590 0x7f219815b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:03.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.664+0000 7f219c9d5700 1 --2- 172.21.15.125:0/1629388014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21980692c0 0x7f21980cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:03.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.664+0000 7f2197fff700 1 -- 172.21.15.125:0/1629388014 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21980af590 msgr2=0x7f219815b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:03.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.664+0000 7f2197fff700 1 --2- 172.21.15.125:0/1629388014 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f21980af590 0x7f219815b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:03.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.664+0000 7f2197fff700 1 -- 172.21.15.125:0/1629388014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21980692c0 msgr2=0x7f21980cc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:03.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.664+0000 7f2197fff700 1 --2- 172.21.15.125:0/1629388014 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21980692c0 0x7f21980cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:03.671 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.664+0000 7f2197fff700 1 -- 172.21.15.125:0/1629388014 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2190009a20 con 0x7f21980af1c0 2023-10-06T03:07:03.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.664+0000 7f2197fff700 1 --2- 172.21.15.125:0/1629388014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21980af1c0 0x7f21980c9bd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f218400c5b0 tx=0x7f2184001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:03.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.664+0000 7f2194ff9700 1 -- 172.21.15.125:0/1629388014 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184005b30 con 0x7f21980af1c0 2023-10-06T03:07:03.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.664+0000 7f2194ff9700 1 -- 172.21.15.125:0/1629388014 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2184005c90 con 0x7f21980af1c0 2023-10-06T03:07:03.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.664+0000 7f219ec39700 1 -- 172.21.15.125:0/1629388014 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f219816a510 con 0x7f21980af1c0 2023-10-06T03:07:03.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.664+0000 7f2194ff9700 1 -- 172.21.15.125:0/1629388014 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184007300 con 0x7f21980af1c0 2023-10-06T03:07:03.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.664+0000 7f219ec39700 1 -- 172.21.15.125:0/1629388014 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2198169b30 con 0x7f21980af1c0 2023-10-06T03:07:03.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.665+0000 7f219ec39700 1 -- 172.21.15.125:0/1629388014 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2198088260 con 0x7f21980af1c0 2023-10-06T03:07:03.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.665+0000 7f2194ff9700 1 -- 172.21.15.125:0/1629388014 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f218401b3b0 con 0x7f21980af1c0 2023-10-06T03:07:03.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.666+0000 7f2194ff9700 1 --2- 172.21.15.125:0/1629388014 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f217c066f30 0x7f217c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:03.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.666+0000 7f2194ff9700 1 -- 172.21.15.125:0/1629388014 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f2184083a00 con 0x7f21980af1c0 2023-10-06T03:07:03.672 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.666+0000 7f219c9d5700 1 --2- 172.21.15.125:0/1629388014 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f217c066f30 0x7f217c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:03.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.666+0000 7f2194ff9700 1 --2- 172.21.15.125:0/1629388014 >> [v2:172.21.15.125:6805/119696,v1:172.21.15.125:6809/119696] conn(0x7f217c06d850 0x7f217c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:03.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.666+0000 7f2194ff9700 1 -- 172.21.15.125:0/1629388014 --> [v2:172.21.15.125:6805/119696,v1:172.21.15.125:6809/119696] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f217c070370 con 0x7f217c06d850 2023-10-06T03:07:03.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.666+0000 7f2194ff9700 1 -- 172.21.15.125:0/1629388014 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2184088240 con 0x7f21980af1c0 2023-10-06T03:07:03.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.666+0000 7f219d1d6700 1 --2- 172.21.15.125:0/1629388014 >> [v2:172.21.15.125:6805/119696,v1:172.21.15.125:6809/119696] conn(0x7f217c06d850 0x7f217c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:03.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.666+0000 7f219c9d5700 1 --2- 172.21.15.125:0/1629388014 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f217c066f30 0x7f217c0693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f218c006fd0 tx=0x7f218c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:03.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.666+0000 7f219d1d6700 1 --2- 172.21.15.125:0/1629388014 >> [v2:172.21.15.125:6805/119696,v1:172.21.15.125:6809/119696] conn(0x7f217c06d850 0x7f217c06fca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:03.673 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.667+0000 7f2194ff9700 1 -- 172.21.15.125:0/1629388014 <== osd.0 v2:172.21.15.125:6805/119696 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f217c070370 con 0x7f217c06d850 2023-10-06T03:07:03.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.681+0000 7f219ec39700 1 -- 172.21.15.125:0/1629388014 --> [v2:172.21.15.125:6805/119696,v1:172.21.15.125:6809/119696] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f21980cfb00 con 0x7f217c06d850 2023-10-06T03:07:03.682 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.681+0000 7f2194ff9700 1 -- 172.21.15.125:0/1629388014 <== osd.0 v2:172.21.15.125:6805/119696 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f21980cfb00 con 0x7f217c06d850 2023-10-06T03:07:03.683 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:07:03.683 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:07:03.683 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:07:03.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.681+0000 7f219ec39700 1 -- 172.21.15.125:0/1629388014 >> [v2:172.21.15.125:6805/119696,v1:172.21.15.125:6809/119696] conn(0x7f217c06d850 msgr2=0x7f217c06fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:03.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.681+0000 7f219ec39700 1 --2- 172.21.15.125:0/1629388014 >> [v2:172.21.15.125:6805/119696,v1:172.21.15.125:6809/119696] conn(0x7f217c06d850 0x7f217c06fca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:03.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.681+0000 7f219ec39700 1 -- 172.21.15.125:0/1629388014 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f217c066f30 msgr2=0x7f217c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:03.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.681+0000 7f219ec39700 1 --2- 172.21.15.125:0/1629388014 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f217c066f30 0x7f217c0693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f218c006fd0 tx=0x7f218c008040 comp rx=0 tx=0).stop 2023-10-06T03:07:03.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.681+0000 7f219ec39700 1 -- 172.21.15.125:0/1629388014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21980af1c0 msgr2=0x7f21980c9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:03.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.681+0000 7f219ec39700 1 --2- 172.21.15.125:0/1629388014 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f21980af1c0 0x7f21980c9bd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f218400c5b0 tx=0x7f2184001070 comp rx=0 tx=0).stop 2023-10-06T03:07:03.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.681+0000 7f219d1d6700 1 -- 172.21.15.125:0/1629388014 reap_dead start 2023-10-06T03:07:03.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.682+0000 7f219ec39700 1 -- 172.21.15.125:0/1629388014 shutdown_connections 2023-10-06T03:07:03.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.682+0000 7f219ec39700 1 -- 172.21.15.125:0/1629388014 >> 172.21.15.125:0/1629388014 conn(0x7f219806f800 msgr2=0x7f21980b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:03.684 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.682+0000 7f219ec39700 1 -- 172.21.15.125:0/1629388014 shutdown_connections 2023-10-06T03:07:03.685 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.682+0000 7f219ec39700 1 -- 172.21.15.125:0/1629388014 wait complete. 2023-10-06T03:07:03.695 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T03:07:03.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.812+0000 7f3dcc461700 1 Processor -- start 2023-10-06T03:07:03.813 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.812+0000 7f3dcc461700 1 -- start start 2023-10-06T03:07:03.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.813+0000 7f3dcc461700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3dc40b0210 0x7f3dc40cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:03.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.813+0000 7f3dcc461700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3dc40b05e0 0x7f3dc40ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:03.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.813+0000 7f3dcc461700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc41597f0 con 0x7f3dc406d9a0 2023-10-06T03:07:03.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.813+0000 7f3dcc461700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc40c9950 con 0x7f3dc40b0210 2023-10-06T03:07:03.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.813+0000 7f3dcc461700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc40c9c30 con 0x7f3dc40b05e0 2023-10-06T03:07:03.816 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.813+0000 7f3dca1fd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f3dc40b0210 0x7f3dc40cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.813+0000 7f3dca9fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f3dc406d9a0 0x7f3dc415ced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40528/0 (socket says 172.21.15.125:40528) 2023-10-06T03:07:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.813+0000 7f3dca9fe700 1 -- 172.21.15.125:0/2261146060 learned_addr learned my addr 172.21.15.125:0/2261146060 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:07:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.813+0000 7f3dc99fc700 1 --2- 172.21.15.125:0/2261146060 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3dc40b05e0 0x7f3dc40ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.813+0000 7f3dca1fd700 1 -- 172.21.15.125:0/2261146060 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3dc40b05e0 msgr2=0x7f3dc40ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.813+0000 7f3dca1fd700 1 --2- 172.21.15.125:0/2261146060 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3dc40b05e0 0x7f3dc40ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.813+0000 7f3dca1fd700 1 -- 172.21.15.125:0/2261146060 >> v1:172.21.15.125:6789/0 conn(0x7f3dc406d9a0 legacy=0x7f3dc415ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.813+0000 7f3dca1fd700 1 -- 172.21.15.125:0/2261146060 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc40c9f10 con 0x7f3dc40b0210 2023-10-06T03:07:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.813+0000 7f3dc91fb700 1 -- 172.21.15.125:0/2261146060 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578941963 0 0) 0x7f3dc41597f0 con 0x7f3dc406d9a0 2023-10-06T03:07:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.813+0000 7f3dca1fd700 1 --2- 172.21.15.125:0/2261146060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dc40b0210 0x7f3dc40cc6f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00098e0 tx=0x7f3dc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b289d74c250d0be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.813+0000 7f3dc91fb700 1 -- 172.21.15.125:0/2261146060 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0009e80 con 0x7f3dc40b0210 2023-10-06T03:07:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.813+0000 7f3dc91fb700 1 -- 172.21.15.125:0/2261146060 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc000b860 con 0x7f3dc40b0210 2023-10-06T03:07:03.817 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.813+0000 7f3dc91fb700 1 -- 172.21.15.125:0/2261146060 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc000bbe0 con 0x7f3dc40b0210 2023-10-06T03:07:03.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.814+0000 7f3dcc461700 1 -- 172.21.15.125:0/2261146060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dc40b0210 msgr2=0x7f3dc40cc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:03.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.814+0000 7f3dcc461700 1 --2- 172.21.15.125:0/2261146060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dc40b0210 0x7f3dc40cc6f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00098e0 tx=0x7f3dc00091a0 comp rx=0 tx=0).stop 2023-10-06T03:07:03.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.814+0000 7f3dcc461700 1 -- 172.21.15.125:0/2261146060 shutdown_connections 2023-10-06T03:07:03.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.814+0000 7f3dcc461700 1 --2- 172.21.15.125:0/2261146060 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dc40b0210 0x7f3dc40cc6f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:03.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.814+0000 7f3dcc461700 1 --2- 172.21.15.125:0/2261146060 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3dc40b05e0 0x7f3dc40ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:03.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.814+0000 7f3dcc461700 1 -- 172.21.15.125:0/2261146060 >> 172.21.15.125:0/2261146060 conn(0x7f3dc40cea30 msgr2=0x7f3dc406c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:03.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.814+0000 7f3dcc461700 1 -- 172.21.15.125:0/2261146060 shutdown_connections 2023-10-06T03:07:03.818 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.814+0000 7f3dcc461700 1 -- 172.21.15.125:0/2261146060 wait complete. 2023-10-06T03:07:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.816+0000 7f3dcc461700 1 Processor -- start 2023-10-06T03:07:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.816+0000 7f3dcc461700 1 -- start start 2023-10-06T03:07:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dcc461700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dc406d9a0 0x7f3dc4147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dcc461700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dc40b0210 0x7f3dc415bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dcc461700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3dc40b05e0 0x7f3dc4069250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dcc461700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc415a440 con 0x7f3dc40b0210 2023-10-06T03:07:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dcc461700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc415a720 con 0x7f3dc406d9a0 2023-10-06T03:07:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dcc461700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc415aa00 con 0x7f3dc40b05e0 2023-10-06T03:07:03.821 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dc99fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dc40b0210 0x7f3dc415bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dc99fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dc40b0210 0x7f3dc415bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35174/0 (socket says 172.21.15.125:35174) 2023-10-06T03:07:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dc99fc700 1 -- 172.21.15.125:0/1374983769 learned_addr learned my addr 172.21.15.125:0/1374983769 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dca1fd700 1 --2- 172.21.15.125:0/1374983769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dc406d9a0 0x7f3dc4147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dca9fe700 1 --2- 172.21.15.125:0/1374983769 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3dc40b05e0 0x7f3dc4069250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dc99fc700 1 -- 172.21.15.125:0/1374983769 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3dc40b05e0 msgr2=0x7f3dc4069250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dc99fc700 1 --2- 172.21.15.125:0/1374983769 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3dc40b05e0 0x7f3dc4069250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dc99fc700 1 -- 172.21.15.125:0/1374983769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dc406d9a0 msgr2=0x7f3dc4147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dc99fc700 1 --2- 172.21.15.125:0/1374983769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dc406d9a0 0x7f3dc4147870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dc99fc700 1 -- 172.21.15.125:0/1374983769 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc0009420 con 0x7f3dc40b0210 2023-10-06T03:07:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dc99fc700 1 --2- 172.21.15.125:0/1374983769 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dc40b0210 0x7f3dc415bf90 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3db400d860 tx=0x7f3db4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dba7fc700 1 -- 172.21.15.125:0/1374983769 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db40125f0 con 0x7f3dc40b0210 2023-10-06T03:07:03.822 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dba7fc700 1 -- 172.21.15.125:0/1374983769 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db4012750 con 0x7f3dc40b0210 2023-10-06T03:07:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dcc461700 1 -- 172.21.15.125:0/1374983769 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc40c6f20 con 0x7f3dc40b0210 2023-10-06T03:07:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dba7fc700 1 -- 172.21.15.125:0/1374983769 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4012b10 con 0x7f3dc40b0210 2023-10-06T03:07:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.817+0000 7f3dcc461700 1 -- 172.21.15.125:0/1374983769 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc40c5dd0 con 0x7f3dc40b0210 2023-10-06T03:07:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.818+0000 7f3dcc461700 1 -- 172.21.15.125:0/1374983769 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc40c73c0 con 0x7f3dc40b0210 2023-10-06T03:07:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.819+0000 7f3dba7fc700 1 -- 172.21.15.125:0/1374983769 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3db401e460 con 0x7f3dc40b0210 2023-10-06T03:07:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.819+0000 7f3dba7fc700 1 --2- 172.21.15.125:0/1374983769 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3da8066f30 0x7f3da80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.819+0000 7f3dba7fc700 1 -- 172.21.15.125:0/1374983769 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f3db4084970 con 0x7f3dc40b0210 2023-10-06T03:07:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.819+0000 7f3dca1fd700 1 --2- 172.21.15.125:0/1374983769 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3da8066f30 0x7f3da80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:03.823 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.820+0000 7f3dca1fd700 1 --2- 172.21.15.125:0/1374983769 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3da8066f30 0x7f3da80693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00091e0 tx=0x7f3dc0017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:03.824 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:03.823+0000 7f3dba7fc700 1 -- 172.21.15.125:0/1374983769 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3db4051c40 con 0x7f3dc40b0210 2023-10-06T03:07:04.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.006+0000 7f3dcc461700 1 -- 172.21.15.125:0/1374983769 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f3dc4066510 con 0x7f3da8066f30 2023-10-06T03:07:04.007 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.006+0000 7f3dba7fc700 1 -- 172.21.15.125:0/1374983769 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3dc4066510 con 0x7f3da8066f30 2023-10-06T03:07:04.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.008+0000 7f3dcc461700 1 -- 172.21.15.125:0/1374983769 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3da8066f30 msgr2=0x7f3da80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.008+0000 7f3dcc461700 1 --2- 172.21.15.125:0/1374983769 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3da8066f30 0x7f3da80693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3dc00091e0 tx=0x7f3dc0017000 comp rx=0 tx=0).stop 2023-10-06T03:07:04.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.008+0000 7f3dcc461700 1 -- 172.21.15.125:0/1374983769 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dc40b0210 msgr2=0x7f3dc415bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.008+0000 7f3dcc461700 1 --2- 172.21.15.125:0/1374983769 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dc40b0210 0x7f3dc415bf90 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3db400d860 tx=0x7f3db4008040 comp rx=0 tx=0).stop 2023-10-06T03:07:04.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.008+0000 7f3dcc461700 1 -- 172.21.15.125:0/1374983769 shutdown_connections 2023-10-06T03:07:04.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.008+0000 7f3dcc461700 1 --2- 172.21.15.125:0/1374983769 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f3da8066f30 0x7f3da80693e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.008+0000 7f3dcc461700 1 --2- 172.21.15.125:0/1374983769 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f3dc40b05e0 0x7f3dc4069250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.010 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.008+0000 7f3dcc461700 1 --2- 172.21.15.125:0/1374983769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dc406d9a0 0x7f3dc4147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.008+0000 7f3dcc461700 1 --2- 172.21.15.125:0/1374983769 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f3dc40b0210 0x7f3dc415bf90 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.008+0000 7f3dcc461700 1 -- 172.21.15.125:0/1374983769 >> 172.21.15.125:0/1374983769 conn(0x7f3dc40cea30 msgr2=0x7f3dc406c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:04.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.008+0000 7f3dcc461700 1 -- 172.21.15.125:0/1374983769 shutdown_connections 2023-10-06T03:07:04.011 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.008+0000 7f3dcc461700 1 -- 172.21.15.125:0/1374983769 wait complete. 2023-10-06T03:07:04.011 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T03:07:04.021 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T03:07:04.021 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:07:04.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.141+0000 7fe7a5fe9700 1 Processor -- start 2023-10-06T03:07:04.142 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.141+0000 7fe7a5fe9700 1 -- start start 2023-10-06T03:07:04.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.141+0000 7fe7a5fe9700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7a00ca5f0 0x7fe7a006e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.141+0000 7fe7a5fe9700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe7a006ee10 0x7fe7a0067780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.141+0000 7fe7a5fe9700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a00cb7e0 con 0x7fe7a01590a0 2023-10-06T03:07:04.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.141+0000 7fe7a5fe9700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a006f290 con 0x7fe7a006ee10 2023-10-06T03:07:04.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.141+0000 7fe7a5fe9700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a00cabd0 con 0x7fe7a00ca5f0 2023-10-06T03:07:04.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.142+0000 7fe79ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe7a006ee10 0x7fe7a0067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.142+0000 7fe79ffff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fe7a006ee10 0x7fe7a0067780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35190/0 (socket says 172.21.15.125:35190) 2023-10-06T03:07:04.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.142+0000 7fe79ffff700 1 -- 172.21.15.125:0/1610403634 learned_addr learned my addr 172.21.15.125:0/1610403634 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:04.145 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.142+0000 7fe79effd700 1 --2- 172.21.15.125:0/1610403634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7a00ca5f0 0x7fe7a006e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.142+0000 7fe79ffff700 1 -- 172.21.15.125:0/1610403634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7a00ca5f0 msgr2=0x7fe7a006e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:04.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.142+0000 7fe79ffff700 1 --2- 172.21.15.125:0/1610403634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7a00ca5f0 0x7fe7a006e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.142+0000 7fe79ffff700 1 -- 172.21.15.125:0/1610403634 >> v1:172.21.15.130:6789/0 conn(0x7fe7a01590a0 legacy=0x7fe7a0159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:04.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.142+0000 7fe79ffff700 1 -- 172.21.15.125:0/1610403634 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a00caeb0 con 0x7fe7a006ee10 2023-10-06T03:07:04.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.142+0000 7fe79effd700 1 --2- 172.21.15.125:0/1610403634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7a00ca5f0 0x7fe7a006e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:07:04.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.142+0000 7fe79ffff700 1 --2- 172.21.15.125:0/1610403634 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7a006ee10 0x7fe7a0067780 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe798009f20 tx=0x7fe798009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2085d6c3e56f62 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:04.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.142+0000 7fe79e7fc700 1 -- 172.21.15.125:0/1610403634 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79800e070 con 0x7fe7a006ee10 2023-10-06T03:07:04.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.142+0000 7fe79e7fc700 1 -- 172.21.15.125:0/1610403634 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79800ba40 con 0x7fe7a006ee10 2023-10-06T03:07:04.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.142+0000 7fe79e7fc700 1 -- 172.21.15.125:0/1610403634 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7980092e0 con 0x7fe7a006ee10 2023-10-06T03:07:04.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.143+0000 7fe7a5fe9700 1 -- 172.21.15.125:0/1610403634 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7a006ee10 msgr2=0x7fe7a0067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.146 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.143+0000 7fe7a5fe9700 1 --2- 172.21.15.125:0/1610403634 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7a006ee10 0x7fe7a0067780 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe798009f20 tx=0x7fe798009840 comp rx=0 tx=0).stop 2023-10-06T03:07:04.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.143+0000 7fe7a5fe9700 1 -- 172.21.15.125:0/1610403634 shutdown_connections 2023-10-06T03:07:04.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.143+0000 7fe7a5fe9700 1 --2- 172.21.15.125:0/1610403634 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7a006ee10 0x7fe7a0067780 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.143+0000 7fe7a5fe9700 1 --2- 172.21.15.125:0/1610403634 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7a00ca5f0 0x7fe7a006e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.143+0000 7fe7a5fe9700 1 -- 172.21.15.125:0/1610403634 >> 172.21.15.125:0/1610403634 conn(0x7fe7a006b3b0 msgr2=0x7fe7a00cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:04.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.143+0000 7fe7a5fe9700 1 -- 172.21.15.125:0/1610403634 shutdown_connections 2023-10-06T03:07:04.147 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.143+0000 7fe7a5fe9700 1 -- 172.21.15.125:0/1610403634 wait complete. 2023-10-06T03:07:04.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.144+0000 7fe7a5fe9700 1 Processor -- start 2023-10-06T03:07:04.150 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.144+0000 7fe7a5fe9700 1 -- start start 2023-10-06T03:07:04.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.145+0000 7fe7a5fe9700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7a006ee10 0x7fe7a0169520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.145+0000 7fe7a5fe9700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7a00ca5f0 0x7fe7a00b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.145+0000 7fe7a5fe9700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7a01590a0 0x7fe7a0155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.145+0000 7fe7a5fe9700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a015efd0 con 0x7fe7a00ca5f0 2023-10-06T03:07:04.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.145+0000 7fe7a5fe9700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a015b260 con 0x7fe7a01590a0 2023-10-06T03:07:04.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.145+0000 7fe7a5fe9700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a0169a60 con 0x7fe7a006ee10 2023-10-06T03:07:04.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.145+0000 7fe79effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7a00ca5f0 0x7fe7a00b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.145+0000 7fe79effd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7a00ca5f0 0x7fe7a00b14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35200/0 (socket says 172.21.15.125:35200) 2023-10-06T03:07:04.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.145+0000 7fe79effd700 1 -- 172.21.15.125:0/331030011 learned_addr learned my addr 172.21.15.125:0/331030011 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:04.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.145+0000 7fe79effd700 1 -- 172.21.15.125:0/331030011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7a006ee10 msgr2=0x7fe7a0169520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.151 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.145+0000 7fe79ffff700 1 --2- 172.21.15.125:0/331030011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7a01590a0 0x7fe7a0155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.145+0000 7fe79f7fe700 1 --2- 172.21.15.125:0/331030011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7a006ee10 0x7fe7a0169520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.145+0000 7fe79effd700 1 --2- 172.21.15.125:0/331030011 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fe7a006ee10 0x7fe7a0169520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.145+0000 7fe79effd700 1 -- 172.21.15.125:0/331030011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7a01590a0 msgr2=0x7fe7a0155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.145+0000 7fe79effd700 1 --2- 172.21.15.125:0/331030011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7a01590a0 0x7fe7a0155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.145+0000 7fe79effd700 1 -- 172.21.15.125:0/331030011 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe798009ae0 con 0x7fe7a00ca5f0 2023-10-06T03:07:04.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.145+0000 7fe79ffff700 1 --2- 172.21.15.125:0/331030011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7a01590a0 0x7fe7a0155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:07:04.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.145+0000 7fe79effd700 1 --2- 172.21.15.125:0/331030011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7a00ca5f0 0x7fe7a00b14b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe79400c860 tx=0x7fe794008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:04.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.145+0000 7fe7877fe700 1 -- 172.21.15.125:0/331030011 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe794011600 con 0x7fe7a00ca5f0 2023-10-06T03:07:04.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.146+0000 7fe7877fe700 1 -- 172.21.15.125:0/331030011 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe794011760 con 0x7fe7a00ca5f0 2023-10-06T03:07:04.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.146+0000 7fe7a5fe9700 1 -- 172.21.15.125:0/331030011 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a015e770 con 0x7fe7a00ca5f0 2023-10-06T03:07:04.152 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.146+0000 7fe7877fe700 1 -- 172.21.15.125:0/331030011 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe794011b00 con 0x7fe7a00ca5f0 2023-10-06T03:07:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.146+0000 7fe7a5fe9700 1 -- 172.21.15.125:0/331030011 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a015ea10 con 0x7fe7a00ca5f0 2023-10-06T03:07:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.146+0000 7fe7a5fe9700 1 -- 172.21.15.125:0/331030011 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe7a006d830 con 0x7fe7a00ca5f0 2023-10-06T03:07:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.147+0000 7fe7877fe700 1 -- 172.21.15.125:0/331030011 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe79400a3e0 con 0x7fe7a00ca5f0 2023-10-06T03:07:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.147+0000 7fe7877fe700 1 --2- 172.21.15.125:0/331030011 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe78c066f60 0x7fe78c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.147+0000 7fe7877fe700 1 -- 172.21.15.125:0/331030011 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fe794084ab0 con 0x7fe7a00ca5f0 2023-10-06T03:07:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.147+0000 7fe79f7fe700 1 --2- 172.21.15.125:0/331030011 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe78c066f60 0x7fe78c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.147+0000 7fe7877fe700 1 --2- 172.21.15.125:0/331030011 >> [v2:172.21.15.125:6800/119697,v1:172.21.15.125:6801/119697] conn(0x7fe78c06d880 0x7fe78c06fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.147+0000 7fe7877fe700 1 -- 172.21.15.125:0/331030011 --> [v2:172.21.15.125:6800/119697,v1:172.21.15.125:6801/119697] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe78c0703a0 con 0x7fe78c06d880 2023-10-06T03:07:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.147+0000 7fe7877fe700 1 -- 172.21.15.125:0/331030011 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe794084e80 con 0x7fe7a00ca5f0 2023-10-06T03:07:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.148+0000 7fe79ffff700 1 --2- 172.21.15.125:0/331030011 >> [v2:172.21.15.125:6800/119697,v1:172.21.15.125:6801/119697] conn(0x7fe78c06d880 0x7fe78c06fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.148+0000 7fe79f7fe700 1 --2- 172.21.15.125:0/331030011 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe78c066f60 0x7fe78c069410 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe7900027e0 tx=0x7fe790009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:04.153 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.148+0000 7fe79ffff700 1 --2- 172.21.15.125:0/331030011 >> [v2:172.21.15.125:6800/119697,v1:172.21.15.125:6801/119697] conn(0x7fe78c06d880 0x7fe78c06fcd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:04.154 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.148+0000 7fe7877fe700 1 -- 172.21.15.125:0/331030011 <== osd.1 v2:172.21.15.125:6800/119697 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe78c0703a0 con 0x7fe78c06d880 2023-10-06T03:07:04.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.162+0000 7fe7a5fe9700 1 -- 172.21.15.125:0/331030011 --> [v2:172.21.15.125:6800/119697,v1:172.21.15.125:6801/119697] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe7a004bb80 con 0x7fe78c06d880 2023-10-06T03:07:04.163 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.162+0000 7fe7877fe700 1 -- 172.21.15.125:0/331030011 <== osd.1 v2:172.21.15.125:6800/119697 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe7a004bb80 con 0x7fe78c06d880 2023-10-06T03:07:04.164 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:07:04.164 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:07:04.164 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:07:04.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.162+0000 7fe7a5fe9700 1 -- 172.21.15.125:0/331030011 >> [v2:172.21.15.125:6800/119697,v1:172.21.15.125:6801/119697] conn(0x7fe78c06d880 msgr2=0x7fe78c06fcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.162+0000 7fe7a5fe9700 1 --2- 172.21.15.125:0/331030011 >> [v2:172.21.15.125:6800/119697,v1:172.21.15.125:6801/119697] conn(0x7fe78c06d880 0x7fe78c06fcd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.163+0000 7fe7a5fe9700 1 -- 172.21.15.125:0/331030011 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe78c066f60 msgr2=0x7fe78c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.163+0000 7fe7a5fe9700 1 --2- 172.21.15.125:0/331030011 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fe78c066f60 0x7fe78c069410 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe7900027e0 tx=0x7fe790009040 comp rx=0 tx=0).stop 2023-10-06T03:07:04.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.163+0000 7fe7a5fe9700 1 -- 172.21.15.125:0/331030011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7a00ca5f0 msgr2=0x7fe7a00b14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.163+0000 7fe7a5fe9700 1 --2- 172.21.15.125:0/331030011 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fe7a00ca5f0 0x7fe7a00b14b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe79400c860 tx=0x7fe794008040 comp rx=0 tx=0).stop 2023-10-06T03:07:04.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.163+0000 7fe79ffff700 1 -- 172.21.15.125:0/331030011 reap_dead start 2023-10-06T03:07:04.165 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.163+0000 7fe7a5fe9700 1 -- 172.21.15.125:0/331030011 shutdown_connections 2023-10-06T03:07:04.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.163+0000 7fe7a5fe9700 1 -- 172.21.15.125:0/331030011 >> 172.21.15.125:0/331030011 conn(0x7fe7a006b3b0 msgr2=0x7fe7a00c1380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:04.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.163+0000 7fe7a5fe9700 1 -- 172.21.15.125:0/331030011 shutdown_connections 2023-10-06T03:07:04.166 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.163+0000 7fe7a5fe9700 1 -- 172.21.15.125:0/331030011 wait complete. 2023-10-06T03:07:04.175 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T03:07:04.295 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.294+0000 7f715952c700 1 Processor -- start 2023-10-06T03:07:04.296 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.294+0000 7f715952c700 1 -- start start 2023-10-06T03:07:04.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.295+0000 7f715952c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7154159040 0x7f71540cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.295+0000 7f715952c700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71540cb710 0x7f71540ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.295+0000 7f715952c700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f715415d270 con 0x7f7154159410 2023-10-06T03:07:04.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.295+0000 7f715952c700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715415d550 con 0x7f7154159040 2023-10-06T03:07:04.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.295+0000 7f715952c700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715415d830 con 0x7f71540cb710 2023-10-06T03:07:04.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.295+0000 7f7152ffd700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f7154159040 0x7f71540cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.295+0000 7f71537fe700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f7154159410 0x7f7154068c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40540/0 (socket says 172.21.15.125:40540) 2023-10-06T03:07:04.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.295+0000 7f71537fe700 1 -- 172.21.15.125:0/1121378240 learned_addr learned my addr 172.21.15.125:0/1121378240 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:07:04.298 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.295+0000 7f71527fc700 1 --2- 172.21.15.125:0/1121378240 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71540cb710 0x7f71540ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.295+0000 7f7152ffd700 1 -- 172.21.15.125:0/1121378240 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71540cb710 msgr2=0x7f71540ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:04.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.295+0000 7f7152ffd700 1 --2- 172.21.15.125:0/1121378240 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71540cb710 0x7f71540ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.295+0000 7f7152ffd700 1 -- 172.21.15.125:0/1121378240 >> v1:172.21.15.125:6789/0 conn(0x7f7154159410 legacy=0x7f7154068c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.295+0000 7f7152ffd700 1 -- 172.21.15.125:0/1121378240 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715415db10 con 0x7f7154159040 2023-10-06T03:07:04.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.295+0000 7f7151ffb700 1 -- 172.21.15.125:0/1121378240 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2778697392 0 0) 0x7f715415d270 con 0x7f7154159410 2023-10-06T03:07:04.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.295+0000 7f7152ffd700 1 --2- 172.21.15.125:0/1121378240 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7154159040 0x7f71540cb1d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f71480098e0 tx=0x7f71480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf41feaf8e6a8040 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:04.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.296+0000 7f7151ffb700 1 -- 172.21.15.125:0/1121378240 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7148009e80 con 0x7f7154159040 2023-10-06T03:07:04.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.296+0000 7f7151ffb700 1 -- 172.21.15.125:0/1121378240 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714800b860 con 0x7f7154159040 2023-10-06T03:07:04.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.296+0000 7f7151ffb700 1 -- 172.21.15.125:0/1121378240 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714800bbe0 con 0x7f7154159040 2023-10-06T03:07:04.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.296+0000 7f715952c700 1 -- 172.21.15.125:0/1121378240 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7154159040 msgr2=0x7f71540cb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.299 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.296+0000 7f715952c700 1 --2- 172.21.15.125:0/1121378240 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7154159040 0x7f71540cb1d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f71480098e0 tx=0x7f71480091a0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.300 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.296+0000 7f715952c700 1 -- 172.21.15.125:0/1121378240 shutdown_connections 2023-10-06T03:07:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.296+0000 7f715952c700 1 --2- 172.21.15.125:0/1121378240 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7154159040 0x7f71540cb1d0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.296+0000 7f715952c700 1 --2- 172.21.15.125:0/1121378240 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f71540cb710 0x7f71540ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.296+0000 7f715952c700 1 -- 172.21.15.125:0/1121378240 >> 172.21.15.125:0/1121378240 conn(0x7f715406ed40 msgr2=0x7f715406f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.296+0000 7f715952c700 1 -- 172.21.15.125:0/1121378240 shutdown_connections 2023-10-06T03:07:04.301 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.296+0000 7f715952c700 1 -- 172.21.15.125:0/1121378240 wait complete. 2023-10-06T03:07:04.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.297+0000 7f715952c700 1 Processor -- start 2023-10-06T03:07:04.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.297+0000 7f715952c700 1 -- start start 2023-10-06T03:07:04.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.298+0000 7f715952c700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71540cb710 0x7f71540c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.298+0000 7f715952c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7154159040 0x7f715416cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.298+0000 7f715952c700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7154159410 0x7f715416d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.298+0000 7f715952c700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7154151f70 con 0x7f7154159040 2023-10-06T03:07:04.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.298+0000 7f715952c700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71540b4aa0 con 0x7f71540cb710 2023-10-06T03:07:04.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.298+0000 7f715952c700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71540b4d80 con 0x7f7154159410 2023-10-06T03:07:04.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.298+0000 7f71527fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7154159040 0x7f715416cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.304 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.298+0000 7f71527fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7154159040 0x7f715416cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35224/0 (socket says 172.21.15.125:35224) 2023-10-06T03:07:04.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.298+0000 7f71527fc700 1 -- 172.21.15.125:0/1726721530 learned_addr learned my addr 172.21.15.125:0/1726721530 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:04.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.298+0000 7f71527fc700 1 -- 172.21.15.125:0/1726721530 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7154159410 msgr2=0x7f715416d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.298+0000 7f71527fc700 1 --2- 172.21.15.125:0/1726721530 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7154159410 0x7f715416d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.298+0000 7f7152ffd700 1 --2- 172.21.15.125:0/1726721530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71540cb710 0x7f71540c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.299+0000 7f71527fc700 1 -- 172.21.15.125:0/1726721530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71540cb710 msgr2=0x7f71540c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.299+0000 7f71527fc700 1 --2- 172.21.15.125:0/1726721530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71540cb710 0x7f71540c9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.299+0000 7f71527fc700 1 -- 172.21.15.125:0/1726721530 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7148009420 con 0x7f7154159040 2023-10-06T03:07:04.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.299+0000 7f71527fc700 1 --2- 172.21.15.125:0/1726721530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7154159040 0x7f715416cea0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f714400c7d0 tx=0x7f7144008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:04.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.299+0000 7f713affd700 1 -- 172.21.15.125:0/1726721530 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7144011600 con 0x7f7154159040 2023-10-06T03:07:04.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.299+0000 7f713affd700 1 -- 172.21.15.125:0/1726721530 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7144011760 con 0x7f7154159040 2023-10-06T03:07:04.305 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.299+0000 7f713affd700 1 -- 172.21.15.125:0/1726721530 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7144011b20 con 0x7f7154159040 2023-10-06T03:07:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.299+0000 7f715952c700 1 -- 172.21.15.125:0/1726721530 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71540b5060 con 0x7f7154159040 2023-10-06T03:07:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.299+0000 7f715952c700 1 -- 172.21.15.125:0/1726721530 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7154149590 con 0x7f7154159040 2023-10-06T03:07:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.300+0000 7f715952c700 1 -- 172.21.15.125:0/1726721530 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7154066510 con 0x7f7154159040 2023-10-06T03:07:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.300+0000 7f713affd700 1 -- 172.21.15.125:0/1726721530 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71440193f0 con 0x7f7154159040 2023-10-06T03:07:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.301+0000 7f713affd700 1 --2- 172.21.15.125:0/1726721530 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7140066f30 0x7f71400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.301+0000 7f7152ffd700 1 --2- 172.21.15.125:0/1726721530 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7140066f30 0x7f71400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.301+0000 7f713affd700 1 -- 172.21.15.125:0/1726721530 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f71440848e0 con 0x7f7154159040 2023-10-06T03:07:04.306 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.301+0000 7f7152ffd700 1 --2- 172.21.15.125:0/1726721530 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7140066f30 0x7f71400693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7148003080 tx=0x7f7148017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:04.307 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.305+0000 7f713affd700 1 -- 172.21.15.125:0/1726721530 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7144051bb0 con 0x7f7154159040 2023-10-06T03:07:04.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.487+0000 7f715952c700 1 -- 172.21.15.125:0/1726721530 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f71540cdf90 con 0x7f7140066f30 2023-10-06T03:07:04.489 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.488+0000 7f713affd700 1 -- 172.21.15.125:0/1726721530 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f71540cdf90 con 0x7f7140066f30 2023-10-06T03:07:04.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.490+0000 7f715952c700 1 -- 172.21.15.125:0/1726721530 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7140066f30 msgr2=0x7f71400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.491 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.490+0000 7f715952c700 1 --2- 172.21.15.125:0/1726721530 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7140066f30 0x7f71400693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7148003080 tx=0x7f7148017000 comp rx=0 tx=0).stop 2023-10-06T03:07:04.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.490+0000 7f715952c700 1 -- 172.21.15.125:0/1726721530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7154159040 msgr2=0x7f715416cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.490+0000 7f715952c700 1 --2- 172.21.15.125:0/1726721530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7154159040 0x7f715416cea0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f714400c7d0 tx=0x7f7144008040 comp rx=0 tx=0).stop 2023-10-06T03:07:04.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.490+0000 7f715952c700 1 -- 172.21.15.125:0/1726721530 shutdown_connections 2023-10-06T03:07:04.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.490+0000 7f715952c700 1 --2- 172.21.15.125:0/1726721530 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f7140066f30 0x7f71400693e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.490+0000 7f715952c700 1 --2- 172.21.15.125:0/1726721530 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7154159410 0x7f715416d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.490+0000 7f715952c700 1 --2- 172.21.15.125:0/1726721530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71540cb710 0x7f71540c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.490+0000 7f715952c700 1 --2- 172.21.15.125:0/1726721530 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7154159040 0x7f715416cea0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.490+0000 7f715952c700 1 -- 172.21.15.125:0/1726721530 >> 172.21.15.125:0/1726721530 conn(0x7f715406ed40 msgr2=0x7f71540afe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:04.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.490+0000 7f715952c700 1 -- 172.21.15.125:0/1726721530 shutdown_connections 2023-10-06T03:07:04.492 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.490+0000 7f715952c700 1 -- 172.21.15.125:0/1726721530 wait complete. 2023-10-06T03:07:04.493 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T03:07:04.503 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T03:07:04.503 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:07:04.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.622+0000 7ff8fbd20700 1 Processor -- start 2023-10-06T03:07:04.624 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.622+0000 7ff8fbd20700 1 -- start start 2023-10-06T03:07:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.623+0000 7ff8fbd20700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff8f41590a0 0x7ff8f40ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.626 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.623+0000 7ff8fbd20700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7ff8f406efe0 0x7ff8f4067780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.623+0000 7ff8fbd20700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f40cb7e0 con 0x7ff8f4159470 2023-10-06T03:07:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.623+0000 7ff8fbd20700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f40cabd0 con 0x7ff8f41590a0 2023-10-06T03:07:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.623+0000 7ff8fbd20700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f40caeb0 con 0x7ff8f406efe0 2023-10-06T03:07:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.623+0000 7ff8f9abc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7ff8f41590a0 0x7ff8f40ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.623+0000 7ff8f92bb700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7ff8f4159470 0x7ff8f406e8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40556/0 (socket says 172.21.15.125:40556) 2023-10-06T03:07:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.623+0000 7ff8f92bb700 1 -- 172.21.15.125:0/3046515126 learned_addr learned my addr 172.21.15.125:0/3046515126 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:07:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.623+0000 7ff8fa2bd700 1 --2- 172.21.15.125:0/3046515126 >> v2:172.21.15.130:3300/0 conn(0x7ff8f406efe0 0x7ff8f4067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.624+0000 7ff8f9abc700 1 -- 172.21.15.125:0/3046515126 >> v2:172.21.15.130:3300/0 conn(0x7ff8f406efe0 msgr2=0x7ff8f4067780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.624+0000 7ff8f9abc700 1 --2- 172.21.15.125:0/3046515126 >> v2:172.21.15.130:3300/0 conn(0x7ff8f406efe0 0x7ff8f4067780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.624+0000 7ff8f9abc700 1 -- 172.21.15.125:0/3046515126 >> v1:172.21.15.125:6789/0 conn(0x7ff8f4159470 legacy=0x7ff8f406e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.624+0000 7ff8f9abc700 1 -- 172.21.15.125:0/3046515126 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f40cb190 con 0x7ff8f41590a0 2023-10-06T03:07:04.627 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.624+0000 7ff8f8aba700 1 -- 172.21.15.125:0/3046515126 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892474184 0 0) 0x7ff8f40cb7e0 con 0x7ff8f4159470 2023-10-06T03:07:04.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.624+0000 7ff8f9abc700 1 --2- 172.21.15.125:0/3046515126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8f41590a0 0x7ff8f40ca5f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff8f40c6b80 tx=0x7ff8e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1bcddafe60c9cea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:04.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.624+0000 7ff8f8aba700 1 -- 172.21.15.125:0/3046515126 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4011630 con 0x7ff8f41590a0 2023-10-06T03:07:04.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.624+0000 7ff8f8aba700 1 -- 172.21.15.125:0/3046515126 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e4011790 con 0x7ff8f41590a0 2023-10-06T03:07:04.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.624+0000 7ff8f8aba700 1 -- 172.21.15.125:0/3046515126 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e4011b30 con 0x7ff8f41590a0 2023-10-06T03:07:04.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.625+0000 7ff8fbd20700 1 -- 172.21.15.125:0/3046515126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8f41590a0 msgr2=0x7ff8f40ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.625+0000 7ff8fbd20700 1 --2- 172.21.15.125:0/3046515126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8f41590a0 0x7ff8f40ca5f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7ff8f40c6b80 tx=0x7ff8e40091a0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.625+0000 7ff8fbd20700 1 -- 172.21.15.125:0/3046515126 shutdown_connections 2023-10-06T03:07:04.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.625+0000 7ff8fbd20700 1 --2- 172.21.15.125:0/3046515126 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8f41590a0 0x7ff8f40ca5f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.625+0000 7ff8fbd20700 1 --2- 172.21.15.125:0/3046515126 >> v2:172.21.15.130:3300/0 conn(0x7ff8f406efe0 0x7ff8f4067780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.625+0000 7ff8fbd20700 1 -- 172.21.15.125:0/3046515126 >> 172.21.15.125:0/3046515126 conn(0x7ff8f406b3b0 msgr2=0x7ff8f40cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:04.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.625+0000 7ff8fbd20700 1 -- 172.21.15.125:0/3046515126 shutdown_connections 2023-10-06T03:07:04.628 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.625+0000 7ff8fbd20700 1 -- 172.21.15.125:0/3046515126 wait complete. 2023-10-06T03:07:04.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.626+0000 7ff8fbd20700 1 Processor -- start 2023-10-06T03:07:04.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.626+0000 7ff8fbd20700 1 -- start start 2023-10-06T03:07:04.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8fbd20700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8f406efe0 0x7ff8f4156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8fbd20700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8f41590a0 0x7ff8f40af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8fbd20700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8f4159470 0x7ff8f40b1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8fbd20700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f40b08e0 con 0x7ff8f4159470 2023-10-06T03:07:04.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8fbd20700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f4156760 con 0x7ff8f41590a0 2023-10-06T03:07:04.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8fbd20700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f40b0d70 con 0x7ff8f406efe0 2023-10-06T03:07:04.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8fa2bd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8f4159470 0x7ff8f40b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.632 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8fa2bd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8f4159470 0x7ff8f40b1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35240/0 (socket says 172.21.15.125:35240) 2023-10-06T03:07:04.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8fa2bd700 1 -- 172.21.15.125:0/137514108 learned_addr learned my addr 172.21.15.125:0/137514108 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:04.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8f92bb700 1 --2- 172.21.15.125:0/137514108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8f41590a0 0x7ff8f40af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8f9abc700 1 --2- 172.21.15.125:0/137514108 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8f406efe0 0x7ff8f4156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8fa2bd700 1 -- 172.21.15.125:0/137514108 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8f406efe0 msgr2=0x7ff8f4156220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8fa2bd700 1 --2- 172.21.15.125:0/137514108 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8f406efe0 0x7ff8f4156220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8fa2bd700 1 -- 172.21.15.125:0/137514108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8f41590a0 msgr2=0x7ff8f40af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8fa2bd700 1 --2- 172.21.15.125:0/137514108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8f41590a0 0x7ff8f40af380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8fa2bd700 1 -- 172.21.15.125:0/137514108 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e4009420 con 0x7ff8f4159470 2023-10-06T03:07:04.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8f9abc700 1 --2- 172.21.15.125:0/137514108 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7ff8f406efe0 0x7ff8f4156220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:07:04.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8fa2bd700 1 --2- 172.21.15.125:0/137514108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8f4159470 0x7ff8f40b1950 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009df0 tx=0x7ff8ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:04.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8e9ffb700 1 -- 172.21.15.125:0/137514108 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec00cb50 con 0x7ff8f4159470 2023-10-06T03:07:04.633 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8e9ffb700 1 -- 172.21.15.125:0/137514108 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec00f040 con 0x7ff8f4159470 2023-10-06T03:07:04.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8fbd20700 1 -- 172.21.15.125:0/137514108 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f40afcd0 con 0x7ff8f4159470 2023-10-06T03:07:04.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.627+0000 7ff8e9ffb700 1 -- 172.21.15.125:0/137514108 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec014480 con 0x7ff8f4159470 2023-10-06T03:07:04.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.628+0000 7ff8fbd20700 1 -- 172.21.15.125:0/137514108 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f40b0290 con 0x7ff8f4159470 2023-10-06T03:07:04.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.628+0000 7ff8fbd20700 1 -- 172.21.15.125:0/137514108 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff8f406d830 con 0x7ff8f4159470 2023-10-06T03:07:04.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.629+0000 7ff8e9ffb700 1 -- 172.21.15.125:0/137514108 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff8ec014830 con 0x7ff8f4159470 2023-10-06T03:07:04.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.629+0000 7ff8e9ffb700 1 --2- 172.21.15.125:0/137514108 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff8d8066f30 0x7ff8d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.629+0000 7ff8e9ffb700 1 -- 172.21.15.125:0/137514108 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7ff8ec085140 con 0x7ff8f4159470 2023-10-06T03:07:04.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.629+0000 7ff8f9abc700 1 --2- 172.21.15.125:0/137514108 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff8d8066f30 0x7ff8d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.629+0000 7ff8e9ffb700 1 --2- 172.21.15.125:0/137514108 >> [v2:172.21.15.125:6803/119699,v1:172.21.15.125:6807/119699] conn(0x7ff8d806d850 0x7ff8d806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.629+0000 7ff8e9ffb700 1 -- 172.21.15.125:0/137514108 --> [v2:172.21.15.125:6803/119699,v1:172.21.15.125:6807/119699] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8d8070370 con 0x7ff8d806d850 2023-10-06T03:07:04.634 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.629+0000 7ff8e9ffb700 1 -- 172.21.15.125:0/137514108 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8ec0876a0 con 0x7ff8f4159470 2023-10-06T03:07:04.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.630+0000 7ff8f92bb700 1 --2- 172.21.15.125:0/137514108 >> [v2:172.21.15.125:6803/119699,v1:172.21.15.125:6807/119699] conn(0x7ff8d806d850 0x7ff8d806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.630+0000 7ff8f9abc700 1 --2- 172.21.15.125:0/137514108 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff8d8066f30 0x7ff8d80693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff8e40093f0 tx=0x7ff8e4017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:04.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.630+0000 7ff8f92bb700 1 --2- 172.21.15.125:0/137514108 >> [v2:172.21.15.125:6803/119699,v1:172.21.15.125:6807/119699] conn(0x7ff8d806d850 0x7ff8d806fca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:04.635 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.630+0000 7ff8e9ffb700 1 -- 172.21.15.125:0/137514108 <== osd.2 v2:172.21.15.125:6803/119699 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff8d8070370 con 0x7ff8d806d850 2023-10-06T03:07:04.645 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.644+0000 7ff8fbd20700 1 -- 172.21.15.125:0/137514108 --> [v2:172.21.15.125:6803/119699,v1:172.21.15.125:6807/119699] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff8f404bb80 con 0x7ff8d806d850 2023-10-06T03:07:04.646 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.644+0000 7ff8e9ffb700 1 -- 172.21.15.125:0/137514108 <== osd.2 v2:172.21.15.125:6803/119699 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff8f404bb80 con 0x7ff8d806d850 2023-10-06T03:07:04.646 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:07:04.646 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:07:04.646 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:07:04.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.644+0000 7ff8fbd20700 1 -- 172.21.15.125:0/137514108 >> [v2:172.21.15.125:6803/119699,v1:172.21.15.125:6807/119699] conn(0x7ff8d806d850 msgr2=0x7ff8d806fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.644+0000 7ff8fbd20700 1 --2- 172.21.15.125:0/137514108 >> [v2:172.21.15.125:6803/119699,v1:172.21.15.125:6807/119699] conn(0x7ff8d806d850 0x7ff8d806fca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.645+0000 7ff8fbd20700 1 -- 172.21.15.125:0/137514108 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff8d8066f30 msgr2=0x7ff8d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.645+0000 7ff8fbd20700 1 --2- 172.21.15.125:0/137514108 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7ff8d8066f30 0x7ff8d80693e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff8e40093f0 tx=0x7ff8e4017000 comp rx=0 tx=0).stop 2023-10-06T03:07:04.647 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.645+0000 7ff8fbd20700 1 -- 172.21.15.125:0/137514108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8f4159470 msgr2=0x7ff8f40b1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.645+0000 7ff8fbd20700 1 --2- 172.21.15.125:0/137514108 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7ff8f4159470 0x7ff8f40b1950 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009df0 tx=0x7ff8ec00b040 comp rx=0 tx=0).stop 2023-10-06T03:07:04.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.645+0000 7ff8fa2bd700 1 -- 172.21.15.125:0/137514108 reap_dead start 2023-10-06T03:07:04.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.645+0000 7ff8fbd20700 1 -- 172.21.15.125:0/137514108 shutdown_connections 2023-10-06T03:07:04.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.645+0000 7ff8fbd20700 1 -- 172.21.15.125:0/137514108 >> 172.21.15.125:0/137514108 conn(0x7ff8f406b3b0 msgr2=0x7ff8f4157ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:04.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.645+0000 7ff8fbd20700 1 -- 172.21.15.125:0/137514108 shutdown_connections 2023-10-06T03:07:04.648 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.645+0000 7ff8fbd20700 1 -- 172.21.15.125:0/137514108 wait complete. 2023-10-06T03:07:04.658 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T03:07:04.775 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.774+0000 7f4dc873d700 1 Processor -- start 2023-10-06T03:07:04.776 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.774+0000 7f4dc873d700 1 -- start start 2023-10-06T03:07:04.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.775+0000 7f4dc873d700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f4dc015cb00 0x7f4dc00b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.775+0000 7f4dc873d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4dc0068ba0 0x7f4dc00cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.775+0000 7f4dc873d700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc00ca670 con 0x7f4dc0067610 2023-10-06T03:07:04.778 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.775+0000 7f4dc873d700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc0068320 con 0x7f4dc0068ba0 2023-10-06T03:07:04.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.775+0000 7f4dc873d700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc0067a80 con 0x7f4dc015cb00 2023-10-06T03:07:04.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.775+0000 7f4dc6cda700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f4dc0068ba0 0x7f4dc00cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.775+0000 7f4dc5cd8700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f4dc0067610 0x7f4dc0068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40564/0 (socket says 172.21.15.125:40564) 2023-10-06T03:07:04.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.775+0000 7f4dc5cd8700 1 -- 172.21.15.125:0/1684621723 learned_addr learned my addr 172.21.15.125:0/1684621723 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:07:04.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.775+0000 7f4dc64d9700 1 --2- 172.21.15.125:0/1684621723 >> v2:172.21.15.130:3300/0 conn(0x7f4dc015cb00 0x7f4dc00b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.775+0000 7f4dc6cda700 1 -- 172.21.15.125:0/1684621723 >> v2:172.21.15.130:3300/0 conn(0x7f4dc015cb00 msgr2=0x7f4dc00b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:04.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.775+0000 7f4dc6cda700 1 --2- 172.21.15.125:0/1684621723 >> v2:172.21.15.130:3300/0 conn(0x7f4dc015cb00 0x7f4dc00b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.775+0000 7f4dc6cda700 1 -- 172.21.15.125:0/1684621723 >> v1:172.21.15.125:6789/0 conn(0x7f4dc0067610 legacy=0x7f4dc0068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.775+0000 7f4dc6cda700 1 -- 172.21.15.125:0/1684621723 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc0067d60 con 0x7f4dc0068ba0 2023-10-06T03:07:04.779 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.776+0000 7f4dc6cda700 1 --2- 172.21.15.125:0/1684621723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dc0068ba0 0x7f4dc00cab00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4dc006fce0 tx=0x7f4db8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d98e0f6c95ad35 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:04.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.776+0000 7f4dc54d7700 1 -- 172.21.15.125:0/1684621723 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db800e070 con 0x7f4dc0068ba0 2023-10-06T03:07:04.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.776+0000 7f4dc54d7700 1 -- 172.21.15.125:0/1684621723 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db800bc30 con 0x7f4dc0068ba0 2023-10-06T03:07:04.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.776+0000 7f4dc54d7700 1 -- 172.21.15.125:0/1684621723 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db8012430 con 0x7f4dc0068ba0 2023-10-06T03:07:04.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.776+0000 7f4dc873d700 1 -- 172.21.15.125:0/1684621723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dc0068ba0 msgr2=0x7f4dc00cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.776+0000 7f4dc873d700 1 --2- 172.21.15.125:0/1684621723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dc0068ba0 0x7f4dc00cab00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4dc006fce0 tx=0x7f4db8009780 comp rx=0 tx=0).stop 2023-10-06T03:07:04.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.776+0000 7f4dc873d700 1 -- 172.21.15.125:0/1684621723 shutdown_connections 2023-10-06T03:07:04.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.776+0000 7f4dc873d700 1 --2- 172.21.15.125:0/1684621723 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dc0068ba0 0x7f4dc00cab00 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.776+0000 7f4dc873d700 1 --2- 172.21.15.125:0/1684621723 >> v2:172.21.15.130:3300/0 conn(0x7f4dc015cb00 0x7f4dc00b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.776+0000 7f4dc873d700 1 -- 172.21.15.125:0/1684621723 >> 172.21.15.125:0/1684621723 conn(0x7f4dc00af730 msgr2=0x7f4dc00afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:04.780 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.776+0000 7f4dc873d700 1 -- 172.21.15.125:0/1684621723 shutdown_connections 2023-10-06T03:07:04.781 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.776+0000 7f4dc873d700 1 -- 172.21.15.125:0/1684621723 wait complete. 2023-10-06T03:07:04.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.777+0000 7f4dc873d700 1 Processor -- start 2023-10-06T03:07:04.783 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.777+0000 7f4dc873d700 1 -- start start 2023-10-06T03:07:04.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.778+0000 7f4dc873d700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dc0067610 0x7f4dc00cc810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.778+0000 7f4dc873d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dc0068ba0 0x7f4dc01560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.778+0000 7f4dc873d700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc015cb00 0x7f4dc00c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.778+0000 7f4dc873d700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc00cc380 con 0x7f4dc0068ba0 2023-10-06T03:07:04.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.778+0000 7f4dc873d700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc00cb770 con 0x7f4dc015cb00 2023-10-06T03:07:04.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.778+0000 7f4dc873d700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc00cba50 con 0x7f4dc0067610 2023-10-06T03:07:04.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.778+0000 7f4dc5cd8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dc0068ba0 0x7f4dc01560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.778+0000 7f4dc5cd8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dc0068ba0 0x7f4dc01560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35250/0 (socket says 172.21.15.125:35250) 2023-10-06T03:07:04.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.778+0000 7f4dc5cd8700 1 -- 172.21.15.125:0/2589204952 learned_addr learned my addr 172.21.15.125:0/2589204952 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:04.784 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.778+0000 7f4dc64d9700 1 --2- 172.21.15.125:0/2589204952 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dc0067610 0x7f4dc00cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.778+0000 7f4dc6cda700 1 --2- 172.21.15.125:0/2589204952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc015cb00 0x7f4dc00c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.779+0000 7f4dc5cd8700 1 -- 172.21.15.125:0/2589204952 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dc0067610 msgr2=0x7f4dc00cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.779+0000 7f4dc5cd8700 1 --2- 172.21.15.125:0/2589204952 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dc0067610 0x7f4dc00cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.779+0000 7f4dc5cd8700 1 -- 172.21.15.125:0/2589204952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc015cb00 msgr2=0x7f4dc00c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.779+0000 7f4dc5cd8700 1 --2- 172.21.15.125:0/2589204952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc015cb00 0x7f4dc00c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.779+0000 7f4dc5cd8700 1 -- 172.21.15.125:0/2589204952 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db8009a20 con 0x7f4dc0068ba0 2023-10-06T03:07:04.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.779+0000 7f4dc5cd8700 1 --2- 172.21.15.125:0/2589204952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dc0068ba0 0x7f4dc01560d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00c790 tx=0x7f4dbc007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:04.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.779+0000 7f4db67fc700 1 -- 172.21.15.125:0/2589204952 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc005b30 con 0x7f4dc0068ba0 2023-10-06T03:07:04.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.779+0000 7f4db67fc700 1 -- 172.21.15.125:0/2589204952 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc005c90 con 0x7f4dc0068ba0 2023-10-06T03:07:04.785 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.779+0000 7f4dc873d700 1 -- 172.21.15.125:0/2589204952 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc00cbd30 con 0x7f4dc0068ba0 2023-10-06T03:07:04.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.779+0000 7f4db67fc700 1 -- 172.21.15.125:0/2589204952 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc007320 con 0x7f4dc0068ba0 2023-10-06T03:07:04.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.779+0000 7f4dc873d700 1 -- 172.21.15.125:0/2589204952 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc00cb400 con 0x7f4dc0068ba0 2023-10-06T03:07:04.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.780+0000 7f4dc873d700 1 -- 172.21.15.125:0/2589204952 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc00cc4f0 con 0x7f4dc0068ba0 2023-10-06T03:07:04.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.780+0000 7f4db67fc700 1 -- 172.21.15.125:0/2589204952 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4dbc01b3b0 con 0x7f4dc0068ba0 2023-10-06T03:07:04.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.781+0000 7f4db67fc700 1 --2- 172.21.15.125:0/2589204952 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4da4066f30 0x7f4da40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:04.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.781+0000 7f4dc64d9700 1 --2- 172.21.15.125:0/2589204952 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4da4066f30 0x7f4da40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:04.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.781+0000 7f4db67fc700 1 -- 172.21.15.125:0/2589204952 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f4dbc0838a0 con 0x7f4dc0068ba0 2023-10-06T03:07:04.786 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.781+0000 7f4dc64d9700 1 --2- 172.21.15.125:0/2589204952 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4da4066f30 0x7f4da40693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4db00061f0 tx=0x7f4db0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:04.787 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.785+0000 7f4db67fc700 1 -- 172.21.15.125:0/2589204952 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4dbc050b70 con 0x7f4dc0068ba0 2023-10-06T03:07:04.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.968+0000 7f4dc873d700 1 -- 172.21.15.125:0/2589204952 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4dc0066510 con 0x7f4da4066f30 2023-10-06T03:07:04.969 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.968+0000 7f4db67fc700 1 -- 172.21.15.125:0/2589204952 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4dc0066510 con 0x7f4da4066f30 2023-10-06T03:07:04.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.970+0000 7f4dc873d700 1 -- 172.21.15.125:0/2589204952 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4da4066f30 msgr2=0x7f4da40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.970+0000 7f4dc873d700 1 --2- 172.21.15.125:0/2589204952 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4da4066f30 0x7f4da40693e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4db00061f0 tx=0x7f4db0008040 comp rx=0 tx=0).stop 2023-10-06T03:07:04.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.970+0000 7f4dc873d700 1 -- 172.21.15.125:0/2589204952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dc0068ba0 msgr2=0x7f4dc01560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:04.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.970+0000 7f4dc873d700 1 --2- 172.21.15.125:0/2589204952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dc0068ba0 0x7f4dc01560d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc00c790 tx=0x7f4dbc007f00 comp rx=0 tx=0).stop 2023-10-06T03:07:04.972 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.970+0000 7f4dc873d700 1 -- 172.21.15.125:0/2589204952 shutdown_connections 2023-10-06T03:07:04.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.970+0000 7f4dc873d700 1 --2- 172.21.15.125:0/2589204952 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f4da4066f30 0x7f4da40693e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.970+0000 7f4dc873d700 1 --2- 172.21.15.125:0/2589204952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4dc015cb00 0x7f4dc00c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.970+0000 7f4dc873d700 1 --2- 172.21.15.125:0/2589204952 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f4dc0067610 0x7f4dc00cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.970+0000 7f4dc873d700 1 --2- 172.21.15.125:0/2589204952 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f4dc0068ba0 0x7f4dc01560d0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:04.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.970+0000 7f4dc873d700 1 -- 172.21.15.125:0/2589204952 >> 172.21.15.125:0/2589204952 conn(0x7f4dc00af730 msgr2=0x7f4dc015b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:04.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.970+0000 7f4dc873d700 1 -- 172.21.15.125:0/2589204952 shutdown_connections 2023-10-06T03:07:04.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:04.970+0000 7f4dc873d700 1 -- 172.21.15.125:0/2589204952 wait complete. 2023-10-06T03:07:04.974 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T03:07:04.983 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T03:07:04.983 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:07:05.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.103+0000 7fd6db3e2700 1 Processor -- start 2023-10-06T03:07:05.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.103+0000 7fd6db3e2700 1 -- start start 2023-10-06T03:07:05.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6db3e2700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd6d40ca5f0 0x7fd6d406e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6db3e2700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d40cb7e0 con 0x7fd6d41590a0 2023-10-06T03:07:05.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6db3e2700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d406f220 con 0x7fd6d406ee10 2023-10-06T03:07:05.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6db3e2700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d40cabd0 con 0x7fd6d40ca5f0 2023-10-06T03:07:05.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6d917e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd6d41590a0 0x7fd6d4159470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40574/0 (socket says 172.21.15.125:40574) 2023-10-06T03:07:05.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6d917e700 1 -- 172.21.15.125:0/3378661232 learned_addr learned my addr 172.21.15.125:0/3378661232 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:07:05.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6d897d700 1 --2- 172.21.15.125:0/3378661232 >> v2:172.21.15.130:3300/0 conn(0x7fd6d40ca5f0 0x7fd6d406e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6cbfff700 1 -- 172.21.15.125:0/3378661232 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614564925 0 0) 0x7fd6d40cb7e0 con 0x7fd6d41590a0 2023-10-06T03:07:05.108 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6cbfff700 1 -- 172.21.15.125:0/3378661232 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6c0003570 con 0x7fd6d41590a0 2023-10-06T03:07:05.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6cbfff700 1 -- 172.21.15.125:0/3378661232 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2557133210 0 0) 0x7fd6c0003570 con 0x7fd6d41590a0 2023-10-06T03:07:05.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6cbfff700 1 -- 172.21.15.125:0/3378661232 >> v2:172.21.15.130:3300/0 conn(0x7fd6d40ca5f0 msgr2=0x7fd6d406e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:05.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6cbfff700 1 --2- 172.21.15.125:0/3378661232 >> v2:172.21.15.130:3300/0 conn(0x7fd6d40ca5f0 0x7fd6d406e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6cbfff700 1 -- 172.21.15.125:0/3378661232 >> v1:172.21.15.130:6789/0 conn(0x7fd6d406ee10 legacy=0x7fd6d4067780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6cbfff700 1 -- 172.21.15.125:0/3378661232 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d40caeb0 con 0x7fd6d41590a0 2023-10-06T03:07:05.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6cbfff700 1 -- 172.21.15.125:0/3378661232 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7fd6d0001470 con 0x7fd6d41590a0 2023-10-06T03:07:05.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6cbfff700 1 -- 172.21.15.125:0/3378661232 >> v1:172.21.15.125:6789/0 conn(0x7fd6d41590a0 legacy=0x7fd6d4159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6cbfff700 1 --2- 172.21.15.125:0/3378661232 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd6c0003a60 0x7fd6c0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6cbfff700 1 --2- 172.21.15.125:0/3378661232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6c0004810 0x7fd6c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.109 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6cbfff700 1 --2- 172.21.15.125:0/3378661232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6c00051c0 0x7fd6c000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6cbfff700 1 -- 172.21.15.125:0/3378661232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40cabd0 con 0x7fd6c0004810 2023-10-06T03:07:05.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6cbfff700 1 -- 172.21.15.125:0/3378661232 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c000c0d0 con 0x7fd6c00051c0 2023-10-06T03:07:05.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.104+0000 7fd6cbfff700 1 -- 172.21.15.125:0/3378661232 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c000c290 con 0x7fd6c0003a60 2023-10-06T03:07:05.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.105+0000 7fd6d897d700 1 --2- 172.21.15.125:0/3378661232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6c0004810 0x7fd6c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.105+0000 7fd6d997f700 1 --2- 172.21.15.125:0/3378661232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6c00051c0 0x7fd6c000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.105+0000 7fd6d917e700 1 --2- 172.21.15.125:0/3378661232 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd6c0003a60 0x7fd6c0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.105+0000 7fd6d897d700 1 -- 172.21.15.125:0/3378661232 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd6c0003a60 msgr2=0x7fd6c0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:05.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.105+0000 7fd6d897d700 1 --2- 172.21.15.125:0/3378661232 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd6c0003a60 0x7fd6c0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.105+0000 7fd6d897d700 1 -- 172.21.15.125:0/3378661232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6c00051c0 msgr2=0x7fd6c000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:05.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.105+0000 7fd6d897d700 1 --2- 172.21.15.125:0/3378661232 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6c00051c0 0x7fd6c000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.105+0000 7fd6d897d700 1 -- 172.21.15.125:0/3378661232 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c0003570 con 0x7fd6c0004810 2023-10-06T03:07:05.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.105+0000 7fd6d997f700 1 -- 172.21.15.125:0/3378661232 reap_dead start 2023-10-06T03:07:05.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.105+0000 7fd6d897d700 1 --2- 172.21.15.125:0/3378661232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6c0004810 0x7fd6c0004c80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009c00 tx=0x7fd6c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aded07a0918778b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:05.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.105+0000 7fd6cbfff700 1 -- 172.21.15.125:0/3378661232 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c400e710 con 0x7fd6c0004810 2023-10-06T03:07:05.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.105+0000 7fd6cbfff700 1 -- 172.21.15.125:0/3378661232 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c400e870 con 0x7fd6c0004810 2023-10-06T03:07:05.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.105+0000 7fd6cbfff700 1 -- 172.21.15.125:0/3378661232 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c400ec30 con 0x7fd6c0004810 2023-10-06T03:07:05.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.106+0000 7fd6db3e2700 1 -- 172.21.15.125:0/3378661232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6c0004810 msgr2=0x7fd6c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.106+0000 7fd6db3e2700 1 --2- 172.21.15.125:0/3378661232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6c0004810 0x7fd6c0004c80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009c00 tx=0x7fd6c40091a0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.106+0000 7fd6db3e2700 1 -- 172.21.15.125:0/3378661232 shutdown_connections 2023-10-06T03:07:05.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.106+0000 7fd6db3e2700 1 --2- 172.21.15.125:0/3378661232 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6c0004810 0x7fd6c0004c80 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.106+0000 7fd6db3e2700 1 -- 172.21.15.125:0/3378661232 >> 172.21.15.125:0/3378661232 conn(0x7fd6d406b3b0 msgr2=0x7fd6d40cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:05.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.106+0000 7fd6db3e2700 1 -- 172.21.15.125:0/3378661232 shutdown_connections 2023-10-06T03:07:05.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.106+0000 7fd6db3e2700 1 -- 172.21.15.125:0/3378661232 wait complete. 2023-10-06T03:07:05.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.107+0000 7fd6db3e2700 1 Processor -- start 2023-10-06T03:07:05.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.107+0000 7fd6db3e2700 1 -- start start 2023-10-06T03:07:05.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.108+0000 7fd6db3e2700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd6c0004810 0x7fd6d415b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.108+0000 7fd6db3e2700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6d415ec10 0x7fd6d40c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.108+0000 7fd6db3e2700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6d4149f40 0x7fd6d4157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.108+0000 7fd6db3e2700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d415ad90 con 0x7fd6d4149f40 2023-10-06T03:07:05.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.108+0000 7fd6db3e2700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d415b350 con 0x7fd6d415ec10 2023-10-06T03:07:05.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.108+0000 7fd6db3e2700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40c5fd0 con 0x7fd6c0004810 2023-10-06T03:07:05.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.108+0000 7fd6d997f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6d4149f40 0x7fd6d4157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.108+0000 7fd6d997f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6d4149f40 0x7fd6d4157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35268/0 (socket says 172.21.15.125:35268) 2023-10-06T03:07:05.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.108+0000 7fd6d997f700 1 -- 172.21.15.125:0/2753111122 learned_addr learned my addr 172.21.15.125:0/2753111122 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:05.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.109+0000 7fd6d897d700 1 --2- 172.21.15.125:0/2753111122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6d415ec10 0x7fd6d40c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.109+0000 7fd6d917e700 1 --2- 172.21.15.125:0/2753111122 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd6c0004810 0x7fd6d415b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.109+0000 7fd6d997f700 1 -- 172.21.15.125:0/2753111122 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd6c0004810 msgr2=0x7fd6d415b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.109+0000 7fd6d997f700 1 --2- 172.21.15.125:0/2753111122 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd6c0004810 0x7fd6d415b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.109+0000 7fd6d997f700 1 -- 172.21.15.125:0/2753111122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6d415ec10 msgr2=0x7fd6d40c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.109+0000 7fd6d997f700 1 --2- 172.21.15.125:0/2753111122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd6d415ec10 0x7fd6d40c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.109+0000 7fd6d997f700 1 -- 172.21.15.125:0/2753111122 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d40c62b0 con 0x7fd6d4149f40 2023-10-06T03:07:05.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.109+0000 7fd6d917e700 1 --2- 172.21.15.125:0/2753111122 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd6c0004810 0x7fd6d415b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:07:05.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.109+0000 7fd6d997f700 1 --2- 172.21.15.125:0/2753111122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6d4149f40 0x7fd6d4157080 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4063880 tx=0x7fd6cc001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:05.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.109+0000 7fd6c97fa700 1 -- 172.21.15.125:0/2753111122 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc006e80 con 0x7fd6d4149f40 2023-10-06T03:07:05.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.109+0000 7fd6c97fa700 1 -- 172.21.15.125:0/2753111122 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc014480 con 0x7fd6d4149f40 2023-10-06T03:07:05.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.109+0000 7fd6db3e2700 1 -- 172.21.15.125:0/2753111122 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d415afe0 con 0x7fd6d4149f40 2023-10-06T03:07:05.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.109+0000 7fd6c97fa700 1 -- 172.21.15.125:0/2753111122 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc014840 con 0x7fd6d4149f40 2023-10-06T03:07:05.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.109+0000 7fd6db3e2700 1 -- 172.21.15.125:0/2753111122 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d40c5c10 con 0x7fd6d4149f40 2023-10-06T03:07:05.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.110+0000 7fd6db3e2700 1 -- 172.21.15.125:0/2753111122 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd6d406d830 con 0x7fd6d4149f40 2023-10-06T03:07:05.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.110+0000 7fd6c97fa700 1 -- 172.21.15.125:0/2753111122 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6cc007070 con 0x7fd6d4149f40 2023-10-06T03:07:05.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.111+0000 7fd6c97fa700 1 --2- 172.21.15.125:0/2753111122 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd6b8066f30 0x7fd6b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.117 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.111+0000 7fd6c97fa700 1 -- 172.21.15.125:0/2753111122 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fd6cc084950 con 0x7fd6d4149f40 2023-10-06T03:07:05.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.111+0000 7fd6d917e700 1 --2- 172.21.15.125:0/2753111122 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd6b8066f30 0x7fd6b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.111+0000 7fd6c97fa700 1 --2- 172.21.15.125:0/2753111122 >> [v2:172.21.15.125:6802/119698,v1:172.21.15.125:6806/119698] conn(0x7fd6b806d850 0x7fd6b806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.111+0000 7fd6c97fa700 1 -- 172.21.15.125:0/2753111122 --> [v2:172.21.15.125:6802/119698,v1:172.21.15.125:6806/119698] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6b8070370 con 0x7fd6b806d850 2023-10-06T03:07:05.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.111+0000 7fd6c97fa700 1 -- 172.21.15.125:0/2753111122 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6cc084d20 con 0x7fd6d4149f40 2023-10-06T03:07:05.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.111+0000 7fd6d897d700 1 --2- 172.21.15.125:0/2753111122 >> [v2:172.21.15.125:6802/119698,v1:172.21.15.125:6806/119698] conn(0x7fd6b806d850 0x7fd6b806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.111+0000 7fd6d917e700 1 --2- 172.21.15.125:0/2753111122 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd6b8066f30 0x7fd6b80693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00015a0 tx=0x7fd6d0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:05.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.111+0000 7fd6d897d700 1 --2- 172.21.15.125:0/2753111122 >> [v2:172.21.15.125:6802/119698,v1:172.21.15.125:6806/119698] conn(0x7fd6b806d850 0x7fd6b806fca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:05.118 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.112+0000 7fd6c97fa700 1 -- 172.21.15.125:0/2753111122 <== osd.3 v2:172.21.15.125:6802/119698 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd6b8070370 con 0x7fd6b806d850 2023-10-06T03:07:05.126 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.125+0000 7fd6db3e2700 1 -- 172.21.15.125:0/2753111122 --> [v2:172.21.15.125:6802/119698,v1:172.21.15.125:6806/119698] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd6d404bb80 con 0x7fd6b806d850 2023-10-06T03:07:05.127 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.126+0000 7fd6c97fa700 1 -- 172.21.15.125:0/2753111122 <== osd.3 v2:172.21.15.125:6802/119698 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd6d404bb80 con 0x7fd6b806d850 2023-10-06T03:07:05.127 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:07:05.127 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:07:05.127 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:07:05.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.126+0000 7fd6db3e2700 1 -- 172.21.15.125:0/2753111122 >> [v2:172.21.15.125:6802/119698,v1:172.21.15.125:6806/119698] conn(0x7fd6b806d850 msgr2=0x7fd6b806fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.126+0000 7fd6db3e2700 1 --2- 172.21.15.125:0/2753111122 >> [v2:172.21.15.125:6802/119698,v1:172.21.15.125:6806/119698] conn(0x7fd6b806d850 0x7fd6b806fca0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.128 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.126+0000 7fd6db3e2700 1 -- 172.21.15.125:0/2753111122 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd6b8066f30 msgr2=0x7fd6b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.126+0000 7fd6db3e2700 1 --2- 172.21.15.125:0/2753111122 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd6b8066f30 0x7fd6b80693e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00015a0 tx=0x7fd6d0009040 comp rx=0 tx=0).stop 2023-10-06T03:07:05.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.126+0000 7fd6db3e2700 1 -- 172.21.15.125:0/2753111122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6d4149f40 msgr2=0x7fd6d4157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.126+0000 7fd6db3e2700 1 --2- 172.21.15.125:0/2753111122 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd6d4149f40 0x7fd6d4157080 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4063880 tx=0x7fd6cc001640 comp rx=0 tx=0).stop 2023-10-06T03:07:05.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.126+0000 7fd6d997f700 1 -- 172.21.15.125:0/2753111122 reap_dead start 2023-10-06T03:07:05.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.126+0000 7fd6db3e2700 1 -- 172.21.15.125:0/2753111122 shutdown_connections 2023-10-06T03:07:05.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.126+0000 7fd6db3e2700 1 -- 172.21.15.125:0/2753111122 >> 172.21.15.125:0/2753111122 conn(0x7fd6d406b3b0 msgr2=0x7fd6d4157ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:05.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.126+0000 7fd6db3e2700 1 -- 172.21.15.125:0/2753111122 shutdown_connections 2023-10-06T03:07:05.129 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.126+0000 7fd6db3e2700 1 -- 172.21.15.125:0/2753111122 wait complete. 2023-10-06T03:07:05.139 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T03:07:05.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.255+0000 7f725ee4b700 1 Processor -- start 2023-10-06T03:07:05.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.255+0000 7f725ee4b700 1 -- start start 2023-10-06T03:07:05.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.256+0000 7f725ee4b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72580cba50 0x7f72580c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.257+0000 7f725ee4b700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f72580c8150 0x7f72580c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.257+0000 7f725ee4b700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72580c9470 con 0x7f72580af320 2023-10-06T03:07:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.257+0000 7f725cbe7700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f72580af320 0x7f72580cb340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:40580/0 (socket says 172.21.15.125:40580) 2023-10-06T03:07:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.257+0000 7f725ee4b700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72580c9b40 con 0x7f72580c8150 2023-10-06T03:07:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.257+0000 7f725cbe7700 1 -- 172.21.15.125:0/3816032394 learned_addr learned my addr 172.21.15.125:0/3816032394 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:07:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.257+0000 7f725ee4b700 1 -- 172.21.15.125:0/3816032394 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72580c85a0 con 0x7f72580cba50 2023-10-06T03:07:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.257+0000 7f725d3e8700 1 --2- 172.21.15.125:0/3816032394 >> v2:172.21.15.125:3300/0 conn(0x7f72580c8150 0x7f72580c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.257+0000 7f7257fff700 1 --2- 172.21.15.125:0/3816032394 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72580cba50 0x7f72580c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.257+0000 7f72577fe700 1 -- 172.21.15.125:0/3816032394 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 560305976 0 0) 0x7f72580c9470 con 0x7f72580af320 2023-10-06T03:07:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.257+0000 7f72577fe700 1 -- 172.21.15.125:0/3816032394 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7248003570 con 0x7f72580af320 2023-10-06T03:07:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.257+0000 7f725d3e8700 1 -- 172.21.15.125:0/3816032394 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72580cba50 msgr2=0x7f72580c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.257+0000 7f725d3e8700 1 --2- 172.21.15.125:0/3816032394 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72580cba50 0x7f72580c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.257+0000 7f725d3e8700 1 -- 172.21.15.125:0/3816032394 >> v1:172.21.15.125:6789/0 conn(0x7f72580af320 legacy=0x7f72580cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.257+0000 7f725d3e8700 1 -- 172.21.15.125:0/3816032394 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72580c8860 con 0x7f72580c8150 2023-10-06T03:07:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.257+0000 7f725d3e8700 1 --2- 172.21.15.125:0/3816032394 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72580c8150 0x7f72580c1e20 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7250009e60 tx=0x7f7250009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97722c8fb3d0f884 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.257+0000 7f72577fe700 1 -- 172.21.15.125:0/3816032394 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725000e070 con 0x7f72580c8150 2023-10-06T03:07:05.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.257+0000 7f72577fe700 1 -- 172.21.15.125:0/3816032394 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725000bab0 con 0x7f72580c8150 2023-10-06T03:07:05.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.257+0000 7f72577fe700 1 -- 172.21.15.125:0/3816032394 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725000be70 con 0x7f72580c8150 2023-10-06T03:07:05.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.258+0000 7f725ee4b700 1 -- 172.21.15.125:0/3816032394 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72580c8150 msgr2=0x7f72580c1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.258+0000 7f725ee4b700 1 --2- 172.21.15.125:0/3816032394 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72580c8150 0x7f72580c1e20 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7250009e60 tx=0x7f7250009780 comp rx=0 tx=0).stop 2023-10-06T03:07:05.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.258+0000 7f725ee4b700 1 -- 172.21.15.125:0/3816032394 shutdown_connections 2023-10-06T03:07:05.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.258+0000 7f725ee4b700 1 --2- 172.21.15.125:0/3816032394 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72580c8150 0x7f72580c1e20 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.258+0000 7f725ee4b700 1 --2- 172.21.15.125:0/3816032394 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72580cba50 0x7f72580c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.258+0000 7f725ee4b700 1 -- 172.21.15.125:0/3816032394 >> 172.21.15.125:0/3816032394 conn(0x7f7258096120 msgr2=0x7f7258068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:05.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.258+0000 7f725ee4b700 1 -- 172.21.15.125:0/3816032394 shutdown_connections 2023-10-06T03:07:05.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.258+0000 7f725ee4b700 1 -- 172.21.15.125:0/3816032394 wait complete. 2023-10-06T03:07:05.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.259+0000 7f725ee4b700 1 Processor -- start 2023-10-06T03:07:05.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.260+0000 7f725ee4b700 1 -- start start 2023-10-06T03:07:05.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.260+0000 7f725ee4b700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72580af320 0x7f725814da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.260+0000 7f725ee4b700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72580c8150 0x7f72580b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.260+0000 7f725ee4b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72580cba50 0x7f72580b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.266 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.260+0000 7f725ee4b700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72580c6260 con 0x7f72580cba50 2023-10-06T03:07:05.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.260+0000 7f725ee4b700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725814dfa0 con 0x7f72580c8150 2023-10-06T03:07:05.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.260+0000 7f725ee4b700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72580c5670 con 0x7f72580af320 2023-10-06T03:07:05.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.261+0000 7f725d3e8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72580cba50 0x7f72580b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.261+0000 7f725d3e8700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72580cba50 0x7f72580b2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35292/0 (socket says 172.21.15.125:35292) 2023-10-06T03:07:05.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.261+0000 7f725d3e8700 1 -- 172.21.15.125:0/4123782639 learned_addr learned my addr 172.21.15.125:0/4123782639 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:05.267 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.261+0000 7f7257fff700 1 --2- 172.21.15.125:0/4123782639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72580c8150 0x7f72580b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.261+0000 7f725cbe7700 1 --2- 172.21.15.125:0/4123782639 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72580af320 0x7f725814da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.261+0000 7f725d3e8700 1 -- 172.21.15.125:0/4123782639 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72580af320 msgr2=0x7f725814da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.261+0000 7f725d3e8700 1 --2- 172.21.15.125:0/4123782639 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72580af320 0x7f725814da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.261+0000 7f725d3e8700 1 -- 172.21.15.125:0/4123782639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72580c8150 msgr2=0x7f72580b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.268 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.261+0000 7f725d3e8700 1 --2- 172.21.15.125:0/4123782639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72580c8150 0x7f72580b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.261+0000 7f725d3e8700 1 -- 172.21.15.125:0/4123782639 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7250009a20 con 0x7f72580cba50 2023-10-06T03:07:05.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.261+0000 7f725d3e8700 1 --2- 172.21.15.125:0/4123782639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72580cba50 0x7f72580b2160 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f725806df40 tx=0x7f7250019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:05.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.261+0000 7f7254ff9700 1 -- 172.21.15.125:0/4123782639 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250027470 con 0x7f72580cba50 2023-10-06T03:07:05.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.261+0000 7f7254ff9700 1 -- 172.21.15.125:0/4123782639 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72500275f0 con 0x7f72580cba50 2023-10-06T03:07:05.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.261+0000 7f7254ff9700 1 -- 172.21.15.125:0/4123782639 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72500279b0 con 0x7f72580cba50 2023-10-06T03:07:05.269 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.261+0000 7f725ee4b700 1 -- 172.21.15.125:0/4123782639 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72580c5930 con 0x7f72580cba50 2023-10-06T03:07:05.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.261+0000 7f725ee4b700 1 -- 172.21.15.125:0/4123782639 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72580c5ef0 con 0x7f72580cba50 2023-10-06T03:07:05.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.262+0000 7f725ee4b700 1 -- 172.21.15.125:0/4123782639 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7258066510 con 0x7f72580cba50 2023-10-06T03:07:05.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.262+0000 7f7254ff9700 1 -- 172.21.15.125:0/4123782639 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7250024070 con 0x7f72580cba50 2023-10-06T03:07:05.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.263+0000 7f7254ff9700 1 --2- 172.21.15.125:0/4123782639 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f723c066f00 0x7f723c0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.263+0000 7f7254ff9700 1 -- 172.21.15.125:0/4123782639 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f7250086eb0 con 0x7f72580cba50 2023-10-06T03:07:05.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.263+0000 7f725cbe7700 1 --2- 172.21.15.125:0/4123782639 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f723c066f00 0x7f723c0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.270 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.263+0000 7f725cbe7700 1 --2- 172.21.15.125:0/4123782639 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f723c066f00 0x7f723c0693b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f724c004c50 tx=0x7f724c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:05.271 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.267+0000 7f7254ff9700 1 -- 172.21.15.125:0/4123782639 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7250054180 con 0x7f72580cba50 2023-10-06T03:07:05.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.452+0000 7f725ee4b700 1 -- 172.21.15.125:0/4123782639 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f72580c8b40 con 0x7f723c066f00 2023-10-06T03:07:05.453 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.452+0000 7f7254ff9700 1 -- 172.21.15.125:0/4123782639 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f72580c8b40 con 0x7f723c066f00 2023-10-06T03:07:05.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.454+0000 7f725ee4b700 1 -- 172.21.15.125:0/4123782639 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f723c066f00 msgr2=0x7f723c0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.454+0000 7f725ee4b700 1 --2- 172.21.15.125:0/4123782639 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f723c066f00 0x7f723c0693b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f724c004c50 tx=0x7f724c009040 comp rx=0 tx=0).stop 2023-10-06T03:07:05.456 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.454+0000 7f725ee4b700 1 -- 172.21.15.125:0/4123782639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72580cba50 msgr2=0x7f72580b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.454+0000 7f725ee4b700 1 --2- 172.21.15.125:0/4123782639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72580cba50 0x7f72580b2160 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f725806df40 tx=0x7f7250019000 comp rx=0 tx=0).stop 2023-10-06T03:07:05.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.454+0000 7f725ee4b700 1 -- 172.21.15.125:0/4123782639 shutdown_connections 2023-10-06T03:07:05.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.454+0000 7f725ee4b700 1 --2- 172.21.15.125:0/4123782639 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f723c066f00 0x7f723c0693b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.457 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.454+0000 7f725ee4b700 1 --2- 172.21.15.125:0/4123782639 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f72580cba50 0x7f72580b2160 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.454+0000 7f725ee4b700 1 --2- 172.21.15.125:0/4123782639 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f72580af320 0x7f725814da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.454+0000 7f725ee4b700 1 --2- 172.21.15.125:0/4123782639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72580c8150 0x7f72580b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.458 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.454+0000 7f725ee4b700 1 -- 172.21.15.125:0/4123782639 >> 172.21.15.125:0/4123782639 conn(0x7f7258096120 msgr2=0x7f72581552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:05.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.454+0000 7f725ee4b700 1 -- 172.21.15.125:0/4123782639 shutdown_connections 2023-10-06T03:07:05.459 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.454+0000 7f725ee4b700 1 -- 172.21.15.125:0/4123782639 wait complete. 2023-10-06T03:07:05.459 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T03:07:05.468 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T03:07:05.468 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:07:05.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.589+0000 7f745019f700 1 Processor -- start 2023-10-06T03:07:05.591 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.590+0000 7f745019f700 1 -- start start 2023-10-06T03:07:05.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.590+0000 7f745019f700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f74480692c0 0x7f74481641a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.590+0000 7f745019f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74480cf2f0 con 0x7f74480af590 2023-10-06T03:07:05.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.590+0000 7f745019f700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74480b3010 con 0x7f74480af1c0 2023-10-06T03:07:05.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.590+0000 7f745019f700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74480cd250 con 0x7f74480692c0 2023-10-06T03:07:05.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.590+0000 7f744d73a700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f74480af590 0x7f7448068bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38782/0 (socket says 172.21.15.125:38782) 2023-10-06T03:07:05.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744d73a700 1 -- 172.21.15.125:0/2744224262 learned_addr learned my addr 172.21.15.125:0/2744224262 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:07:05.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744e73c700 1 --2- 172.21.15.125:0/2744224262 >> v2:172.21.15.130:3300/0 conn(0x7f74480692c0 0x7f74481641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744cf39700 1 -- 172.21.15.125:0/2744224262 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066639897 0 0) 0x7f74480cf2f0 con 0x7f74480af590 2023-10-06T03:07:05.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744cf39700 1 -- 172.21.15.125:0/2744224262 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7434003570 con 0x7f74480af590 2023-10-06T03:07:05.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744cf39700 1 -- 172.21.15.125:0/2744224262 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2976951868 0 0) 0x7f7434003570 con 0x7f74480af590 2023-10-06T03:07:05.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744cf39700 1 -- 172.21.15.125:0/2744224262 >> v2:172.21.15.130:3300/0 conn(0x7f74480692c0 msgr2=0x7f74481641a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:05.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744cf39700 1 --2- 172.21.15.125:0/2744224262 >> v2:172.21.15.130:3300/0 conn(0x7f74480692c0 0x7f74481641a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744cf39700 1 -- 172.21.15.125:0/2744224262 >> v1:172.21.15.130:6789/0 conn(0x7f74480af1c0 legacy=0x7f74480ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744cf39700 1 -- 172.21.15.125:0/2744224262 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74480cf540 con 0x7f74480af590 2023-10-06T03:07:05.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744cf39700 1 -- 172.21.15.125:0/2744224262 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f7444001470 con 0x7f74480af590 2023-10-06T03:07:05.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744cf39700 1 -- 172.21.15.125:0/2744224262 >> v1:172.21.15.125:6789/0 conn(0x7f74480af590 legacy=0x7f7448068bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744cf39700 1 --2- 172.21.15.125:0/2744224262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7434003a60 0x7f7434003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744cf39700 1 --2- 172.21.15.125:0/2744224262 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7434004810 0x7f7434004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744cf39700 1 --2- 172.21.15.125:0/2744224262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74340051c0 0x7f743400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744cf39700 1 -- 172.21.15.125:0/2744224262 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743400c0a0 con 0x7f7434003a60 2023-10-06T03:07:05.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744cf39700 1 -- 172.21.15.125:0/2744224262 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743400c210 con 0x7f74340051c0 2023-10-06T03:07:05.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744cf39700 1 -- 172.21.15.125:0/2744224262 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f743400c3d0 con 0x7f7434004810 2023-10-06T03:07:05.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744df3b700 1 --2- 172.21.15.125:0/2744224262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7434003a60 0x7f7434003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744e73c700 1 --2- 172.21.15.125:0/2744224262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74340051c0 0x7f743400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744d73a700 1 --2- 172.21.15.125:0/2744224262 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7434004810 0x7f7434004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744df3b700 1 -- 172.21.15.125:0/2744224262 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7434004810 msgr2=0x7f7434004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:05.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744df3b700 1 --2- 172.21.15.125:0/2744224262 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f7434004810 0x7f7434004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.591+0000 7f744df3b700 1 -- 172.21.15.125:0/2744224262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74340051c0 msgr2=0x7f743400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:05.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.592+0000 7f744df3b700 1 --2- 172.21.15.125:0/2744224262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f74340051c0 0x7f743400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.592+0000 7f744e73c700 1 -- 172.21.15.125:0/2744224262 reap_dead start 2023-10-06T03:07:05.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.592+0000 7f744df3b700 1 -- 172.21.15.125:0/2744224262 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7434003570 con 0x7f7434003a60 2023-10-06T03:07:05.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.592+0000 7f744df3b700 1 --2- 172.21.15.125:0/2744224262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7434003a60 0x7f7434003e70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f74380018b0 tx=0x7f7438007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600d4ffb13c83a53 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:05.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.592+0000 7f744cf39700 1 -- 172.21.15.125:0/2744224262 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438012420 con 0x7f7434003a60 2023-10-06T03:07:05.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.592+0000 7f744cf39700 1 -- 172.21.15.125:0/2744224262 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74380125a0 con 0x7f7434003a60 2023-10-06T03:07:05.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.592+0000 7f744cf39700 1 -- 172.21.15.125:0/2744224262 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438012960 con 0x7f7434003a60 2023-10-06T03:07:05.598 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.592+0000 7f745019f700 1 -- 172.21.15.125:0/2744224262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7434003a60 msgr2=0x7f7434003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.592+0000 7f745019f700 1 --2- 172.21.15.125:0/2744224262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7434003a60 0x7f7434003e70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f74380018b0 tx=0x7f7438007d30 comp rx=0 tx=0).stop 2023-10-06T03:07:05.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.592+0000 7f745019f700 1 -- 172.21.15.125:0/2744224262 shutdown_connections 2023-10-06T03:07:05.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.592+0000 7f745019f700 1 --2- 172.21.15.125:0/2744224262 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f7434003a60 0x7f7434003e70 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.592+0000 7f745019f700 1 -- 172.21.15.125:0/2744224262 >> 172.21.15.125:0/2744224262 conn(0x7f744806f800 msgr2=0x7f74480b1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:05.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.592+0000 7f745019f700 1 -- 172.21.15.125:0/2744224262 shutdown_connections 2023-10-06T03:07:05.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.592+0000 7f745019f700 1 -- 172.21.15.125:0/2744224262 wait complete. 2023-10-06T03:07:05.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.594+0000 7f745019f700 1 Processor -- start 2023-10-06T03:07:05.599 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.594+0000 7f745019f700 1 -- start start 2023-10-06T03:07:05.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.594+0000 7f745019f700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7434003a60 0x7f7448152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.594+0000 7f745019f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74480b32f0 0x7f74480b3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.594+0000 7f745019f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74480b3ca0 0x7f7448154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.594+0000 7f745019f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7448150280 con 0x7f74480b32f0 2023-10-06T03:07:05.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.594+0000 7f745019f700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7448155930 con 0x7f7434003a60 2023-10-06T03:07:05.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.594+0000 7f745019f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744815a390 con 0x7f74480b3ca0 2023-10-06T03:07:05.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.594+0000 7f744d73a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74480b32f0 0x7f74480b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.594+0000 7f744d73a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74480b32f0 0x7f74480b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:35978/0 (socket says 172.21.15.125:35978) 2023-10-06T03:07:05.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.594+0000 7f744d73a700 1 -- 172.21.15.125:0/1521675669 learned_addr learned my addr 172.21.15.125:0/1521675669 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:05.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.594+0000 7f744df3b700 1 --2- 172.21.15.125:0/1521675669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7434003a60 0x7f7448152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.595+0000 7f744e73c700 1 --2- 172.21.15.125:0/1521675669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74480b3ca0 0x7f7448154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.595+0000 7f744d73a700 1 -- 172.21.15.125:0/1521675669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74480b3ca0 msgr2=0x7f7448154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.595+0000 7f744d73a700 1 --2- 172.21.15.125:0/1521675669 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f74480b3ca0 0x7f7448154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.595+0000 7f744d73a700 1 -- 172.21.15.125:0/1521675669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7434003a60 msgr2=0x7f7448152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.595+0000 7f744d73a700 1 --2- 172.21.15.125:0/1521675669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7434003a60 0x7f7448152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.595+0000 7f744d73a700 1 -- 172.21.15.125:0/1521675669 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744815a670 con 0x7f74480b32f0 2023-10-06T03:07:05.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.595+0000 7f744d73a700 1 --2- 172.21.15.125:0/1521675669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74480b32f0 0x7f74480b3760 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7444007390 tx=0x7f7444001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:05.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.595+0000 7f743dffb700 1 -- 172.21.15.125:0/1521675669 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7444018030 con 0x7f74480b32f0 2023-10-06T03:07:05.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.595+0000 7f743dffb700 1 -- 172.21.15.125:0/1521675669 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7444007750 con 0x7f74480b32f0 2023-10-06T03:07:05.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.595+0000 7f743dffb700 1 -- 172.21.15.125:0/1521675669 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744400faa0 con 0x7f74480b32f0 2023-10-06T03:07:05.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.595+0000 7f745019f700 1 -- 172.21.15.125:0/1521675669 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744815a950 con 0x7f74480b32f0 2023-10-06T03:07:05.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.595+0000 7f745019f700 1 -- 172.21.15.125:0/1521675669 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744815b150 con 0x7f74480b32f0 2023-10-06T03:07:05.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.596+0000 7f745019f700 1 -- 172.21.15.125:0/1521675669 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7448088260 con 0x7f74480b32f0 2023-10-06T03:07:05.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.596+0000 7f743dffb700 1 -- 172.21.15.125:0/1521675669 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f744401b070 con 0x7f74480b32f0 2023-10-06T03:07:05.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.597+0000 7f743dffb700 1 --2- 172.21.15.125:0/1521675669 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f742c066f30 0x7f742c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.597+0000 7f743dffb700 1 -- 172.21.15.125:0/1521675669 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f7444019070 con 0x7f74480b32f0 2023-10-06T03:07:05.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.597+0000 7f744df3b700 1 --2- 172.21.15.125:0/1521675669 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f742c066f30 0x7f742c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.597+0000 7f743dffb700 1 --2- 172.21.15.125:0/1521675669 >> [v2:172.21.15.130:6816/119973,v1:172.21.15.130:6817/119973] conn(0x7f742c06d850 0x7f742c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.597+0000 7f743dffb700 1 -- 172.21.15.125:0/1521675669 --> [v2:172.21.15.130:6816/119973,v1:172.21.15.130:6817/119973] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f742c070370 con 0x7f742c06d850 2023-10-06T03:07:05.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.597+0000 7f743dffb700 1 -- 172.21.15.125:0/1521675669 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74440866f0 con 0x7f74480b32f0 2023-10-06T03:07:05.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.597+0000 7f744e73c700 1 --2- 172.21.15.125:0/1521675669 >> [v2:172.21.15.130:6816/119973,v1:172.21.15.130:6817/119973] conn(0x7f742c06d850 0x7f742c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.597+0000 7f744df3b700 1 --2- 172.21.15.125:0/1521675669 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f742c066f30 0x7f742c0693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f74380018b0 tx=0x7f7438015000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:05.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.597+0000 7f744e73c700 1 --2- 172.21.15.125:0/1521675669 >> [v2:172.21.15.130:6816/119973,v1:172.21.15.130:6817/119973] conn(0x7f742c06d850 0x7f742c06fca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:05.606 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.598+0000 7f743dffb700 1 -- 172.21.15.125:0/1521675669 <== osd.4 v2:172.21.15.130:6816/119973 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f742c070370 con 0x7f742c06d850 2023-10-06T03:07:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.612+0000 7f745019f700 1 -- 172.21.15.125:0/1521675669 --> [v2:172.21.15.130:6816/119973,v1:172.21.15.130:6817/119973] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f74480cf820 con 0x7f742c06d850 2023-10-06T03:07:05.613 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.612+0000 7f743dffb700 1 -- 172.21.15.125:0/1521675669 <== osd.4 v2:172.21.15.130:6816/119973 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f74480cf820 con 0x7f742c06d850 2023-10-06T03:07:05.613 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:07:05.614 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:07:05.614 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:07:05.614 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.612+0000 7f745019f700 1 -- 172.21.15.125:0/1521675669 >> [v2:172.21.15.130:6816/119973,v1:172.21.15.130:6817/119973] conn(0x7f742c06d850 msgr2=0x7f742c06fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.612+0000 7f745019f700 1 --2- 172.21.15.125:0/1521675669 >> [v2:172.21.15.130:6816/119973,v1:172.21.15.130:6817/119973] conn(0x7f742c06d850 0x7f742c06fca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.612+0000 7f745019f700 1 -- 172.21.15.125:0/1521675669 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f742c066f30 msgr2=0x7f742c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.612+0000 7f745019f700 1 --2- 172.21.15.125:0/1521675669 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f742c066f30 0x7f742c0693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f74380018b0 tx=0x7f7438015000 comp rx=0 tx=0).stop 2023-10-06T03:07:05.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.612+0000 7f745019f700 1 -- 172.21.15.125:0/1521675669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74480b32f0 msgr2=0x7f74480b3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.612+0000 7f745019f700 1 --2- 172.21.15.125:0/1521675669 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f74480b32f0 0x7f74480b3760 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7444007390 tx=0x7f7444001e50 comp rx=0 tx=0).stop 2023-10-06T03:07:05.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.612+0000 7f744e73c700 1 -- 172.21.15.125:0/1521675669 reap_dead start 2023-10-06T03:07:05.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.613+0000 7f745019f700 1 -- 172.21.15.125:0/1521675669 shutdown_connections 2023-10-06T03:07:05.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.613+0000 7f745019f700 1 -- 172.21.15.125:0/1521675669 >> 172.21.15.125:0/1521675669 conn(0x7f744806f800 msgr2=0x7f744815cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:05.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.613+0000 7f745019f700 1 -- 172.21.15.125:0/1521675669 shutdown_connections 2023-10-06T03:07:05.615 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.613+0000 7f745019f700 1 -- 172.21.15.125:0/1521675669 wait complete. 2023-10-06T03:07:05.625 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T03:07:05.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.741+0000 7faae0caf700 1 Processor -- start 2023-10-06T03:07:05.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.741+0000 7faae0caf700 1 -- start start 2023-10-06T03:07:05.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.742+0000 7faae0caf700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faadc068ba0 0x7faadc0b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.742+0000 7faae0caf700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faadc0ca670 con 0x7faadc15cb00 2023-10-06T03:07:05.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.742+0000 7faae0caf700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faadc067a80 con 0x7faadc067610 2023-10-06T03:07:05.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.742+0000 7faae0caf700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faadc068320 con 0x7faadc068ba0 2023-10-06T03:07:05.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.742+0000 7faadad9d700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7faadc068ba0 0x7faadc0b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.742+0000 7faada59c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7faadc15cb00 0x7faadc068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38786/0 (socket says 172.21.15.125:38786) 2023-10-06T03:07:05.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.742+0000 7faada59c700 1 -- 172.21.15.125:0/4120268999 learned_addr learned my addr 172.21.15.125:0/4120268999 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:07:05.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.742+0000 7faadad9d700 1 -- 172.21.15.125:0/4120268999 >> v1:172.21.15.130:6789/0 conn(0x7faadc067610 legacy=0x7faadc0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:05.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.742+0000 7faadad9d700 1 -- 172.21.15.125:0/4120268999 >> v1:172.21.15.125:6789/0 conn(0x7faadc15cb00 legacy=0x7faadc068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.742+0000 7faadad9d700 1 -- 172.21.15.125:0/4120268999 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc067d60 con 0x7faadc068ba0 2023-10-06T03:07:05.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.742+0000 7faad959a700 1 -- 172.21.15.125:0/4120268999 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579508905 0 0) 0x7faadc0ca670 con 0x7faadc15cb00 2023-10-06T03:07:05.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.743+0000 7faadad9d700 1 --2- 172.21.15.125:0/4120268999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faadc068ba0 0x7faadc0b0240 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7faad4009e60 tx=0x7faad4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca2620e371dd4c1b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:05.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.743+0000 7faad959a700 1 -- 172.21.15.125:0/4120268999 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400e070 con 0x7faadc068ba0 2023-10-06T03:07:05.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.743+0000 7faad959a700 1 -- 172.21.15.125:0/4120268999 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad400bbf0 con 0x7faadc068ba0 2023-10-06T03:07:05.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.743+0000 7faad959a700 1 -- 172.21.15.125:0/4120268999 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad4012430 con 0x7faadc068ba0 2023-10-06T03:07:05.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.743+0000 7faae0caf700 1 -- 172.21.15.125:0/4120268999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faadc068ba0 msgr2=0x7faadc0b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.743+0000 7faae0caf700 1 --2- 172.21.15.125:0/4120268999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faadc068ba0 0x7faadc0b0240 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7faad4009e60 tx=0x7faad4009780 comp rx=0 tx=0).stop 2023-10-06T03:07:05.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.743+0000 7faae0caf700 1 -- 172.21.15.125:0/4120268999 shutdown_connections 2023-10-06T03:07:05.746 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.743+0000 7faae0caf700 1 --2- 172.21.15.125:0/4120268999 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faadc068ba0 0x7faadc0b0240 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.743+0000 7faae0caf700 1 -- 172.21.15.125:0/4120268999 >> 172.21.15.125:0/4120268999 conn(0x7faadc0af730 msgr2=0x7faadc0afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:05.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.743+0000 7faae0caf700 1 -- 172.21.15.125:0/4120268999 shutdown_connections 2023-10-06T03:07:05.747 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.743+0000 7faae0caf700 1 -- 172.21.15.125:0/4120268999 wait complete. 2023-10-06T03:07:05.749 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.744+0000 7faae0caf700 1 Processor -- start 2023-10-06T03:07:05.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.744+0000 7faae0caf700 1 -- start start 2023-10-06T03:07:05.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.745+0000 7faae0caf700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faadc067610 0x7faadc14e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.745+0000 7faae0caf700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faadc068ba0 0x7faadc0c3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.745+0000 7faae0caf700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faadc15cb00 0x7faadc1500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.745+0000 7faae0caf700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0c4b10 con 0x7faadc15cb00 2023-10-06T03:07:05.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.745+0000 7faae0caf700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc15d100 con 0x7faadc067610 2023-10-06T03:07:05.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.745+0000 7faae0caf700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc14edd0 con 0x7faadc068ba0 2023-10-06T03:07:05.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.745+0000 7faadad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faadc15cb00 0x7faadc1500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.745+0000 7faadad9d700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faadc15cb00 0x7faadc1500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36000/0 (socket says 172.21.15.125:36000) 2023-10-06T03:07:05.750 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.745+0000 7faadad9d700 1 -- 172.21.15.125:0/3070723125 learned_addr learned my addr 172.21.15.125:0/3070723125 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:05.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.746+0000 7faadad9d700 1 -- 172.21.15.125:0/3070723125 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faadc068ba0 msgr2=0x7faadc0c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.746+0000 7faadad9d700 1 --2- 172.21.15.125:0/3070723125 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faadc068ba0 0x7faadc0c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.746+0000 7faadad9d700 1 -- 172.21.15.125:0/3070723125 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faadc067610 msgr2=0x7faadc14e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.746+0000 7faada59c700 1 --2- 172.21.15.125:0/3070723125 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faadc067610 0x7faadc14e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.746+0000 7faadad9d700 1 --2- 172.21.15.125:0/3070723125 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faadc067610 0x7faadc14e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.746+0000 7faadad9d700 1 -- 172.21.15.125:0/3070723125 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad4009a20 con 0x7faadc15cb00 2023-10-06T03:07:05.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.746+0000 7faada59c700 1 --2- 172.21.15.125:0/3070723125 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faadc067610 0x7faadc14e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:07:05.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.746+0000 7faadad9d700 1 --2- 172.21.15.125:0/3070723125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faadc15cb00 0x7faadc1500b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7faadc06dbf0 tx=0x7faad4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:05.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.746+0000 7faaca7fc700 1 -- 172.21.15.125:0/3070723125 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad401e710 con 0x7faadc15cb00 2023-10-06T03:07:05.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.746+0000 7faaca7fc700 1 -- 172.21.15.125:0/3070723125 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad401e870 con 0x7faadc15cb00 2023-10-06T03:07:05.751 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.746+0000 7faae0caf700 1 -- 172.21.15.125:0/3070723125 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc0c4270 con 0x7faadc15cb00 2023-10-06T03:07:05.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.746+0000 7faaca7fc700 1 -- 172.21.15.125:0/3070723125 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad401ec10 con 0x7faadc15cb00 2023-10-06T03:07:05.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.746+0000 7faae0caf700 1 -- 172.21.15.125:0/3070723125 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc0c4830 con 0x7faadc15cb00 2023-10-06T03:07:05.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.747+0000 7faae0caf700 1 -- 172.21.15.125:0/3070723125 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faadc15ced0 con 0x7faadc15cb00 2023-10-06T03:07:05.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.747+0000 7faaca7fc700 1 -- 172.21.15.125:0/3070723125 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faad4024070 con 0x7faadc15cb00 2023-10-06T03:07:05.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.747+0000 7faaca7fc700 1 --2- 172.21.15.125:0/3070723125 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7faabc066f30 0x7faabc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:05.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.748+0000 7faaca7fc700 1 -- 172.21.15.125:0/3070723125 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7faad40870e0 con 0x7faadc15cb00 2023-10-06T03:07:05.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.748+0000 7faada59c700 1 --2- 172.21.15.125:0/3070723125 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7faabc066f30 0x7faabc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:05.752 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.748+0000 7faada59c700 1 --2- 172.21.15.125:0/3070723125 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7faabc066f30 0x7faabc0693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7faad0001810 tx=0x7faad0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:05.753 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.752+0000 7faaca7fc700 1 -- 172.21.15.125:0/3070723125 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faadc15ced0 con 0x7faadc15cb00 2023-10-06T03:07:05.941 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.939+0000 7faae0caf700 1 -- 172.21.15.125:0/3070723125 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7faadc0665a0 con 0x7faabc066f30 2023-10-06T03:07:05.973 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.940+0000 7faaca7fc700 1 -- 172.21.15.125:0/3070723125 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faad00070d0 con 0x7faabc066f30 2023-10-06T03:07:05.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.942+0000 7faae0caf700 1 -- 172.21.15.125:0/3070723125 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7faabc066f30 msgr2=0x7faabc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.975 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.942+0000 7faae0caf700 1 --2- 172.21.15.125:0/3070723125 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7faabc066f30 0x7faabc0693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7faad0001810 tx=0x7faad0009040 comp rx=0 tx=0).stop 2023-10-06T03:07:05.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.942+0000 7faae0caf700 1 -- 172.21.15.125:0/3070723125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faadc15cb00 msgr2=0x7faadc1500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:05.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.942+0000 7faae0caf700 1 --2- 172.21.15.125:0/3070723125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faadc15cb00 0x7faadc1500b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7faadc06dbf0 tx=0x7faad4018000 comp rx=0 tx=0).stop 2023-10-06T03:07:05.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.942+0000 7faae0caf700 1 -- 172.21.15.125:0/3070723125 shutdown_connections 2023-10-06T03:07:05.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.942+0000 7faae0caf700 1 --2- 172.21.15.125:0/3070723125 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7faabc066f30 0x7faabc0693e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.942+0000 7faae0caf700 1 --2- 172.21.15.125:0/3070723125 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7faadc15cb00 0x7faadc1500b0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.942+0000 7faae0caf700 1 --2- 172.21.15.125:0/3070723125 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faadc067610 0x7faadc14e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.976 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.942+0000 7faae0caf700 1 --2- 172.21.15.125:0/3070723125 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7faadc068ba0 0x7faadc0c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:05.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.942+0000 7faae0caf700 1 -- 172.21.15.125:0/3070723125 >> 172.21.15.125:0/3070723125 conn(0x7faadc0af730 msgr2=0x7faadc14f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:05.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.942+0000 7faae0caf700 1 -- 172.21.15.125:0/3070723125 shutdown_connections 2023-10-06T03:07:05.977 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:05.942+0000 7faae0caf700 1 -- 172.21.15.125:0/3070723125 wait complete. 2023-10-06T03:07:05.977 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T03:07:05.977 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T03:07:05.978 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:07:06.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.099+0000 7f087d7eb700 1 Processor -- start 2023-10-06T03:07:06.100 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.099+0000 7f087d7eb700 1 -- start start 2023-10-06T03:07:06.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.100+0000 7f087d7eb700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f08780b0630 0x7f087815b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.100+0000 7f087d7eb700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08780c3d80 con 0x7f08780b0260 2023-10-06T03:07:06.103 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.100+0000 7f087d7eb700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08780cea90 con 0x7f087815ba50 2023-10-06T03:07:06.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.100+0000 7f087d7eb700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0878068420 con 0x7f08780b0630 2023-10-06T03:07:06.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.100+0000 7f08767fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f08780b0630 0x7f087815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.100+0000 7f0876ffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f08780b0260 0x7f087815ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38792/0 (socket says 172.21.15.125:38792) 2023-10-06T03:07:06.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.100+0000 7f08767fc700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f08780b0630 0x7f087815b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36016/0 (socket says 172.21.15.125:36016) 2023-10-06T03:07:06.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.100+0000 7f0876ffd700 1 -- 172.21.15.125:0/6811093 learned_addr learned my addr 172.21.15.125:0/6811093 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:07:06.104 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.100+0000 7f08767fc700 1 -- 172.21.15.125:0/6811093 >> v1:172.21.15.130:6789/0 conn(0x7f087815ba50 legacy=0x7f08780c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.100+0000 7f08767fc700 1 -- 172.21.15.125:0/6811093 >> v1:172.21.15.125:6789/0 conn(0x7f08780b0260 legacy=0x7f087815ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.100+0000 7f08767fc700 1 -- 172.21.15.125:0/6811093 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08780ced70 con 0x7f08780b0630 2023-10-06T03:07:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.100+0000 7f0875ffb700 1 -- 172.21.15.125:0/6811093 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4263345320 0 0) 0x7f08780c3d80 con 0x7f08780b0260 2023-10-06T03:07:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.100+0000 7f08767fc700 1 --2- 172.21.15.125:0/6811093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08780b0630 0x7f087815b510 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f086c0098e0 tx=0x7f086c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0fd84e0247e3ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.100+0000 7f0875ffb700 1 -- 172.21.15.125:0/6811093 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c009e80 con 0x7f08780b0630 2023-10-06T03:07:06.105 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.100+0000 7f0875ffb700 1 -- 172.21.15.125:0/6811093 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086c00b860 con 0x7f08780b0630 2023-10-06T03:07:06.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.100+0000 7f0875ffb700 1 -- 172.21.15.125:0/6811093 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c00bbe0 con 0x7f08780b0630 2023-10-06T03:07:06.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.101+0000 7f087d7eb700 1 -- 172.21.15.125:0/6811093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08780b0630 msgr2=0x7f087815b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.101+0000 7f087d7eb700 1 --2- 172.21.15.125:0/6811093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08780b0630 0x7f087815b510 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f086c0098e0 tx=0x7f086c0091a0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.101+0000 7f087d7eb700 1 -- 172.21.15.125:0/6811093 shutdown_connections 2023-10-06T03:07:06.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.101+0000 7f087d7eb700 1 --2- 172.21.15.125:0/6811093 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08780b0630 0x7f087815b510 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.106 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.101+0000 7f087d7eb700 1 -- 172.21.15.125:0/6811093 >> 172.21.15.125:0/6811093 conn(0x7f0878067df0 msgr2=0x7f08780cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:06.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.101+0000 7f087d7eb700 1 -- 172.21.15.125:0/6811093 shutdown_connections 2023-10-06T03:07:06.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.101+0000 7f087d7eb700 1 -- 172.21.15.125:0/6811093 wait complete. 2023-10-06T03:07:06.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.102+0000 7f087d7eb700 1 Processor -- start 2023-10-06T03:07:06.107 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.102+0000 7f087d7eb700 1 -- start start 2023-10-06T03:07:06.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.103+0000 7f087d7eb700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08780b0260 0x7f0878152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.110 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.103+0000 7f087d7eb700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08780b0630 0x7f08780b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.103+0000 7f087d7eb700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f087815ba50 0x7f08780c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.103+0000 7f087d7eb700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08780b3330 con 0x7f08780b0630 2023-10-06T03:07:06.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.103+0000 7f087d7eb700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08780c6020 con 0x7f087815ba50 2023-10-06T03:07:06.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.103+0000 7f087d7eb700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08780b3090 con 0x7f08780b0260 2023-10-06T03:07:06.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.103+0000 7f08767fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08780b0630 0x7f08780b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.111 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.103+0000 7f08767fc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08780b0630 0x7f08780b2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36022/0 (socket says 172.21.15.125:36022) 2023-10-06T03:07:06.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.103+0000 7f08767fc700 1 -- 172.21.15.125:0/1260859395 learned_addr learned my addr 172.21.15.125:0/1260859395 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:06.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.103+0000 7f0876ffd700 1 --2- 172.21.15.125:0/1260859395 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08780b0260 0x7f0878152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.103+0000 7f08777fe700 1 --2- 172.21.15.125:0/1260859395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f087815ba50 0x7f08780c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.103+0000 7f08767fc700 1 -- 172.21.15.125:0/1260859395 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08780b0260 msgr2=0x7f0878152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.103+0000 7f08767fc700 1 --2- 172.21.15.125:0/1260859395 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f08780b0260 0x7f0878152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.112 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.103+0000 7f08767fc700 1 -- 172.21.15.125:0/1260859395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f087815ba50 msgr2=0x7f08780c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.103+0000 7f08767fc700 1 --2- 172.21.15.125:0/1260859395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f087815ba50 0x7f08780c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.103+0000 7f08767fc700 1 -- 172.21.15.125:0/1260859395 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c009420 con 0x7f08780b0630 2023-10-06T03:07:06.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.103+0000 7f08767fc700 1 --2- 172.21.15.125:0/1260859395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08780b0630 0x7f08780b2b50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f086c0030c0 tx=0x7f086c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:06.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.104+0000 7f085effd700 1 -- 172.21.15.125:0/1260859395 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c00bb20 con 0x7f08780b0630 2023-10-06T03:07:06.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.104+0000 7f085effd700 1 -- 172.21.15.125:0/1260859395 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086c020070 con 0x7f08780b0630 2023-10-06T03:07:06.113 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.104+0000 7f087d7eb700 1 -- 172.21.15.125:0/1260859395 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08780c56f0 con 0x7f08780b0630 2023-10-06T03:07:06.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.104+0000 7f085effd700 1 -- 172.21.15.125:0/1260859395 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086c01b680 con 0x7f08780b0630 2023-10-06T03:07:06.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.104+0000 7f087d7eb700 1 -- 172.21.15.125:0/1260859395 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08780c5cb0 con 0x7f08780b0630 2023-10-06T03:07:06.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.104+0000 7f087d7eb700 1 -- 172.21.15.125:0/1260859395 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f08780cc870 con 0x7f08780b0630 2023-10-06T03:07:06.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.105+0000 7f085effd700 1 -- 172.21.15.125:0/1260859395 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f086c022030 con 0x7f08780b0630 2023-10-06T03:07:06.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.105+0000 7f085effd700 1 --2- 172.21.15.125:0/1260859395 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0864066f30 0x7f08640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.105+0000 7f085effd700 1 -- 172.21.15.125:0/1260859395 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f086c086520 con 0x7f08780b0630 2023-10-06T03:07:06.114 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.105+0000 7f0876ffd700 1 --2- 172.21.15.125:0/1260859395 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0864066f30 0x7f08640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.105+0000 7f085effd700 1 --2- 172.21.15.125:0/1260859395 >> [v2:172.21.15.130:6808/119955,v1:172.21.15.130:6809/119955] conn(0x7f086406d850 0x7f086406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.105+0000 7f085effd700 1 -- 172.21.15.125:0/1260859395 --> [v2:172.21.15.130:6808/119955,v1:172.21.15.130:6809/119955] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0864070370 con 0x7f086406d850 2023-10-06T03:07:06.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.105+0000 7f085effd700 1 -- 172.21.15.125:0/1260859395 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f086c088b60 con 0x7f08780b0630 2023-10-06T03:07:06.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.106+0000 7f08777fe700 1 --2- 172.21.15.125:0/1260859395 >> [v2:172.21.15.130:6808/119955,v1:172.21.15.130:6809/119955] conn(0x7f086406d850 0x7f086406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.106+0000 7f0876ffd700 1 --2- 172.21.15.125:0/1260859395 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0864066f30 0x7f08640693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f08780ca600 tx=0x7f0868009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:06.115 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.106+0000 7f08777fe700 1 --2- 172.21.15.125:0/1260859395 >> [v2:172.21.15.130:6808/119955,v1:172.21.15.130:6809/119955] conn(0x7f086406d850 0x7f086406fca0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:06.116 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.107+0000 7f085effd700 1 -- 172.21.15.125:0/1260859395 <== osd.5 v2:172.21.15.130:6808/119955 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f0864070370 con 0x7f086406d850 2023-10-06T03:07:06.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.120+0000 7f087d7eb700 1 -- 172.21.15.125:0/1260859395 --> [v2:172.21.15.130:6808/119955,v1:172.21.15.130:6809/119955] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f087804bb80 con 0x7f086406d850 2023-10-06T03:07:06.122 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.121+0000 7f085effd700 1 -- 172.21.15.125:0/1260859395 <== osd.5 v2:172.21.15.130:6808/119955 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f087804bb80 con 0x7f086406d850 2023-10-06T03:07:06.122 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:07:06.123 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:07:06.123 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:07:06.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.121+0000 7f087d7eb700 1 -- 172.21.15.125:0/1260859395 >> [v2:172.21.15.130:6808/119955,v1:172.21.15.130:6809/119955] conn(0x7f086406d850 msgr2=0x7f086406fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.121+0000 7f087d7eb700 1 --2- 172.21.15.125:0/1260859395 >> [v2:172.21.15.130:6808/119955,v1:172.21.15.130:6809/119955] conn(0x7f086406d850 0x7f086406fca0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.121+0000 7f087d7eb700 1 -- 172.21.15.125:0/1260859395 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0864066f30 msgr2=0x7f08640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.121+0000 7f087d7eb700 1 --2- 172.21.15.125:0/1260859395 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f0864066f30 0x7f08640693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f08780ca600 tx=0x7f0868009040 comp rx=0 tx=0).stop 2023-10-06T03:07:06.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.121+0000 7f087d7eb700 1 -- 172.21.15.125:0/1260859395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08780b0630 msgr2=0x7f08780b2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.121+0000 7f087d7eb700 1 --2- 172.21.15.125:0/1260859395 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f08780b0630 0x7f08780b2b50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f086c0030c0 tx=0x7f086c016000 comp rx=0 tx=0).stop 2023-10-06T03:07:06.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.121+0000 7f08777fe700 1 -- 172.21.15.125:0/1260859395 reap_dead start 2023-10-06T03:07:06.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.121+0000 7f087d7eb700 1 -- 172.21.15.125:0/1260859395 shutdown_connections 2023-10-06T03:07:06.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.121+0000 7f087d7eb700 1 -- 172.21.15.125:0/1260859395 >> 172.21.15.125:0/1260859395 conn(0x7f0878067df0 msgr2=0x7f08781541f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:06.124 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.122+0000 7f087d7eb700 1 -- 172.21.15.125:0/1260859395 shutdown_connections 2023-10-06T03:07:06.125 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.122+0000 7f087d7eb700 1 -- 172.21.15.125:0/1260859395 wait complete. 2023-10-06T03:07:06.134 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T03:07:06.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.251+0000 7f287d097700 1 Processor -- start 2023-10-06T03:07:06.253 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.251+0000 7f287d097700 1 -- start start 2023-10-06T03:07:06.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.252+0000 7f287d097700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f287815cb00 0x7f28780b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.252+0000 7f287d097700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2878067610 0x7f2878068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.252+0000 7f287d097700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28780ca670 con 0x7f287815ced0 2023-10-06T03:07:06.255 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.252+0000 7f287d097700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2878068320 con 0x7f287815cb00 2023-10-06T03:07:06.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.252+0000 7f287d097700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2878067a80 con 0x7f2878067610 2023-10-06T03:07:06.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.252+0000 7f287759e700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f287815ced0 0x7f28780c90e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38796/0 (socket says 172.21.15.125:38796) 2023-10-06T03:07:06.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.252+0000 7f287759e700 1 -- 172.21.15.125:0/1232575283 learned_addr learned my addr 172.21.15.125:0/1232575283 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:07:06.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.253+0000 7f2876d9d700 1 --2- 172.21.15.125:0/1232575283 >> v2:172.21.15.130:3300/0 conn(0x7f287815cb00 0x7f28780b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.253+0000 7f287659c700 1 --2- 172.21.15.125:0/1232575283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2878067610 0x7f2878068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.253+0000 7f2875d9b700 1 -- 172.21.15.125:0/1232575283 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658216061 0 0) 0x7f28780ca670 con 0x7f287815ced0 2023-10-06T03:07:06.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.253+0000 7f2875d9b700 1 -- 172.21.15.125:0/1232575283 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2860003570 con 0x7f287815ced0 2023-10-06T03:07:06.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.253+0000 7f2875d9b700 1 -- 172.21.15.125:0/1232575283 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 400706577 0 0) 0x7f2860003570 con 0x7f287815ced0 2023-10-06T03:07:06.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.253+0000 7f287659c700 1 -- 172.21.15.125:0/1232575283 >> v2:172.21.15.130:3300/0 conn(0x7f287815cb00 msgr2=0x7f28780b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:06.256 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.253+0000 7f287659c700 1 --2- 172.21.15.125:0/1232575283 >> v2:172.21.15.130:3300/0 conn(0x7f287815cb00 0x7f28780b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.253+0000 7f287659c700 1 -- 172.21.15.125:0/1232575283 >> v1:172.21.15.125:6789/0 conn(0x7f287815ced0 legacy=0x7f28780c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.253+0000 7f287659c700 1 -- 172.21.15.125:0/1232575283 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2878067d60 con 0x7f2878067610 2023-10-06T03:07:06.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.253+0000 7f2876d9d700 1 --2- 172.21.15.125:0/1232575283 >> v2:172.21.15.130:3300/0 conn(0x7f287815cb00 0x7f28780b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T03:07:06.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.253+0000 7f287659c700 1 --2- 172.21.15.125:0/1232575283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2878067610 0x7f2878068490 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f28680098e0 tx=0x7f28680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15eca15e6cfa58f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:06.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.253+0000 7f2875d9b700 1 -- 172.21.15.125:0/1232575283 <== mon.2 v2:172.21.15.130:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28700017f0 con 0x7f2878067610 2023-10-06T03:07:06.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.253+0000 7f2875d9b700 1 -- 172.21.15.125:0/1232575283 <== mon.2 v2:172.21.15.130:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2868011420 con 0x7f2878067610 2023-10-06T03:07:06.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.253+0000 7f2875d9b700 1 -- 172.21.15.125:0/1232575283 <== mon.2 v2:172.21.15.130:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28680117a0 con 0x7f2878067610 2023-10-06T03:07:06.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.254+0000 7f287d097700 1 -- 172.21.15.125:0/1232575283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2878067610 msgr2=0x7f2878068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.254+0000 7f287d097700 1 --2- 172.21.15.125:0/1232575283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2878067610 0x7f2878068490 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f28680098e0 tx=0x7f28680091a0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.254+0000 7f287d097700 1 -- 172.21.15.125:0/1232575283 shutdown_connections 2023-10-06T03:07:06.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.254+0000 7f287d097700 1 --2- 172.21.15.125:0/1232575283 >> v2:172.21.15.130:3300/0 conn(0x7f287815cb00 0x7f28780b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.257 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.254+0000 7f287d097700 1 --2- 172.21.15.125:0/1232575283 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2878067610 0x7f2878068490 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.254+0000 7f287d097700 1 -- 172.21.15.125:0/1232575283 >> 172.21.15.125:0/1232575283 conn(0x7f28780af730 msgr2=0x7f28780afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:06.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.254+0000 7f287d097700 1 -- 172.21.15.125:0/1232575283 shutdown_connections 2023-10-06T03:07:06.258 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.254+0000 7f287d097700 1 -- 172.21.15.125:0/1232575283 wait complete. 2023-10-06T03:07:06.260 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.255+0000 7f287d097700 1 Processor -- start 2023-10-06T03:07:06.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.255+0000 7f287d097700 1 -- start start 2023-10-06T03:07:06.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.256+0000 7f287d097700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2878067610 0x7f2878157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.256+0000 7f287d097700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f287815cb00 0x7f287814a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.256+0000 7f287d097700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f287815ced0 0x7f287815fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.256+0000 7f287d097700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287814ac70 con 0x7f287815cb00 2023-10-06T03:07:06.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.256+0000 7f287d097700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287816c000 con 0x7f287815ced0 2023-10-06T03:07:06.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.256+0000 7f287d097700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287816c2e0 con 0x7f2878067610 2023-10-06T03:07:06.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.256+0000 7f287659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f287815cb00 0x7f287814a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.256+0000 7f287659c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f287815cb00 0x7f287814a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36026/0 (socket says 172.21.15.125:36026) 2023-10-06T03:07:06.261 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.256+0000 7f287659c700 1 -- 172.21.15.125:0/707893549 learned_addr learned my addr 172.21.15.125:0/707893549 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:06.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.256+0000 7f287759e700 1 --2- 172.21.15.125:0/707893549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f287815ced0 0x7f287815fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.256+0000 7f2876d9d700 1 --2- 172.21.15.125:0/707893549 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2878067610 0x7f2878157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.256+0000 7f287659c700 1 -- 172.21.15.125:0/707893549 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2878067610 msgr2=0x7f2878157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.256+0000 7f287659c700 1 --2- 172.21.15.125:0/707893549 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2878067610 0x7f2878157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.256+0000 7f287659c700 1 -- 172.21.15.125:0/707893549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f287815ced0 msgr2=0x7f287815fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.256+0000 7f287659c700 1 --2- 172.21.15.125:0/707893549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f287815ced0 0x7f287815fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.256+0000 7f287659c700 1 -- 172.21.15.125:0/707893549 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c0093c0 con 0x7f287815cb00 2023-10-06T03:07:06.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.256+0000 7f287659c700 1 --2- 172.21.15.125:0/707893549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f287815cb00 0x7f287814a730 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2868002000 tx=0x7f2868016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:06.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.257+0000 7f285effd700 1 -- 172.21.15.125:0/707893549 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286801cba0 con 0x7f287815cb00 2023-10-06T03:07:06.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.257+0000 7f285effd700 1 -- 172.21.15.125:0/707893549 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286801cd00 con 0x7f287815cb00 2023-10-06T03:07:06.262 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.257+0000 7f287d097700 1 -- 172.21.15.125:0/707893549 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2868009420 con 0x7f287815cb00 2023-10-06T03:07:06.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.257+0000 7f285effd700 1 -- 172.21.15.125:0/707893549 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286801a6a0 con 0x7f287815cb00 2023-10-06T03:07:06.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.257+0000 7f287d097700 1 -- 172.21.15.125:0/707893549 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287816c8a0 con 0x7f287815cb00 2023-10-06T03:07:06.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.257+0000 7f287d097700 1 -- 172.21.15.125:0/707893549 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287816ca90 con 0x7f287815cb00 2023-10-06T03:07:06.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.258+0000 7f285effd700 1 -- 172.21.15.125:0/707893549 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f286801aa10 con 0x7f287815cb00 2023-10-06T03:07:06.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.258+0000 7f285effd700 1 --2- 172.21.15.125:0/707893549 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2864066f30 0x7f28640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.258+0000 7f285effd700 1 -- 172.21.15.125:0/707893549 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f2868085ec0 con 0x7f287815cb00 2023-10-06T03:07:06.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.258+0000 7f2876d9d700 1 --2- 172.21.15.125:0/707893549 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2864066f30 0x7f28640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.263 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.259+0000 7f2876d9d700 1 --2- 172.21.15.125:0/707893549 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2864066f30 0x7f28640693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f286c009390 tx=0x7f286c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:06.264 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.263+0000 7f285effd700 1 -- 172.21.15.125:0/707893549 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2868053190 con 0x7f287815cb00 2023-10-06T03:07:06.446 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.445+0000 7f287d097700 1 -- 172.21.15.125:0/707893549 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f2878066510 con 0x7f2864066f30 2023-10-06T03:07:06.447 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.445+0000 7f285effd700 1 -- 172.21.15.125:0/707893549 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2878066510 con 0x7f2864066f30 2023-10-06T03:07:06.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.447+0000 7f287d097700 1 -- 172.21.15.125:0/707893549 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2864066f30 msgr2=0x7f28640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.447+0000 7f287d097700 1 --2- 172.21.15.125:0/707893549 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2864066f30 0x7f28640693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f286c009390 tx=0x7f286c008040 comp rx=0 tx=0).stop 2023-10-06T03:07:06.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.447+0000 7f287d097700 1 -- 172.21.15.125:0/707893549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f287815cb00 msgr2=0x7f287814a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.447+0000 7f287d097700 1 --2- 172.21.15.125:0/707893549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f287815cb00 0x7f287814a730 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2868002000 tx=0x7f2868016000 comp rx=0 tx=0).stop 2023-10-06T03:07:06.450 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.447+0000 7f287d097700 1 -- 172.21.15.125:0/707893549 shutdown_connections 2023-10-06T03:07:06.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.447+0000 7f287d097700 1 --2- 172.21.15.125:0/707893549 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f2864066f30 0x7f28640693e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.447+0000 7f287d097700 1 --2- 172.21.15.125:0/707893549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f287815ced0 0x7f287815fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.447+0000 7f287d097700 1 --2- 172.21.15.125:0/707893549 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f2878067610 0x7f2878157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.447+0000 7f287d097700 1 --2- 172.21.15.125:0/707893549 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f287815cb00 0x7f287814a730 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.447+0000 7f287d097700 1 -- 172.21.15.125:0/707893549 >> 172.21.15.125:0/707893549 conn(0x7f28780af730 msgr2=0x7f287806b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:06.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.447+0000 7f287d097700 1 -- 172.21.15.125:0/707893549 shutdown_connections 2023-10-06T03:07:06.451 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.447+0000 7f287d097700 1 -- 172.21.15.125:0/707893549 wait complete. 2023-10-06T03:07:06.451 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T03:07:06.460 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T03:07:06.460 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:07:06.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.579+0000 7f56a87a0700 1 Processor -- start 2023-10-06T03:07:06.581 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.580+0000 7f56a87a0700 1 -- start start 2023-10-06T03:07:06.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.580+0000 7f56a87a0700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f56a006eb20 0x7f56a0067610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.580+0000 7f56a87a0700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56a00c7f40 0x7f56a0156af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.580+0000 7f56a87a0700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a0067e60 con 0x7f56a006eef0 2023-10-06T03:07:06.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.580+0000 7f56a87a0700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a00ad7e0 con 0x7f56a006eb20 2023-10-06T03:07:06.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.580+0000 7f56a87a0700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a0068140 con 0x7f56a00c7f40 2023-10-06T03:07:06.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.581+0000 7f56a653c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f56a006eb20 0x7f56a0067610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.584 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.581+0000 7f56a653c700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f56a006eb20 0x7f56a0067610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36032/0 (socket says 172.21.15.125:36032) 2023-10-06T03:07:06.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.581+0000 7f56a653c700 1 -- 172.21.15.125:0/827040885 learned_addr learned my addr 172.21.15.125:0/827040885 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:06.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.581+0000 7f56a5d3b700 1 --2- 172.21.15.125:0/827040885 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56a00c7f40 0x7f56a0156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.581+0000 7f56a653c700 1 -- 172.21.15.125:0/827040885 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56a00c7f40 msgr2=0x7f56a0156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:06.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.581+0000 7f56a653c700 1 --2- 172.21.15.125:0/827040885 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56a00c7f40 0x7f56a0156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.581+0000 7f56a653c700 1 -- 172.21.15.125:0/827040885 >> v1:172.21.15.130:6789/0 conn(0x7f56a006eef0 legacy=0x7f56a0157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:06.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.581+0000 7f56a653c700 1 -- 172.21.15.125:0/827040885 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a0068420 con 0x7f56a006eb20 2023-10-06T03:07:06.585 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.581+0000 7f56a653c700 1 --2- 172.21.15.125:0/827040885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56a006eb20 0x7f56a0067610 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f56900099b0 tx=0x7f5690009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d715a1303dd28f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:06.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.581+0000 7f56a553a700 1 -- 172.21.15.125:0/827040885 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569000b820 con 0x7f56a006eb20 2023-10-06T03:07:06.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.581+0000 7f56a553a700 1 -- 172.21.15.125:0/827040885 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569000b980 con 0x7f56a006eb20 2023-10-06T03:07:06.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.581+0000 7f56a553a700 1 -- 172.21.15.125:0/827040885 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569000bd20 con 0x7f56a006eb20 2023-10-06T03:07:06.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.582+0000 7f56a87a0700 1 -- 172.21.15.125:0/827040885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56a006eb20 msgr2=0x7f56a0067610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.582+0000 7f56a87a0700 1 --2- 172.21.15.125:0/827040885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56a006eb20 0x7f56a0067610 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f56900099b0 tx=0x7f5690009250 comp rx=0 tx=0).stop 2023-10-06T03:07:06.586 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.582+0000 7f56a87a0700 1 -- 172.21.15.125:0/827040885 shutdown_connections 2023-10-06T03:07:06.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.582+0000 7f56a87a0700 1 --2- 172.21.15.125:0/827040885 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56a006eb20 0x7f56a0067610 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.582+0000 7f56a87a0700 1 --2- 172.21.15.125:0/827040885 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56a00c7f40 0x7f56a0156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.582+0000 7f56a87a0700 1 -- 172.21.15.125:0/827040885 >> 172.21.15.125:0/827040885 conn(0x7f56a006b3b0 msgr2=0x7f56a00cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:06.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.582+0000 7f56a87a0700 1 -- 172.21.15.125:0/827040885 shutdown_connections 2023-10-06T03:07:06.587 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.582+0000 7f56a87a0700 1 -- 172.21.15.125:0/827040885 wait complete. 2023-10-06T03:07:06.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.583+0000 7f56a87a0700 1 Processor -- start 2023-10-06T03:07:06.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.583+0000 7f56a87a0700 1 -- start start 2023-10-06T03:07:06.592 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.584+0000 7f56a87a0700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56a006eb20 0x7f56a01697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.584+0000 7f56a87a0700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56a006eef0 0x7f56a00c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.584+0000 7f56a87a0700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56a00c7f40 0x7f56a0154f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.584+0000 7f56a87a0700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a0158150 con 0x7f56a006eef0 2023-10-06T03:07:06.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.584+0000 7f56a87a0700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a0169cf0 con 0x7f56a00c7f40 2023-10-06T03:07:06.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.584+0000 7f56a87a0700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00cb050 con 0x7f56a006eb20 2023-10-06T03:07:06.593 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.584+0000 7f56a5d3b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56a006eef0 0x7f56a00c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.584+0000 7f56a5d3b700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56a006eef0 0x7f56a00c75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36034/0 (socket says 172.21.15.125:36034) 2023-10-06T03:07:06.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.584+0000 7f56a5d3b700 1 -- 172.21.15.125:0/3437828865 learned_addr learned my addr 172.21.15.125:0/3437828865 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:06.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.584+0000 7f56a653c700 1 --2- 172.21.15.125:0/3437828865 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56a006eb20 0x7f56a01697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.584+0000 7f56a6d3d700 1 --2- 172.21.15.125:0/3437828865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56a00c7f40 0x7f56a0154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.584+0000 7f56a5d3b700 1 -- 172.21.15.125:0/3437828865 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56a006eb20 msgr2=0x7f56a01697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.584+0000 7f56a5d3b700 1 --2- 172.21.15.125:0/3437828865 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f56a006eb20 0x7f56a01697b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.594 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.584+0000 7f56a5d3b700 1 -- 172.21.15.125:0/3437828865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56a00c7f40 msgr2=0x7f56a0154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.584+0000 7f56a5d3b700 1 --2- 172.21.15.125:0/3437828865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56a00c7f40 0x7f56a0154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.584+0000 7f56a5d3b700 1 -- 172.21.15.125:0/3437828865 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56900094f0 con 0x7f56a006eef0 2023-10-06T03:07:06.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.584+0000 7f56a6d3d700 1 --2- 172.21.15.125:0/3437828865 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56a00c7f40 0x7f56a0154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:07:06.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.584+0000 7f56a5d3b700 1 --2- 172.21.15.125:0/3437828865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56a006eef0 0x7f56a00c75d0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f569c00d890 tx=0x7f569c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:06.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.584+0000 7f56967fc700 1 -- 172.21.15.125:0/3437828865 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c0125f0 con 0x7f56a006eef0 2023-10-06T03:07:06.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.585+0000 7f56967fc700 1 -- 172.21.15.125:0/3437828865 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c012750 con 0x7f56a006eef0 2023-10-06T03:07:06.595 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.585+0000 7f56a87a0700 1 -- 172.21.15.125:0/3437828865 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a00cb330 con 0x7f56a006eef0 2023-10-06T03:07:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.585+0000 7f56967fc700 1 -- 172.21.15.125:0/3437828865 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c012ad0 con 0x7f56a006eef0 2023-10-06T03:07:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.585+0000 7f56a87a0700 1 -- 172.21.15.125:0/3437828865 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a0157de0 con 0x7f56a006eef0 2023-10-06T03:07:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.585+0000 7f56a87a0700 1 -- 172.21.15.125:0/3437828865 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f56a006d830 con 0x7f56a006eef0 2023-10-06T03:07:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.586+0000 7f56967fc700 1 -- 172.21.15.125:0/3437828865 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f569c01e460 con 0x7f56a006eef0 2023-10-06T03:07:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.586+0000 7f56967fc700 1 --2- 172.21.15.125:0/3437828865 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5684066f30 0x7f56840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.586+0000 7f56967fc700 1 -- 172.21.15.125:0/3437828865 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f569c084ac0 con 0x7f56a006eef0 2023-10-06T03:07:06.596 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.586+0000 7f56a653c700 1 --2- 172.21.15.125:0/3437828865 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5684066f30 0x7f56840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.586+0000 7f56967fc700 1 --2- 172.21.15.125:0/3437828865 >> [v2:172.21.15.130:6824/119980,v1:172.21.15.130:6825/119980] conn(0x7f568406d850 0x7f568406fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.586+0000 7f56967fc700 1 -- 172.21.15.125:0/3437828865 --> [v2:172.21.15.130:6824/119980,v1:172.21.15.130:6825/119980] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5684070370 con 0x7f568406d850 2023-10-06T03:07:06.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.586+0000 7f56967fc700 1 -- 172.21.15.125:0/3437828865 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f569c089240 con 0x7f56a006eef0 2023-10-06T03:07:06.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.587+0000 7f56a6d3d700 1 --2- 172.21.15.125:0/3437828865 >> [v2:172.21.15.130:6824/119980,v1:172.21.15.130:6825/119980] conn(0x7f568406d850 0x7f568406fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.587+0000 7f56a653c700 1 --2- 172.21.15.125:0/3437828865 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5684066f30 0x7f56840693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f56900099b0 tx=0x7f5690016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:06.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.587+0000 7f56a6d3d700 1 --2- 172.21.15.125:0/3437828865 >> [v2:172.21.15.130:6824/119980,v1:172.21.15.130:6825/119980] conn(0x7f568406d850 0x7f568406fca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:06.597 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.588+0000 7f56967fc700 1 -- 172.21.15.125:0/3437828865 <== osd.6 v2:172.21.15.130:6824/119980 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5684070370 con 0x7f568406d850 2023-10-06T03:07:06.602 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.601+0000 7f56a87a0700 1 -- 172.21.15.125:0/3437828865 --> [v2:172.21.15.130:6824/119980,v1:172.21.15.130:6825/119980] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f56a0157f70 con 0x7f568406d850 2023-10-06T03:07:06.603 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.602+0000 7f56967fc700 1 -- 172.21.15.125:0/3437828865 <== osd.6 v2:172.21.15.130:6824/119980 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f56a0157f70 con 0x7f568406d850 2023-10-06T03:07:06.603 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:07:06.603 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:07:06.603 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:07:06.604 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.602+0000 7f56a87a0700 1 -- 172.21.15.125:0/3437828865 >> [v2:172.21.15.130:6824/119980,v1:172.21.15.130:6825/119980] conn(0x7f568406d850 msgr2=0x7f568406fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.602+0000 7f56a87a0700 1 --2- 172.21.15.125:0/3437828865 >> [v2:172.21.15.130:6824/119980,v1:172.21.15.130:6825/119980] conn(0x7f568406d850 0x7f568406fca0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.602+0000 7f56a87a0700 1 -- 172.21.15.125:0/3437828865 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5684066f30 msgr2=0x7f56840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.602+0000 7f56a87a0700 1 --2- 172.21.15.125:0/3437828865 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f5684066f30 0x7f56840693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f56900099b0 tx=0x7f5690016000 comp rx=0 tx=0).stop 2023-10-06T03:07:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.602+0000 7f56a87a0700 1 -- 172.21.15.125:0/3437828865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56a006eef0 msgr2=0x7f56a00c75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.602+0000 7f56a87a0700 1 --2- 172.21.15.125:0/3437828865 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f56a006eef0 0x7f56a00c75d0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f569c00d890 tx=0x7f569c008040 comp rx=0 tx=0).stop 2023-10-06T03:07:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.602+0000 7f56a6d3d700 1 -- 172.21.15.125:0/3437828865 reap_dead start 2023-10-06T03:07:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.602+0000 7f56a87a0700 1 -- 172.21.15.125:0/3437828865 shutdown_connections 2023-10-06T03:07:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.602+0000 7f56a87a0700 1 -- 172.21.15.125:0/3437828865 >> 172.21.15.125:0/3437828865 conn(0x7f56a006b3b0 msgr2=0x7f56a00b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.602+0000 7f56a87a0700 1 -- 172.21.15.125:0/3437828865 shutdown_connections 2023-10-06T03:07:06.605 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.602+0000 7f56a87a0700 1 -- 172.21.15.125:0/3437828865 wait complete. 2023-10-06T03:07:06.615 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T03:07:06.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.732+0000 7f1972e1f700 1 Processor -- start 2023-10-06T03:07:06.734 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.732+0000 7f1972e1f700 1 -- start start 2023-10-06T03:07:06.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.733+0000 7f1972e1f700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f196c067d20 0x7f196c0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.733+0000 7f1972e1f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f196c0ca190 0x7f196c0c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.733+0000 7f1972e1f700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196c0cafe0 con 0x7f196c0af320 2023-10-06T03:07:06.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.733+0000 7f1972e1f700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196c0c3b40 con 0x7f196c067d20 2023-10-06T03:07:06.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.733+0000 7f1972e1f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c0ca710 con 0x7f196c0ca190 2023-10-06T03:07:06.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.733+0000 7f196bfff700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f196c067d20 0x7f196c0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.733+0000 7f1970bbb700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f196c0af320 0x7f196c067610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38810/0 (socket says 172.21.15.125:38810) 2023-10-06T03:07:06.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.733+0000 7f1970bbb700 1 -- 172.21.15.125:0/3993866363 learned_addr learned my addr 172.21.15.125:0/3993866363 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:07:06.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.734+0000 7f19713bc700 1 --2- 172.21.15.125:0/3993866363 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f196c0ca190 0x7f196c0c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.734+0000 7f196bfff700 1 -- 172.21.15.125:0/3993866363 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f196c0ca190 msgr2=0x7f196c0c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:06.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.734+0000 7f196bfff700 1 --2- 172.21.15.125:0/3993866363 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f196c0ca190 0x7f196c0c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.734+0000 7f196bfff700 1 -- 172.21.15.125:0/3993866363 >> v1:172.21.15.125:6789/0 conn(0x7f196c0af320 legacy=0x7f196c067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.734+0000 7f196b7fe700 1 -- 172.21.15.125:0/3993866363 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017256493 0 0) 0x7f1960001290 con 0x7f196c0af320 2023-10-06T03:07:06.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.734+0000 7f196bfff700 1 -- 172.21.15.125:0/3993866363 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c0cc750 con 0x7f196c067d20 2023-10-06T03:07:06.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.734+0000 7f196bfff700 1 --2- 172.21.15.125:0/3993866363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f196c067d20 0x7f196c0caaa0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f19580098e0 tx=0x7f19580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0303301f80c3b07 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:06.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.734+0000 7f196b7fe700 1 -- 172.21.15.125:0/3993866363 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1958009e80 con 0x7f196c067d20 2023-10-06T03:07:06.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.734+0000 7f196b7fe700 1 -- 172.21.15.125:0/3993866363 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f195800b860 con 0x7f196c067d20 2023-10-06T03:07:06.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.734+0000 7f196b7fe700 1 -- 172.21.15.125:0/3993866363 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f195800bbe0 con 0x7f196c067d20 2023-10-06T03:07:06.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.734+0000 7f1972e1f700 1 -- 172.21.15.125:0/3993866363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f196c067d20 msgr2=0x7f196c0caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.734+0000 7f1972e1f700 1 --2- 172.21.15.125:0/3993866363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f196c067d20 0x7f196c0caaa0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f19580098e0 tx=0x7f19580091a0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.735+0000 7f1972e1f700 1 -- 172.21.15.125:0/3993866363 shutdown_connections 2023-10-06T03:07:06.738 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.735+0000 7f1972e1f700 1 --2- 172.21.15.125:0/3993866363 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f196c0ca190 0x7f196c0c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.735+0000 7f1972e1f700 1 --2- 172.21.15.125:0/3993866363 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f196c067d20 0x7f196c0caaa0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.735+0000 7f1972e1f700 1 -- 172.21.15.125:0/3993866363 >> 172.21.15.125:0/3993866363 conn(0x7f196c096120 msgr2=0x7f196c068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:06.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.735+0000 7f1972e1f700 1 -- 172.21.15.125:0/3993866363 shutdown_connections 2023-10-06T03:07:06.739 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.735+0000 7f1972e1f700 1 -- 172.21.15.125:0/3993866363 wait complete. 2023-10-06T03:07:06.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.736+0000 7f1972e1f700 1 Processor -- start 2023-10-06T03:07:06.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.736+0000 7f1972e1f700 1 -- start start 2023-10-06T03:07:06.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.736+0000 7f1972e1f700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f196c067d20 0x7f196c146c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.736+0000 7f1972e1f700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f196c0af320 0x7f196c0b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.736+0000 7f1972e1f700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f196c0ca190 0x7f196c0b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.736+0000 7f1972e1f700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c15cac0 con 0x7f196c0ca190 2023-10-06T03:07:06.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.736+0000 7f1972e1f700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c15c7e0 con 0x7f196c0af320 2023-10-06T03:07:06.742 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.737+0000 7f1972e1f700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c147980 con 0x7f196c067d20 2023-10-06T03:07:06.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.737+0000 7f19713bc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f196c0ca190 0x7f196c0b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.737+0000 7f19713bc700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f196c0ca190 0x7f196c0b1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36040/0 (socket says 172.21.15.125:36040) 2023-10-06T03:07:06.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.737+0000 7f19713bc700 1 -- 172.21.15.125:0/1469825214 learned_addr learned my addr 172.21.15.125:0/1469825214 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:06.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.737+0000 7f1970bbb700 1 --2- 172.21.15.125:0/1469825214 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f196c067d20 0x7f196c146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.737+0000 7f196bfff700 1 --2- 172.21.15.125:0/1469825214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f196c0af320 0x7f196c0b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.737+0000 7f19713bc700 1 -- 172.21.15.125:0/1469825214 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f196c067d20 msgr2=0x7f196c146c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.737+0000 7f19713bc700 1 --2- 172.21.15.125:0/1469825214 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f196c067d20 0x7f196c146c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.743 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.737+0000 7f19713bc700 1 -- 172.21.15.125:0/1469825214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f196c0af320 msgr2=0x7f196c0b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.737+0000 7f19713bc700 1 --2- 172.21.15.125:0/1469825214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f196c0af320 0x7f196c0b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.737+0000 7f19713bc700 1 -- 172.21.15.125:0/1469825214 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1958009420 con 0x7f196c0ca190 2023-10-06T03:07:06.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.737+0000 7f19713bc700 1 --2- 172.21.15.125:0/1469825214 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f196c0ca190 0x7f196c0b1180 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f1964009fa0 tx=0x7f1964009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:06.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.737+0000 7f1968ff9700 1 -- 172.21.15.125:0/1469825214 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196400ebc0 con 0x7f196c0ca190 2023-10-06T03:07:06.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.737+0000 7f1968ff9700 1 -- 172.21.15.125:0/1469825214 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196400ed20 con 0x7f196c0ca190 2023-10-06T03:07:06.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.737+0000 7f1972e1f700 1 -- 172.21.15.125:0/1469825214 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c147c60 con 0x7f196c0ca190 2023-10-06T03:07:06.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.737+0000 7f1968ff9700 1 -- 172.21.15.125:0/1469825214 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964014670 con 0x7f196c0ca190 2023-10-06T03:07:06.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.737+0000 7f1972e1f700 1 -- 172.21.15.125:0/1469825214 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c1576c0 con 0x7f196c0ca190 2023-10-06T03:07:06.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.738+0000 7f1972e1f700 1 -- 172.21.15.125:0/1469825214 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c148180 con 0x7f196c0ca190 2023-10-06T03:07:06.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.739+0000 7f1968ff9700 1 -- 172.21.15.125:0/1469825214 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19640149e0 con 0x7f196c0ca190 2023-10-06T03:07:06.744 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.739+0000 7f1968ff9700 1 --2- 172.21.15.125:0/1469825214 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1950066f30 0x7f19500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:06.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.739+0000 7f1968ff9700 1 -- 172.21.15.125:0/1469825214 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f1964084b60 con 0x7f196c0ca190 2023-10-06T03:07:06.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.739+0000 7f1970bbb700 1 --2- 172.21.15.125:0/1469825214 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1950066f30 0x7f19500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:06.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.740+0000 7f1970bbb700 1 --2- 172.21.15.125:0/1469825214 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1950066f30 0x7f19500693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1960007fd0 tx=0x7f1960009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:06.745 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.743+0000 7f1968ff9700 1 -- 172.21.15.125:0/1469825214 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f196c148180 con 0x7f196c0ca190 2023-10-06T03:07:06.925 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.924+0000 7f1972e1f700 1 -- 172.21.15.125:0/1469825214 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f196c148180 con 0x7f1950066f30 2023-10-06T03:07:06.926 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.924+0000 7f1968ff9700 1 -- 172.21.15.125:0/1469825214 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f196c148180 con 0x7f1950066f30 2023-10-06T03:07:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.926+0000 7f1972e1f700 1 -- 172.21.15.125:0/1469825214 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1950066f30 msgr2=0x7f19500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.926+0000 7f1972e1f700 1 --2- 172.21.15.125:0/1469825214 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1950066f30 0x7f19500693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1960007fd0 tx=0x7f1960009040 comp rx=0 tx=0).stop 2023-10-06T03:07:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.926+0000 7f1972e1f700 1 -- 172.21.15.125:0/1469825214 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f196c0ca190 msgr2=0x7f196c0b1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.926+0000 7f1972e1f700 1 --2- 172.21.15.125:0/1469825214 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f196c0ca190 0x7f196c0b1180 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f1964009fa0 tx=0x7f1964009900 comp rx=0 tx=0).stop 2023-10-06T03:07:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.926+0000 7f1972e1f700 1 -- 172.21.15.125:0/1469825214 shutdown_connections 2023-10-06T03:07:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.926+0000 7f1972e1f700 1 --2- 172.21.15.125:0/1469825214 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f1950066f30 0x7f19500693e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.926+0000 7f1972e1f700 1 --2- 172.21.15.125:0/1469825214 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f196c0ca190 0x7f196c0b1180 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.926+0000 7f1972e1f700 1 --2- 172.21.15.125:0/1469825214 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f196c067d20 0x7f196c146c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.926+0000 7f1972e1f700 1 --2- 172.21.15.125:0/1469825214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f196c0af320 0x7f196c0b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:06.928 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.926+0000 7f1972e1f700 1 -- 172.21.15.125:0/1469825214 >> 172.21.15.125:0/1469825214 conn(0x7f196c096120 msgr2=0x7f196c0c1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:06.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.926+0000 7f1972e1f700 1 -- 172.21.15.125:0/1469825214 shutdown_connections 2023-10-06T03:07:06.929 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:06.926+0000 7f1972e1f700 1 -- 172.21.15.125:0/1469825214 wait complete. 2023-10-06T03:07:06.929 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T03:07:06.939 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T03:07:06.939 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T03:07:07.063 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.059+0000 7fb205dc6700 1 Processor -- start 2023-10-06T03:07:07.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.059+0000 7fb205dc6700 1 -- start start 2023-10-06T03:07:07.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.059+0000 7fb205dc6700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb2001590a0 0x7fb2000ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.059+0000 7fb205dc6700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2000cb7e0 con 0x7fb200159470 2023-10-06T03:07:07.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.059+0000 7fb205dc6700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2000cabd0 con 0x7fb20006efe0 2023-10-06T03:07:07.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.059+0000 7fb205dc6700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2000caeb0 con 0x7fb2001590a0 2023-10-06T03:07:07.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.060+0000 7fb1ff7fe700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7fb2001590a0 0x7fb2000ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.060+0000 7fb1feffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fb200159470 0x7fb20006e8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38816/0 (socket says 172.21.15.125:38816) 2023-10-06T03:07:07.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.060+0000 7fb1feffd700 1 -- 172.21.15.125:0/409317947 learned_addr learned my addr 172.21.15.125:0/409317947 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:07:07.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.060+0000 7fb1ff7fe700 1 -- 172.21.15.125:0/409317947 >> v1:172.21.15.130:6789/0 conn(0x7fb20006efe0 legacy=0x7fb200067780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:07.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.060+0000 7fb1ff7fe700 1 -- 172.21.15.125:0/409317947 >> v1:172.21.15.125:6789/0 conn(0x7fb200159470 legacy=0x7fb20006e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.064 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.060+0000 7fb1ff7fe700 1 -- 172.21.15.125:0/409317947 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2000cb190 con 0x7fb2001590a0 2023-10-06T03:07:07.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.060+0000 7fb1fe7fc700 1 -- 172.21.15.125:0/409317947 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710428807 0 0) 0x7fb2000cb7e0 con 0x7fb200159470 2023-10-06T03:07:07.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.060+0000 7fb1ff7fe700 1 --2- 172.21.15.125:0/409317947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2001590a0 0x7fb2000ca5f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40098e0 tx=0x7fb1f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50dd547f2238c341 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:07.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.060+0000 7fb1fe7fc700 1 -- 172.21.15.125:0/409317947 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4009e80 con 0x7fb2001590a0 2023-10-06T03:07:07.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.060+0000 7fb1fe7fc700 1 -- 172.21.15.125:0/409317947 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f400b820 con 0x7fb2001590a0 2023-10-06T03:07:07.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.060+0000 7fb1fe7fc700 1 -- 172.21.15.125:0/409317947 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f400bba0 con 0x7fb2001590a0 2023-10-06T03:07:07.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.061+0000 7fb205dc6700 1 -- 172.21.15.125:0/409317947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2001590a0 msgr2=0x7fb2000ca5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.061+0000 7fb205dc6700 1 --2- 172.21.15.125:0/409317947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2001590a0 0x7fb2000ca5f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40098e0 tx=0x7fb1f40091a0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.061+0000 7fb205dc6700 1 -- 172.21.15.125:0/409317947 shutdown_connections 2023-10-06T03:07:07.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.061+0000 7fb205dc6700 1 --2- 172.21.15.125:0/409317947 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2001590a0 0x7fb2000ca5f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.061+0000 7fb205dc6700 1 -- 172.21.15.125:0/409317947 >> 172.21.15.125:0/409317947 conn(0x7fb20006b3b0 msgr2=0x7fb2000cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:07.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.061+0000 7fb205dc6700 1 -- 172.21.15.125:0/409317947 shutdown_connections 2023-10-06T03:07:07.065 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.061+0000 7fb205dc6700 1 -- 172.21.15.125:0/409317947 wait complete. 2023-10-06T03:07:07.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.062+0000 7fb205dc6700 1 Processor -- start 2023-10-06T03:07:07.066 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.062+0000 7fb205dc6700 1 -- start start 2023-10-06T03:07:07.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb205dc6700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb20006efe0 0x7fb200149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb205dc6700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2001590a0 0x7fb2000c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb205dc6700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb200159470 0x7fb2000c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb205dc6700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000b2430 con 0x7fb2001590a0 2023-10-06T03:07:07.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb205dc6700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000b0db0 con 0x7fb20006efe0 2023-10-06T03:07:07.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb205dc6700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2000b0480 con 0x7fb200159470 2023-10-06T03:07:07.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb1feffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2001590a0 0x7fb2000c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb1feffd700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2001590a0 0x7fb2000c9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36054/0 (socket says 172.21.15.125:36054) 2023-10-06T03:07:07.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb1feffd700 1 -- 172.21.15.125:0/1432567698 learned_addr learned my addr 172.21.15.125:0/1432567698 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:07.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb1ff7fe700 1 --2- 172.21.15.125:0/1432567698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb20006efe0 0x7fb200149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.069 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb1fffff700 1 --2- 172.21.15.125:0/1432567698 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb200159470 0x7fb2000c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb1feffd700 1 -- 172.21.15.125:0/1432567698 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb200159470 msgr2=0x7fb2000c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb1feffd700 1 --2- 172.21.15.125:0/1432567698 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fb200159470 0x7fb2000c9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb1feffd700 1 -- 172.21.15.125:0/1432567698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb20006efe0 msgr2=0x7fb200149f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb1feffd700 1 --2- 172.21.15.125:0/1432567698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb20006efe0 0x7fb200149f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb1feffd700 1 -- 172.21.15.125:0/1432567698 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f4009420 con 0x7fb2001590a0 2023-10-06T03:07:07.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb1feffd700 1 --2- 172.21.15.125:0/1432567698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2001590a0 0x7fb2000c9050 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000c5e0 tx=0x7fb1f0001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:07.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb1e77fe700 1 -- 172.21.15.125:0/1432567698 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0005b30 con 0x7fb2001590a0 2023-10-06T03:07:07.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb1e77fe700 1 -- 172.21.15.125:0/1432567698 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f0005c90 con 0x7fb2001590a0 2023-10-06T03:07:07.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb205dc6700 1 -- 172.21.15.125:0/1432567698 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2000b0760 con 0x7fb2001590a0 2023-10-06T03:07:07.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.063+0000 7fb1e77fe700 1 -- 172.21.15.125:0/1432567698 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f00072e0 con 0x7fb2001590a0 2023-10-06T03:07:07.070 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.064+0000 7fb205dc6700 1 -- 172.21.15.125:0/1432567698 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2000b1240 con 0x7fb2001590a0 2023-10-06T03:07:07.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.064+0000 7fb205dc6700 1 -- 172.21.15.125:0/1432567698 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb20006d830 con 0x7fb2001590a0 2023-10-06T03:07:07.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.065+0000 7fb1e77fe700 1 -- 172.21.15.125:0/1432567698 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1f001b3b0 con 0x7fb2001590a0 2023-10-06T03:07:07.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.065+0000 7fb1e77fe700 1 --2- 172.21.15.125:0/1432567698 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb1ec066f30 0x7fb1ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.065+0000 7fb1e77fe700 1 -- 172.21.15.125:0/1432567698 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fb1f0083920 con 0x7fb2001590a0 2023-10-06T03:07:07.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.065+0000 7fb1ff7fe700 1 --2- 172.21.15.125:0/1432567698 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb1ec066f30 0x7fb1ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.065+0000 7fb1e77fe700 1 --2- 172.21.15.125:0/1432567698 >> [v2:172.21.15.130:6800/119956,v1:172.21.15.130:6801/119956] conn(0x7fb1ec06d850 0x7fb1ec06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.065+0000 7fb1e77fe700 1 -- 172.21.15.125:0/1432567698 --> [v2:172.21.15.130:6800/119956,v1:172.21.15.130:6801/119956] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1ec070370 con 0x7fb1ec06d850 2023-10-06T03:07:07.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.065+0000 7fb1e77fe700 1 -- 172.21.15.125:0/1432567698 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1f0088240 con 0x7fb2001590a0 2023-10-06T03:07:07.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.066+0000 7fb1ff7fe700 1 --2- 172.21.15.125:0/1432567698 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb1ec066f30 0x7fb1ec0693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40030c0 tx=0x7fb1f4016000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:07.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.066+0000 7fb1fffff700 1 --2- 172.21.15.125:0/1432567698 >> [v2:172.21.15.130:6800/119956,v1:172.21.15.130:6801/119956] conn(0x7fb1ec06d850 0x7fb1ec06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.071 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.066+0000 7fb1fffff700 1 --2- 172.21.15.125:0/1432567698 >> [v2:172.21.15.130:6800/119956,v1:172.21.15.130:6801/119956] conn(0x7fb1ec06d850 0x7fb1ec06fca0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:07.072 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.067+0000 7fb1e77fe700 1 -- 172.21.15.125:0/1432567698 <== osd.7 v2:172.21.15.130:6800/119956 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb1ec070370 con 0x7fb1ec06d850 2023-10-06T03:07:07.081 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.080+0000 7fb205dc6700 1 -- 172.21.15.125:0/1432567698 --> [v2:172.21.15.130:6800/119956,v1:172.21.15.130:6801/119956] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb20004bb80 con 0x7fb1ec06d850 2023-10-06T03:07:07.082 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.081+0000 7fb1e77fe700 1 -- 172.21.15.125:0/1432567698 <== osd.7 v2:172.21.15.130:6800/119956 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb20004bb80 con 0x7fb1ec06d850 2023-10-06T03:07:07.082 INFO:teuthology.orchestra.run.smithi125.stdout:{ 2023-10-06T03:07:07.083 INFO:teuthology.orchestra.run.smithi125.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T03:07:07.083 INFO:teuthology.orchestra.run.smithi125.stdout:} 2023-10-06T03:07:07.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.081+0000 7fb205dc6700 1 -- 172.21.15.125:0/1432567698 >> [v2:172.21.15.130:6800/119956,v1:172.21.15.130:6801/119956] conn(0x7fb1ec06d850 msgr2=0x7fb1ec06fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.081+0000 7fb205dc6700 1 --2- 172.21.15.125:0/1432567698 >> [v2:172.21.15.130:6800/119956,v1:172.21.15.130:6801/119956] conn(0x7fb1ec06d850 0x7fb1ec06fca0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.081+0000 7fb205dc6700 1 -- 172.21.15.125:0/1432567698 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb1ec066f30 msgr2=0x7fb1ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.081+0000 7fb205dc6700 1 --2- 172.21.15.125:0/1432567698 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fb1ec066f30 0x7fb1ec0693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb1f40030c0 tx=0x7fb1f4016000 comp rx=0 tx=0).stop 2023-10-06T03:07:07.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.081+0000 7fb205dc6700 1 -- 172.21.15.125:0/1432567698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2001590a0 msgr2=0x7fb2000c9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.081+0000 7fb205dc6700 1 --2- 172.21.15.125:0/1432567698 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fb2001590a0 0x7fb2000c9050 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000c5e0 tx=0x7fb1f0001070 comp rx=0 tx=0).stop 2023-10-06T03:07:07.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.081+0000 7fb1fffff700 1 -- 172.21.15.125:0/1432567698 reap_dead start 2023-10-06T03:07:07.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.081+0000 7fb205dc6700 1 -- 172.21.15.125:0/1432567698 shutdown_connections 2023-10-06T03:07:07.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.081+0000 7fb205dc6700 1 -- 172.21.15.125:0/1432567698 >> 172.21.15.125:0/1432567698 conn(0x7fb20006b3b0 msgr2=0x7fb200068670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:07.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.081+0000 7fb205dc6700 1 -- 172.21.15.125:0/1432567698 shutdown_connections 2023-10-06T03:07:07.085 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.081+0000 7fb205dc6700 1 -- 172.21.15.125:0/1432567698 wait complete. 2023-10-06T03:07:07.094 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T03:07:07.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.211+0000 7f6c3310a700 1 Processor -- start 2023-10-06T03:07:07.212 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.211+0000 7f6c3310a700 1 -- start start 2023-10-06T03:07:07.214 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.211+0000 7f6c3310a700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f6c2c067d20 0x7f6c2c0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.211+0000 7f6c3310a700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c2c0cafe0 con 0x7f6c2c0af320 2023-10-06T03:07:07.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.212+0000 7f6c3310a700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c2c0c3b40 con 0x7f6c2c0ca190 2023-10-06T03:07:07.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.212+0000 7f6c3310a700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c2c0ca710 con 0x7f6c2c067d20 2023-10-06T03:07:07.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.212+0000 7f6c30ea6700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f6c2c0af320 0x7f6c2c067610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38832/0 (socket says 172.21.15.125:38832) 2023-10-06T03:07:07.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.212+0000 7f6c30ea6700 1 -- 172.21.15.125:0/1900207853 learned_addr learned my addr 172.21.15.125:0/1900207853 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:07:07.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.212+0000 7f6c2bfff700 1 --2- 172.21.15.125:0/1900207853 >> v2:172.21.15.130:3300/0 conn(0x7f6c2c067d20 0x7f6c2c0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.212+0000 7f6c2b7fe700 1 -- 172.21.15.125:0/1900207853 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381152877 0 0) 0x7f6c20001290 con 0x7f6c2c0af320 2023-10-06T03:07:07.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.212+0000 7f6c2b7fe700 1 -- 172.21.15.125:0/1900207853 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c1c003570 con 0x7f6c2c0af320 2023-10-06T03:07:07.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.212+0000 7f6c2b7fe700 1 -- 172.21.15.125:0/1900207853 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3409253646 0 0) 0x7f6c1c003570 con 0x7f6c2c0af320 2023-10-06T03:07:07.215 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.212+0000 7f6c2bfff700 1 -- 172.21.15.125:0/1900207853 >> v1:172.21.15.130:6789/0 conn(0x7f6c2c0ca190 legacy=0x7f6c2c0c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.212+0000 7f6c2bfff700 1 -- 172.21.15.125:0/1900207853 >> v1:172.21.15.125:6789/0 conn(0x7f6c2c0af320 legacy=0x7f6c2c067610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.212+0000 7f6c2bfff700 1 -- 172.21.15.125:0/1900207853 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c0cc750 con 0x7f6c2c067d20 2023-10-06T03:07:07.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.212+0000 7f6c2bfff700 1 --2- 172.21.15.125:0/1900207853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c2c067d20 0x7f6c2c0caaa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6c180098e0 tx=0x7f6c180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48d97f615b0ec65c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:07.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.213+0000 7f6c2b7fe700 1 -- 172.21.15.125:0/1900207853 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c20001780 con 0x7f6c2c067d20 2023-10-06T03:07:07.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.213+0000 7f6c2b7fe700 1 -- 172.21.15.125:0/1900207853 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c18011420 con 0x7f6c2c067d20 2023-10-06T03:07:07.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.213+0000 7f6c2b7fe700 1 -- 172.21.15.125:0/1900207853 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c180117a0 con 0x7f6c2c067d20 2023-10-06T03:07:07.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.213+0000 7f6c3310a700 1 -- 172.21.15.125:0/1900207853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c2c067d20 msgr2=0x7f6c2c0caaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.213+0000 7f6c3310a700 1 --2- 172.21.15.125:0/1900207853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c2c067d20 0x7f6c2c0caaa0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6c180098e0 tx=0x7f6c180091a0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.213+0000 7f6c3310a700 1 -- 172.21.15.125:0/1900207853 shutdown_connections 2023-10-06T03:07:07.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.213+0000 7f6c3310a700 1 --2- 172.21.15.125:0/1900207853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c2c067d20 0x7f6c2c0caaa0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.216 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.213+0000 7f6c3310a700 1 -- 172.21.15.125:0/1900207853 >> 172.21.15.125:0/1900207853 conn(0x7f6c2c096120 msgr2=0x7f6c2c068f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:07.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.213+0000 7f6c3310a700 1 -- 172.21.15.125:0/1900207853 shutdown_connections 2023-10-06T03:07:07.217 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.213+0000 7f6c3310a700 1 -- 172.21.15.125:0/1900207853 wait complete. 2023-10-06T03:07:07.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.214+0000 7f6c3310a700 1 Processor -- start 2023-10-06T03:07:07.219 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.214+0000 7f6c3310a700 1 -- start start 2023-10-06T03:07:07.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.215+0000 7f6c3310a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c2c067d20 0x7f6c2c16a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.215+0000 7f6c3310a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c2c0af320 0x7f6c2c16aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.215+0000 7f6c3310a700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c2c0ca190 0x7f6c2c0c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.215+0000 7f6c3310a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c156b30 con 0x7f6c2c0af320 2023-10-06T03:07:07.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.215+0000 7f6c3310a700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c155f20 con 0x7f6c2c0ca190 2023-10-06T03:07:07.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.215+0000 7f6c3310a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c156200 con 0x7f6c2c067d20 2023-10-06T03:07:07.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.215+0000 7f6c2bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c2c0af320 0x7f6c2c16aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.220 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.215+0000 7f6c2bfff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c2c0af320 0x7f6c2c16aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36060/0 (socket says 172.21.15.125:36060) 2023-10-06T03:07:07.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.215+0000 7f6c2bfff700 1 -- 172.21.15.125:0/3108577319 learned_addr learned my addr 172.21.15.125:0/3108577319 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:07.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.215+0000 7f6c30ea6700 1 --2- 172.21.15.125:0/3108577319 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c2c067d20 0x7f6c2c16a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.215+0000 7f6c316a7700 1 --2- 172.21.15.125:0/3108577319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c2c0ca190 0x7f6c2c0c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.215+0000 7f6c2bfff700 1 -- 172.21.15.125:0/3108577319 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c2c067d20 msgr2=0x7f6c2c16a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.215+0000 7f6c2bfff700 1 --2- 172.21.15.125:0/3108577319 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c2c067d20 0x7f6c2c16a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.215+0000 7f6c2bfff700 1 -- 172.21.15.125:0/3108577319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c2c0ca190 msgr2=0x7f6c2c0c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.215+0000 7f6c2bfff700 1 --2- 172.21.15.125:0/3108577319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c2c0ca190 0x7f6c2c0c3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.216+0000 7f6c2bfff700 1 -- 172.21.15.125:0/3108577319 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c18009420 con 0x7f6c2c0af320 2023-10-06T03:07:07.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.216+0000 7f6c2bfff700 1 --2- 172.21.15.125:0/3108577319 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c2c0af320 0x7f6c2c16aec0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6c18002000 tx=0x7f6c18016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:07.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.216+0000 7f6c28ff9700 1 -- 172.21.15.125:0/3108577319 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1801cb60 con 0x7f6c2c0af320 2023-10-06T03:07:07.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.216+0000 7f6c28ff9700 1 -- 172.21.15.125:0/3108577319 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1801cce0 con 0x7f6c2c0af320 2023-10-06T03:07:07.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.216+0000 7f6c28ff9700 1 -- 172.21.15.125:0/3108577319 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1801a6a0 con 0x7f6c2c0af320 2023-10-06T03:07:07.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.216+0000 7f6c3310a700 1 -- 172.21.15.125:0/3108577319 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c2c1564e0 con 0x7f6c2c0af320 2023-10-06T03:07:07.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.216+0000 7f6c3310a700 1 -- 172.21.15.125:0/3108577319 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2c16abb0 con 0x7f6c2c0af320 2023-10-06T03:07:07.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.217+0000 7f6c3310a700 1 -- 172.21.15.125:0/3108577319 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c2c06ee00 con 0x7f6c2c0af320 2023-10-06T03:07:07.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.217+0000 7f6c28ff9700 1 -- 172.21.15.125:0/3108577319 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c1801aad0 con 0x7f6c2c0af320 2023-10-06T03:07:07.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.218+0000 7f6c28ff9700 1 --2- 172.21.15.125:0/3108577319 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6c10066f30 0x7f6c100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.218+0000 7f6c28ff9700 1 -- 172.21.15.125:0/3108577319 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f6c18085b00 con 0x7f6c2c0af320 2023-10-06T03:07:07.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.218+0000 7f6c30ea6700 1 --2- 172.21.15.125:0/3108577319 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6c10066f30 0x7f6c100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.218+0000 7f6c30ea6700 1 --2- 172.21.15.125:0/3108577319 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6c10066f30 0x7f6c100693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6c20002ee0 tx=0x7f6c20009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:07.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.222+0000 7f6c28ff9700 1 -- 172.21.15.125:0/3108577319 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c18052e80 con 0x7f6c2c0af320 2023-10-06T03:07:07.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.405+0000 7f6c3310a700 1 -- 172.21.15.125:0/3108577319 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c2c066510 con 0x7f6c10066f30 2023-10-06T03:07:07.407 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.406+0000 7f6c28ff9700 1 -- 172.21.15.125:0/3108577319 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6c2c066510 con 0x7f6c10066f30 2023-10-06T03:07:07.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.407+0000 7f6c3310a700 1 -- 172.21.15.125:0/3108577319 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6c10066f30 msgr2=0x7f6c100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.407+0000 7f6c3310a700 1 --2- 172.21.15.125:0/3108577319 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6c10066f30 0x7f6c100693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6c20002ee0 tx=0x7f6c20009040 comp rx=0 tx=0).stop 2023-10-06T03:07:07.409 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.407+0000 7f6c3310a700 1 -- 172.21.15.125:0/3108577319 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c2c0af320 msgr2=0x7f6c2c16aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.407+0000 7f6c3310a700 1 --2- 172.21.15.125:0/3108577319 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c2c0af320 0x7f6c2c16aec0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f6c18002000 tx=0x7f6c18016000 comp rx=0 tx=0).stop 2023-10-06T03:07:07.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.407+0000 7f6c3310a700 1 -- 172.21.15.125:0/3108577319 shutdown_connections 2023-10-06T03:07:07.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.407+0000 7f6c3310a700 1 --2- 172.21.15.125:0/3108577319 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f6c10066f30 0x7f6c100693e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.407+0000 7f6c3310a700 1 --2- 172.21.15.125:0/3108577319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c2c0ca190 0x7f6c2c0c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.407+0000 7f6c3310a700 1 --2- 172.21.15.125:0/3108577319 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f6c2c067d20 0x7f6c2c16a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.407+0000 7f6c3310a700 1 --2- 172.21.15.125:0/3108577319 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f6c2c0af320 0x7f6c2c16aec0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.408+0000 7f6c3310a700 1 -- 172.21.15.125:0/3108577319 >> 172.21.15.125:0/3108577319 conn(0x7f6c2c096120 msgr2=0x7f6c2c151ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:07.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.408+0000 7f6c3310a700 1 -- 172.21.15.125:0/3108577319 shutdown_connections 2023-10-06T03:07:07.410 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.408+0000 7f6c3310a700 1 -- 172.21.15.125:0/3108577319 wait complete. 2023-10-06T03:07:07.411 INFO:teuthology.orchestra.run.smithi125.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T03:07:07.421 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:07:07.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.538+0000 7f34d4da1700 1 Processor -- start 2023-10-06T03:07:07.539 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.538+0000 7f34d4da1700 1 -- start start 2023-10-06T03:07:07.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34d4da1700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34d0155d50 0x7f34d00abc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.543 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34d4da1700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f34d00b20a0 0x7f34d00ca400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34d4da1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d00afe70 con 0x7f34d00ab7f0 2023-10-06T03:07:07.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34d4da1700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d00b0150 con 0x7f34d00b20a0 2023-10-06T03:07:07.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34d4da1700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d00b0430 con 0x7f34d0155d50 2023-10-06T03:07:07.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34ceffd700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7f34d00ab7f0 0x7f34d00b1990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:38842/0 (socket says 172.21.15.125:38842) 2023-10-06T03:07:07.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34ceffd700 1 -- 172.21.15.125:0/2130432342 learned_addr learned my addr 172.21.15.125:0/2130432342 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:07:07.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34ce7fc700 1 -- 172.21.15.125:0/2130432342 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4294598658 0 0) 0x7f34d00afe70 con 0x7f34d00ab7f0 2023-10-06T03:07:07.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34cf7fe700 1 --2- 172.21.15.125:0/2130432342 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34d0155d50 0x7f34d00abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.544 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34ce7fc700 1 -- 172.21.15.125:0/2130432342 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34b8003570 con 0x7f34d00ab7f0 2023-10-06T03:07:07.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34cffff700 1 --2- 172.21.15.125:0/2130432342 >> v2:172.21.15.130:3300/0 conn(0x7f34d00b20a0 0x7f34d00ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34ce7fc700 1 -- 172.21.15.125:0/2130432342 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 756156126 0 0) 0x7f34b8003570 con 0x7f34d00ab7f0 2023-10-06T03:07:07.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34ce7fc700 1 -- 172.21.15.125:0/2130432342 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34d0155d50 msgr2=0x7f34d00abc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:07.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34ce7fc700 1 --2- 172.21.15.125:0/2130432342 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34d0155d50 0x7f34d00abc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34ce7fc700 1 -- 172.21.15.125:0/2130432342 >> v2:172.21.15.130:3300/0 conn(0x7f34d00b20a0 msgr2=0x7f34d00ca400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:07.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34ce7fc700 1 --2- 172.21.15.125:0/2130432342 >> v2:172.21.15.130:3300/0 conn(0x7f34d00b20a0 0x7f34d00ca400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34ce7fc700 1 -- 172.21.15.125:0/2130432342 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d00b0710 con 0x7f34d00ab7f0 2023-10-06T03:07:07.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34ce7fc700 1 -- 172.21.15.125:0/2130432342 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7f34c4001470 con 0x7f34d00ab7f0 2023-10-06T03:07:07.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34ce7fc700 1 -- 172.21.15.125:0/2130432342 >> v1:172.21.15.125:6789/0 conn(0x7f34d00ab7f0 legacy=0x7f34d00b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.545 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34ce7fc700 1 --2- 172.21.15.125:0/2130432342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34b8003a60 0x7f34b8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34ce7fc700 1 --2- 172.21.15.125:0/2130432342 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34d0155d50 0x7f34b8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34ce7fc700 1 --2- 172.21.15.125:0/2130432342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34b8004d50 0x7f34b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.539+0000 7f34ce7fc700 1 -- 172.21.15.125:0/2130432342 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d00b0150 con 0x7f34b8003a60 2023-10-06T03:07:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.540+0000 7f34ce7fc700 1 -- 172.21.15.125:0/2130432342 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d00b0430 con 0x7f34b8004d50 2023-10-06T03:07:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.540+0000 7f34ce7fc700 1 -- 172.21.15.125:0/2130432342 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b800ba60 con 0x7f34d0155d50 2023-10-06T03:07:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.540+0000 7f34cf7fe700 1 --2- 172.21.15.125:0/2130432342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34b8003a60 0x7f34b8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.540+0000 7f34ceffd700 1 --2- 172.21.15.125:0/2130432342 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34d0155d50 0x7f34b8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.540+0000 7f34cffff700 1 --2- 172.21.15.125:0/2130432342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34b8004d50 0x7f34b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.540+0000 7f34cf7fe700 1 -- 172.21.15.125:0/2130432342 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34d0155d50 msgr2=0x7f34b8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:07.546 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.540+0000 7f34cf7fe700 1 --2- 172.21.15.125:0/2130432342 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34d0155d50 0x7f34b8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.540+0000 7f34cf7fe700 1 -- 172.21.15.125:0/2130432342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34b8004d50 msgr2=0x7f34b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:07.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.540+0000 7f34cf7fe700 1 --2- 172.21.15.125:0/2130432342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34b8004d50 0x7f34b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.540+0000 7f34cf7fe700 1 -- 172.21.15.125:0/2130432342 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b8003570 con 0x7f34b8003a60 2023-10-06T03:07:07.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.540+0000 7f34cffff700 1 --2- 172.21.15.125:0/2130432342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34b8004d50 0x7f34b80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T03:07:07.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.540+0000 7f34cf7fe700 1 --2- 172.21.15.125:0/2130432342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34b8003a60 0x7f34b8003e70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f34c000beb0 tx=0x7f34c000b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0addc2f6a035ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:07.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.540+0000 7f34ce7fc700 1 -- 172.21.15.125:0/2130432342 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c0010ba0 con 0x7f34b8003a60 2023-10-06T03:07:07.547 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.540+0000 7f34ce7fc700 1 -- 172.21.15.125:0/2130432342 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c0010d00 con 0x7f34b8003a60 2023-10-06T03:07:07.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.540+0000 7f34ce7fc700 1 -- 172.21.15.125:0/2130432342 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c0011680 con 0x7f34b8003a60 2023-10-06T03:07:07.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.541+0000 7f34d4da1700 1 -- 172.21.15.125:0/2130432342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34b8003a60 msgr2=0x7f34b8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.541+0000 7f34d4da1700 1 --2- 172.21.15.125:0/2130432342 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34b8003a60 0x7f34b8003e70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f34c000beb0 tx=0x7f34c000b430 comp rx=0 tx=0).stop 2023-10-06T03:07:07.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.541+0000 7f34cffff700 1 -- 172.21.15.125:0/2130432342 reap_dead start 2023-10-06T03:07:07.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.541+0000 7f34d4da1700 1 -- 172.21.15.125:0/2130432342 shutdown_connections 2023-10-06T03:07:07.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.541+0000 7f34d4da1700 1 -- 172.21.15.125:0/2130432342 >> 172.21.15.125:0/2130432342 conn(0x7f34d00691f0 msgr2=0x7f34d00cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:07.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.541+0000 7f34d4da1700 1 -- 172.21.15.125:0/2130432342 shutdown_connections 2023-10-06T03:07:07.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.541+0000 7f34d4da1700 1 -- 172.21.15.125:0/2130432342 wait complete. 2023-10-06T03:07:07.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.542+0000 7f34d4da1700 1 Processor -- start 2023-10-06T03:07:07.548 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.542+0000 7f34d4da1700 1 -- start start 2023-10-06T03:07:07.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34d4da1700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34b8003a60 0x7f34d016e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34d4da1700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34d016cf10 0x7f34d00aabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34d4da1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34d016a010 0x7f34d01536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34d4da1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d00a92c0 con 0x7f34d016a010 2023-10-06T03:07:07.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34d4da1700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d00ab390 con 0x7f34d016cf10 2023-10-06T03:07:07.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34d4da1700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d00a89d0 con 0x7f34b8003a60 2023-10-06T03:07:07.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34cffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34d016a010 0x7f34d01536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34cffff700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34d016a010 0x7f34d01536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:36080/0 (socket says 172.21.15.125:36080) 2023-10-06T03:07:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34cffff700 1 -- 172.21.15.125:0/3460685010 learned_addr learned my addr 172.21.15.125:0/3460685010 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34cf7fe700 1 --2- 172.21.15.125:0/3460685010 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34b8003a60 0x7f34d016e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34ceffd700 1 --2- 172.21.15.125:0/3460685010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34d016cf10 0x7f34d00aabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34cffff700 1 -- 172.21.15.125:0/3460685010 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34b8003a60 msgr2=0x7f34d016e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34cffff700 1 --2- 172.21.15.125:0/3460685010 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34b8003a60 0x7f34d016e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34cffff700 1 -- 172.21.15.125:0/3460685010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34d016cf10 msgr2=0x7f34d00aabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34cffff700 1 --2- 172.21.15.125:0/3460685010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34d016cf10 0x7f34d00aabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34cffff700 1 -- 172.21.15.125:0/3460685010 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d00ab0f0 con 0x7f34d016a010 2023-10-06T03:07:07.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34cffff700 1 --2- 172.21.15.125:0/3460685010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34d016a010 0x7f34d01536f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f34d006dac0 tx=0x7f34c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:07.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34b77fe700 1 -- 172.21.15.125:0/3460685010 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c800e050 con 0x7f34d016a010 2023-10-06T03:07:07.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34b77fe700 1 -- 172.21.15.125:0/3460685010 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c800f040 con 0x7f34d016a010 2023-10-06T03:07:07.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34d4da1700 1 -- 172.21.15.125:0/3460685010 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d016d380 con 0x7f34d016a010 2023-10-06T03:07:07.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34b77fe700 1 -- 172.21.15.125:0/3460685010 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8010d40 con 0x7f34d016a010 2023-10-06T03:07:07.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.543+0000 7f34d4da1700 1 -- 172.21.15.125:0/3460685010 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d00a8f50 con 0x7f34d016a010 2023-10-06T03:07:07.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.544+0000 7f34d4da1700 1 -- 172.21.15.125:0/3460685010 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d006df20 con 0x7f34d016a010 2023-10-06T03:07:07.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.545+0000 7f34b77fe700 1 -- 172.21.15.125:0/3460685010 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34c8003020 con 0x7f34d016a010 2023-10-06T03:07:07.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.546+0000 7f34b77fe700 1 --2- 172.21.15.125:0/3460685010 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f34bc066f30 0x7f34bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:07.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.546+0000 7f34b77fe700 1 -- 172.21.15.125:0/3460685010 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f34c80850c0 con 0x7f34d016a010 2023-10-06T03:07:07.553 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.546+0000 7f34cf7fe700 1 --2- 172.21.15.125:0/3460685010 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f34bc066f30 0x7f34bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:07.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.546+0000 7f34cf7fe700 1 --2- 172.21.15.125:0/3460685010 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f34bc066f30 0x7f34bc0693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f34c000b2c0 tx=0x7f34c001c000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:07.554 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.549+0000 7f34b77fe700 1 -- 172.21.15.125:0/3460685010 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34c8052410 con 0x7f34d016a010 2023-10-06T03:07:07.730 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.729+0000 7f34d4da1700 1 -- 172.21.15.125:0/3460685010 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34d0151d50 con 0x7f34bc066f30 2023-10-06T03:07:07.733 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.732+0000 7f34b77fe700 1 -- 172.21.15.125:0/3460685010 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72528 (secure 0 0 0) 0x7f34d0151d50 con 0x7f34bc066f30 2023-10-06T03:07:07.734 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:07:07.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.734+0000 7f34d4da1700 1 -- 172.21.15.125:0/3460685010 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f34bc066f30 msgr2=0x7f34bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.734+0000 7f34d4da1700 1 --2- 172.21.15.125:0/3460685010 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f34bc066f30 0x7f34bc0693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f34c000b2c0 tx=0x7f34c001c000 comp rx=0 tx=0).stop 2023-10-06T03:07:07.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.734+0000 7f34d4da1700 1 -- 172.21.15.125:0/3460685010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34d016a010 msgr2=0x7f34d01536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:07.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.734+0000 7f34d4da1700 1 --2- 172.21.15.125:0/3460685010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34d016a010 0x7f34d01536f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f34d006dac0 tx=0x7f34c800b040 comp rx=0 tx=0).stop 2023-10-06T03:07:07.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.734+0000 7f34d4da1700 1 -- 172.21.15.125:0/3460685010 shutdown_connections 2023-10-06T03:07:07.736 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.734+0000 7f34d4da1700 1 --2- 172.21.15.125:0/3460685010 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f34bc066f30 0x7f34bc0693e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.734+0000 7f34d4da1700 1 --2- 172.21.15.125:0/3460685010 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f34d016a010 0x7f34d01536f0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.734+0000 7f34d4da1700 1 --2- 172.21.15.125:0/3460685010 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f34b8003a60 0x7f34d016e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.734+0000 7f34d4da1700 1 --2- 172.21.15.125:0/3460685010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f34d016cf10 0x7f34d00aabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:07.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.734+0000 7f34d4da1700 1 -- 172.21.15.125:0/3460685010 >> 172.21.15.125:0/3460685010 conn(0x7f34d00691f0 msgr2=0x7f34d00cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:07.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.734+0000 7f34d4da1700 1 -- 172.21.15.125:0/3460685010 shutdown_connections 2023-10-06T03:07:07.737 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:07.734+0000 7f34d4da1700 1 -- 172.21.15.125:0/3460685010 wait complete. 2023-10-06T03:07:07.738 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-06T03:07:07.747 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2023-10-06T03:07:05.840335+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2385156,"kb_used_data":6852,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589564,"statfs":{"total":773094113280,"available":770651713536,"internally_reserved":0,"allocated":7016448,"data_stored":3882053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-16691,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-58,"num_write_kb":-37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001159"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.366327+0000","last_change":"2023-10-06T03:04:23.986472+0000","last_active":"2023-10-06T03:06:59.366327+0000","last_peered":"2023-10-06T03:06:59.366327+0000","last_clean":"2023-10-06T03:06:59.366327+0000","last_became_active":"2023-10-06T03:04:23.986228+0000","last_became_peered":"2023-10-06T03:04:23.986228+0000","last_unstale":"2023-10-06T03:06:59.366327+0000","last_undegraded":"2023-10-06T03:06:59.366327+0000","last_fullsized":"2023-10-06T03:06:59.366327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.158189+0000","last_change":"2023-10-06T03:04:23.814917+0000","last_active":"2023-10-06T03:06:59.158189+0000","last_peered":"2023-10-06T03:06:59.158189+0000","last_clean":"2023-10-06T03:06:59.158189+0000","last_became_active":"2023-10-06T03:04:23.814601+0000","last_became_peered":"2023-10-06T03:04:23.814601+0000","last_unstale":"2023-10-06T03:06:59.158189+0000","last_undegraded":"2023-10-06T03:06:59.158189+0000","last_fullsized":"2023-10-06T03:06:59.158189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:07:05.370969+0000","last_change":"2023-10-06T03:07:05.370936+0000","last_active":"2023-10-06T03:07:05.370969+0000","last_peered":"2023-10-06T03:07:05.370969+0000","last_clean":"2023-10-06T03:07:05.370969+0000","last_became_active":"2023-10-06T03:04:24.314278+0000","last_became_peered":"2023-10-06T03:04:24.314278+0000","last_unstale":"2023-10-06T03:07:05.370969+0000","last_undegraded":"2023-10-06T03:07:05.370969+0000","last_fullsized":"2023-10-06T03:07:05.370969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:07:05.370870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:07:05.370870+0000","last_clean_scrub_stamp":"2023-10-06T03:07:05.370870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:52.544034+0000","scrub_duration":0.0011834110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.158166+0000","last_change":"2023-10-06T03:04:23.807972+0000","last_active":"2023-10-06T03:06:59.158166+0000","last_peered":"2023-10-06T03:06:59.158166+0000","last_clean":"2023-10-06T03:06:59.158166+0000","last_became_active":"2023-10-06T03:04:23.807723+0000","last_became_peered":"2023-10-06T03:04:23.807723+0000","last_unstale":"2023-10-06T03:06:59.158166+0000","last_undegraded":"2023-10-06T03:06:59.158166+0000","last_fullsized":"2023-10-06T03:06:59.158166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:54:11.977786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":198,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.157774+0000","last_change":"2023-10-06T03:04:17.779925+0000","last_active":"2023-10-06T03:06:59.157774+0000","last_peered":"2023-10-06T03:06:59.157774+0000","last_clean":"2023-10-06T03:06:59.157774+0000","last_became_active":"2023-10-06T03:04:17.778997+0000","last_became_peered":"2023-10-06T03:04:17.778997+0000","last_unstale":"2023-10-06T03:06:59.157774+0000","last_undegraded":"2023-10-06T03:06:59.157774+0000","last_fullsized":"2023-10-06T03:06:59.157774+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:16.761610+0000","last_clean_scrub_stamp":"2023-10-06T03:04:16.761610+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:37:48.545235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.157661+0000","last_change":"2023-10-06T03:04:23.814887+0000","last_active":"2023-10-06T03:06:59.157661+0000","last_peered":"2023-10-06T03:06:59.157661+0000","last_clean":"2023-10-06T03:06:59.157661+0000","last_became_active":"2023-10-06T03:04:23.814581+0000","last_became_peered":"2023-10-06T03:04:23.814581+0000","last_unstale":"2023-10-06T03:06:59.157661+0000","last_undegraded":"2023-10-06T03:06:59.157661+0000","last_fullsized":"2023-10-06T03:06:59.157661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:20.928710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":45,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:59.160835+0000","last_change":"2023-10-06T03:04:23.986771+0000","last_active":"2023-10-06T03:06:59.160835+0000","last_peered":"2023-10-06T03:06:59.160835+0000","last_clean":"2023-10-06T03:06:59.160835+0000","last_became_active":"2023-10-06T03:04:23.986552+0000","last_became_peered":"2023-10-06T03:04:23.986552+0000","last_unstale":"2023-10-06T03:06:59.160835+0000","last_undegraded":"2023-10-06T03:06:59.160835+0000","last_fullsized":"2023-10-06T03:06:59.160835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:59:38.041906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:07:05.347896+0000","last_change":"2023-10-06T03:07:05.347860+0000","last_active":"2023-10-06T03:07:05.347896+0000","last_peered":"2023-10-06T03:07:05.347896+0000","last_clean":"2023-10-06T03:07:05.347896+0000","last_became_active":"2023-10-06T03:04:23.813584+0000","last_became_peered":"2023-10-06T03:04:23.813584+0000","last_unstale":"2023-10-06T03:07:05.347896+0000","last_undegraded":"2023-10-06T03:07:05.347896+0000","last_fullsized":"2023-10-06T03:07:05.347896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:07:05.347706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:07:05.347706+0000","last_clean_scrub_stamp":"2023-10-06T03:07:05.347706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:35.898554+0000","scrub_duration":0.001829773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T03:06:58.317986+0000","last_change":"2023-10-06T03:04:23.805874+0000","last_active":"2023-10-06T03:06:58.317986+0000","last_peered":"2023-10-06T03:06:58.317986+0000","last_clean":"2023-10-06T03:06:58.317986+0000","last_became_active":"2023-10-06T03:04:23.805551+0000","last_became_peered":"2023-10-06T03:04:23.805551+0000","last_unstale":"2023-10-06T03:06:58.317986+0000","last_undegraded":"2023-10-06T03:06:58.317986+0000","last_fullsized":"2023-10-06T03:06:58.317986+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:04:22.791626+0000","last_clean_scrub_stamp":"2023-10-06T03:04:22.791626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:21.250275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574886,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1323008,"data_stored":928159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.629,"15min":0.64300000000000002},"min":{"1min":0.318,"5min":0.314,"15min":0.314},"max":{"1min":0.69999999999999996,"5min":3.8860000000000001,"15min":3.8860000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.64900000000000002,"15min":0.66400000000000003},"min":{"1min":0.38700000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.69699999999999995,"5min":3.988,"15min":3.988},"last":0.52300000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.65200000000000002,"15min":0.67000000000000004},"min":{"1min":0.36199999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.81899999999999995,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.64800000000000002,"15min":0.66400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73099999999999998,"5min":3.444,"15min":3.444},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.67000000000000004,"15min":0.68799999999999994},"min":{"1min":0.40500000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.78800000000000003,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.69699999999999995,"15min":0.71299999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85599999999999998,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.51400000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.68799999999999994,"15min":0.70599999999999996},"min":{"1min":0.45600000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.73099999999999998,"5min":3.903,"15min":3.903},"last":0.503},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.71499999999999997,"15min":0.73399999999999999},"min":{"1min":0.41199999999999998,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.746,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":0.60099999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46800000000000003,"15min":0.47199999999999998},"min":{"1min":0.33800000000000002,"5min":0.318,"15min":0.318},"max":{"1min":0.55700000000000005,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.51400000000000001,"15min":0.51700000000000002},"min":{"1min":0.38800000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65400000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.45200000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54900000000000004,"15min":0.55200000000000005},"min":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.64000000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.54500000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:06:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59899999999999998,"15min":0.60399999999999998},"min":{"1min":0.46600000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.71399999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.44600000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.79100000000000004,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.57699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.79700000000000004,"15min":0.84299999999999997},"min":{"1min":0.38900000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77200000000000002,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.627},{"interface":"front","average":{"1min":0.501,"5min":0.83699999999999997,"15min":0.89300000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.64600000000000002,"5min":6.8330000000000002,"15min":6.8330000000000002},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.71599999999999997,"15min":0.74399999999999999},"min":{"1min":0.34899999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.72299999999999998,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.73899999999999999,"15min":0.76500000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":3.948,"15min":3.948},"last":0.753}]},{"osd":2,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.53500000000000003,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.745,"5min":0.754,"15min":0.754},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.70999999999999996,"15min":0.73599999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.75800000000000001,"5min":3.996,"15min":3.996},"last":0.72699999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57499999999999996},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.71799999999999997,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.69799999999999995}]},{"osd":4,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.34399999999999997,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.498,"5min":0.48399999999999999,"15min":0.48199999999999998},"min":{"1min":0.36499999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.71499999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.50600000000000001,"15min":0.499},"min":{"1min":0.40999999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57999999999999996,"15min":0.57399999999999995},"min":{"1min":0.435,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.76600000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:06:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.443,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.46600000000000003,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.74199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.38700000000000001,"15min":0.39700000000000002},"min":{"1min":0.20999999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.50900000000000001,"5min":1.159,"15min":1.159},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.375,"15min":0.379},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.46999999999999997,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.35599999999999998}]},{"osd":2,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.58999999999999997,"15min":0.63200000000000001},"min":{"1min":0.254,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.44500000000000001,"5min":6.056,"15min":6.056},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.42699999999999999,"15min":0.437},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57499999999999996,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.38100000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.44800000000000001,"15min":0.45500000000000002},"min":{"1min":0.27700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.502,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.443,"15min":0.45100000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.56000000000000005,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.46800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":0.77800000000000002,"5min":1.244,"15min":1.244},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.64400000000000002,"15min":0.64000000000000001},"min":{"1min":0.495,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91300000000000003,"5min":1.216,"15min":1.216},"last":0.47699999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.628,"15min":0.624},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.82899999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.627,"15min":0.627},"min":{"1min":0.53800000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.76800000000000002,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.45800000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.44400000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89200000000000002,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85699999999999998,"5min":1.014,"15min":1.014},"last":0.437}]},{"osd":7,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66200000000000003,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":1.099,"15min":1.099},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66200000000000003,"15min":0.66000000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.79800000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.48699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298576,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073264,"statfs":{"total":96636764160,"available":96331022336,"internally_reserved":0,"allocated":1318912,"data_stored":927148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.30099999999999999,"15min":0.29299999999999998},"min":{"1min":0.23599999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.34000000000000002,"15min":0.33400000000000002},"min":{"1min":0.28499999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.40300000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"min":{"1min":0.23200000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"min":{"1min":0.26000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.36199999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.32400000000000001},"min":{"1min":0.26000000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.371,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.379}]},{"osd":4,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.44900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.46600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.54900000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.39400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.49299999999999999}]},{"osd":6,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82299999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.46300000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61499999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.434,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.45400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.60099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.80100000000000005,"15min":0.88400000000000001},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.437,"5min":12.913,"15min":12.913},"last":0.251},{"interface":"front","average":{"1min":0.316,"5min":0.36799999999999999,"15min":0.377},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.49199999999999999,"5min":0.997,"15min":0.997},"last":0.32600000000000001}]},{"osd":1,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.51200000000000001,"15min":0.53900000000000003},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53000000000000003,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.42599999999999999,"15min":0.434},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54900000000000004,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.35599999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.36199999999999999,"15min":0.36799999999999999},"min":{"1min":0.252,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.46200000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.88,"15min":0.96399999999999997},"min":{"1min":0.29199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57299999999999995,"5min":12.941000000000001,"15min":12.941000000000001},"last":0.33900000000000002}]},{"osd":4,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":1.042,"15min":1.1200000000000001},"min":{"1min":0.40600000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.76900000000000002,"5min":12.846,"15min":12.846},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.62,"15min":0.622},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.75900000000000001,"5min":1.046,"15min":1.046},"last":0.53200000000000003}]},{"osd":5,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61699999999999999,"15min":0.622},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76900000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":1.0620000000000001,"15min":1.141},"min":{"1min":0.47999999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72799999999999998,"5min":12.884,"15min":12.884},"last":0.52100000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.41699999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.77100000000000002,"5min":1.071,"15min":1.071},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.62,"15min":0.622},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.73199999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Oct 6 03:06:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.65300000000000002,"15min":0.66300000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.72999999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77000000000000002,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.50600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.373,"15min":0.38400000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.55000000000000004,"5min":1.361,"15min":1.361},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.311,"5min":0.34899999999999998,"15min":0.35499999999999998},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.51200000000000001,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.221}]},{"osd":1,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.376,"15min":0.38300000000000001},"min":{"1min":0.20699999999999999,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.53400000000000003,"5min":1.133,"15min":1.133},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.41999999999999998,"15min":0.42799999999999999},"min":{"1min":0.27800000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66100000000000003,"5min":1.45,"15min":1.45},"last":0.29999999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.57399999999999995,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.433,"15min":0.443},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.59499999999999997,"5min":1.476,"15min":1.476},"last":0.36399999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.627,"15min":0.63500000000000001},"min":{"1min":0.38100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.75600000000000001,"5min":1.649,"15min":1.649},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.35999999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.80200000000000005,"5min":1.054,"15min":1.054},"last":0.60999999999999999}]},{"osd":5,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.621,"15min":0.623},"min":{"1min":0.42799999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77300000000000002,"5min":1.401,"15min":1.401},"last":0.621},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63500000000000001,"15min":0.63900000000000001},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.77800000000000002,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.78000000000000003,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64300000000000002,"15min":0.64700000000000002},"min":{"1min":0.46200000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83399999999999996,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Oct 6 03:06:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.42899999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81999999999999995,"5min":1.679,"15min":1.679},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.62,"15min":0.621},"min":{"1min":0.44600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80300000000000005,"5min":1.083,"15min":1.083},"last":0.56899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574885,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52000000000000002,"15min":0.51100000000000001},"min":{"1min":0.376,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.41099999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84999999999999998,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.82699999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80400000000000005,"5min":0.875,"15min":0.875},"last":0.48899999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.55800000000000005},"min":{"1min":0.42699999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.57599999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90200000000000002,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.64900000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.34300000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.83899999999999997,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.33900000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56299999999999994,"15min":0.56100000000000005},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.441},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.621}]},{"osd":7,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.68500000000000005,"5min":1.012,"15min":1.012},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.74399999999999999,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.42999999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70599999999999996,"5min":1.03,"15min":1.03},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.71399999999999997,"5min":0.755,"15min":0.755},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.55400000000000005,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.76800000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.71899999999999997,"5min":0.998,"15min":0.998},"last":0.54500000000000004}]},{"osd":3,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.58299999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.69599999999999995,"5min":1.048,"15min":1.048},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.40999999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.72799999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73899999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.57899999999999996,"15min":0.58699999999999997},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73399999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.622}]},{"osd":6,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.54600000000000004,"15min":0.55300000000000005},"min":{"1min":0.38300000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.40500000000000003,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.745,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.59399999999999997}]},{"osd":7,"last update":"Fri Oct 6 03:06:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61699999999999999,"15min":0.625},"min":{"1min":0.35599999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.76200000000000001,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.61299999999999999,"15min":0.61899999999999999},"min":{"1min":0.34200000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69199999999999995,"5min":0.872,"15min":0.872},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:07:07.752 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-06T03:04:22.791626+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=4, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=7, tm_sec=2, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:07:07.752 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-06T03:04:22.791626+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=4, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=7, tm_sec=2, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:07:07.752 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-06T03:04:22.791626+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=4, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=7, tm_sec=2, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:07:07.752 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T03:04:16.761610+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=4, tm_sec=16, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=7, tm_sec=2, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:07:07.752 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T03:04:22.791626+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=4, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=7, tm_sec=2, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:07:07.752 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-06T03:04:22.791626+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=4, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=7, tm_sec=2, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:07:07.753 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-06T03:04:22.791626+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=4, tm_sec=22, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=3, tm_min=7, tm_sec=2, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T03:07:07.753 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T03:07:27.753 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T03:07:27.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.892+0000 7f15af17a700 1 Processor -- start 2023-10-06T03:07:27.893 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.892+0000 7f15af17a700 1 -- start start 2023-10-06T03:07:27.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.893+0000 7f15af17a700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f15a8157220 0x7f15a80b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:27.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.893+0000 7f15af17a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15a80b1280 0x7f15a80c4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:27.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.893+0000 7f15af17a700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7f15a80c4750 0x7f15a80c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:27.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.893+0000 7f15af17a700 1 -- --> v2:172.21.15.125:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a80c4bb0 con 0x7f15a8157220 2023-10-06T03:07:27.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.893+0000 7f15af17a700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15a80c9d10 con 0x7f15a80c4750 2023-10-06T03:07:27.896 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.893+0000 7f15af17a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a80c9ff0 con 0x7f15a80b1280 2023-10-06T03:07:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.893+0000 7f15acf16700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f15a8157220 0x7f15a80b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.893+0000 7f15acf16700 1 --2- >> v2:172.21.15.125:3300/0 conn(0x7f15a8157220 0x7f15a80b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59410/0 (socket says 172.21.15.125:59410) 2023-10-06T03:07:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.893+0000 7f15acf16700 1 -- 172.21.15.125:0/3475169696 learned_addr learned my addr 172.21.15.125:0/3475169696 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.893+0000 7f15ad717700 1 --2- 172.21.15.125:0/3475169696 >> v2:172.21.15.130:3300/0 conn(0x7f15a80c4750 0x7f15a80c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.893+0000 7f15a7fff700 1 --2- 172.21.15.125:0/3475169696 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15a80b1280 0x7f15a80c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.894+0000 7f15acf16700 1 -- 172.21.15.125:0/3475169696 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15a80b1280 msgr2=0x7f15a80c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.894+0000 7f15acf16700 1 --2- 172.21.15.125:0/3475169696 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15a80b1280 0x7f15a80c4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.894+0000 7f15acf16700 1 -- 172.21.15.125:0/3475169696 >> v2:172.21.15.130:3300/0 conn(0x7f15a80c4750 msgr2=0x7f15a80c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.894+0000 7f15acf16700 1 --2- 172.21.15.125:0/3475169696 >> v2:172.21.15.130:3300/0 conn(0x7f15a80c4750 0x7f15a80c8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.894+0000 7f15acf16700 1 -- 172.21.15.125:0/3475169696 --> v2:172.21.15.125:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a80c3730 con 0x7f15a8157220 2023-10-06T03:07:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.894+0000 7f15acf16700 1 --2- 172.21.15.125:0/3475169696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15a8157220 0x7f15a80b0d40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f15a80ca4c0 tx=0x7f159c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceaa82c8fe3a0d94 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:27.897 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.894+0000 7f15a77fe700 1 -- 172.21.15.125:0/3475169696 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c00b860 con 0x7f15a8157220 2023-10-06T03:07:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.894+0000 7f15a77fe700 1 -- 172.21.15.125:0/3475169696 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c00b9c0 con 0x7f15a8157220 2023-10-06T03:07:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.894+0000 7f15a77fe700 1 -- 172.21.15.125:0/3475169696 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c00bd60 con 0x7f15a8157220 2023-10-06T03:07:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.894+0000 7f15af17a700 1 -- 172.21.15.125:0/3475169696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15a8157220 msgr2=0x7f15a80b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.894+0000 7f15af17a700 1 --2- 172.21.15.125:0/3475169696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15a8157220 0x7f15a80b0d40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f15a80ca4c0 tx=0x7f159c009250 comp rx=0 tx=0).stop 2023-10-06T03:07:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.894+0000 7f15af17a700 1 -- 172.21.15.125:0/3475169696 shutdown_connections 2023-10-06T03:07:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.894+0000 7f15af17a700 1 --2- 172.21.15.125:0/3475169696 >> v2:172.21.15.130:3300/0 conn(0x7f15a80c4750 0x7f15a80c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.894+0000 7f15af17a700 1 --2- 172.21.15.125:0/3475169696 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15a8157220 0x7f15a80b0d40 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.894+0000 7f15af17a700 1 --2- 172.21.15.125:0/3475169696 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15a80b1280 0x7f15a80c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.894+0000 7f15af17a700 1 -- 172.21.15.125:0/3475169696 >> 172.21.15.125:0/3475169696 conn(0x7f15a8067df0 msgr2=0x7f15a80cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.895+0000 7f15af17a700 1 -- 172.21.15.125:0/3475169696 shutdown_connections 2023-10-06T03:07:27.898 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.895+0000 7f15af17a700 1 -- 172.21.15.125:0/3475169696 wait complete. 2023-10-06T03:07:27.900 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.896+0000 7f15af17a700 1 Processor -- start 2023-10-06T03:07:27.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.896+0000 7f15af17a700 1 -- start start 2023-10-06T03:07:27.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.897+0000 7f15af17a700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15a80b1280 0x7f15a80b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:27.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.897+0000 7f15af17a700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15a80c4750 0x7f15a8068720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:27.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.897+0000 7f15af17a700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15a8157220 0x7f15a806a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:27.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.897+0000 7f15af17a700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a8069b80 con 0x7f15a8157220 2023-10-06T03:07:27.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.897+0000 7f15af17a700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a8068f70 con 0x7f15a80c4750 2023-10-06T03:07:27.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.897+0000 7f15af17a700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a8069250 con 0x7f15a80b1280 2023-10-06T03:07:27.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.897+0000 7f15ad717700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15a8157220 0x7f15a806a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:27.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.897+0000 7f15ad717700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15a8157220 0x7f15a806a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59420/0 (socket says 172.21.15.125:59420) 2023-10-06T03:07:27.901 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.897+0000 7f15ad717700 1 -- 172.21.15.125:0/3878515209 learned_addr learned my addr 172.21.15.125:0/3878515209 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.898+0000 7f15a7fff700 1 --2- 172.21.15.125:0/3878515209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15a80c4750 0x7f15a8068720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.898+0000 7f15acf16700 1 --2- 172.21.15.125:0/3878515209 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15a80b1280 0x7f15a80b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.898+0000 7f15ad717700 1 -- 172.21.15.125:0/3878515209 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15a80b1280 msgr2=0x7f15a80b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.898+0000 7f15ad717700 1 --2- 172.21.15.125:0/3878515209 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15a80b1280 0x7f15a80b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.898+0000 7f15ad717700 1 -- 172.21.15.125:0/3878515209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15a80c4750 msgr2=0x7f15a8068720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.898+0000 7f15ad717700 1 --2- 172.21.15.125:0/3878515209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15a80c4750 0x7f15a8068720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.898+0000 7f15ad717700 1 -- 172.21.15.125:0/3878515209 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c0094f0 con 0x7f15a8157220 2023-10-06T03:07:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.898+0000 7f15ad717700 1 --2- 172.21.15.125:0/3878515209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15a8157220 0x7f15a806a010 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f15a000ceb0 tx=0x7f15a0007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.898+0000 7f15a4ff9700 1 -- 172.21.15.125:0/3878515209 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a000ad90 con 0x7f15a8157220 2023-10-06T03:07:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.898+0000 7f15a4ff9700 1 -- 172.21.15.125:0/3878515209 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a0016430 con 0x7f15a8157220 2023-10-06T03:07:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.898+0000 7f15af17a700 1 -- 172.21.15.125:0/3878515209 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a8069530 con 0x7f15a8157220 2023-10-06T03:07:27.902 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.898+0000 7f15a4ff9700 1 -- 172.21.15.125:0/3878515209 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a00167d0 con 0x7f15a8157220 2023-10-06T03:07:27.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.898+0000 7f15af17a700 1 -- 172.21.15.125:0/3878515209 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a8068c60 con 0x7f15a8157220 2023-10-06T03:07:27.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.899+0000 7f15af17a700 1 -- 172.21.15.125:0/3878515209 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a8066510 con 0x7f15a8157220 2023-10-06T03:07:27.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.899+0000 7f15a4ff9700 1 -- 172.21.15.125:0/3878515209 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f15a0003020 con 0x7f15a8157220 2023-10-06T03:07:27.903 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.900+0000 7f15a4ff9700 1 --2- 172.21.15.125:0/3878515209 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f158c066f30 0x7f158c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:27.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.900+0000 7f15a4ff9700 1 -- 172.21.15.125:0/3878515209 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7f15a0012070 con 0x7f15a8157220 2023-10-06T03:07:27.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.900+0000 7f15acf16700 1 --2- 172.21.15.125:0/3878515209 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f158c066f30 0x7f158c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:27.904 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.900+0000 7f15acf16700 1 --2- 172.21.15.125:0/3878515209 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f158c066f30 0x7f158c0693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f15a80ca4c0 tx=0x7f159c017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:27.906 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:27.904+0000 7f15a4ff9700 1 -- 172.21.15.125:0/3878515209 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f15a00525f0 con 0x7f15a8157220 2023-10-06T03:07:28.084 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.083+0000 7f15af17a700 1 -- 172.21.15.125:0/3878515209 --> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f15a8069cc0 con 0x7f158c066f30 2023-10-06T03:07:28.087 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.085+0000 7f15a4ff9700 1 -- 172.21.15.125:0/3878515209 <== mgr.4101 v2:172.21.15.125:6832/119397 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72636 (secure 0 0 0) 0x7f15a8069cc0 con 0x7f158c066f30 2023-10-06T03:07:28.088 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:07:28.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.087+0000 7f15af17a700 1 -- 172.21.15.125:0/3878515209 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f158c066f30 msgr2=0x7f158c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:28.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.087+0000 7f15af17a700 1 --2- 172.21.15.125:0/3878515209 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f158c066f30 0x7f158c0693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f15a80ca4c0 tx=0x7f159c017000 comp rx=0 tx=0).stop 2023-10-06T03:07:28.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.087+0000 7f15af17a700 1 -- 172.21.15.125:0/3878515209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15a8157220 msgr2=0x7f15a806a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:28.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.087+0000 7f15af17a700 1 --2- 172.21.15.125:0/3878515209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15a8157220 0x7f15a806a010 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f15a000ceb0 tx=0x7f15a0007870 comp rx=0 tx=0).stop 2023-10-06T03:07:28.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.087+0000 7f15af17a700 1 -- 172.21.15.125:0/3878515209 shutdown_connections 2023-10-06T03:07:28.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.087+0000 7f15af17a700 1 --2- 172.21.15.125:0/3878515209 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7f158c066f30 0x7f158c0693e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.089 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.087+0000 7f15af17a700 1 --2- 172.21.15.125:0/3878515209 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7f15a8157220 0x7f15a806a010 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.087+0000 7f15af17a700 1 --2- 172.21.15.125:0/3878515209 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7f15a80b1280 0x7f15a80b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.087+0000 7f15af17a700 1 --2- 172.21.15.125:0/3878515209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f15a80c4750 0x7f15a8068720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.087+0000 7f15af17a700 1 -- 172.21.15.125:0/3878515209 >> 172.21.15.125:0/3878515209 conn(0x7f15a8067df0 msgr2=0x7f15a8153e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:28.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.087+0000 7f15af17a700 1 -- 172.21.15.125:0/3878515209 shutdown_connections 2023-10-06T03:07:28.090 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.087+0000 7f15af17a700 1 -- 172.21.15.125:0/3878515209 wait complete. 2023-10-06T03:07:28.090 INFO:teuthology.orchestra.run.smithi125.stderr:dumped all 2023-10-06T03:07:28.100 INFO:teuthology.orchestra.run.smithi125.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2023-10-06T03:07:27.844493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2385156,"kb_used_data":6852,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589564,"statfs":{"total":773094113280,"available":770651713536,"internally_reserved":0,"allocated":7016448,"data_stored":3882053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002232"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":59,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:07:09.422450+0000","last_change":"2023-10-06T03:07:09.422421+0000","last_active":"2023-10-06T03:07:09.422450+0000","last_peered":"2023-10-06T03:07:09.422450+0000","last_clean":"2023-10-06T03:07:09.422450+0000","last_became_active":"2023-10-06T03:04:23.986228+0000","last_became_peered":"2023-10-06T03:04:23.986228+0000","last_unstale":"2023-10-06T03:07:09.422450+0000","last_undegraded":"2023-10-06T03:07:09.422450+0000","last_fullsized":"2023-10-06T03:07:09.422450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:07:09.422315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:07:09.422315+0000","last_clean_scrub_stamp":"2023-10-06T03:07:09.422315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:23:35.655627+0000","scrub_duration":0.0015072009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":58,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:07:09.356684+0000","last_change":"2023-10-06T03:07:09.356646+0000","last_active":"2023-10-06T03:07:09.356684+0000","last_peered":"2023-10-06T03:07:09.356684+0000","last_clean":"2023-10-06T03:07:09.356684+0000","last_became_active":"2023-10-06T03:04:23.814601+0000","last_became_peered":"2023-10-06T03:04:23.814601+0000","last_unstale":"2023-10-06T03:07:09.356684+0000","last_undegraded":"2023-10-06T03:07:09.356684+0000","last_fullsized":"2023-10-06T03:07:09.356684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:07:09.356494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:07:09.356494+0000","last_clean_scrub_stamp":"2023-10-06T03:07:09.356494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:40.425095+0000","scrub_duration":0.0017116379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":59,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:07:05.370969+0000","last_change":"2023-10-06T03:07:05.370936+0000","last_active":"2023-10-06T03:07:05.370969+0000","last_peered":"2023-10-06T03:07:05.370969+0000","last_clean":"2023-10-06T03:07:05.370969+0000","last_became_active":"2023-10-06T03:04:24.314278+0000","last_became_peered":"2023-10-06T03:04:24.314278+0000","last_unstale":"2023-10-06T03:07:05.370969+0000","last_undegraded":"2023-10-06T03:07:05.370969+0000","last_fullsized":"2023-10-06T03:07:05.370969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:07:05.370870+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:07:05.370870+0000","last_clean_scrub_stamp":"2023-10-06T03:07:05.370870+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:47:52.544034+0000","scrub_duration":0.0011834110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":58,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:07:07.438441+0000","last_change":"2023-10-06T03:07:07.438412+0000","last_active":"2023-10-06T03:07:07.438441+0000","last_peered":"2023-10-06T03:07:07.438441+0000","last_clean":"2023-10-06T03:07:07.438441+0000","last_became_active":"2023-10-06T03:04:23.807723+0000","last_became_peered":"2023-10-06T03:04:23.807723+0000","last_unstale":"2023-10-06T03:07:07.438441+0000","last_undegraded":"2023-10-06T03:07:07.438441+0000","last_fullsized":"2023-10-06T03:07:07.438441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:07:07.438316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:07:07.438316+0000","last_clean_scrub_stamp":"2023-10-06T03:07:07.438316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:07.187862+0000","scrub_duration":0.0017215209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"60'119","reported_seq":211,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:07:07.707354+0000","last_change":"2023-10-06T03:07:07.707321+0000","last_active":"2023-10-06T03:07:07.707354+0000","last_peered":"2023-10-06T03:07:07.707354+0000","last_clean":"2023-10-06T03:07:07.707354+0000","last_became_active":"2023-10-06T03:04:17.778997+0000","last_became_peered":"2023-10-06T03:04:17.778997+0000","last_unstale":"2023-10-06T03:07:07.707354+0000","last_undegraded":"2023-10-06T03:07:07.707354+0000","last_fullsized":"2023-10-06T03:07:07.707354+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"60'119","last_scrub_stamp":"2023-10-06T03:07:07.707226+0000","last_deep_scrub":"60'119","last_deep_scrub_stamp":"2023-10-06T03:07:07.707226+0000","last_clean_scrub_stamp":"2023-10-06T03:07:07.707226+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:54:18.310497+0000","scrub_duration":0.006861799,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:07:10.791519+0000","last_change":"2023-10-06T03:07:10.791491+0000","last_active":"2023-10-06T03:07:10.791519+0000","last_peered":"2023-10-06T03:07:10.791519+0000","last_clean":"2023-10-06T03:07:10.791519+0000","last_became_active":"2023-10-06T03:04:23.814581+0000","last_became_peered":"2023-10-06T03:04:23.814581+0000","last_unstale":"2023-10-06T03:07:10.791519+0000","last_undegraded":"2023-10-06T03:07:10.791519+0000","last_fullsized":"2023-10-06T03:07:10.791519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:07:10.791388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:07:10.791388+0000","last_clean_scrub_stamp":"2023-10-06T03:07:10.791388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:55:29.868720+0000","scrub_duration":0.0020004609999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:07:08.734787+0000","last_change":"2023-10-06T03:07:08.734761+0000","last_active":"2023-10-06T03:07:08.734787+0000","last_peered":"2023-10-06T03:07:08.734787+0000","last_clean":"2023-10-06T03:07:08.734787+0000","last_became_active":"2023-10-06T03:04:23.986552+0000","last_became_peered":"2023-10-06T03:04:23.986552+0000","last_unstale":"2023-10-06T03:07:08.734787+0000","last_undegraded":"2023-10-06T03:07:08.734787+0000","last_fullsized":"2023-10-06T03:07:08.734787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:07:08.734668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:07:08.734668+0000","last_clean_scrub_stamp":"2023-10-06T03:07:08.734668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:49.888787+0000","scrub_duration":0.0020819060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":59,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:07:05.347896+0000","last_change":"2023-10-06T03:07:05.347860+0000","last_active":"2023-10-06T03:07:05.347896+0000","last_peered":"2023-10-06T03:07:05.347896+0000","last_clean":"2023-10-06T03:07:05.347896+0000","last_became_active":"2023-10-06T03:04:23.813584+0000","last_became_peered":"2023-10-06T03:04:23.813584+0000","last_unstale":"2023-10-06T03:07:05.347896+0000","last_undegraded":"2023-10-06T03:07:05.347896+0000","last_fullsized":"2023-10-06T03:07:05.347896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:07:05.347706+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:07:05.347706+0000","last_clean_scrub_stamp":"2023-10-06T03:07:05.347706+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:10:35.898554+0000","scrub_duration":0.001829773,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":58,"reported_epoch":60,"state":"active+clean","last_fresh":"2023-10-06T03:07:09.638440+0000","last_change":"2023-10-06T03:07:09.638399+0000","last_active":"2023-10-06T03:07:09.638440+0000","last_peered":"2023-10-06T03:07:09.638440+0000","last_clean":"2023-10-06T03:07:09.638440+0000","last_became_active":"2023-10-06T03:04:23.805551+0000","last_became_peered":"2023-10-06T03:04:23.805551+0000","last_unstale":"2023-10-06T03:07:09.638440+0000","last_undegraded":"2023-10-06T03:07:09.638440+0000","last_fullsized":"2023-10-06T03:07:09.638440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T03:07:09.638306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T03:07:09.638306+0000","last_clean_scrub_stamp":"2023-10-06T03:07:09.638306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:54:40.938458+0000","scrub_duration":0.001571238,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1323008,"data_stored":928159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.60299999999999998,"15min":0.63400000000000001},"min":{"1min":0.36399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.71299999999999997,"5min":3.8860000000000001,"15min":3.8860000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.621,"15min":0.65500000000000003},"min":{"1min":0.41099999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.68000000000000005,"5min":3.988,"15min":3.988},"last":0.60199999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.622,"15min":0.66000000000000003},"min":{"1min":0.42399999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.67200000000000004,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.624,"15min":0.65600000000000003},"min":{"1min":0.36599999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67400000000000004,"5min":3.444,"15min":3.444},"last":0.63600000000000001}]},{"osd":2,"last update":"Fri Oct 6 03:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.63900000000000001,"15min":0.67700000000000005},"min":{"1min":0.39800000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70099999999999996,"5min":4.1429999999999998,"15min":4.1429999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.66800000000000004,"15min":0.70299999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.80200000000000005,"5min":4.1260000000000003,"15min":4.1260000000000003},"last":0.70299999999999996}]},{"osd":3,"last update":"Fri Oct 6 03:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.65200000000000002,"15min":0.69399999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.65400000000000003,"5min":3.903,"15min":3.903},"last":0.625},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.68799999999999994,"15min":0.72499999999999998},"min":{"1min":0.52200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.755,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":0.65500000000000003}]},{"osd":4,"last update":"Fri Oct 6 03:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46899999999999997,"15min":0.47199999999999998},"min":{"1min":0.35599999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.505,"15min":0.51400000000000001},"min":{"1min":0.374,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65700000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.438}]},{"osd":5,"last update":"Fri Oct 6 03:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.51300000000000001,"15min":0.51400000000000001},"min":{"1min":0.36499999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.42499999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.47999999999999998}]},{"osd":6,"last update":"Fri Oct 6 03:07:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76700000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57799999999999996,"15min":0.58099999999999996},"min":{"1min":0.443,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.74199999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.51600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.73199999999999998,"15min":0.82199999999999995},"min":{"1min":0.42999999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.69399999999999995,"5min":6.8220000000000001,"15min":6.8220000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.76100000000000001,"15min":0.86699999999999999},"min":{"1min":0.35599999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.76600000000000001,"5min":6.8330000000000002,"15min":6.8330000000000002},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Oct 6 03:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.67800000000000005,"15min":0.73199999999999998},"min":{"1min":0.40500000000000003,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.68500000000000005,"5min":3.8929999999999998,"15min":3.8929999999999998},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.70599999999999996,"15min":0.754},"min":{"1min":0.498,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.753,"5min":3.948,"15min":3.948},"last":0.69699999999999995}]},{"osd":2,"last update":"Fri Oct 6 03:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.436,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.70499999999999996,"5min":0.754,"15min":0.754},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.67500000000000004,"15min":0.72399999999999998},"min":{"1min":0.49199999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.72699999999999998,"5min":3.996,"15min":3.996},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.42299999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.69099999999999995,"5min":0.877,"15min":0.877},"last":0.75},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.57399999999999995},"min":{"1min":0.50800000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.70799999999999996,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.73399999999999999}]},{"osd":4,"last update":"Fri Oct 6 03:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48299999999999998,"15min":0.48699999999999999},"min":{"1min":0.37,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.63,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.315,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72799999999999998,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.44}]},{"osd":5,"last update":"Fri Oct 6 03:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.503,"15min":0.498},"min":{"1min":0.34100000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.61199999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.42199999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76600000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.46300000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55600000000000005,"15min":0.55700000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78100000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.58599999999999997,"15min":0.58199999999999996},"min":{"1min":0.35599999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.74199999999999999,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.57599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.377,"15min":0.39300000000000002},"min":{"1min":0.23400000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.42599999999999999,"5min":1.159,"15min":1.159},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.36699999999999999,"15min":0.376},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51900000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Oct 6 03:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.52900000000000003,"15min":0.61199999999999999},"min":{"1min":0.22900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.45700000000000002,"5min":6.056,"15min":6.056},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.41699999999999998,"15min":0.433},"min":{"1min":0.29199999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.51100000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.34499999999999997}]},{"osd":3,"last update":"Fri Oct 6 03:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.441,"15min":0.45300000000000001},"min":{"1min":0.34300000000000003,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.64600000000000002,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.42599999999999999,"15min":0.44500000000000001},"min":{"1min":0.255,"5min":0.252,"15min":0.252},"max":{"1min":0.57099999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.443}]},{"osd":4,"last update":"Fri Oct 6 03:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.59999999999999998,"15min":0.60399999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83899999999999997,"5min":1.244,"15min":1.244},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.47699999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.88300000000000001,"5min":1.216,"15min":1.216},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Oct 6 03:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.62,"15min":0.621},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86399999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.623,"15min":0.626},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76200000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.63800000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.64000000000000001,"15min":0.63500000000000001},"min":{"1min":0.442,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.91500000000000004,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.626},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.64600000000000002,"15min":0.65400000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.90400000000000003,"5min":1.014,"15min":1.014},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri Oct 6 03:07:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.64900000000000002,"15min":0.65700000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.92800000000000005,"5min":1.099,"15min":1.099},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.65400000000000003,"15min":0.65700000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.81000000000000005,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.60799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298576,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073264,"statfs":{"total":96636764160,"available":96331022336,"internally_reserved":0,"allocated":1318912,"data_stored":927148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.30099999999999999,"15min":0.29299999999999998},"min":{"1min":0.23599999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.372,"5min":0.34000000000000002,"15min":0.33400000000000002},"min":{"1min":0.28499999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.46000000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"min":{"1min":0.23200000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.34100000000000003,"15min":0.33700000000000002},"min":{"1min":0.26000000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.35799999999999998}]},{"osd":3,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.32800000000000001,"15min":0.32400000000000001},"min":{"1min":0.26000000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.371,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.442}]},{"osd":4,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.44900000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.629,"5min":0.56699999999999995,"15min":0.55700000000000005},"min":{"1min":0.46600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.75900000000000001}]},{"osd":5,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.39400000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80400000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.55500000000000005,"15min":0.54900000000000004},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82299999999999995,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57899999999999996,"15min":0.57499999999999996},"min":{"1min":0.46300000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.64700000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.434,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.45400000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.79800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.68000000000000005,"15min":0.84399999999999997},"min":{"1min":0.24099999999999999,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.48799999999999999,"5min":12.913,"15min":12.913},"last":0.253},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.36099999999999999,"15min":0.375},"min":{"1min":0.25900000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.46700000000000003,"5min":0.997,"15min":0.997},"last":0.36199999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.47599999999999998,"15min":0.52700000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.55000000000000004,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41699999999999998,"15min":0.43099999999999999},"min":{"1min":0.32700000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.56399999999999995,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35999999999999999,"15min":0.36699999999999999},"min":{"1min":0.26200000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56299999999999994,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.313},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.75700000000000001,"15min":0.92300000000000004},"min":{"1min":0.29499999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.61699999999999999,"5min":12.941000000000001,"15min":12.941000000000001},"last":0.39000000000000001}]},{"osd":4,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.93100000000000005,"15min":1.083},"min":{"1min":0.42199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.75700000000000001,"5min":12.846,"15min":12.846},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.62,"15min":0.622},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.83999999999999997,"5min":1.046,"15min":1.046},"last":0.51900000000000002}]},{"osd":5,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60999999999999999,"15min":0.62},"min":{"1min":0.46000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.751,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.497},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.94799999999999995,"15min":1.103},"min":{"1min":0.442,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85299999999999998,"5min":12.884,"15min":12.884},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.63200000000000001,"15min":0.64000000000000001},"min":{"1min":0.499,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.874,"5min":1.071,"15min":1.071},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61799999999999999,"15min":0.621},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.82999999999999996,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64400000000000002,"15min":0.66000000000000003},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89900000000000002,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63100000000000001,"15min":0.63400000000000001},"min":{"1min":0.49099999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86599999999999999,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.57099999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.36299999999999999,"15min":0.38100000000000001},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.58499999999999996,"5min":1.361,"15min":1.361},"last":0.255},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.35599999999999998},"min":{"1min":0.221,"5min":0.214,"15min":0.214},"max":{"1min":0.56000000000000005,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.30399999999999999}]},{"osd":1,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.371,"15min":0.38100000000000001},"min":{"1min":0.26200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.54700000000000004,"5min":1.133,"15min":1.133},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.41299999999999998,"15min":0.42499999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.65500000000000003,"5min":1.45,"15min":1.45},"last":0.39500000000000002}]},{"osd":2,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.61099999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.42299999999999999,"15min":0.44},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.74299999999999999,"5min":1.476,"15min":1.476},"last":0.35599999999999998}]},{"osd":4,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.61799999999999999,"15min":0.63200000000000001},"min":{"1min":0.42699999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.745,"5min":1.649,"15min":1.649},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.44,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83799999999999997,"5min":1.054,"15min":1.054},"last":0.83799999999999997}]},{"osd":5,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.43099999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81699999999999995,"5min":1.401,"15min":1.401},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.42299999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.79300000000000004,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.79300000000000004}]},{"osd":6,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.45200000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86099999999999999,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.63700000000000001,"15min":0.64500000000000002},"min":{"1min":0.45800000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.76900000000000002,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63500000000000001,"15min":0.64500000000000002},"min":{"1min":0.42099999999999999,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.80300000000000005,"5min":1.679,"15min":1.679},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.623,"15min":0.622},"min":{"1min":0.498,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80200000000000005,"5min":1.083,"15min":1.083},"last":0.80200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.51300000000000001},"min":{"1min":0.39200000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.65200000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.374,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.72899999999999998,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.60599999999999998}]},{"osd":1,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.39400000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.74099999999999999,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.42799999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.753,"5min":0.875,"15min":0.875},"last":0.62}]},{"osd":2,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.439,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72899999999999998,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56000000000000005},"min":{"1min":0.42599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73999999999999999,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.68500000000000005}]},{"osd":3,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.442,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.68999999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.42799999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66300000000000003,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.54200000000000004}]},{"osd":5,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.33200000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.66600000000000004,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.51500000000000001,"15min":0.51400000000000001},"min":{"1min":0.36499999999999999,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.63500000000000001,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.33100000000000002}]},{"osd":6,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.54500000000000004,"15min":0.55500000000000005},"min":{"1min":0.36799999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.68000000000000005,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58399999999999996,"15min":0.58199999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.72199999999999998,"5min":1.034,"15min":1.034},"last":0.39400000000000002}]},{"osd":7,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.35399999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70799999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.379},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.41199999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.75900000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.47099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":337791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52600000000000002,"15min":0.51800000000000002},"min":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.434},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.39700000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.58999999999999997}]},{"osd":1,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.39300000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.99099999999999999,"5min":1.03,"15min":1.03},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56200000000000006,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1,"5min":1,"15min":1},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56000000000000005,"15min":0.55500000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.42699999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.02,"5min":1.048,"15min":1.048},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.442,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.89600000000000002,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.5}]},{"osd":4,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.36499999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.379}]},{"osd":6,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54300000000000004,"15min":0.55200000000000005},"min":{"1min":0.34399999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60799999999999998,"15min":0.628},"min":{"1min":0.42499999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.91300000000000003,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.48399999999999999}]},{"osd":7,"last update":"Fri Oct 6 03:07:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60599999999999998,"15min":0.621},"min":{"1min":0.39200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.872,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.61399999999999999,"15min":0.61899999999999999},"min":{"1min":0.39500000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.53500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T03:07:28.103 DEBUG:teuthology.orchestra.run.smithi125:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T03:07:28.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.219+0000 7fcddf797700 1 Processor -- start 2023-10-06T03:07:28.221 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.219+0000 7fcddf797700 1 -- start start 2023-10-06T03:07:28.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.220+0000 7fcddf797700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fcdd80aa2f0 0x7fcdd80b0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:28.222 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.220+0000 7fcddf797700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd80aa760 con 0x7fcdd8157300 2023-10-06T03:07:28.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.220+0000 7fcddf797700 1 -- --> v1:172.21.15.130:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd80aaa40 con 0x7fcdd8068bd0 2023-10-06T03:07:28.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.220+0000 7fcddf797700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd80aad20 con 0x7fcdd80aa2f0 2023-10-06T03:07:28.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.220+0000 7fcddd533700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fcdd8157300 0x7fcdd80684c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59744/0 (socket says 172.21.15.125:59744) 2023-10-06T03:07:28.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.220+0000 7fcddd533700 1 -- 172.21.15.125:0/1203900641 learned_addr learned my addr 172.21.15.125:0/1203900641 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:07:28.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.220+0000 7fcddcd32700 1 --2- 172.21.15.125:0/1203900641 >> v2:172.21.15.130:3300/0 conn(0x7fcdd80aa2f0 0x7fcdd80b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:28.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.221+0000 7fcdcffff700 1 -- 172.21.15.125:0/1203900641 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102589450 0 0) 0x7fcdd80aa760 con 0x7fcdd8157300 2023-10-06T03:07:28.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.221+0000 7fcdcffff700 1 -- 172.21.15.125:0/1203900641 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdc4003570 con 0x7fcdd8157300 2023-10-06T03:07:28.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.221+0000 7fcddcd32700 1 -- 172.21.15.125:0/1203900641 >> v1:172.21.15.130:6789/0 conn(0x7fcdd8068bd0 legacy=0x7fcdd80cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:28.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.221+0000 7fcddcd32700 1 -- 172.21.15.125:0/1203900641 >> v1:172.21.15.125:6789/0 conn(0x7fcdd8157300 legacy=0x7fcdd80684c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:28.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.221+0000 7fcddcd32700 1 -- 172.21.15.125:0/1203900641 --> v2:172.21.15.130:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd80ab000 con 0x7fcdd80aa2f0 2023-10-06T03:07:28.223 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.221+0000 7fcddcd32700 1 --2- 172.21.15.125:0/1203900641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdd80aa2f0 0x7fcdd80b0240 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80098e0 tx=0x7fcdc80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=554022b3f64d8213 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:28.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.221+0000 7fcdcffff700 1 -- 172.21.15.125:0/1203900641 <== mon.1 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800b640 con 0x7fcdd80aa2f0 2023-10-06T03:07:28.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.221+0000 7fcdcffff700 1 -- 172.21.15.125:0/1203900641 <== mon.1 v2:172.21.15.130:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc800b7a0 con 0x7fcdd80aa2f0 2023-10-06T03:07:28.224 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.221+0000 7fcdcffff700 1 -- 172.21.15.125:0/1203900641 <== mon.1 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc800bb40 con 0x7fcdd80aa2f0 2023-10-06T03:07:28.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.222+0000 7fcddf797700 1 -- 172.21.15.125:0/1203900641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdd80aa2f0 msgr2=0x7fcdd80b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:28.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.222+0000 7fcddf797700 1 --2- 172.21.15.125:0/1203900641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdd80aa2f0 0x7fcdd80b0240 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80098e0 tx=0x7fcdc80091a0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.222+0000 7fcddf797700 1 -- 172.21.15.125:0/1203900641 shutdown_connections 2023-10-06T03:07:28.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.222+0000 7fcddf797700 1 --2- 172.21.15.125:0/1203900641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdd80aa2f0 0x7fcdd80b0240 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.222+0000 7fcddf797700 1 -- 172.21.15.125:0/1203900641 >> 172.21.15.125:0/1203900641 conn(0x7fcdd80af730 msgr2=0x7fcdd80afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:28.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.222+0000 7fcddf797700 1 -- 172.21.15.125:0/1203900641 shutdown_connections 2023-10-06T03:07:28.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.222+0000 7fcddf797700 1 -- 172.21.15.125:0/1203900641 wait complete. 2023-10-06T03:07:28.225 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.223+0000 7fcddf797700 1 Processor -- start 2023-10-06T03:07:28.226 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.223+0000 7fcddf797700 1 -- start start 2023-10-06T03:07:28.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.224+0000 7fcddf797700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdd8068bd0 0x7fcdd8145440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:28.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.224+0000 7fcddf797700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcdd80aa2f0 0x7fcdd80ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:28.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.224+0000 7fcddf797700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdd8157300 0x7fcdd80aea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:28.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.224+0000 7fcddf797700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80aefa0 con 0x7fcdd8068bd0 2023-10-06T03:07:28.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.224+0000 7fcddf797700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80ac100 con 0x7fcdd8157300 2023-10-06T03:07:28.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.224+0000 7fcddf797700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80ac3e0 con 0x7fcdd80aa2f0 2023-10-06T03:07:28.228 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.224+0000 7fcddd533700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdd8068bd0 0x7fcdd8145440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:28.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.224+0000 7fcddd533700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdd8068bd0 0x7fcdd8145440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59434/0 (socket says 172.21.15.125:59434) 2023-10-06T03:07:28.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.224+0000 7fcddd533700 1 -- 172.21.15.125:0/3101771218 learned_addr learned my addr 172.21.15.125:0/3101771218 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:28.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.225+0000 7fcdddd34700 1 --2- 172.21.15.125:0/3101771218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdd8157300 0x7fcdd80aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:28.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.225+0000 7fcddcd32700 1 --2- 172.21.15.125:0/3101771218 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcdd80aa2f0 0x7fcdd80ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:28.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.225+0000 7fcddd533700 1 -- 172.21.15.125:0/3101771218 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcdd80aa2f0 msgr2=0x7fcdd80ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:28.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.225+0000 7fcddd533700 1 --2- 172.21.15.125:0/3101771218 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcdd80aa2f0 0x7fcdd80ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.225+0000 7fcddd533700 1 -- 172.21.15.125:0/3101771218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdd8157300 msgr2=0x7fcdd80aea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:28.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.225+0000 7fcddd533700 1 --2- 172.21.15.125:0/3101771218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdd8157300 0x7fcdd80aea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.225+0000 7fcddd533700 1 -- 172.21.15.125:0/3101771218 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc8009420 con 0x7fcdd8068bd0 2023-10-06T03:07:28.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.225+0000 7fcddd533700 1 --2- 172.21.15.125:0/3101771218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdd8068bd0 0x7fcdd8145440 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400c790 tx=0x7fcdd4007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:28.229 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.225+0000 7fcdcd7fa700 1 -- 172.21.15.125:0/3101771218 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4007300 con 0x7fcdd8068bd0 2023-10-06T03:07:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.225+0000 7fcdcd7fa700 1 -- 172.21.15.125:0/3101771218 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd4007460 con 0x7fcdd8068bd0 2023-10-06T03:07:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.225+0000 7fcddf797700 1 -- 172.21.15.125:0/3101771218 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd80ac6c0 con 0x7fcdd8068bd0 2023-10-06T03:07:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.225+0000 7fcdcd7fa700 1 -- 172.21.15.125:0/3101771218 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd40057f0 con 0x7fcdd8068bd0 2023-10-06T03:07:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.225+0000 7fcddf797700 1 -- 172.21.15.125:0/3101771218 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd80acc80 con 0x7fcdd8068bd0 2023-10-06T03:07:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.226+0000 7fcddf797700 1 -- 172.21.15.125:0/3101771218 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd80acea0 con 0x7fcdd8068bd0 2023-10-06T03:07:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.226+0000 7fcdcd7fa700 1 -- 172.21.15.125:0/3101771218 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcdd4005c20 con 0x7fcdd8068bd0 2023-10-06T03:07:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.227+0000 7fcdcd7fa700 1 --2- 172.21.15.125:0/3101771218 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcdbc066f30 0x7fcdbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.227+0000 7fcdcd7fa700 1 -- 172.21.15.125:0/3101771218 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fcdd40840b0 con 0x7fcdd8068bd0 2023-10-06T03:07:28.230 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.227+0000 7fcddcd32700 1 --2- 172.21.15.125:0/3101771218 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcdbc066f30 0x7fcdbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:28.231 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.227+0000 7fcddcd32700 1 --2- 172.21.15.125:0/3101771218 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcdbc066f30 0x7fcdbc0693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80098e0 tx=0x7fcdc8017000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:28.232 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.231+0000 7fcdcd7fa700 1 -- 172.21.15.125:0/3101771218 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcdd4051380 con 0x7fcdd8068bd0 2023-10-06T03:07:28.414 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.412+0000 7fcddf797700 1 -- 172.21.15.125:0/3101771218 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fcdd8066510 con 0x7fcdd8068bd0 2023-10-06T03:07:28.419 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.418+0000 7fcdcd7fa700 1 -- 172.21.15.125:0/3101771218 <== mon.0 v2:172.21.15.125:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fcdd4051380 con 0x7fcdd8068bd0 2023-10-06T03:07:28.420 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.419+0000 7fcdcd7fa700 1 -- 172.21.15.125:0/3101771218 <== mon.0 v2:172.21.15.125:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7fcdd40549a0 con 0x7fcdd8068bd0 2023-10-06T03:07:28.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.421+0000 7fcddf797700 1 -- 172.21.15.125:0/3101771218 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcdbc066f30 msgr2=0x7fcdbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:28.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.421+0000 7fcddf797700 1 --2- 172.21.15.125:0/3101771218 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcdbc066f30 0x7fcdbc0693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80098e0 tx=0x7fcdc8017000 comp rx=0 tx=0).stop 2023-10-06T03:07:28.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.421+0000 7fcddf797700 1 -- 172.21.15.125:0/3101771218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdd8068bd0 msgr2=0x7fcdd8145440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:28.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.421+0000 7fcddf797700 1 --2- 172.21.15.125:0/3101771218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdd8068bd0 0x7fcdd8145440 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400c790 tx=0x7fcdd4007c80 comp rx=0 tx=0).stop 2023-10-06T03:07:28.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.421+0000 7fcddf797700 1 -- 172.21.15.125:0/3101771218 shutdown_connections 2023-10-06T03:07:28.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.421+0000 7fcddf797700 1 --2- 172.21.15.125:0/3101771218 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fcdbc066f30 0x7fcdbc0693e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.421+0000 7fcddf797700 1 --2- 172.21.15.125:0/3101771218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdd8157300 0x7fcdd80aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.423 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.421+0000 7fcddf797700 1 --2- 172.21.15.125:0/3101771218 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fcdd8068bd0 0x7fcdd8145440 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.421+0000 7fcddf797700 1 --2- 172.21.15.125:0/3101771218 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fcdd80aa2f0 0x7fcdd80ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.421+0000 7fcddf797700 1 -- 172.21.15.125:0/3101771218 >> 172.21.15.125:0/3101771218 conn(0x7fcdd80af730 msgr2=0x7fcdd806ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:28.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.421+0000 7fcddf797700 1 -- 172.21.15.125:0/3101771218 shutdown_connections 2023-10-06T03:07:28.424 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.421+0000 7fcddf797700 1 -- 172.21.15.125:0/3101771218 wait complete. 2023-10-06T03:07:28.434 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T03:07:28.435 DEBUG:teuthology.orchestra.run.smithi125:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T03:07:28.551 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.550+0000 7fd9634f1700 1 Processor -- start 2023-10-06T03:07:28.552 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.550+0000 7fd9634f1700 1 -- start start 2023-10-06T03:07:28.558 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.551+0000 7fd9634f1700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd95c0cbb50 0x7fd95c0a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.551+0000 7fd9634f1700 1 --2- >> v2:172.21.15.130:3300/0 conn(0x7fd95c0cb150 0x7fd95c0c8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.551+0000 7fd9634f1700 1 -- --> v1:172.21.15.125:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd95c0c2910 con 0x7fd95c0cbf20 2023-10-06T03:07:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.551+0000 7fd9634f1700 1 -- --> v2:172.21.15.130:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd95c0c1d40 con 0x7fd95c0cb150 2023-10-06T03:07:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.551+0000 7fd9634f1700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0c1fe0 con 0x7fd95c0cbb50 2023-10-06T03:07:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.551+0000 7fd960a8c700 1 --1- >> v1:172.21.15.125:6789/0 conn(0x7fd95c0cbf20 0x7fd95c0caa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.125:6789/0 says I am v1:172.21.15.125:59754/0 (socket says 172.21.15.125:59754) 2023-10-06T03:07:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.551+0000 7fd960a8c700 1 -- 172.21.15.125:0/3882720983 learned_addr learned my addr 172.21.15.125:0/3882720983 (peer_addr_for_me v1:172.21.15.125:0/0) 2023-10-06T03:07:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.551+0000 7fd953fff700 1 -- 172.21.15.125:0/3882720983 <== mon.0 v1:172.21.15.125:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078820990 0 0) 0x7fd95c0c2910 con 0x7fd95c0cbf20 2023-10-06T03:07:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd953fff700 1 -- 172.21.15.125:0/3882720983 --> v1:172.21.15.125:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd948003570 con 0x7fd95c0cbf20 2023-10-06T03:07:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd96128d700 1 --2- 172.21.15.125:0/3882720983 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd95c0cbb50 0x7fd95c0a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd961a8e700 1 --2- 172.21.15.125:0/3882720983 >> v2:172.21.15.130:3300/0 conn(0x7fd95c0cb150 0x7fd95c0c8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:28.559 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd953fff700 1 -- 172.21.15.125:0/3882720983 <== mon.0 v1:172.21.15.125:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 678300963 0 0) 0x7fd948003570 con 0x7fd95c0cbf20 2023-10-06T03:07:28.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd953fff700 1 -- 172.21.15.125:0/3882720983 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd95c0cbb50 msgr2=0x7fd95c0a99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:28.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd953fff700 1 --2- 172.21.15.125:0/3882720983 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd95c0cbb50 0x7fd95c0a99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd953fff700 1 -- 172.21.15.125:0/3882720983 >> v2:172.21.15.130:3300/0 conn(0x7fd95c0cb150 msgr2=0x7fd95c0c8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:28.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd953fff700 1 --2- 172.21.15.125:0/3882720983 >> v2:172.21.15.130:3300/0 conn(0x7fd95c0cb150 0x7fd95c0c8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd953fff700 1 -- 172.21.15.125:0/3882720983 --> v1:172.21.15.125:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c0c22c0 con 0x7fd95c0cbf20 2023-10-06T03:07:28.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd953fff700 1 -- 172.21.15.125:0/3882720983 <== mon.0 v1:172.21.15.125:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1898873589 0 0) 0x7fd958001470 con 0x7fd95c0cbf20 2023-10-06T03:07:28.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd953fff700 1 -- 172.21.15.125:0/3882720983 >> v1:172.21.15.125:6789/0 conn(0x7fd95c0cbf20 legacy=0x7fd95c0caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:28.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd953fff700 1 --2- 172.21.15.125:0/3882720983 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd948003a60 0x7fd948003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:28.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd953fff700 1 --2- 172.21.15.125:0/3882720983 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd948004810 0x7fd948004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:28.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd953fff700 1 --2- 172.21.15.125:0/3882720983 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd95c0cbb50 0x7fd9480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:28.560 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd953fff700 1 -- 172.21.15.125:0/3882720983 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0c1d40 con 0x7fd948003a60 2023-10-06T03:07:28.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd953fff700 1 -- 172.21.15.125:0/3882720983 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0c1fe0 con 0x7fd948004810 2023-10-06T03:07:28.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd953fff700 1 -- 172.21.15.125:0/3882720983 --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94800ba60 con 0x7fd95c0cbb50 2023-10-06T03:07:28.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd96128d700 1 --2- 172.21.15.125:0/3882720983 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd948003a60 0x7fd948003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:28.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd960a8c700 1 --2- 172.21.15.125:0/3882720983 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd948004810 0x7fd948004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:28.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd961a8e700 1 --2- 172.21.15.125:0/3882720983 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd95c0cbb50 0x7fd9480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:28.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd96128d700 1 -- 172.21.15.125:0/3882720983 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd95c0cbb50 msgr2=0x7fd9480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:28.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd96128d700 1 --2- 172.21.15.125:0/3882720983 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd95c0cbb50 0x7fd9480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd96128d700 1 -- 172.21.15.125:0/3882720983 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd948004810 msgr2=0x7fd948004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T03:07:28.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd96128d700 1 --2- 172.21.15.125:0/3882720983 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd948004810 0x7fd948004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd96128d700 1 -- 172.21.15.125:0/3882720983 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd948003570 con 0x7fd948003a60 2023-10-06T03:07:28.561 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd96128d700 1 --2- 172.21.15.125:0/3882720983 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd948003a60 0x7fd948003e70 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd94c009c20 tx=0x7fd94c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a5334f9f033fdb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:28.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd953fff700 1 -- 172.21.15.125:0/3882720983 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c005a00 con 0x7fd948003a60 2023-10-06T03:07:28.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd953fff700 1 -- 172.21.15.125:0/3882720983 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd94c005b60 con 0x7fd948003a60 2023-10-06T03:07:28.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.552+0000 7fd953fff700 1 -- 172.21.15.125:0/3882720983 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c00e710 con 0x7fd948003a60 2023-10-06T03:07:28.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.553+0000 7fd9634f1700 1 -- 172.21.15.125:0/3882720983 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd948003a60 msgr2=0x7fd948003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:28.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.553+0000 7fd9634f1700 1 --2- 172.21.15.125:0/3882720983 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd948003a60 0x7fd948003e70 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd94c009c20 tx=0x7fd94c009120 comp rx=0 tx=0).stop 2023-10-06T03:07:28.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.553+0000 7fd961a8e700 1 -- 172.21.15.125:0/3882720983 reap_dead start 2023-10-06T03:07:28.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.553+0000 7fd9634f1700 1 -- 172.21.15.125:0/3882720983 shutdown_connections 2023-10-06T03:07:28.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.553+0000 7fd9634f1700 1 -- 172.21.15.125:0/3882720983 >> 172.21.15.125:0/3882720983 conn(0x7fd95c068f00 msgr2=0x7fd95c0cce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:28.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.553+0000 7fd9634f1700 1 -- 172.21.15.125:0/3882720983 shutdown_connections 2023-10-06T03:07:28.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.553+0000 7fd9634f1700 1 -- 172.21.15.125:0/3882720983 wait complete. 2023-10-06T03:07:28.562 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.554+0000 7fd9634f1700 1 Processor -- start 2023-10-06T03:07:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.554+0000 7fd9634f1700 1 -- start start 2023-10-06T03:07:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.555+0000 7fd9634f1700 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd948003a60 0x7fd95c0c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.555+0000 7fd9634f1700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd95c0ca7f0 0x7fd95c0c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.555+0000 7fd9634f1700 1 --2- >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd95c0c9910 0x7fd95c0c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.555+0000 7fd9634f1700 1 -- --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0ca2f0 con 0x7fd95c0ca7f0 2023-10-06T03:07:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.555+0000 7fd9634f1700 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0c5390 con 0x7fd948003a60 2023-10-06T03:07:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.555+0000 7fd9634f1700 1 -- --> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95c0c5670 con 0x7fd95c0c9910 2023-10-06T03:07:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.555+0000 7fd960a8c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd95c0ca7f0 0x7fd95c0c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.555+0000 7fd960a8c700 1 --2- >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd95c0ca7f0 0x7fd95c0c93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.125:3300/0 says I am v2:172.21.15.125:59438/0 (socket says 172.21.15.125:59438) 2023-10-06T03:07:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.555+0000 7fd960a8c700 1 -- 172.21.15.125:0/2857677636 learned_addr learned my addr 172.21.15.125:0/2857677636 (peer_addr_for_me v2:172.21.15.125:0/0) 2023-10-06T03:07:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.555+0000 7fd961a8e700 1 --2- 172.21.15.125:0/2857677636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd95c0c9910 0x7fd95c0c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:28.563 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.555+0000 7fd96128d700 1 --2- 172.21.15.125:0/2857677636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd948003a60 0x7fd95c0c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.555+0000 7fd960a8c700 1 -- 172.21.15.125:0/2857677636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd95c0c9910 msgr2=0x7fd95c0c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.556+0000 7fd960a8c700 1 --2- 172.21.15.125:0/2857677636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd95c0c9910 0x7fd95c0c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.556+0000 7fd960a8c700 1 -- 172.21.15.125:0/2857677636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd948003a60 msgr2=0x7fd95c0c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.556+0000 7fd960a8c700 1 --2- 172.21.15.125:0/2857677636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd948003a60 0x7fd95c0c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.556+0000 7fd960a8c700 1 -- 172.21.15.125:0/2857677636 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c0c5950 con 0x7fd95c0ca7f0 2023-10-06T03:07:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.556+0000 7fd961a8e700 1 --2- 172.21.15.125:0/2857677636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd95c0c9910 0x7fd95c0c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:07:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.556+0000 7fd96128d700 1 --2- 172.21.15.125:0/2857677636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd948003a60 0x7fd95c0c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T03:07:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.556+0000 7fd960a8c700 1 --2- 172.21.15.125:0/2857677636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd95c0ca7f0 0x7fd95c0c93d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd95800ebc0 tx=0x7fd9580015e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.556+0000 7fd9517fa700 1 -- 172.21.15.125:0/2857677636 <== mon.0 v2:172.21.15.125:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95800c760 con 0x7fd95c0ca7f0 2023-10-06T03:07:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.556+0000 7fd9517fa700 1 -- 172.21.15.125:0/2857677636 <== mon.0 v2:172.21.15.125:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd95800c8c0 con 0x7fd95c0ca7f0 2023-10-06T03:07:28.564 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.556+0000 7fd9634f1700 1 -- 172.21.15.125:0/2857677636 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd95c0c5c30 con 0x7fd95c0ca7f0 2023-10-06T03:07:28.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.556+0000 7fd9517fa700 1 -- 172.21.15.125:0/2857677636 <== mon.0 v2:172.21.15.125:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95800cca0 con 0x7fd95c0ca7f0 2023-10-06T03:07:28.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.556+0000 7fd9634f1700 1 -- 172.21.15.125:0/2857677636 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95c1522c0 con 0x7fd95c0ca7f0 2023-10-06T03:07:28.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.557+0000 7fd9634f1700 1 -- 172.21.15.125:0/2857677636 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd95c0c5e50 con 0x7fd95c0ca7f0 2023-10-06T03:07:28.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.557+0000 7fd9517fa700 1 -- 172.21.15.125:0/2857677636 <== mon.0 v2:172.21.15.125:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd958013630 con 0x7fd95c0ca7f0 2023-10-06T03:07:28.565 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.558+0000 7fd9517fa700 1 --2- 172.21.15.125:0/2857677636 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd940066f20 0x7fd9400693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T03:07:28.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.558+0000 7fd9517fa700 1 -- 172.21.15.125:0/2857677636 <== mon.0 v2:172.21.15.125:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5612+0+0 (secure 0 0 0) 0x7fd958084440 con 0x7fd95c0ca7f0 2023-10-06T03:07:28.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.558+0000 7fd96128d700 1 --2- 172.21.15.125:0/2857677636 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd940066f20 0x7fd9400693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T03:07:28.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.558+0000 7fd96128d700 1 --2- 172.21.15.125:0/2857677636 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd940066f20 0x7fd9400693d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0099b0 tx=0x7fd94c009120 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T03:07:28.566 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.562+0000 7fd9517fa700 1 -- 172.21.15.125:0/2857677636 <== mon.0 v2:172.21.15.125:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd958051790 con 0x7fd95c0ca7f0 2023-10-06T03:07:28.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.787+0000 7fd9634f1700 1 -- 172.21.15.125:0/2857677636 --> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd95c066510 con 0x7fd95c0ca7f0 2023-10-06T03:07:28.790 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.787+0000 7fd9517fa700 1 -- 172.21.15.125:0/2857677636 <== mon.0 v2:172.21.15.125:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3541 (secure 0 0 0) 0x7fd958054db0 con 0x7fd95c0ca7f0 2023-10-06T03:07:28.791 INFO:teuthology.orchestra.run.smithi125.stdout: 2023-10-06T03:07:28.791 INFO:teuthology.orchestra.run.smithi125.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5012,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6834/2151384589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":2151384589},{"type":"v1","addr":"172.21.15.130:6834","nonce":2151384589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5299,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/1214475159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6833","nonce":1214475159},{"type":"v1","addr":"172.21.15.130:6835","nonce":1214475159}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5553,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6836/4005469649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6834","nonce":4005469649},{"type":"v1","addr":"172.21.15.125:6836","nonce":4005469649}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5883,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.125:6837/2547095202","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.125:6835","nonce":2547095202},{"type":"v1","addr":"172.21.15.125:6837","nonce":2547095202}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[]} 2023-10-06T03:07:28.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.789+0000 7fd9634f1700 1 -- 172.21.15.125:0/2857677636 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd940066f20 msgr2=0x7fd9400693d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:28.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.789+0000 7fd9634f1700 1 --2- 172.21.15.125:0/2857677636 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd940066f20 0x7fd9400693d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0099b0 tx=0x7fd94c009120 comp rx=0 tx=0).stop 2023-10-06T03:07:28.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.789+0000 7fd9634f1700 1 -- 172.21.15.125:0/2857677636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd95c0ca7f0 msgr2=0x7fd95c0c93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T03:07:28.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.789+0000 7fd9634f1700 1 --2- 172.21.15.125:0/2857677636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd95c0ca7f0 0x7fd95c0c93d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd95800ebc0 tx=0x7fd9580015e0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.792 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.790+0000 7fd9634f1700 1 -- 172.21.15.125:0/2857677636 shutdown_connections 2023-10-06T03:07:28.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.790+0000 7fd9634f1700 1 --2- 172.21.15.125:0/2857677636 >> [v2:172.21.15.125:6832/119397,v1:172.21.15.125:6833/119397] conn(0x7fd940066f20 0x7fd9400693d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.790+0000 7fd9634f1700 1 --2- 172.21.15.125:0/2857677636 >> [v2:172.21.15.130:3301/0,v1:172.21.15.130:6790/0] conn(0x7fd95c0c9910 0x7fd95c0c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.790+0000 7fd9634f1700 1 --2- 172.21.15.125:0/2857677636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd948003a60 0x7fd95c0c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.790+0000 7fd9634f1700 1 --2- 172.21.15.125:0/2857677636 >> [v2:172.21.15.125:3300/0,v1:172.21.15.125:6789/0] conn(0x7fd95c0ca7f0 0x7fd95c0c93d0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T03:07:28.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.790+0000 7fd9634f1700 1 -- 172.21.15.125:0/2857677636 >> 172.21.15.125:0/2857677636 conn(0x7fd95c068f00 msgr2=0x7fd95c0ab030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T03:07:28.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.790+0000 7fd9634f1700 1 -- 172.21.15.125:0/2857677636 shutdown_connections 2023-10-06T03:07:28.793 INFO:teuthology.orchestra.run.smithi125.stderr:2023-10-06T03:07:28.790+0000 7fd9634f1700 1 -- 172.21.15.125:0/2857677636 wait complete. 2023-10-06T03:07:28.794 INFO:teuthology.orchestra.run.smithi125.stderr:dumped fsmap epoch 29 2023-10-06T03:07:28.803 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T03:07:28.803 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T03:07:28.803 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T03:07:28.803 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:07:28.811 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T03:07:28.812 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T03:07:28.812 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:07:28.861 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T03:07:28.861 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T03:07:28.861 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:07:28.872 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T03:07:28.872 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T03:07:28.872 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:07:28.923 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T03:07:28.923 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T03:07:28.923 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T03:07:28.923 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:07:28.950 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T03:07:28.950 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T03:07:28.950 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:07:29.013 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T03:07:29.014 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T03:07:29.014 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:07:29.078 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T03:07:29.078 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T03:07:29.079 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:07:29.100 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:07:29.121 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:07:29.149 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T03:07:29.149 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T03:07:29.149 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:07:29.204 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T03:07:29.204 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T03:07:29.204 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:07:29.270 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T03:07:29.270 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T03:07:29.270 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:07:29.337 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T03:07:29.338 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T03:07:29.338 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:07:29.409 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T03:07:29.410 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T03:07:29.410 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T03:07:29.410 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:07:29.433 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T03:07:29.433 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T03:07:29.434 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:07:29.473 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T03:07:29.474 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T03:07:29.474 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T03:07:29.474 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:07:29.484 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T03:07:29.484 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T03:07:29.484 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:07:29.525 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T03:07:29.525 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T03:07:29.525 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T03:07:29.576 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T03:07:29.576 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T03:07:29.576 DEBUG:teuthology.orchestra.run.smithi125:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:07:29.607 INFO:teuthology.orchestra.run.smithi125.stdout:1696561474.2539754 mon.a (mon.0) 237 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T03:07:29.607 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T03:07:29.607 DEBUG:teuthology.orchestra.run.smithi125:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:07:29.678 DEBUG:teuthology.orchestra.run.smithi125:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:07:29.749 DEBUG:teuthology.orchestra.run.smithi125:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-06T03:07:29.820 INFO:teuthology.orchestra.run.smithi125.stdout:1696561474.2539754 mon.a (mon.0) 237 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T03:07:29.820 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:07:29.820 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T03:07:30.088 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:07:30.089 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T03:07:30.168 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:07:30.169 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T03:07:30.256 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:07:30.256 DEBUG:teuthology.orchestra.run.smithi125:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T03:07:30.328 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-06T03:07:30.328 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T03:07:30.475 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-06T03:07:30.476 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T03:07:30.568 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-06T03:07:30.568 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T03:07:30.634 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi130.front.sepia.ceph.com 2023-10-06T03:07:30.634 DEBUG:teuthology.orchestra.run.smithi130:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T03:07:30.699 INFO:tasks.ceph:Archiving mon data... 2023-10-06T03:07:30.700 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412180/data/mon.a.tgz 2023-10-06T03:07:30.700 DEBUG:teuthology.orchestra.run.smithi125:> mktemp 2023-10-06T03:07:30.719 INFO:teuthology.orchestra.run.smithi125.stdout:/tmp/tmp.G9PKUbX0Y2 2023-10-06T03:07:30.719 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.G9PKUbX0Y2 2023-10-06T03:07:30.873 DEBUG:teuthology.orchestra.run.smithi125:> sudo chmod 0666 /tmp/tmp.G9PKUbX0Y2 2023-10-06T03:07:30.962 DEBUG:teuthology.orchestra.remote:smithi125:/tmp/tmp.G9PKUbX0Y2 is 344KB 2023-10-06T03:07:31.059 DEBUG:teuthology.orchestra.run.smithi125:> rm -fr /tmp/tmp.G9PKUbX0Y2 2023-10-06T03:07:31.078 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412180/data/mon.b.tgz 2023-10-06T03:07:31.078 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2023-10-06T03:07:31.100 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.VrImcGEvSu 2023-10-06T03:07:31.100 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.VrImcGEvSu 2023-10-06T03:07:31.261 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.VrImcGEvSu 2023-10-06T03:07:31.349 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.VrImcGEvSu is 456KB 2023-10-06T03:07:31.445 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.VrImcGEvSu 2023-10-06T03:07:31.463 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412180/data/mon.c.tgz 2023-10-06T03:07:31.463 DEBUG:teuthology.orchestra.run.smithi130:> mktemp 2023-10-06T03:07:31.520 INFO:teuthology.orchestra.run.smithi130.stdout:/tmp/tmp.lg49AezdeU 2023-10-06T03:07:31.520 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.lg49AezdeU 2023-10-06T03:07:31.670 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 0666 /tmp/tmp.lg49AezdeU 2023-10-06T03:07:31.759 DEBUG:teuthology.orchestra.remote:smithi130:/tmp/tmp.lg49AezdeU is 456KB 2023-10-06T03:07:31.855 DEBUG:teuthology.orchestra.run.smithi130:> rm -fr /tmp/tmp.lg49AezdeU 2023-10-06T03:07:31.874 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T03:07:31.874 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T03:07:31.876 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T03:07:31.939 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T03:07:31.939 DEBUG:teuthology.orchestra.run.smithi125:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T03:07:31.947 DEBUG:teuthology.orchestra.run.smithi130:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T03:07:31.976 INFO:teuthology.orchestra.run.smithi125.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T03:07:32.007 INFO:teuthology.orchestra.run.smithi130.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T03:07:32.013 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T03:07:32.014 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412180/remote/smithi125/crash 2023-10-06T03:07:32.015 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T03:07:32.052 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412180/remote/smithi130/crash 2023-10-06T03:07:32.053 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T03:07:32.080 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T03:07:32.080 DEBUG:teuthology.orchestra.run.smithi125:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:07:32.096 DEBUG:teuthology.orchestra.run.smithi130:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T03:07:32.173 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T03:07:32.201 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T03:07:32.227 INFO:tasks.ceph:Compressing logs... 2023-10-06T03:07:32.228 DEBUG:teuthology.orchestra.run.smithi125:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:07:32.243 DEBUG:teuthology.orchestra.run.smithi130:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:07:35.892 INFO:tasks.ceph:Archiving logs... 2023-10-06T03:07:35.892 DEBUG:teuthology.misc:Transferring archived files from smithi125:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412180/remote/smithi125/log 2023-10-06T03:07:35.893 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T03:07:36.575 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412180/remote/smithi130/log 2023-10-06T03:07:36.576 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T03:07:37.008 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T03:07:37.017 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T03:07:37.017 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T03:07:37.020 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T03:07:37.113 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T03:07:37.122 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T03:07:37.122 DEBUG:teuthology.orchestra.run.smithi125:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:07:37.125 DEBUG:teuthology.orchestra.run.smithi130:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T03:07:37.141 INFO:teuthology.orchestra.run.smithi125.stderr:bash: ntpq: command not found 2023-10-06T03:07:37.144 INFO:teuthology.orchestra.run.smithi130.stderr:bash: ntpq: command not found 2023-10-06T03:07:37.146 INFO:teuthology.orchestra.run.smithi125.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T03:07:37.146 INFO:teuthology.orchestra.run.smithi125.stdout:=============================================================================== 2023-10-06T03:07:37.146 INFO:teuthology.orchestra.run.smithi125.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 9 -307us[ -296us] +/- 89ms 2023-10-06T03:07:37.146 INFO:teuthology.orchestra.run.smithi125.stdout:^* hv02.front.sepia.ceph.com 3 6 377 9 -320us[ -309us] +/- 78ms 2023-10-06T03:07:37.146 INFO:teuthology.orchestra.run.smithi125.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 +662us[ +662us] +/- 85ms 2023-10-06T03:07:37.146 INFO:teuthology.orchestra.run.smithi125.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:07:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T03:07:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2023-10-06T03:07:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 10 -295us[ -273us] +/- 89ms 2023-10-06T03:07:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:^* hv02.front.sepia.ceph.com 3 6 377 8 -310us[ -288us] +/- 78ms 2023-10-06T03:07:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 9 +687us[ +709us] +/- 85ms 2023-10-06T03:07:37.149 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T03:07:37.150 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T03:07:37.159 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T03:07:37.160 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T03:07:37.168 DEBUG:teuthology.orchestra.run.smithi125:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T03:07:37.292 DEBUG:teuthology.orchestra.run.smithi130:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T03:07:37.390 DEBUG:teuthology.orchestra.run.smithi125:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T03:07:37.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:07:37.424 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T03:07:37.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:07:37.458 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T03:07:37.468 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T03:07:37.478 INFO:teuthology.task.internal:Duration was 846.590132 seconds 2023-10-06T03:07:37.478 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T03:07:37.487 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T03:07:37.487 DEBUG:teuthology.orchestra.run.smithi125:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T03:07:37.490 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T03:07:37.534 INFO:teuthology.orchestra.run.smithi125.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T03:07:37.545 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T03:07:37.814 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T03:07:37.814 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi125.front.sepia.ceph.com 2023-10-06T03:07:37.814 DEBUG:teuthology.orchestra.run.smithi125:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T03:07:37.837 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi130.front.sepia.ceph.com 2023-10-06T03:07:37.837 DEBUG:teuthology.orchestra.run.smithi130:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T03:07:37.861 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T03:07:37.861 DEBUG:teuthology.orchestra.run.smithi125:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:07:37.879 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T03:07:37.940 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T03:07:37.940 DEBUG:teuthology.orchestra.run.smithi125:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T03:07:37.961 DEBUG:teuthology.orchestra.run.smithi130:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T03:07:38.047 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T03:07:38.057 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T03:07:38.058 DEBUG:teuthology.orchestra.run.smithi125:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T03:07:38.085 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T03:07:38.113 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T03:07:38.123 DEBUG:teuthology.orchestra.run.smithi125:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:07:38.127 DEBUG:teuthology.orchestra.run.smithi130:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:07:38.152 INFO:teuthology.orchestra.run.smithi125.stdout:kernel.core_pattern = core 2023-10-06T03:07:38.179 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = core 2023-10-06T03:07:38.417 DEBUG:teuthology.orchestra.run.smithi125:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:07:38.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:07:38.436 DEBUG:teuthology.orchestra.run.smithi130:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T03:07:38.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T03:07:38.475 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T03:07:38.486 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T03:07:38.486 DEBUG:teuthology.misc:Transferring archived files from smithi125:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412180/remote/smithi125 2023-10-06T03:07:38.486 DEBUG:teuthology.orchestra.run.smithi125:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T03:07:38.526 DEBUG:teuthology.misc:Transferring archived files from smithi130:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412180/remote/smithi130 2023-10-06T03:07:38.526 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T03:07:38.564 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T03:07:38.564 DEBUG:teuthology.orchestra.run.smithi125:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T03:07:38.566 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T03:07:38.616 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T03:07:38.630 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T03:07:38.630 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T03:07:38.641 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T03:07:38.641 DEBUG:teuthology.orchestra.run.smithi125:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T03:07:38.644 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T03:07:38.659 INFO:teuthology.orchestra.run.smithi125.stdout: 525357 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 03:07 /home/ubuntu/cephtest 2023-10-06T03:07:38.674 INFO:teuthology.orchestra.run.smithi130.stdout: 525357 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 03:07 /home/ubuntu/cephtest 2023-10-06T03:07:38.675 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T03:07:38.686 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T03:07:38.708 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T03:07:38.734 DEBUG:teuthology.nuke:shortname: smithi125 2023-10-06T03:07:38.734 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:07:38.759 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi125.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412180', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:45:19.294093', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLMm0/tC54OqctW/6NOr0JjGFyBYJQrLYamtDn1HVZ/PGppy0ZiOxmlxcCmEhC+q/g/akDf7LHSEuo9zZob1UuE='} 2023-10-06T03:07:38.763 DEBUG:teuthology.nuke:shortname: smithi130 2023-10-06T03:07:38.763 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T03:07:38.785 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412180', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 02:45:19.295639', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAZtS6KUubNiYH/E/d3hs3JkgqTG/TbcaWtWLghQmDL/qv0IggKGQ38iK1ZqMzBew/GzoyV652PrLfwE0fSJvxE='} 2023-10-06T03:07:38.837 INFO:teuthology.orchestra.console.smithi130:Power off 2023-10-06T03:07:38.837 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T03:07:38.854 INFO:teuthology.orchestra.console.smithi125:Power off 2023-10-06T03:07:38.854 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T03:07:38.864 DEBUG:teuthology.orchestra.console.smithi130:power off output: Chassis Power Control: Down/Off 2023-10-06T03:07:38.864 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:07:38.877 DEBUG:teuthology.orchestra.console.smithi125:power off output: Chassis Power Control: Down/Off 2023-10-06T03:07:38.878 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:07:38.888 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2023-10-06T03:07:38.914 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-06T03:07:42.889 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:07:42.915 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:07:43.000 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is on 2023-10-06T03:07:43.026 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is on 2023-10-06T03:07:47.002 DEBUG:teuthology.orchestra.console.smithi130:pexpect command: ipmitool -H smithi130.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:07:47.028 DEBUG:teuthology.orchestra.console.smithi125:pexpect command: ipmitool -H smithi125.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T03:07:47.113 DEBUG:teuthology.orchestra.console.smithi130:check power output: Chassis Power is off 2023-10-06T03:07:47.137 DEBUG:teuthology.orchestra.console.smithi125:check power output: Chassis Power is off 2023-10-06T03:07:47.215 INFO:teuthology.orchestra.console.smithi130:Power off completed 2023-10-06T03:07:47.238 INFO:teuthology.orchestra.console.smithi125:Power off completed 2023-10-06T03:07:47.344 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/pool-perm} duration: 846.590131521225 failure_reason: '"1696561474.2539754 mon.a (mon.0) 237 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T03:07:47.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T03:07:47.421 INFO:teuthology.run:FAIL